-- Logs begin at Sat 2022-05-07 20:01:27 UTC, end at Sat 2022-05-07 23:02:02 UTC. -- May 07 21:34:58.505644 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 07 21:34:58.514311 ncdv-master-1 devstack@n-api.service[121092]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 7 21:34:58 2022] *** May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: nodename: ncdv-master-1 May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: machine: x86_64 May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: clock source: unix May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: pcre jit disabled May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: detected number of CPU cores: 4 May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: current working directory: / May 07 21:34:58.516309 ncdv-master-1 devstack@n-api.service[121092]: detected binary path: /usr/bin/uwsgi-core May 07 21:34:58.517008 ncdv-master-1 devstack@n-api.service[121092]: your processes number limit is 47680 May 07 21:34:58.517008 ncdv-master-1 devstack@n-api.service[121092]: your memory page size is 4096 bytes May 07 21:34:58.517008 ncdv-master-1 devstack@n-api.service[121092]: detected max file descriptor number: 2048 May 07 21:34:58.517008 ncdv-master-1 devstack@n-api.service[121092]: lock engine: pthread robust mutexes May 07 21:34:58.517008 ncdv-master-1 devstack@n-api.service[121092]: thunder lock: enabled May 07 21:34:58.517008 ncdv-master-1 devstack@n-api.service[121092]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 07 21:34:58.517008 ncdv-master-1 devstack@n-api.service[121092]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 07 21:34:58.565271 ncdv-master-1 devstack@n-api.service[121092]: Python main interpreter initialized at 0x55be9fa389c0 May 07 21:34:58.565271 ncdv-master-1 devstack@n-api.service[121092]: python threads support enabled May 07 21:34:58.565271 ncdv-master-1 devstack@n-api.service[121092]: your server socket listen backlog is limited to 100 connections May 07 21:34:58.565271 ncdv-master-1 devstack@n-api.service[121092]: your mercy for graceful operations on workers is 90 seconds May 07 21:34:58.565608 ncdv-master-1 devstack@n-api.service[121092]: mapped 403077 bytes (393 KB) for 2 cores May 07 21:34:58.565687 ncdv-master-1 devstack@n-api.service[121092]: *** Operational MODE: preforking *** May 07 21:34:58.565928 ncdv-master-1 devstack@n-api.service[121092]: *** uWSGI is running in multiple interpreter mode *** May 07 21:34:58.565928 ncdv-master-1 devstack@n-api.service[121092]: spawned uWSGI master process (pid: 121092) May 07 21:34:58.566115 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 07 21:34:58.566663 ncdv-master-1 devstack@n-api.service[121092]: spawned uWSGI worker 1 (pid: 121093, cores: 1) May 07 21:34:58.567023 ncdv-master-1 devstack@n-api.service[121092]: spawned uWSGI worker 2 (pid: 121094, cores: 1) May 07 21:34:58.567197 ncdv-master-1 devstack@n-api.service[121092]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 07 21:34:59.845369 ncdv-master-1 devstack@n-api.service[121093]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 07 21:34:59.846479 ncdv-master-1 devstack@n-api.service[121094]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 07 21:35:00.581490 ncdv-master-1 devstack@n-api.service[121094]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:35:00.581490 ncdv-master-1 devstack@n-api.service[121094]: from cryptography.utils import int_from_bytes May 07 21:35:00.581826 ncdv-master-1 devstack@n-api.service[121094]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:35:00.581826 ncdv-master-1 devstack@n-api.service[121094]: from cryptography.utils import int_from_bytes May 07 21:35:00.595493 ncdv-master-1 devstack@n-api.service[121093]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:35:00.595493 ncdv-master-1 devstack@n-api.service[121093]: from cryptography.utils import int_from_bytes May 07 21:35:00.595823 ncdv-master-1 devstack@n-api.service[121093]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:35:00.595823 ncdv-master-1 devstack@n-api.service[121093]: from cryptography.utils import int_from_bytes May 07 21:35:03.184921 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 07 21:35:03.185594 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 07 21:35:03.185690 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 07 21:35:03.185690 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 07 21:35:03.186122 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 07 21:35:03.186122 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 07 21:35:03.186286 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 07 21:35:03.186371 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 07 21:35:03.186471 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 07 21:35:03.186656 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.186761 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 07 21:35:03.187022 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.187176 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.187348 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.187452 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.187671 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.187769 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.188007 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.188106 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.188322 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.188427 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.188647 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.188731 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.188969 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.189070 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.189290 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.189385 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.189555 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.189643 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.189871 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.189968 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.190187 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.190274 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.190509 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.190595 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.190844 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.190949 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.191159 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.191246 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.191476 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.191576 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.191781 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.191869 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.192098 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.192206 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.192404 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.192503 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.192722 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.192903 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.193232 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.193346 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194350 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194466 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194540 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194609 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194684 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194753 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194846 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.194931 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.195002 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.195068 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.195134 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.195200 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.195966 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.196081 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.196286 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.196380 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.196618 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.196771 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.196940 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.197097 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.197323 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.197480 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.197646 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.197806 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.197948 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.198095 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.198280 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.198437 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.198671 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.198841 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.199027 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.199185 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.199326 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.199472 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.199694 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.199854 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.200017 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.200701 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.200857 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.201001 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.201131 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.201288 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.201435 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.201582 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.201730 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.201864 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202014 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202153 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202308 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202401 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202483 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202563 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202653 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202736 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202846 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.202926 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203008 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203096 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203223 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203337 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203535 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203629 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203857 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.203959 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.204181 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.204273 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.204497 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.204596 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.204752 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.204851 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.205005 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.205107 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.205326 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.205422 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.205647 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.205737 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.205957 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.206045 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.206266 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.206378 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.206577 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.206726 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.206913 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.207026 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.207226 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.207324 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.207534 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.207645 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.207841 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.207932 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.208403 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.208509 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.208715 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.208804 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.209030 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.209125 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.209349 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.209582 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.209713 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.209828 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.209965 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.210081 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.210293 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.210419 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.210606 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.210728 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.210988 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.211645 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.211836 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.211962 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.212160 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.212276 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.212476 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.212599 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.212801 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.212927 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.213127 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.213263 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.213480 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.213613 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.213757 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.213898 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.214031 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.214164 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.214342 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.214472 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.214671 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.214823 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.215014 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.215155 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.215282 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.215406 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.215563 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.215694 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.215871 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.216000 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.216191 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.216293 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.216503 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.216593 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.216813 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.216946 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.217124 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.217230 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.217426 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.217540 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.217733 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.217830 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.218041 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.218138 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.218352 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.218440 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.218660 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.218747 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.218993 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.219097 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.219301 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.219398 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.219610 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.219698 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.219915 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.220014 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.220223 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.220312 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.220531 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.220618 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.220857 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.220948 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.221164 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.221259 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.221473 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.221563 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.221782 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.221878 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.222088 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.222186 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.222398 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.222487 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.222708 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.222828 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.223045 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.223142 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.223359 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.223477 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.223667 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.223766 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.223975 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.224065 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.224286 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.224373 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.224593 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.224682 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.224903 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.224995 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.225212 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.225302 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.225515 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.225611 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.225825 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.225915 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.226142 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.226230 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.226450 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.226558 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.226821 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.226915 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.227120 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.227210 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.227427 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.227524 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.227736 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.227832 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.228043 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.228141 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.228346 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.228434 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.228652 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.228742 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.228953 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.229051 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.229257 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.229346 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.229581 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.229670 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.229890 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.229988 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.230199 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.230296 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.230508 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.230597 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.230846 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.230948 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.231180 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:35:03.231277 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.231516 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.231607 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.231854 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.231942 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.232170 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.232265 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.232508 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.232598 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.232843 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.232932 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.233162 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.233250 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.233479 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.233568 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.233797 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.233888 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.234116 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.234205 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.234431 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.234529 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.234747 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.234875 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.235087 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.235185 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.235404 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.235502 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.235723 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.235811 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.236048 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.236153 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.236368 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.236515 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.236676 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.236763 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.237000 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.237089 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.237313 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.237419 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.237628 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.237724 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.237950 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.238049 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.238274 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.238378 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.238589 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.238686 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.238929 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.239032 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.239276 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.239380 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.239602 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.239691 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.239930 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.240019 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.240255 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.240346 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.240572 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.240661 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.240885 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.240976 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.241200 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.241290 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.241517 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.241606 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.241848 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.241939 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.242676 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.242821 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.243037 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.243126 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.243356 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.243467 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.243670 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.243806 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.243984 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.244082 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.244295 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.244394 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.244609 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.244697 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.244926 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.245015 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.245248 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.245405 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.245565 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.245656 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.245880 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.245969 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.246198 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.246297 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.246511 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.246600 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.246845 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.246950 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.247166 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.247265 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.247473 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.247561 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.247781 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.247878 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.248089 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.248194 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.248400 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.248489 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.248705 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.248794 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.249016 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.249105 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.249345 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.249445 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.249655 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.249743 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.249981 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.250070 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.250290 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.250379 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.250606 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.250696 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.250944 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.251035 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.251261 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.251350 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.251574 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.251663 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.251884 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.251973 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.252196 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.252284 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.252506 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.252604 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.252815 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.252903 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.253137 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.253225 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.253446 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.253544 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.253758 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.253883 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.254071 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.254170 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.254379 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.254478 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.254687 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.254796 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.255025 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.255113 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.255340 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.255446 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.255655 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.255744 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.255970 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.256068 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.256291 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.256382 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.256605 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.256693 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.256925 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.257015 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.257240 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.257344 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.257581 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.257671 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.258469 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.258570 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.258824 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.258919 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.259139 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.259241 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.259474 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.259563 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.259782 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.259871 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.260095 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.260194 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.260402 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.260499 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.260713 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.260802 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.261018 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.261106 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.261325 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.261493 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.261630 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.261726 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.261939 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.262034 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.262241 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.262339 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.262547 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.262637 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.262882 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.262984 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.263191 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.263289 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.263510 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.263605 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.263818 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.263909 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.264125 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.264228 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.264431 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.264529 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.264739 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.264833 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.265070 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.265160 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.265387 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.265476 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.265737 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.265827 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.266058 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.266148 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.266386 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.266483 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.266703 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.266819 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.267053 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.267144 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.267366 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.267453 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.267681 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.267787 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.267997 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.268095 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.268309 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.268406 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.268624 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.268725 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.268935 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.269023 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.269257 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.269352 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.269570 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.269667 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.269888 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.269975 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.270200 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.270287 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.270525 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.270623 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.270848 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.270940 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.271169 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.271259 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.271489 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.271586 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.271836 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.271924 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.272156 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.272245 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.272482 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.272572 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.272798 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.272886 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.273115 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.273209 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.273448 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.273538 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.273764 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.273860 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.274076 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.274164 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.274390 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.274480 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.274706 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.274845 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.275045 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.275133 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.275361 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.275451 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.275673 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.275760 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.275986 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.276084 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.276305 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.276393 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.276622 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.276710 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.276929 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.277029 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.277242 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.277329 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.277562 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.277651 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.277896 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.277993 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.278211 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.278298 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.278528 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.278617 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.278874 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.278980 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.279188 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.279288 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.279502 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.279598 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.279816 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.279905 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.280123 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.280217 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.280433 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.280530 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.280745 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.280842 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.281060 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.281149 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.281373 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.281460 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.281688 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.281777 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.281995 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.282096 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.282303 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.282553 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.282655 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.282737 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.282935 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.283038 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.283243 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.283342 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.283553 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.283653 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.283871 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.283961 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.284184 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.284281 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.284509 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.284597 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.284835 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.284930 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.285147 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.285246 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.285457 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.285553 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.285765 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.285853 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.286085 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.286186 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.286393 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.286483 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.286701 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.286809 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.287039 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.287143 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.287349 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.287445 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.287686 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.287782 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.287996 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.288087 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.288303 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.288391 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.288626 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.288714 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.288943 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.289036 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.289282 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.289371 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.289596 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.289765 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.289911 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.290002 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.290223 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.290311 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.290541 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.290630 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.290877 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.290983 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.291193 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.291282 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.291504 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.291600 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.291817 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.291917 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.292129 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.292225 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.292442 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.292559 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.292754 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.292843 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.293068 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.293165 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.293385 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.293512 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.293691 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.293787 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.293996 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.294085 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.294313 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.294411 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.294635 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.294911 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.295233 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.295322 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.295554 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.295644 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.295877 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.295966 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.296202 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.296292 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.296526 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.296617 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.296850 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.296939 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.297181 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.297276 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.297514 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.297604 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.297820 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.297918 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.298133 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.298231 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.298442 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.298532 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.298748 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.298920 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.299083 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.299172 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.299388 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.299476 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.299695 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.299797 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.300001 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.300089 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.300311 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.300398 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.300619 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.300710 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.300925 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.301020 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.301228 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.301316 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.301533 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.301629 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.301842 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.301932 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.302146 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.302243 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.302452 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.302541 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.302754 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.302910 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.303088 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.303187 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.303414 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.303513 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.303726 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.303816 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.304036 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.304134 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.304341 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.304481 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.305151 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.305246 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.305510 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.305822 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.306166 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.306500 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.306763 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.306912 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.307172 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.307483 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.307763 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.307880 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.308105 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.308232 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.308414 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.308723 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.308898 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.309037 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.309232 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.309350 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.309658 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.309748 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.309973 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.310058 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.310286 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.310599 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.310938 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.311247 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.311327 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.311561 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.311645 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.311869 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.311948 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.312190 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.312267 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.312504 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.312593 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.312812 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.312902 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.313121 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.313216 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.313436 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.313525 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.313750 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.313840 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.314059 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.314148 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.314375 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.314475 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.314685 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.314787 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.315033 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.315123 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.315345 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.315444 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.315654 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.315743 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.315962 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.316050 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.316274 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.316371 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.316590 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.316678 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.316897 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.316986 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.317208 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.317408 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.317511 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.317595 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.317824 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.317914 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.318134 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.318237 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.318449 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.318540 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.318761 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.318890 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.319095 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.319186 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.319413 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.319503 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.319746 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.319849 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.320053 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.320144 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.320900 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.321003 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.321227 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.321323 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.321539 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.321629 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.321847 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.321935 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.322159 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.322247 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.322473 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.322585 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.322797 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.322899 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.323114 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.323218 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.323425 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.323515 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.323736 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.323826 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.324045 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.324149 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.324360 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.324449 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.324673 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.324763 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.324981 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.325081 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.325288 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.325376 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.325594 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.325681 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.325900 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.325989 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.326209 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.326306 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.326517 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.326614 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.326846 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.326941 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.327159 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.327266 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.327487 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.327581 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.327803 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.327894 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.328113 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.328202 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.328423 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.328520 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.328730 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.328827 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.329070 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.329165 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.329379 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.329468 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.329695 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.329799 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.330005 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.330105 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.330312 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.330411 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.330638 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.330726 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.330983 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.331074 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.331298 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.331399 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.331618 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.331707 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.331926 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.332023 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.332246 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.332345 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.332561 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.332696 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.332867 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.332965 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.333425 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.333528 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.333734 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.333830 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.334044 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.334133 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.334360 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.334457 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.334672 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.334760 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.335014 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.335103 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.335331 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.335430 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.335649 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.335739 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.335981 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.336081 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.336291 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.336382 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.336603 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.336730 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.336915 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.337004 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.337224 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.337315 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.337535 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.337629 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.337849 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.337949 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.338155 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.338243 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.338468 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.338557 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.338791 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.338901 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.339112 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.339200 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.339420 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.339510 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.339733 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.339857 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.340048 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.340179 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.340358 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.340496 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.340687 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.340808 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.341008 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.341124 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.341315 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.341443 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.341628 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.341766 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.341936 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.342088 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.342248 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.342400 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.342556 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.342847 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.343013 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.343166 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.343330 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.343489 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.343636 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.343805 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.343942 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.344116 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.344256 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.344425 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.344572 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.344742 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.344888 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.345072 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.345200 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.345380 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.345508 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.345690 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.345931 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.346020 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.346246 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.346346 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.346562 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.346660 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.346905 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.347008 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.347216 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.347382 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.347523 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.347663 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.347837 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.347975 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.348164 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.348397 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.348487 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.348714 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.348812 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.349032 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.349131 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.349360 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.349449 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.349666 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.349762 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.349989 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.350088 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.350300 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.350409 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.350619 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.350728 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.350962 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.351065 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.351295 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.351474 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.351649 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.351817 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.351967 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.352136 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.352286 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.352464 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.352594 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.352795 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.352929 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.353124 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.353257 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.353434 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.353577 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.353754 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.353903 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.354069 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.354320 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.354412 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.354650 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.354739 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.354993 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.355095 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.355321 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.355413 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.355640 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.355728 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.355953 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.356042 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.356266 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.356357 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.356585 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.356674 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.356894 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.356982 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.357206 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.357297 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.357534 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.357623 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.357847 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.358021 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.358165 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.358255 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.358481 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.358578 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.358830 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.358937 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.359129 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.359220 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.359440 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.359529 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.359764 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.359863 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.360075 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.360164 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.360401 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.360498 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.360710 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.360809 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.361032 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.361122 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.361346 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.361438 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.361658 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.361748 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.361965 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.362055 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.362273 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.362363 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.362586 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.362682 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.362919 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.363024 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.363230 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.363323 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.363556 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.363655 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.363874 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.363966 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.364200 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.364291 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.364510 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.364602 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.364835 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.364926 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.365150 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.365269 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.365458 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.365548 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.365766 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.365857 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.366075 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.366177 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.366419 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.366508 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.366725 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.366853 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.367073 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.367669 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.367901 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.367993 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.368219 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.368310 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.368532 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.368638 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.368842 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.368935 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.369156 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.369245 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.369473 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.369564 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.369784 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.369875 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.370095 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.370192 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.370406 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.370496 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.370712 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.370834 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.371053 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.371144 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.371368 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.371466 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.371678 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.371767 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.371984 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.372080 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.372295 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.372386 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.372599 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.372687 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.372907 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.373021 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.373217 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.373318 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.373541 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.373632 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.373850 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.373954 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.374174 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.374264 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.374488 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.374577 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.374819 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.374926 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.375133 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.375243 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.375441 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.375533 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.375771 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.375875 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.376085 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.376178 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.376404 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.376495 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.376729 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.376827 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.377047 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.377139 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.377367 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.377458 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.377677 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.377768 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.377999 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.378097 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.378319 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.378408 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.378639 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.378728 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.378983 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.379197 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.379288 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.379532 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.379635 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.379852 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.379942 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.380169 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.380259 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.380488 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.380578 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.380806 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.380895 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.381122 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.381219 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.381438 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.381529 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.381753 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.381965 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.382128 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.382300 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.382400 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.382620 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.382717 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.383520 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.383631 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.383842 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.383942 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.384161 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.384251 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.384476 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.384566 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.384793 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.384884 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.385108 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.385212 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.385426 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.385536 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.385738 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.385830 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.386068 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.386159 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.386396 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.386496 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.386721 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.386857 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.387073 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.387164 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.387393 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.387495 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.387709 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.387798 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.388024 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.388170 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.388341 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.388508 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.388662 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.388761 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.388981 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.389071 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.389299 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.389391 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.389616 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.389705 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.389934 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.390023 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.390250 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.390340 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.390565 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.390723 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.390916 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.391018 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.391238 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.391336 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.391553 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.391642 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.391869 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.391968 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.392184 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.392392 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.392502 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.392713 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.392803 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.393053 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.393144 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.393386 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.393476 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.393717 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.393821 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.394040 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.394131 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.394367 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.394456 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.394683 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.394804 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.395027 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.395296 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.395385 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.395613 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.395706 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.395944 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.396035 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.396255 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.396345 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.396584 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.396672 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.396900 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.396989 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.397208 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.397297 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.397533 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.397636 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.397842 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.397939 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.398151 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.398377 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.398502 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.398762 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.398898 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.399110 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.399199 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.399438 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.399527 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.399752 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.399844 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.400059 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.400150 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.400377 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.400707 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.401013 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.401105 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.401321 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.401409 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.401642 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.401880 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.401971 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.402235 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.402325 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.402549 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.402637 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.402893 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.402998 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.403213 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.403311 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.403524 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.403613 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.403835 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.403924 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.404142 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.404234 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.404460 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.404549 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.404771 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.404862 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.405078 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.405166 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.405389 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.405488 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.405695 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.405786 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.406002 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.406092 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.406308 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.406410 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.406622 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.406710 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.406957 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.407101 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.407274 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.407372 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.407582 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.407671 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.407896 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.407986 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.408209 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.408343 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.408517 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.408607 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.408825 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.408915 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.409140 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.409231 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.409448 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.409536 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.409757 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.409846 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.410065 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.410155 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.410375 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.410464 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.410690 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.410800 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.411024 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.411116 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.411338 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.411429 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.411649 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.411739 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.411973 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.412064 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.412283 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.412372 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.412599 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.412697 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.412951 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.413166 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.413277 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.413510 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.413599 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.413839 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.413937 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.414282 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.414572 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.414924 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.415203 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.415308 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.415542 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.415876 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.416120 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.416207 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.416479 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.416571 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.416812 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.417130 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.417215 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.417446 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.417534 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.417763 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.418022 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.418108 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.418366 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.418445 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.418689 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.419033 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.419351 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.419668 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.419871 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.419989 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.420236 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.420332 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.420579 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.420669 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.420935 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.421035 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.421257 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.421347 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.421580 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.421677 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.421896 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.421999 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.422213 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.422309 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.422524 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.422612 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.422861 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.422974 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.423185 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.423284 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.423510 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.423599 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.423830 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.423973 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.424147 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.424238 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.424466 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.424556 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.424794 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.424885 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.425113 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.425204 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.425434 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.425523 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.425810 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.425908 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.426130 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.426220 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.426450 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.426541 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.426785 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.426891 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.427126 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.427216 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.427445 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.427549 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.427768 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.427858 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.428094 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.428183 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.428420 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.428524 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.428736 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.428828 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.429049 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.429145 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.429357 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.429457 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.430185 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.430283 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.430505 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.430602 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.430854 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.430961 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.431175 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.431265 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.431484 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.431574 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.431793 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.431909 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.432109 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.432231 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.432419 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.432560 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.432730 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.432890 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.433037 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.433211 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.433345 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.433542 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.433661 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.433878 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.433967 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.434198 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.434295 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.434527 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.434625 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.434873 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.435009 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.435185 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.435277 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.435496 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.435593 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.435813 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.435944 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.436123 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.436212 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.436432 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.436524 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.436740 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.436837 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.437054 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.437157 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.437361 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.437452 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.437700 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.437814 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.438014 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.438131 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.438324 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.438415 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.438634 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.438724 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.438976 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.439086 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.439289 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.439380 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.439599 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.439697 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.439907 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.439998 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.440213 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.440304 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.440526 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.440623 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.440833 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.440924 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.441142 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.441245 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.441453 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.441543 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.441763 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.441854 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.442091 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.442189 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.442380 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.442470 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.442696 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.442829 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.443029 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.443119 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.443339 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.443440 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.443647 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.443814 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.443956 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.444053 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.444262 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.444372 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.444598 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.444689 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.444924 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.445021 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.445266 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.445875 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.446102 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.446193 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.446417 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.446507 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.446743 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.446876 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.447079 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.447169 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.447402 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.447493 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.447722 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.447821 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.448037 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.448132 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.448352 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.448442 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.448672 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.448762 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.448998 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.449094 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.449318 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.449408 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.449637 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.449729 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.449955 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.450046 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.450273 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.450448 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.450591 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.450689 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.450949 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.451041 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.451281 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.451384 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.451595 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.451696 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.451912 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.452009 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.452225 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.452325 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.452477 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 07 21:35:03.452568 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.452858 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.453174 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.453509 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.453827 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.454145 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.454468 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.454823 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.455127 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.455451 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.455773 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.456105 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.456439 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.456768 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.457099 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.457452 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.457771 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.458370 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.458705 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.459048 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.459370 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.459682 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:35:03.459933 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121093) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 07 21:35:03.476437 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:03.482972 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed49014-388f-4af5-b701-213d369099da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:03.538734 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.context [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=121094) load_cells /opt/stack/nova/nova/context.py:464}} May 07 21:35:03.543178 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:35:03.544244 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.context [None req-2ed49014-388f-4af5-b701-213d369099da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=121093) load_cells /opt/stack/nova/nova/context.py:464}} May 07 21:35:03.544738 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:35:03.545540 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:35:03.547516 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:35:03.548556 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2ed49014-388f-4af5-b701-213d369099da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:35:03.550113 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2ed49014-388f-4af5-b701-213d369099da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:35:03.550932 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2ed49014-388f-4af5-b701-213d369099da None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:35:03.552853 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_concurrency.lockutils [None req-2ed49014-388f-4af5-b701-213d369099da None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121093) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:35:03.558739 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:03.561921 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:03.566836 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed49014-388f-4af5-b701-213d369099da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:03.569587 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed49014-388f-4af5-b701-213d369099da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:03.722878 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_db.sqlalchemy.engines [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:03.729224 ncdv-master-1 devstack@n-api.service[121093]: DEBUG oslo_db.sqlalchemy.engines [None req-2ed49014-388f-4af5-b701-213d369099da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121093) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:35:04.060554 ncdv-master-1 devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-2ed49014-388f-4af5-b701-213d369099da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:35:04.062659 ncdv-master-1 devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:35:04.067925 ncdv-master-1 devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-2ed49014-388f-4af5-b701-213d369099da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:35:04.070147 ncdv-master-1 devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:35:04.410754 ncdv-master-1 devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-2ed49014-388f-4af5-b701-213d369099da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:35:04.413102 ncdv-master-1 devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:35:04.416837 ncdv-master-1 devstack@n-api.service[121093]: WARNING keystonemiddleware.auth_token [None req-2ed49014-388f-4af5-b701-213d369099da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:35:04.419257 ncdv-master-1 devstack@n-api.service[121094]: WARNING keystonemiddleware.auth_token [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:35:04.422070 ncdv-master-1 devstack@n-api.service[121093]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be9fa389c0 pid: 121093 (default app) May 07 21:35:04.424176 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2ed49014-388f-4af5-b701-213d369099da None None] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:35:04.424515 ncdv-master-1 devstack@n-api.service[121094]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be9fa389c0 pid: 121094 (default app) May 07 21:35:04.425366 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2ed49014-388f-4af5-b701-213d369099da None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 May 07 21:35:04.425781 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Sat May 7 21:35:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:24.392516 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:24.394056 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 May 07 21:36:24.394751 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:24.808255 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-4cf923fc-0cc6-4d94-91fb-ec0b2adadb66 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:24.838704 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-4cf923fc-0cc6-4d94-91fb-ec0b2adadb66 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.437803 May 07 21:36:24.841436 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:36:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:27.174370 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:27.175422 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a3a40691-3d4f-4a46-9ec0-9e15ea0030b6 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 07 21:36:27.175831 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 2/4] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:27.246259 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d881a313-97a5-477e-98a6-524d0cba656b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "id": "c1"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:27.265867 ncdv-master-1 devstack@n-api.service[121093]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:36:27.265867 ncdv-master-1 devstack@n-api.service[121093]: warnings.warn(msg) May 07 21:36:27.295224 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d881a313-97a5-477e-98a6-524d0cba656b admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112753 May 07 21:36:27.295804 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 3/5] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:27.514584 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0fb1a439-56e5-4003-a73c-99cc1c6b230e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:27.517011 ncdv-master-1 devstack@n-api.service[121094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:36:27.517011 ncdv-master-1 devstack@n-api.service[121094]: warnings.warn(msg) May 07 21:36:27.566373 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0fb1a439-56e5-4003-a73c-99cc1c6b230e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262561 May 07 21:36:27.567176 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 3/6] 10.222.0.32 () {64 vars in 1335 bytes} [Sat May 7 21:36:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:29.913254 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d881a313-97a5-477e-98a6-524d0cba656b admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:29.914961 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d881a313-97a5-477e-98a6-524d0cba656b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002731 May 07 21:36:29.915646 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 4/7] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:30.020294 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d33dc0cf-7166-468e-a757-9b80764d3174 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:30.039691 ncdv-master-1 devstack@n-api.service[121094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:36:30.039691 ncdv-master-1 devstack@n-api.service[121094]: warnings.warn(msg) May 07 21:36:30.057215 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d33dc0cf-7166-468e-a757-9b80764d3174 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135614 May 07 21:36:30.057774 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 4/8] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:30.069239 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-bee0c26a-a737-4105-80f3-8c46d5c04e09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:30.070704 ncdv-master-1 devstack@n-api.service[121093]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:36:30.070704 ncdv-master-1 devstack@n-api.service[121093]: warnings.warn(msg) May 07 21:36:30.103676 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-bee0c26a-a737-4105-80f3-8c46d5c04e09 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037850 May 07 21:36:30.104593 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 5/9] 10.222.0.32 () {64 vars in 1335 bytes} [Sat May 7 21:36:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:32.480950 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d33dc0cf-7166-468e-a757-9b80764d3174 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:32.482516 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d33dc0cf-7166-468e-a757-9b80764d3174 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 May 07 21:36:32.487036 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:32.559783 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-87fe5a01-774a-41a5-a691-c391fc71474f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:32.584474 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-87fe5a01-774a-41a5-a691-c391fc71474f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094677 May 07 21:36:32.585285 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 6/11] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:32.599284 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-483a32aa-5608-4739-b2af-c8f498856597 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:32.636000 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-483a32aa-5608-4739-b2af-c8f498856597 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041101 May 07 21:36:32.637269 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 6/12] 10.222.0.32 () {64 vars in 1335 bytes} [Sat May 7 21:36:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:36:35.298182 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-87fe5a01-774a-41a5-a691-c391fc71474f admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:35.300044 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-87fe5a01-774a-41a5-a691-c391fc71474f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002561 May 07 21:36:35.300868 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 7/13] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:35.362570 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-63f33cbd-3384-4cf8-a482-885c31cc0ba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:35.386614 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-63f33cbd-3384-4cf8-a482-885c31cc0ba6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079149 May 07 21:36:35.394155 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 7/14] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:35.399706 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-ef087ec6-b155-48a9-9ccf-1239db3added admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:35.427240 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-ef087ec6-b155-48a9-9ccf-1239db3added admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031342 May 07 21:36:35.438311 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 8/15] 10.222.0.32 () {64 vars in 1335 bytes} [Sat May 7 21:36:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:38.266513 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-63f33cbd-3384-4cf8-a482-885c31cc0ba6 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:38.267590 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-63f33cbd-3384-4cf8-a482-885c31cc0ba6 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 07 21:36:38.267997 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 8/16] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:38.355263 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a960403e-1951-4f26-8138-7d88433f4698 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:38.373599 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a960403e-1951-4f26-8138-7d88433f4698 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098574 May 07 21:36:38.375099 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 9/17] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:38.387427 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9d2c73d7-bb3a-4722-86a5-9f3b693b1a27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:38.411999 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9d2c73d7-bb3a-4722-86a5-9f3b693b1a27 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028052 May 07 21:36:38.419192 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 9/18] 10.222.0.32 () {64 vars in 1335 bytes} [Sat May 7 21:36:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:40.867639 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a960403e-1951-4f26-8138-7d88433f4698 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:40.868660 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a960403e-1951-4f26-8138-7d88433f4698 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 May 07 21:36:40.869071 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 10/19] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:40.940830 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-919c6177-3dc8-4665-bb37-1b5125c29538 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:40.966506 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-919c6177-3dc8-4665-bb37-1b5125c29538 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091602 May 07 21:36:40.967096 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 10/20] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:36:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:36:43.363275 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-a960403e-1951-4f26-8138-7d88433f4698 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:43.364299 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-a960403e-1951-4f26-8138-7d88433f4698 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 07 21:36:43.364904 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 11/21] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:43.422898 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-31216d89-af98-40d4-ad00-fd49b613b018 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:43.440422 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-31216d89-af98-40d4-ad00-fd49b613b018 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069697 May 07 21:36:43.441207 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 11/22] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:43.453700 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-b39c7844-9e64-414e-9e98-67768c498ccc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:43.478744 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-b39c7844-9e64-414e-9e98-67768c498ccc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029222 May 07 21:36:43.479874 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 12/23] 10.222.0.32 () {64 vars in 1332 bytes} [Sat May 7 21:36:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:36:45.873311 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-31216d89-af98-40d4-ad00-fd49b613b018 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:45.874336 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-31216d89-af98-40d4-ad00-fd49b613b018 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 07 21:36:45.874748 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:45.945626 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6eede46d-7922-4b4d-9d84-89e6391f8800 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "swap": 0, "id": "2", "vcpus": 1}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:45.975239 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6eede46d-7922-4b4d-9d84-89e6391f8800 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.094246 May 07 21:36:45.975814 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 13/25] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:45.987857 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-9ba2fd13-66be-455a-b813-35ba204aeab8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:46.010120 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-9ba2fd13-66be-455a-b813-35ba204aeab8 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025874 May 07 21:36:46.011025 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 13/26] 10.222.0.32 () {64 vars in 1332 bytes} [Sat May 7 21:36:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:48.510052 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6eede46d-7922-4b4d-9d84-89e6391f8800 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:48.511161 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6eede46d-7922-4b4d-9d84-89e6391f8800 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 May 07 21:36:48.511592 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:48.572518 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4254bb70-cd02-41c1-b01c-9d73ddb5b2ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "disk": 40}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:48.591215 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4254bb70-cd02-41c1-b01c-9d73ddb5b2ef admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073548 May 07 21:36:48.591732 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 14/28] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 07 21:36:48.604318 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c5f3c740-6540-4fe1-a17a-a5ce3d248f2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:48.631580 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c5f3c740-6540-4fe1-a17a-a5ce3d248f2c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029760 May 07 21:36:48.633249 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 15/29] 10.222.0.32 () {64 vars in 1332 bytes} [Sat May 7 21:36:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:51.419111 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4254bb70-cd02-41c1-b01c-9d73ddb5b2ef admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:51.420132 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4254bb70-cd02-41c1-b01c-9d73ddb5b2ef admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 07 21:36:51.420596 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 15/30] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:51.478669 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-62c3c7af-4500-4514-887d-e807b23d4f9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:51.495842 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-62c3c7af-4500-4514-887d-e807b23d4f9f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069590 May 07 21:36:51.496379 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 16/31] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:36:51.507847 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-81b2e4ab-223a-4ad8-921a-abe9473354b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:51.529762 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-81b2e4ab-223a-4ad8-921a-abe9473354b3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025597 May 07 21:36:51.530339 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 16/32] 10.222.0.32 () {64 vars in 1332 bytes} [Sat May 7 21:36:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:36:53.868809 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-62c3c7af-4500-4514-887d-e807b23d4f9f admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:36:53.869820 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-62c3c7af-4500-4514-887d-e807b23d4f9f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 07 21:36:53.870218 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 17/33] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:36:53.928962 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3a63a22f-8f54-4813-8d4f-0eef53bcda60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "vcpus": 8, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:53.949728 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3a63a22f-8f54-4813-8d4f-0eef53bcda60 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073493 May 07 21:36:53.954872 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 17/34] 10.222.0.32 () {64 vars in 1282 bytes} [Sat May 7 21:36:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 07 21:36:53.962683 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-56e05fb3-588b-4c72-a3c4-2eaa55cadf56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:36:53.989451 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-56e05fb3-588b-4c72-a3c4-2eaa55cadf56 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030944 May 07 21:36:53.990494 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 18/35] 10.222.0.32 () {64 vars in 1332 bytes} [Sat May 7 21:36:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:37:20.637105 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3a63a22f-8f54-4813-8d4f-0eef53bcda60 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:20.638109 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3a63a22f-8f54-4813-8d4f-0eef53bcda60 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 07 21:37:20.638510 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:20.695972 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c7760db7-ce62-485f-a6b1-c8f1bac836b3 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:20.714182 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c7760db7-ce62-485f-a6b1-c8f1bac836b3 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069701 May 07 21:37:20.714727 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:37:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:37:21.777155 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-3a63a22f-8f54-4813-8d4f-0eef53bcda60 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:21.778398 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-3a63a22f-8f54-4813-8d4f-0eef53bcda60 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 May 07 21:37:21.778869 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 19/38] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:22.076990 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6aa48dae-9d51-4286-b712-207ebfa86e96 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:22.083415 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-6aa48dae-9d51-4286-b712-207ebfa86e96 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 07 21:37:22.083986 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6aa48dae-9d51-4286-b712-207ebfa86e96 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:37:22.084784 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6aa48dae-9d51-4286-b712-207ebfa86e96 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061394 May 07 21:37:22.085299 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 20/39] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:37:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 07 21:37:22.095753 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-f06f7f6d-cafd-49cd-b2df-d094995ab1c9 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:22.119664 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-f06f7f6d-cafd-49cd-b2df-d094995ab1c9 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027427 May 07 21:37:22.120236 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:37:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:37:22.140673 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-81a91c71-637d-4cd0-9d67-46f4849f495e admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:22.164248 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-81a91c71-637d-4cd0-9d67-46f4849f495e admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026977 May 07 21:37:22.164859 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:37:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:37:22.175578 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dfa1aff1-9240-4c55-a193-8699c261a8f4 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:22.181601 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-dfa1aff1-9240-4c55-a193-8699c261a8f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 07 21:37:22.182164 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dfa1aff1-9240-4c55-a193-8699c261a8f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:37:22.183086 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dfa1aff1-9240-4c55-a193-8699c261a8f4 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.012434 May 07 21:37:22.183694 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:37:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 07 21:37:23.087077 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-81a91c71-637d-4cd0-9d67-46f4849f495e admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:23.088082 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-81a91c71-637d-4cd0-9d67-46f4849f495e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 07 21:37:23.088476 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:23.282976 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-34c98960-2fcf-4a3f-98f7-9206a7628cc5 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:23.288245 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-34c98960-2fcf-4a3f-98f7-9206a7628cc5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 07 21:37:23.288805 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-34c98960-2fcf-4a3f-98f7-9206a7628cc5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:37:23.289581 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-34c98960-2fcf-4a3f-98f7-9206a7628cc5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058567 May 07 21:37:23.290086 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:37:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 07 21:37:23.299235 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-c5d09094-2903-44bd-8814-7bc6cf097c3a admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:23.312550 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-c5d09094-2903-44bd-8814-7bc6cf097c3a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017037 May 07 21:37:23.313075 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:37:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:37:23.322656 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4f1edd47-bc47-4ffb-a0da-b4913ed698da admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:23.336877 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4f1edd47-bc47-4ffb-a0da-b4913ed698da admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017672 May 07 21:37:23.337390 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:37:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:37:23.346148 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7c0f5ddd-82c1-4e63-9794-13f3752115d5 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:23.351277 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-7c0f5ddd-82c1-4e63-9794-13f3752115d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 07 21:37:23.351844 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-7c0f5ddd-82c1-4e63-9794-13f3752115d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:37:23.352629 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-7c0f5ddd-82c1-4e63-9794-13f3752115d5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009934 May 07 21:37:23.353117 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 24/47] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:37:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 07 21:37:24.256629 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-4f1edd47-bc47-4ffb-a0da-b4913ed698da admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:24.257631 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-4f1edd47-bc47-4ffb-a0da-b4913ed698da admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 07 21:37:24.258269 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 24/48] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:24.464647 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6ebc8e4d-39bd-47d2-9b34-540f7370f401 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:24.471377 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.wsgi [None req-6ebc8e4d-39bd-47d2-9b34-540f7370f401 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 07 21:37:24.471952 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-6ebc8e4d-39bd-47d2-9b34-540f7370f401 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121093) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:37:24.472748 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-6ebc8e4d-39bd-47d2-9b34-540f7370f401 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065799 May 07 21:37:24.473499 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 25/49] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:37:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 07 21:37:24.482858 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c767d00d-34a9-4381-a85e-957bdf439b84 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:24.497128 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c767d00d-34a9-4381-a85e-957bdf439b84 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017938 May 07 21:37:24.497665 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 25/50] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:37:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:37:24.509123 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:24.526420 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022486 May 07 21:37:24.527017 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 26/51] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:37:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:37:24.536584 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0e2c0cde-ffb9-44aa-8ecf-5d6a9dc765dd admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:24.541850 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.wsgi [None req-0e2c0cde-ffb9-44aa-8ecf-5d6a9dc765dd admin admin] HTTP exception thrown: Flavor 451 could not be found. May 07 21:37:24.542420 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-0e2c0cde-ffb9-44aa-8ecf-5d6a9dc765dd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121094) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:37:24.543284 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-0e2c0cde-ffb9-44aa-8ecf-5d6a9dc765dd admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010440 May 07 21:37:24.543783 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 26/52] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:37:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 07 21:37:25.456340 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:25.457645 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 May 07 21:37:25.458050 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:25.655561 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-54783aee-3163-4d7b-9d68-3bcd44d4a396 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:37:25.672271 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-54783aee-3163-4d7b-9d68-3bcd44d4a396 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067829 May 07 21:37:25.672810 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 27/54] 10.222.0.32 () {64 vars in 1235 bytes} [Sat May 7 21:37:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:37:26.572696 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:26.573702 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 07 21:37:26.574104 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:26.768409 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-dcda0828-4b04-41f1-ae6e-f135172d4035 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:37:26.785739 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-dcda0828-4b04-41f1-ae6e-f135172d4035 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068251 May 07 21:37:26.786257 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 28/56] 10.222.0.32 () {64 vars in 1235 bytes} [Sat May 7 21:37:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:37:27.684918 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:27.685922 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 07 21:37:27.686329 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:27.881240 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-197782db-a75c-4722-8f75-17e837f57f0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:37:27.898596 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-197782db-a75c-4722-8f75-17e837f57f0c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068349 May 07 21:37:27.899115 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 29/58] 10.222.0.32 () {64 vars in 1235 bytes} [Sat May 7 21:37:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:37:28.796367 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:28.797485 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 07 21:37:28.797920 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 30/59] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:28.993351 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d99a9c74-edbc-4603-97b7-5d4dc83493c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:37:29.010033 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d99a9c74-edbc-4603-97b7-5d4dc83493c7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067844 May 07 21:37:29.010508 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 30/60] 10.222.0.32 () {64 vars in 1235 bytes} [Sat May 7 21:37:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:37:29.915837 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:29.916839 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 07 21:37:29.917248 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 31/61] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:37:30.122961 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1e2213fc-cd22-47df-b8d6-a2ae499a1378 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:37:30.141793 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1e2213fc-cd22-47df-b8d6-a2ae499a1378 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074438 May 07 21:37:30.142267 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 31/62] 10.222.0.32 () {60 vars in 1202 bytes} [Sat May 7 21:37:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:38:34.903475 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:38:34.904488 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-d1a45239-6cde-4aaf-8c2e-21c21e919a53 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 07 21:38:34.904898 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 930 bytes} [Sat May 7 21:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:38:34.962807 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-d1fa68c8-223e-4b8e-97af-9c5f5845dec6 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:38:34.981377 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-d1fa68c8-223e-4b8e-97af-9c5f5845dec6 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070634 May 07 21:38:34.981906 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 32/64] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:38:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:38:35.004777 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-5fe16997-ed7a-4c96-9249-8ee5384f54d8 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:38:35.012414 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-5fe16997-ed7a-4c96-9249-8ee5384f54d8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012394 May 07 21:38:35.013104 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 33/65] 10.222.0.32 () {60 vars in 1282 bytes} [Sat May 7 21:38:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:38:35.024858 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-c3d79013-527b-414c-84aa-a069072b4c83 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:38:35.032335 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-c3d79013-527b-414c-84aa-a069072b4c83 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011064 May 07 21:38:35.032853 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 33/66] 10.222.0.32 () {60 vars in 1285 bytes} [Sat May 7 21:38:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:38:35.044437 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2f418f4d-de9e-4284-b625-56b53d4dc1b4 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:38:35.052482 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2f418f4d-de9e-4284-b625-56b53d4dc1b4 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011662 May 07 21:38:35.053007 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 34/67] 10.222.0.32 () {60 vars in 1285 bytes} [Sat May 7 21:38:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:38:35.065927 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-fda5b3df-fcef-47c0-81d5-a9cc2fe11dc0 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:38:35.073247 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-fda5b3df-fcef-47c0-81d5-a9cc2fe11dc0 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011540 May 07 21:38:35.073755 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 34/68] 10.222.0.32 () {60 vars in 1282 bytes} [Sat May 7 21:38:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:43:59.028778 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2f418f4d-de9e-4284-b625-56b53d4dc1b4 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:43:59.029827 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2f418f4d-de9e-4284-b625-56b53d4dc1b4 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 07 21:43:59.030218 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 35/69] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:43:59.302476 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-a2fb73bf-6f82-4b97-948b-ba6223a22f24 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:43:59.303769 ncdv-master-1 devstack@n-api.service[121094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:43:59.303769 ncdv-master-1 devstack@n-api.service[121094]: warnings.warn(msg) May 07 21:43:59.304992 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a2fb73bf-6f82-4b97-948b-ba6223a22f24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:43:59.305430 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a2fb73bf-6f82-4b97-948b-ba6223a22f24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:43:59.306238 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a2fb73bf-6f82-4b97-948b-ba6223a22f24 admin admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:43:59.306666 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-a2fb73bf-6f82-4b97-948b-ba6223a22f24 admin admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:43:59.346655 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-a2fb73bf-6f82-4b97-948b-ba6223a22f24 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.155452 May 07 21:43:59.347250 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 35/70] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:43:59 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:44:00.244546 ncdv-master-1 devstack@n-api.service[121093]: DEBUG nova.api.openstack.wsgi [None req-2f418f4d-de9e-4284-b625-56b53d4dc1b4 admin admin] Calling method '>' {{(pid=121093) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:44:00.245561 ncdv-master-1 devstack@n-api.service[121093]: INFO nova.api.openstack.requestlog [None req-2f418f4d-de9e-4284-b625-56b53d4dc1b4 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 07 21:44:00.245967 ncdv-master-1 devstack@n-api.service[121093]: [pid: 121093|app: 0|req: 36/71] 10.222.0.32 () {56 vars in 1074 bytes} [Sat May 7 21:44:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:44:00.441905 ncdv-master-1 devstack@n-api.service[121094]: DEBUG nova.api.openstack.wsgi [None req-1bd0982d-51c2-45db-bf16-291f772c0c93 admin admin] Calling method '>' {{(pid=121094) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:44:00.444099 ncdv-master-1 devstack@n-api.service[121094]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:44:00.444099 ncdv-master-1 devstack@n-api.service[121094]: warnings.warn(msg) May 07 21:44:00.445375 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1bd0982d-51c2-45db-bf16-291f772c0c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:44:00.445824 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1bd0982d-51c2-45db-bf16-291f772c0c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:44:00.446647 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1bd0982d-51c2-45db-bf16-291f772c0c93 admin admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:44:00.447110 ncdv-master-1 devstack@n-api.service[121094]: DEBUG oslo_concurrency.lockutils [None req-1bd0982d-51c2-45db-bf16-291f772c0c93 admin admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121094) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:44:00.469569 ncdv-master-1 devstack@n-api.service[121094]: INFO nova.api.openstack.requestlog [None req-1bd0982d-51c2-45db-bf16-291f772c0c93 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.077392 May 07 21:44:00.470117 ncdv-master-1 devstack@n-api.service[121094]: [pid: 121094|app: 0|req: 36/72] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:44:00 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:44:44.357780 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... May 07 21:44:44.358588 ncdv-master-1 devstack@n-api.service[121092]: Sat May 7 21:44:44 2022 - graceful shutdown triggered... May 07 21:44:44.359082 ncdv-master-1 devstack@n-api.service[121093]: Gracefully killing worker 1 (pid: 121093)... May 07 21:44:44.359469 ncdv-master-1 devstack@n-api.service[121094]: Gracefully killing worker 2 (pid: 121094)... May 07 21:44:45.358228 ncdv-master-1 devstack@n-api.service[121092]: worker 1 buried after 1 seconds May 07 21:44:45.358228 ncdv-master-1 devstack@n-api.service[121092]: worker 2 buried after 1 seconds May 07 21:44:45.358228 ncdv-master-1 devstack@n-api.service[121092]: goodbye to uWSGI. May 07 21:44:45.359814 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. May 07 21:44:45.360423 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. May 07 21:44:45.363277 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 07 21:44:45.412576 ncdv-master-1 devstack@n-api.service[136667]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 7 21:44:45 2022] *** May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: nodename: ncdv-master-1 May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: machine: x86_64 May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: clock source: unix May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: pcre jit disabled May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: detected number of CPU cores: 4 May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: current working directory: / May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: detected binary path: /usr/bin/uwsgi-core May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: your processes number limit is 47680 May 07 21:44:45.417523 ncdv-master-1 devstack@n-api.service[136667]: your memory page size is 4096 bytes May 07 21:44:45.418472 ncdv-master-1 devstack@n-api.service[136667]: detected max file descriptor number: 2048 May 07 21:44:45.418472 ncdv-master-1 devstack@n-api.service[136667]: lock engine: pthread robust mutexes May 07 21:44:45.418472 ncdv-master-1 devstack@n-api.service[136667]: thunder lock: enabled May 07 21:44:45.418472 ncdv-master-1 devstack@n-api.service[136667]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 07 21:44:45.418472 ncdv-master-1 devstack@n-api.service[136667]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 07 21:44:45.467980 ncdv-master-1 devstack@n-api.service[136667]: Python main interpreter initialized at 0x563ebf26e9c0 May 07 21:44:45.467980 ncdv-master-1 devstack@n-api.service[136667]: python threads support enabled May 07 21:44:45.467980 ncdv-master-1 devstack@n-api.service[136667]: your server socket listen backlog is limited to 100 connections May 07 21:44:45.467980 ncdv-master-1 devstack@n-api.service[136667]: your mercy for graceful operations on workers is 90 seconds May 07 21:44:45.468391 ncdv-master-1 devstack@n-api.service[136667]: mapped 403077 bytes (393 KB) for 2 cores May 07 21:44:45.468391 ncdv-master-1 devstack@n-api.service[136667]: *** Operational MODE: preforking *** May 07 21:44:45.468638 ncdv-master-1 devstack@n-api.service[136667]: *** uWSGI is running in multiple interpreter mode *** May 07 21:44:45.468638 ncdv-master-1 devstack@n-api.service[136667]: spawned uWSGI master process (pid: 136667) May 07 21:44:45.468856 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 07 21:44:45.469408 ncdv-master-1 devstack@n-api.service[136667]: spawned uWSGI worker 1 (pid: 136681, cores: 1) May 07 21:44:45.474795 ncdv-master-1 devstack@n-api.service[136667]: spawned uWSGI worker 2 (pid: 136682, cores: 1) May 07 21:44:45.474795 ncdv-master-1 devstack@n-api.service[136667]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 07 21:44:46.760999 ncdv-master-1 devstack@n-api.service[136682]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 07 21:44:46.766058 ncdv-master-1 devstack@n-api.service[136681]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 07 21:44:47.579737 ncdv-master-1 devstack@n-api.service[136682]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:44:47.579737 ncdv-master-1 devstack@n-api.service[136682]: from cryptography.utils import int_from_bytes May 07 21:44:47.580043 ncdv-master-1 devstack@n-api.service[136682]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:44:47.580043 ncdv-master-1 devstack@n-api.service[136682]: from cryptography.utils import int_from_bytes May 07 21:44:47.596635 ncdv-master-1 devstack@n-api.service[136681]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:44:47.596635 ncdv-master-1 devstack@n-api.service[136681]: from cryptography.utils import int_from_bytes May 07 21:44:47.596954 ncdv-master-1 devstack@n-api.service[136681]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:44:47.596954 ncdv-master-1 devstack@n-api.service[136681]: from cryptography.utils import int_from_bytes May 07 21:44:50.075756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 07 21:44:50.076336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 07 21:44:50.076638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 07 21:44:50.076921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 07 21:44:50.077182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 07 21:44:50.077577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.077912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.078244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.078572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.078936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.079256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.079590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.079918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.080270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.080525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.080869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.081209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.081543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.081853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.082170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.082494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.082830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.083166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.083482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.084548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.085950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.085950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.085950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.085950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.086288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.086535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 07 21:44:50.087030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.087119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 07 21:44:50.087200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.087200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.087363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 07 21:44:50.087596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.087820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 07 21:44:50.087934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.088019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 07 21:44:50.088258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.088378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.088582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.088706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.088899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.089027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.089223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.089344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.089633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.089754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.089958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.090081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.090276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.090487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.090691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.090955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.091198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.091444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.091654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.091866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.091866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.092289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.092289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.092719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.092940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.093135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.093324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.093506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.093664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.093816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.094371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.094552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.094748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.094938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.095096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.095255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.095411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.095556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.095708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.095708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.096080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.096253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.096413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.096566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.096718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.096873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.097036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.097187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.097336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.097492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.097639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.097800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.097958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.098110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.098256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.098408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.098564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.098727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.098936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.099083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.099235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.099390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.099390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.099705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.099862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.100748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.100905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.101067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.101242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.101400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.101569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.101726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.101873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.102076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.102227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.102928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.103088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.103234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.103395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.103548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.103694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.103849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.104001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.104206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.104366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.104511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.104673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.104835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.104995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.105154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.105308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.105453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.105597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.105748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.105893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.106062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.106218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.106372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.106526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.106677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.106850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.107011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.107167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.107319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.107513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.107673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.107832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.107978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.108133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.108286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.108437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.108589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.108757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.108917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.109072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.109226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.109381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.109525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.109683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.109835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.110000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.111115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.111291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.111525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.111685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.111837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.111989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.112141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.112298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.112452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.112608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.112752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.112895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.113059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.113213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.113367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.113512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.113662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.113818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.113962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.114106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.114106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.114401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.114554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.114717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.114906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.115067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.115213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.115367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.115511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.115662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.115807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.115960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.116105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.116258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.116418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.116571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.116722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.117009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.117174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.117332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.117490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.117636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.117787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.117931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.118074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.118226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.118385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.118531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.118683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.118870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.119033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.119299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.119299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.119600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.119754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.119754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.120037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.120197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.121233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.121510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.121510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.121795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.121950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.121950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.122282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.122445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.122445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.122729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.122917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.122917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.123379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.123532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.123532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.123814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.123969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.123969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.124271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.124417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.124576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.124989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.125238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.125402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.125549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.125703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.125850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.126009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.126164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.126309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.126466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.126612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.127605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.127995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.128159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.128314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.128470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.128616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.128760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.128918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.129216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.129529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.129830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.132504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.132664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.132811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.132974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.133133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.133278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.133533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.133533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.133823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.133974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.134129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.134280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.134441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.134598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.134752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.134996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.135154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.135299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.135458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.135611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.135766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.135917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.136074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.136233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.136377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.136529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.136674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.136829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:44:50.137155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.137324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.137478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.137624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.137767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.137919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.138073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.138232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.138387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.138532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.138686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.138863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.139033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.139269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.139438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.139592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.139737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.139881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.140033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.140178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.140339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.140486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.140736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.140903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.141069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.141237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.142746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.142926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.143075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.143234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.143381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.143558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.143773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.143922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.144075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.144220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.144372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.144539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.144712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.144858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.145002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.145157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.145302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.145456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.145610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.145756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.145909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.146061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.146216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.146410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.147203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.147381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.147539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.147686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.147842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.147995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.148140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.148293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.148438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.148590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.148750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.148903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.149114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.149285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.149432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.149576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.149729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.149729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.150012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.150165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.150317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.150462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.150616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.150790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.151028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.151187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.151350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.152042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.152211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.152481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.152662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.153006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.153175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.153341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.153487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.153631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.153801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.154028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.154179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.154349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.154501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.154656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.154820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.154982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.155130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.155284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.155437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.155589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.155734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.155877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.156035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.156181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.156344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.156497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.156650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.156803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.156959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.157104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.157248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.157399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.157544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.157689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.157847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.157999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.158162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.158318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.158470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.158615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.158804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.158958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.159111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.159269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.159414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.159573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.159718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.159869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.160021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.160184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.160338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.160498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.160645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.160789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.160932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.161172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.161335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.161492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.161743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.162383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.162546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.162694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.162873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.163259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.163413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.163558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.163711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.163863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.164037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.164258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.164429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.164581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.164727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.164879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.165034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.165190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.165351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.166208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.166368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.166516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.166673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.166842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.167037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.167186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.167341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.167498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.167654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.167821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.167968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.168153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.168153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.168444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.168589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.168735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.168886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.169030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.169030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.169316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.169462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.169612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.169769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.169931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.170084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.170249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.170402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.170554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.170706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.170901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.171048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.171300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.171534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.171749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.171998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.172624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.172796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.172944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.173088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.173442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.173595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.173740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.173894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.174056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.174209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.174483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.174634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.174808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.174994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.175149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.175376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.175534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.175686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.175831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.175984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.176138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.176282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.176433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.176588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.176828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.176991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.177150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.177302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.177456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.177642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.177798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.177952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.178098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.178250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.178394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.178547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.178701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.178938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.179985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.180265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.180265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.180552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.180714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.180860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.181021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.181166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.181324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.181470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.181714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.181882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.182111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.182281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.182867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.183023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.183168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.183312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.183646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.183820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.183976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.184129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.184275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.184513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.184664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.184808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.184967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.185122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.185267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.185411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.185556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.185748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.185909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.186062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.186214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.186367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.186521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.186683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.186870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.187029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.187181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.187342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.187503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.187667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.187827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.187998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.188150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.188309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.188461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.188627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.188779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.188938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.189090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.189242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.189408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.189569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.189722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.189883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.190035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.190193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.190358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.190511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.190662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.190918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.191087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.191248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.191415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.191567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.191737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.191974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.192227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.192385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.192982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.193857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.194032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.194231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.194388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.194627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.194820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.194981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.195133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.195295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.195455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.195629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.195781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.195940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.196100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.196252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.196410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.196571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.196724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.196875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.197034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.197194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.197354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.197517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.197680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.197839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.197999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.198152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.198310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.198475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.198635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.198805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.198964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.199364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.199539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.199692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.199842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.200011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.200166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.200325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.200486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.200647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.200800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.200951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.201142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.201300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.201466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.201619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.201771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.201958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.201958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.202427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.202427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.202427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.202427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.202427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.203660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.203840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.204175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.204345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.204516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.204756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.204926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.205168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.205322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.205488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.205641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.205813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.205973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.206125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.206276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.206428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.206588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.206751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.206929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.207092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.207261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.207531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.207531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.207842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.208002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.208161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.208328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.208480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.208641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.208817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.209502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.209707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.210105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.210260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.210427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.210427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.210737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.210946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.211108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.211277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.211431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.211581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.211734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.211894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.212057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.212242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.212526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.212695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.212881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.213460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.213623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.213787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.213787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.214093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.214093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.214607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.214801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.215051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.215210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.215362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.215523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.215676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.215827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.215979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.216137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.216290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.216451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.216603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.217028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.217216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.217216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.217525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.217758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.217915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.218076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.218227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.218378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.218538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.218690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.218876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.219033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.219184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.219346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.219612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.219781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.219942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.220096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.220255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.220415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.220576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.220729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.220888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.221047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.221208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.221368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.221540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.221699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.221851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.222003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.222155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.222321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.222492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.222716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.222948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.223129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.223652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.223830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.223830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.224148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.224302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.224600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.224843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.225033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.225262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.225500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.225659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.225811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.225970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.226132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.226284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.226448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.226600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.226752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.227018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.227178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.227329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.227481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.228363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.228533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.228688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.228849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.229009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.229170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.229342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.229506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.229659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.229810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.229970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.230123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.230281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.230447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.230608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.230760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.230991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.231144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.231321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.231490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.231643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.231794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.231953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.232112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.232274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.232426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.232577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.232747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.232974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.233131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.233297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.233803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.233965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.234126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.234286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.234448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.234640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.234996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.235166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.235408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.235575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.235742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.235896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.236048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.236225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.236379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.236531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.236769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.236925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.237159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.237317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.237476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.237637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.237803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.237956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.238115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.238356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.238534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.238688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.238879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.239036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.239187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.239345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.239503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.239667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.239819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.239971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.240162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.240315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.240481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.240658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.240826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.240980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.241132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.241291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.241444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.241608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.241768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.241919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.242078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.242230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.242380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.242571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.242959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.243198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.243365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.243518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.244012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.244176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.244329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.244494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.244658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.244818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.245174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.245335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.245588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.245747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.245907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.246068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.246235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.246390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.246540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.246705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.246883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.247054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.247299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.247460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.247460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.247759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.247910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.248061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.248226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.248458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.248616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.248776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.248937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.249099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.249307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.249470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.249622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.249773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.249943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.250106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.250267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.250419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.250579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.250731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.250925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.251092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.251245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.251405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.251559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.251718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.251871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.252043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.252211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.252363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.252515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.252666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.252835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.252988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.254156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.254382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.254566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.254735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.254923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.255108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.255458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.256224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.256395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.256550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.256550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.256840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.256992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.257150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.257334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.257574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.257574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.257892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.258045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.258206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.258365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.258616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.258795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.258955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.259118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.259284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.259448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.259600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.259801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.259968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.260140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.260307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.260460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.260619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.260778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.260931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.261093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.261245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.261245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.261532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.261682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.261833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.261993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.262156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.262307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.262459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.262459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.262745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.262973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.263137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.263289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.263448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.263698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.264239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.264419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.264594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.264756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.264909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.265070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.265243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.265629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.265995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.266390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.266553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.266706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.266900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.267101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.267261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.267426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.267595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.267830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.268000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.268342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.268501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.268750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.268919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.269080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.269249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.269411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.269572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.269725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.269889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.269889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.270203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.270203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.270502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.270502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.270860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.271033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.271194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.271194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.272083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.272248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.272411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.272584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.272736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.272895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.273046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.273213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.273373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.273527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.273696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.273926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.274447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.274627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.274627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.274967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.275131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.275283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.275443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.275665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.275833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.276069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.276227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.276388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.276550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.276712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.276873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.277026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.277204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.277365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.277528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.277681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.277858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.278086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.278260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.278413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.278583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.278761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.278934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.279086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.279237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.279397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.279567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.279721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.279881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.280033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.280183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.280347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.280507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.280658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.280810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.280961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.281113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.281287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.281440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.281598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.281758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.281917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.282077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.282239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.282391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.282549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.282708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.282914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.283078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.283244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.283422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.283575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.283734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.283903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.284138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.284629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.284799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.284951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.285113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.285267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.285428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.285580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.285731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.285894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.286074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.286304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.286472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.286472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.286788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.286973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.287128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.287291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.287457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.287609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.287760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.287911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.288091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.288324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.288489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.288641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.288791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.288941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.289099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.289268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.289427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.289578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.289736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.289888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.290050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.290212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.290366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.290525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.290907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.291089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.291253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.291253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.291558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.291558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.291843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.291996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.292162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.292326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.292478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.292630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.292788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.292939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.293104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.293257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.293408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.293560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.293709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.293709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.294017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.294265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.294784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.294961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.295124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.295277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.295482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.295645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.295804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.295957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.296115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.296373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.296373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.296760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.296921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.297086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.297239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.297399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.297551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.297703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.297862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.298016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.298176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.298358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.298591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.298757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.298996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.299170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.299373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.299527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.299679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.299839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.299999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.300152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.300314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.300474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.300626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.300778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.300929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.301088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.301267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.301428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.301589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.301742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.301894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.302053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.302219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.302380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.302557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.302714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.302908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.303078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.303245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.303405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.303566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.303718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.303869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.304032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.304184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.304424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.304921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.305090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.305259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.305420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.305583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.305743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.305743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.306041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.306209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.306369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.306521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.306754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.306986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.307141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.307368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.307531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.307685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.307856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.308009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.308161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.308322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.308476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.308711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.308881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.309034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.309196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.309356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.309508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.309661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.309822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.309822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.310128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.310282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.310434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.310584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.310744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.310931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.311103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.311255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.311408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.311559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.311722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.311886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.312039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.312190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.312353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.312505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.312665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.312830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.312984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.313134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.313285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.313437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.313616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.313616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.313922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.314075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.314233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.314402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.314972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.315146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.315300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.315465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.315627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.315788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.315954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.315954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.316256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.316408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.316570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.316917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.317096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.317251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.317411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.317572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.317733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.317899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.318062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.319911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.320975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.321946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.322960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.323919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.324994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.325081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.325167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.325395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.325543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.325736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.325926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.326036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.326754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.327099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.327278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.327438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.327626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.327791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.327791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.328104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.328261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.328425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.328589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.328754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.328944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.329104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.329266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.329421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.329596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.329766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.329921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.330083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.330244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.330406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.330561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.330729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.330913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.331070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.331226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.331391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.331548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.331727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.331882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.332037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.332190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.332353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.332516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.332654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.332779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.332894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.333826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.334547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.334647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.334744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.334866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.334965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.335997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.336933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.337966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.338952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.339936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.340978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.341872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.342736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.343973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.344063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.344927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.345929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.346971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.347915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.348978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.349910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.350969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.351944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.352959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.353975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.354628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.355971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.356796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:44:50.357516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 07 21:44:50.369576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_db.sqlalchemy.engines [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.378631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_db.sqlalchemy.engines [None req-9f54a385-c703-4407-9934-926267e37d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.435167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.context [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=136682) load_cells /opt/stack/nova/nova/context.py:464}} May 07 21:44:50.439704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:44:50.441324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:44:50.442167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:44:50.444743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:44:50.446659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.context [None req-9f54a385-c703-4407-9934-926267e37d08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=136681) load_cells /opt/stack/nova/nova/context.py:464}} May 07 21:44:50.456526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_db.sqlalchemy.engines [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.459881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_db.sqlalchemy.engines [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.464500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f54a385-c703-4407-9934-926267e37d08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:44:50.466140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f54a385-c703-4407-9934-926267e37d08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:44:50.467048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f54a385-c703-4407-9934-926267e37d08 None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:44:50.469112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f54a385-c703-4407-9934-926267e37d08 None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:44:50.487234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_db.sqlalchemy.engines [None req-9f54a385-c703-4407-9934-926267e37d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.488576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_db.sqlalchemy.engines [None req-9f54a385-c703-4407-9934-926267e37d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.634047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_db.sqlalchemy.engines [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.653651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_db.sqlalchemy.engines [None req-9f54a385-c703-4407-9934-926267e37d08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:44:50.967782 ncdv-master-1 devstack@n-api.service[136682]: WARNING keystonemiddleware.auth_token [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:44:50.975304 ncdv-master-1 devstack@n-api.service[136682]: WARNING keystonemiddleware.auth_token [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:44:50.981468 ncdv-master-1 devstack@n-api.service[136681]: WARNING keystonemiddleware.auth_token [None req-9f54a385-c703-4407-9934-926267e37d08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:44:50.989253 ncdv-master-1 devstack@n-api.service[136681]: WARNING keystonemiddleware.auth_token [None req-9f54a385-c703-4407-9934-926267e37d08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:44:51.331755 ncdv-master-1 devstack@n-api.service[136682]: WARNING keystonemiddleware.auth_token [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:44:51.336435 ncdv-master-1 devstack@n-api.service[136681]: WARNING keystonemiddleware.auth_token [None req-9f54a385-c703-4407-9934-926267e37d08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 07 21:44:51.338036 ncdv-master-1 devstack@n-api.service[136682]: WARNING keystonemiddleware.auth_token [None req-b4ca226f-4213-41ab-a32b-e66f5a0dcbbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:44:51.342671 ncdv-master-1 devstack@n-api.service[136681]: WARNING keystonemiddleware.auth_token [None req-9f54a385-c703-4407-9934-926267e37d08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 07 21:44:51.343420 ncdv-master-1 devstack@n-api.service[136682]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ebf26e9c0 pid: 136682 (default app) May 07 21:44:51.348078 ncdv-master-1 devstack@n-api.service[136681]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ebf26e9c0 pid: 136681 (default app) May 07 21:45:39.094076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Calling method '.version_select at 0x7fc41f46a310>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:39.096574 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:39.096574 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:39.103799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=136682) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 07 21:45:39.104833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.105572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.133623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.134272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.147787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.148375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.156246 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c595d4b3-335f-484e-bc9b-38ab9aae66cc tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.298354 May 07 21:45:39.157235 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1207 bytes} [Sat May 7 21:45:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:45:39.174235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d07431e-46d3-409b-b060-44c4720bfe97 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-920045665"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:39.195540 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:39.195540 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:39.196643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-3d07431e-46d3-409b-b060-44c4720bfe97 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Generated uuid ca65603d-8131-43c3-a3c4-7c91a162bbc2 for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:39.275631 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d07431e-46d3-409b-b060-44c4720bfe97 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.106270 May 07 21:45:39.276274 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2/2] 10.222.0.32 () {62 vars in 1204 bytes} [Sat May 7 21:45:39 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:39.662640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97d9c139-3cc4-4f51-8ee7-0508690778c5 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Action: 'create', calling method: .version_select at 0x7fc41f468310>, body: {"keypair": {"name": "tempest-keypair-1994876833", "type": "ssh", "user_id": "799d6070fafb4901b08626b9aeebd197"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:39.708332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-97d9c139-3cc4-4f51-8ee7-0508690778c5 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:39.716149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-97d9c139-3cc4-4f51-8ee7-0508690778c5 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for user 75347057109e40d09c0e5152fd8605ef and project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:39.736857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Calling method '.version_select at 0x7fc41f31b9d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:39.738143 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:39.738143 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:39.739693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.740199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.759891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.760450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.801753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.802342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.815871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.816326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.833942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:39.834621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:39.842960 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ecc3e180-a04a-4634-8762-ae8391c52bc9 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.563665 May 07 21:45:39.842960 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3/3] 10.222.0.32 () {60 vars in 1242 bytes} [Sat May 7 21:45:39 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:45:39.845831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6207464a-4798-4e47-9eb1-ce5de77a179d tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1005486234"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:39.918942 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:39.918942 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:39.964985 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6207464a-4798-4e47-9eb1-ce5de77a179d tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.119231 May 07 21:45:39.965994 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 4/4] 10.222.0.32 () {62 vars in 1209 bytes} [Sat May 7 21:45:39 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:40.129750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-97d9c139-3cc4-4f51-8ee7-0508690778c5 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:40.133561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-97d9c139-3cc4-4f51-8ee7-0508690778c5 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for user 75347057109e40d09c0e5152fd8605ef and project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:40.143124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '.version_select at 0x7fc41f31b1f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:40.144541 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.144541 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:40.147022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.147776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.147897 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97d9c139-3cc4-4f51-8ee7-0508690778c5 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 1.659877 May 07 21:45:40.148438 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1/5] 10.222.0.32 () {62 vars in 1199 bytes} [Sat May 7 21:45:38 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1662 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 07 21:45:40.166724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.168081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.179356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.179897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.186342 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8cb3e6e3-5e33-456d-9425-e95d2c51b4f1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.219058 May 07 21:45:40.187122 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 5/6] 10.222.0.32 () {58 vars in 1166 bytes} [Sat May 7 21:45:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:40.325644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d35c8cb7-ef6d-4c52-acb0-966a31c9a07d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:40.327896 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.327896 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:40.329164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35c8cb7-ef6d-4c52-acb0-966a31c9a07d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.329637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35c8cb7-ef6d-4c52-acb0-966a31c9a07d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.330451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35c8cb7-ef6d-4c52-acb0-966a31c9a07d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.330929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35c8cb7-ef6d-4c52-acb0-966a31c9a07d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.374347 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d35c8cb7-ef6d-4c52-acb0-966a31c9a07d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.224797 May 07 21:45:40.374958 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2/7] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:45:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:40.388225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-427d3f00-a141-4c8a-8721-9f799d0a7408 tempest-AZAdminNegativeTestJSON-273543814 tempest-AZAdminNegativeTestJSON-273543814-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:40.389856 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.389856 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:40.391181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-427d3f00-a141-4c8a-8721-9f799d0a7408 tempest-AZAdminNegativeTestJSON-273543814 tempest-AZAdminNegativeTestJSON-273543814-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '92f1c2e2f8f44009b3ede81d9b970c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451d8752792a4106b2ea34d23ecc5593', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:40.391984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-427d3f00-a141-4c8a-8721-9f799d0a7408 tempest-AZAdminNegativeTestJSON-273543814 tempest-AZAdminNegativeTestJSON-273543814-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:40.392875 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-427d3f00-a141-4c8a-8721-9f799d0a7408 tempest-AZAdminNegativeTestJSON-273543814 tempest-AZAdminNegativeTestJSON-273543814-project] 10.222.0.32 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.205030 May 07 21:45:40.393613 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 6/8] 10.222.0.32 () {58 vars in 1184 bytes} [Sat May 7 21:45:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 206 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:40.398335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Calling method '.version_select at 0x7fc41daa38b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:40.399775 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.399775 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:40.401050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.401590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.416012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.416467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.429429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.430012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.440011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.440469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.452890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.453344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.459086 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aefd2e7d-dbb9-4873-9392-e9b04a8890b6 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.064584 May 07 21:45:40.464747 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 7/9] 10.222.0.32 () {60 vars in 1221 bytes} [Sat May 7 21:45:40 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:40.464747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1f05268-f9ca-44b1-a18b-373101c4e713 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:40.465379 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.465379 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:40.472018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1f05268-f9ca-44b1-a18b-373101c4e713 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.011037 May 07 21:45:40.479001 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 8/10] 10.222.0.32 () {60 vars in 1189 bytes} [Sat May 7 21:45:40 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:40.483481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3a91f32-f37c-4dac-badc-637106de339e tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Action: 'create', calling method: .version_select at 0x7fc41daa33a0>, body: {"keypair": {"name": "tempest-keypair-835559834", "type": "ssh", "user_id": "799d6070fafb4901b08626b9aeebd197"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:40.492066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a4866d6f-0221-4394-b2ed-01723540d491 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-841388293", "ram": 512, "vcpus": 1, "disk": 10, "id": 971627927, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:40.494116 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.494116 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:40.511200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b3a91f32-f37c-4dac-badc-637106de339e tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:40.517661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b3a91f32-f37c-4dac-badc-637106de339e tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for user 75347057109e40d09c0e5152fd8605ef and project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:40.537461 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a4866d6f-0221-4394-b2ed-01723540d491 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.161108 May 07 21:45:40.538323 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3/11] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:45:40 2022] POST /compute/v2.1/flavors => generated 412 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:40.544254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-406e065a-091e-4220-b55e-4898f8dc9dc4 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Calling method '.version_select at 0x7fc41eacb940>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:40.547804 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.547804 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:40.554929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-406e065a-091e-4220-b55e-4898f8dc9dc4 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=136681) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 07 21:45:40.555412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-406e065a-091e-4220-b55e-4898f8dc9dc4 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.556127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-406e065a-091e-4220-b55e-4898f8dc9dc4 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.593573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-406e065a-091e-4220-b55e-4898f8dc9dc4 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.594037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-406e065a-091e-4220-b55e-4898f8dc9dc4 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.605118 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-406e065a-091e-4220-b55e-4898f8dc9dc4 tempest-HypervisorAdminV253TestBase-2088112564 tempest-HypervisorAdminV253TestBase-2088112564-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/f8e950aa-c8c5-4687-8cf7-7b3317ffd96c" status: 200 len: 791 microversion: 2.53 time: 0.063855 May 07 21:45:40.606363 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 4/12] 10.222.0.32 () {60 vars in 1297 bytes} [Sat May 7 21:45:40 2022] GET /compute/v2.1/os-hypervisors/f8e950aa-c8c5-4687-8cf7-7b3317ffd96c => generated 791 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:40.611154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aecd70bc-b98b-4308-ad94-1e07d32e4e3d tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:40.612624 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:40.612624 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:40.626670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aecd70bc-b98b-4308-ad94-1e07d32e4e3d tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:40.627334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aecd70bc-b98b-4308-ad94-1e07d32e4e3d tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:40.731717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b3a91f32-f37c-4dac-badc-637106de339e tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:40.735719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b3a91f32-f37c-4dac-badc-637106de339e tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for user 75347057109e40d09c0e5152fd8605ef and project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:40.749886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3a91f32-f37c-4dac-badc-637106de339e tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.10 time: 0.269296 May 07 21:45:40.750514 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 9/13] 10.222.0.32 () {62 vars in 1199 bytes} [Sat May 7 21:45:40 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 271 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 07 21:45:41.045489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60f62f9d-7e8c-4b10-a22f-18072f9cee7b tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.068804 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-60f62f9d-7e8c-4b10-a22f-18072f9cee7b tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] HTTP exception thrown: Flavor 971627927 has no extra specs with key hw:cpu_thread_policy. May 07 21:45:41.069610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60f62f9d-7e8c-4b10-a22f-18072f9cee7b tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Returning 404 to user: Flavor 971627927 has no extra specs with key hw:cpu_thread_policy. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:41.079360 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-60f62f9d-7e8c-4b10-a22f-18072f9cee7b tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] 10.222.0.32 "GET /compute/v2.1/flavors/971627927/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.318524 May 07 21:45:41.079971 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 10/14] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:45:40 2022] GET /compute/v2.1/flavors/971627927/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:41.085873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f360d45-a413-4b1b-9abe-3d9b21da76a9 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Calling method '.version_select at 0x7fc41da1b430>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.095000 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f360d45-a413-4b1b-9abe-3d9b21da76a9 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-1994876833?user_id=799d6070fafb4901b08626b9aeebd197" status: 200 len: 706 microversion: 2.10 time: 0.013705 May 07 21:45:41.095739 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 11/15] 10.222.0.32 () {60 vars in 1339 bytes} [Sat May 7 21:45:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1994876833?user_id=799d6070fafb4901b08626b9aeebd197 => generated 706 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:41.100960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e7e4aac-f39c-49a8-bc98-b689fa1e4bed tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.102659 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.102659 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:41.103841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6e7e4aac-f39c-49a8-bc98-b689fa1e4bed tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '474acbe7ce864bdfa6b213bf0f19e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412d53f87f74db2bad375bb6ff29901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:41.104517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e7e4aac-f39c-49a8-bc98-b689fa1e4bed tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:41.105353 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e7e4aac-f39c-49a8-bc98-b689fa1e4bed tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] 10.222.0.32 "POST /compute/v2.1/flavors/971627927/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.008545 May 07 21:45:41.106253 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 12/16] 10.222.0.32 () {60 vars in 1220 bytes} [Sat May 7 21:45:41 2022] POST /compute/v2.1/flavors/971627927/os-extra_specs => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:41.110875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3320c750-0054-4257-b468-ad985c8c7fcf tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Action: 'create', calling method: .version_select at 0x7fc41da201f0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-403996533", "type": "ssh"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.125766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3320c750-0054-4257-b468-ad985c8c7fcf tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:41.130286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3320c750-0054-4257-b468-ad985c8c7fcf tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for user 75347057109e40d09c0e5152fd8605ef and project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:41.257978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3320c750-0054-4257-b468-ad985c8c7fcf tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:41.266920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3320c750-0054-4257-b468-ad985c8c7fcf tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Getting quotas for user 75347057109e40d09c0e5152fd8605ef and project 894b035e2d7f492892e2b866e5f474a2. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:41.299788 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3320c750-0054-4257-b468-ad985c8c7fcf tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.10 time: 0.191673 May 07 21:45:41.302064 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 13/17] 10.222.0.32 () {62 vars in 1198 bytes} [Sat May 7 21:45:41 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 07 21:45:41.307361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-896aa07c-0ae0-49a1-8e87-ec941ef65707 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.411405 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-896aa07c-0ae0-49a1-8e87-ec941ef65707 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/971627927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.107517 May 07 21:45:41.413452 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 14/18] 10.222.0.32 () {60 vars in 1220 bytes} [Sat May 7 21:45:41 2022] POST /compute/v2.1/flavors/971627927/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:45:41.423846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d3c5b26-75eb-4c58-8fbf-488e208f654c tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Calling method '.version_select at 0x7fc41da20ee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.427241 ncdv-master-1 devstack@n-api.service[136682]: WARNING oslo_db.sqlalchemy.utils [None req-3d3c5b26-75eb-4c58-8fbf-488e208f654c tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 07 21:45:41.439211 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d3c5b26-75eb-4c58-8fbf-488e208f654c tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "GET /compute/v2.1/os-keypairs?user_id=799d6070fafb4901b08626b9aeebd197" status: 200 len: 1113 microversion: 2.10 time: 0.024316 May 07 21:45:41.447534 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 15/19] 10.222.0.32 () {60 vars in 1258 bytes} [Sat May 7 21:45:41 2022] GET /compute/v2.1/os-keypairs?user_id=799d6070fafb4901b08626b9aeebd197 => generated 1113 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:45:41.589983 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aecd70bc-b98b-4308-ad94-1e07d32e4e3d tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 0.982365 May 07 21:45:41.590691 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 5/20] 10.222.0.32 () {62 vars in 1231 bytes} [Sat May 7 21:45:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:41.596332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d66f2b1-c0f0-4c9f-a78b-3aecb912c254 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.597155 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.597155 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:41.598062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d66f2b1-c0f0-4c9f-a78b-3aecb912c254 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '474acbe7ce864bdfa6b213bf0f19e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412d53f87f74db2bad375bb6ff29901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:41.598707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d66f2b1-c0f0-4c9f-a78b-3aecb912c254 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:41.599571 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d66f2b1-c0f0-4c9f-a78b-3aecb912c254 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] 10.222.0.32 "DELETE /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007889 May 07 21:45:41.600330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 6/21] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 21:45:41 2022] DELETE /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:41.613828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ae71c07-e9be-45da-ab53-05355504505f tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Calling method '.version_select at 0x7fc41f95e1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.632614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6c80697a-7a59-40f3-ab4e-87db3c27d1b7 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.635863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c80697a-7a59-40f3-ab4e-87db3c27d1b7 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:41.637107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c80697a-7a59-40f3-ab4e-87db3c27d1b7 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:41.639136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c80697a-7a59-40f3-ab4e-87db3c27d1b7 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:41.642531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c80697a-7a59-40f3-ab4e-87db3c27d1b7 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:41.650033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ae71c07-e9be-45da-ab53-05355504505f tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-403996533" status: 204 len: 0 microversion: 2.10 time: 0.047662 May 07 21:45:41.650943 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 7/22] 10.222.0.32 () {60 vars in 1321 bytes} [Sat May 7 21:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-403996533 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:45:41.661184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-133376b0-0bd1-4c4a-8014-9a5da7edbf25 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.662636 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.662636 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:41.674207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-133376b0-0bd1-4c4a-8014-9a5da7edbf25 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:41.674601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-133376b0-0bd1-4c4a-8014-9a5da7edbf25 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:41.694087 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6c80697a-7a59-40f3-ab4e-87db3c27d1b7 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] 10.222.0.32 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.244629 May 07 21:45:41.701388 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 16/23] 10.222.0.32 () {58 vars in 1163 bytes} [Sat May 7 21:45:41 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:45:41.701388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a6a80765-be98-4500-9878-c8e66fec1286 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.702323 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.702323 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:41.724747 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a6a80765-be98-4500-9878-c8e66fec1286 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/971627927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028686 May 07 21:45:41.729683 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 17/24] 10.222.0.32 () {60 vars in 1220 bytes} [Sat May 7 21:45:41 2022] POST /compute/v2.1/flavors/971627927/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:45:41.730534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-493a6d0a-cf2e-49b7-98a6-80b9240852c7 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Calling method '.version_select at 0x7fc41d972ee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.753171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-493a6d0a-cf2e-49b7-98a6-80b9240852c7 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835559834?user_id=799d6070fafb4901b08626b9aeebd197" status: 204 len: 0 microversion: 2.10 time: 0.025958 May 07 21:45:41.753834 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 18/25] 10.222.0.32 () {60 vars in 1339 bytes} [Sat May 7 21:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835559834?user_id=799d6070fafb4901b08626b9aeebd197 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:45:41.761416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9779c587-d3de-497c-87e6-12a4d566a3b2 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.763612 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.763612 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:41.764783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9779c587-d3de-497c-87e6-12a4d566a3b2 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:41.767330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9779c587-d3de-497c-87e6-12a4d566a3b2 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:41.768908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9779c587-d3de-497c-87e6-12a4d566a3b2 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:41.769818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9779c587-d3de-497c-87e6-12a4d566a3b2 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:41.807185 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9779c587-d3de-497c-87e6-12a4d566a3b2 tempest-AZAdminV2TestJSON-2055065154 tempest-AZAdminV2TestJSON-2055065154-project-admin] 10.222.0.32 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.047441 May 07 21:45:41.808684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 19/26] 10.222.0.32 () {58 vars in 1184 bytes} [Sat May 7 21:45:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:41.814211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1da642b3-c9d3-402c-8795-7b0f7e65f255 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.815615 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.815615 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:41.816997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1da642b3-c9d3-402c-8795-7b0f7e65f255 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '474acbe7ce864bdfa6b213bf0f19e18a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1412d53f87f74db2bad375bb6ff29901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:41.817839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1da642b3-c9d3-402c-8795-7b0f7e65f255 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:41.818690 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1da642b3-c9d3-402c-8795-7b0f7e65f255 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020 tempest-FlavorsExtraSpecsNegativeTestJSON-1550038020-project] 10.222.0.32 "PUT /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008868 May 07 21:45:41.819568 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 20/27] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:45:41 2022] PUT /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:41.826917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-50da9ee6-5a3e-4eaf-be47-f4cce0430157 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] Calling method '.version_select at 0x7fc41d989040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.835559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-133376b0-0bd1-4c4a-8014-9a5da7edbf25 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.183353 May 07 21:45:41.836622 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 8/28] 10.222.0.32 () {62 vars in 1231 bytes} [Sat May 7 21:45:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:41.844423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-443e177f-b94e-488e-87f8-2c22961c4661 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.845845 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.845845 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:41.858629 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-50da9ee6-5a3e-4eaf-be47-f4cce0430157 tempest-KeyPairsV210TestJSON-771688217 tempest-KeyPairsV210TestJSON-771688217-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994876833?user_id=799d6070fafb4901b08626b9aeebd197" status: 204 len: 0 microversion: 2.10 time: 0.037823 May 07 21:45:41.864800 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 21/29] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:45:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994876833?user_id=799d6070fafb4901b08626b9aeebd197 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:45:41.868554 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-443e177f-b94e-488e-87f8-2c22961c4661 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] HTTP exception thrown: Flavor 971627927 has no extra specs with key hw:cpu_thread_policy. May 07 21:45:41.869481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-443e177f-b94e-488e-87f8-2c22961c4661 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Returning 404 to user: Flavor 971627927 has no extra specs with key hw:cpu_thread_policy. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:41.870470 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-443e177f-b94e-488e-87f8-2c22961c4661 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/971627927/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.031097 May 07 21:45:41.870730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aee7224d-a4bc-4295-af81-c1281d002e94 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.871505 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 9/30] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:45:41 2022] DELETE /compute/v2.1/flavors/971627927/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:41.871606 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.871606 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:41.881292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c7eabac-421d-4cb4-a7a0-26e2eebe3a69 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.882792 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.882792 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:41.883846 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-9c7eabac-421d-4cb4-a7a0-26e2eebe3a69 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] HTTP exception thrown: Request body and URI mismatch May 07 21:45:41.884406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c7eabac-421d-4cb4-a7a0-26e2eebe3a69 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:41.886086 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c7eabac-421d-4cb4-a7a0-26e2eebe3a69 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.008578 May 07 21:45:41.886997 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 10/31] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:45:41 2022] PUT /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes => generated 73 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 07 21:45:41.896227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35e48342-8d21-476b-97ec-7faa2b57231e tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.897546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35e48342-8d21-476b-97ec-7faa2b57231e tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:41.898691 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-35e48342-8d21-476b-97ec-7faa2b57231e tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.006890 May 07 21:45:41.903678 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 11/32] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:45:41 2022] PUT /compute/v2.1/flavors/971627927/os-extra_specs/hw:numa_nodes => generated 117 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 07 21:45:41.906332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aee7224d-a4bc-4295-af81-c1281d002e94 tempest-AggregatesAdminTestV241-258420426 tempest-AggregatesAdminTestV241-258420426-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.039731 May 07 21:45:41.909572 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 22/33] 10.222.0.32 () {60 vars in 1192 bytes} [Sat May 7 21:45:41 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:41.911078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b41d2f9e-01fd-4b50-9b2c-e2f271bd634b tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.912078 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.912078 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:41.943236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-36465847-c90e-4b37-8c04-0f05ed61decd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1943457932"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.944525 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.944525 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:41.945404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-36465847-c90e-4b37-8c04-0f05ed61decd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid bb12e260-5ff9-4c98-942d-ce730fc57fff for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:41.949754 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b41d2f9e-01fd-4b50-9b2c-e2f271bd634b tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/971627927" status: 202 len: 0 microversion: 2.1 time: 0.044839 May 07 21:45:41.953824 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 12/34] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:45:41 2022] DELETE /compute/v2.1/flavors/971627927 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:45:41.958918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9cc7bb2c-a777-4d21-a6a5-5423ef7715c7 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:41.980468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-36465847-c90e-4b37-8c04-0f05ed61decd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041150 May 07 21:45:41.981650 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 23/35] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:45:41.992848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f6cbd4e-2a87-4c07-96a1-114a81685447 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:41.994907 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.994907 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:42.004003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f6cbd4e-2a87-4c07-96a1-114a81685447 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:42.004810 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9cc7bb2c-a777-4d21-a6a5-5423ef7715c7 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792 tempest-FlavorsExtraSpecsNegativeTestJSON-1038013792-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049339 May 07 21:45:42.005210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f6cbd4e-2a87-4c07-96a1-114a81685447 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:42.005907 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 13/36] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:45:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:43.170302 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f6cbd4e-2a87-4c07-96a1-114a81685447 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 1.181731 May 07 21:45:43.176665 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 24/37] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:45:41 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:45:43.181498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd89b035-136c-4e4a-9d05-eba0a604d118 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:43.182736 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.182736 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:43.196720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd89b035-136c-4e4a-9d05-eba0a604d118 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:43.197226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd89b035-136c-4e4a-9d05-eba0a604d118 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:43.252471 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-bd89b035-136c-4e4a-9d05-eba0a604d118 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] HTTP exception thrown: Aggregate 2 already has host nch1-master-1. May 07 21:45:43.253260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd89b035-136c-4e4a-9d05-eba0a604d118 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 409 to user: Aggregate 2 already has host nch1-master-1. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:43.254855 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bd89b035-136c-4e4a-9d05-eba0a604d118 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.077042 May 07 21:45:43.261696 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 14/38] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:45:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 07 21:45:43.264552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aaa755b9-04ca-4f72-af42-121bacd15255 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:43.265936 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.265936 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:43.278834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aaa755b9-04ca-4f72-af42-121bacd15255 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:43.279306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aaa755b9-04ca-4f72-af42-121bacd15255 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:43.482206 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aaa755b9-04ca-4f72-af42-121bacd15255 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.221864 May 07 21:45:43.484934 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 25/39] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:45:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:43.497950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b4b90f57-fe4f-4863-b0a7-15f875dfe71d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:43.497950 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.497950 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:43.569491 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b4b90f57-fe4f-4863-b0a7-15f875dfe71d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.076877 May 07 21:45:43.577352 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 15/40] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:43 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 07 21:45:43.586890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c18d4c87-0f20-4ce5-bf2d-b27645ccae14 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-724434661"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:43.588899 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.588899 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:43.589979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-c18d4c87-0f20-4ce5-bf2d-b27645ccae14 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid 939bd77c-9967-45ff-9688-888f41a1761b for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:43.636503 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c18d4c87-0f20-4ce5-bf2d-b27645ccae14 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053287 May 07 21:45:43.638213 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 26/41] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:43 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:43.661007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2c9a1f3-b34a-4c15-9a68-0f0de983510a tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-4362714", "name": "tempest-test_aggregate-2129646342"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:43.694898 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.694898 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:43.701216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-c2c9a1f3-b34a-4c15-9a68-0f0de983510a tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid 6ba657de-21dd-4f87-94b0-47760323b373 for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:43.792638 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2c9a1f3-b34a-4c15-9a68-0f0de983510a tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.133349 May 07 21:45:43.795401 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 27/42] 10.222.0.32 () {60 vars in 1164 bytes} [Sat May 7 21:45:43 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:43.805126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b08789be-1778-4675-92e3-d652c3001e54 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:43.806092 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.806092 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:43.819323 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b08789be-1778-4675-92e3-d652c3001e54 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 510 microversion: 2.1 time: 0.018629 May 07 21:45:43.826355 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 28/43] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:45:43 2022] GET /compute/v2.1/os-aggregates => generated 510 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:43.835144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b61eda2-ece4-4ebc-bb19-d04083457895 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:43.844585 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.844585 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:43.859434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b61eda2-ece4-4ebc-bb19-d04083457895 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:43.859877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b61eda2-ece4-4ebc-bb19-d04083457895 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:43.980117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9def4da2-51b7-4e2a-a121-cee37184929f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:43.981615 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.981615 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:43.983323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9def4da2-51b7-4e2a-a121-cee37184929f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '5abf38af9d8b41dc9871b612a06dfb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2224daefc94f40bb919f8052e55a8fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:43.983992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9def4da2-51b7-4e2a-a121-cee37184929f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:43.984805 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9def4da2-51b7-4e2a-a121-cee37184929f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] 10.222.0.32 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.341906 May 07 21:45:43.985774 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 16/44] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:45:43 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 343 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:43.994545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-265aa564-b4f9-4edf-bf7b-918a311977d9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:43.995346 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:43.995346 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.030544 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-265aa564-b4f9-4edf-bf7b-918a311977d9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.038846 May 07 21:45:44.031545 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 17/45] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:43 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:45:44.040119 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b61eda2-ece4-4ebc-bb19-d04083457895 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 309 microversion: 2.1 time: 0.212444 May 07 21:45:44.041328 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 29/46] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:45:43 2022] POST /compute/v2.1/os-aggregates/4/action => generated 309 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:44.052361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80755280-f0d3-4a88-92fe-bee4a3ff6ff4 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-108594475"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.052361 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.052361 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.052361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.aggregate [None req-80755280-f0d3-4a88-92fe-bee4a3ff6ff4 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid c18a151f-0633-467e-a09c-8353cb9ce7bd for aggregate {{(pid=136681) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:44.087560 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80755280-f0d3-4a88-92fe-bee4a3ff6ff4 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.050200 May 07 21:45:44.088966 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 18/47] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:44.099512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-573559422"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.100848 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.100848 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:44.110282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:44.111017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:44.120464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:44.121046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:44.132309 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-573559422 could not be found. May 07 21:45:44.132918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-573559422 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.133794 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f70c188d-a020-44cd-8a93-226ff7b7fca9 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.038834 May 07 21:45:44.134414 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 30/48] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:44.145937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5ce0f3aa-1b39-43c9-b5df-09623b50f4d8 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.147229 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.147229 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.182385 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5ce0f3aa-1b39-43c9-b5df-09623b50f4d8 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.043617 May 07 21:45:44.187581 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 19/49] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:44 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 07 21:45:44.193025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1cc2101-10ea-4b72-9dcc-4cbad9a66998 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.194255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1cc2101-10ea-4b72-9dcc-4cbad9a66998 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.203343 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b1cc2101-10ea-4b72-9dcc-4cbad9a66998 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.006069 May 07 21:45:44.208867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 31/50] 10.222.0.32 () {60 vars in 1164 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:45:44.217921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d57e1d5-4215-4808-86f1-e274e7c12349 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.219397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d57e1d5-4215-4808-86f1-e274e7c12349 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.220419 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d57e1d5-4215-4808-86f1-e274e7c12349 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010420 May 07 21:45:44.221110 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 20/51] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:45:44.233287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a4ef214-afd7-47b1-a6e1-ef0921bfb38b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-834877636"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.234613 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.234613 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:44.235506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a4ef214-afd7-47b1-a6e1-ef0921bfb38b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '5abf38af9d8b41dc9871b612a06dfb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2224daefc94f40bb919f8052e55a8fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:44.236136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a4ef214-afd7-47b1-a6e1-ef0921bfb38b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.237578 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a4ef214-afd7-47b1-a6e1-ef0921bfb38b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.008214 May 07 21:45:44.245078 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 32/52] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:44.247938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-55a101e7-e211-4c1e-9abc-99008c1764d3 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1834907889"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.249449 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.249449 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.250839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.aggregate [None req-55a101e7-e211-4c1e-9abc-99008c1764d3 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid a3d50c76-b05b-4d85-bb63-0d23c6ead1cd for aggregate {{(pid=136681) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:44.282305 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-55a101e7-e211-4c1e-9abc-99008c1764d3 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038070 May 07 21:45:44.283106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 21/53] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:44.294055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-abb0c95a-0e90-4569-862c-448a0a3c83fd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1834907889"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.296205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-abb0c95a-0e90-4569-862c-448a0a3c83fd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid 062a8843-c8ec-48df-8b2b-55e99eca2eea for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:44.312538 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-abb0c95a-0e90-4569-862c-448a0a3c83fd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1834907889 already exists. May 07 21:45:44.313409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-abb0c95a-0e90-4569-862c-448a0a3c83fd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1834907889 already exists. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.314473 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-abb0c95a-0e90-4569-862c-448a0a3c83fd tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.024028 May 07 21:45:44.315958 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 33/54] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 26 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 21:45:44.326522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f9bf9677-59e0-46db-8923-259156b9db16 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.327593 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.327593 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.356774 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f9bf9677-59e0-46db-8923-259156b9db16 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.036656 May 07 21:45:44.357419 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 22/55] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:44 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:45:44.372400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15652087-62b8-4ed2-8f8c-a12a55baa300 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1715258410"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.373963 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.373963 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:44.374968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-15652087-62b8-4ed2-8f8c-a12a55baa300 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid 83e35776-9681-408f-8135-23013487774e for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:44.417431 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15652087-62b8-4ed2-8f8c-a12a55baa300 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051526 May 07 21:45:44.418226 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 34/56] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:45:44.429884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e558473b-f811-405c-9eeb-e4c01f97883f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.430744 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.430744 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.431745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e558473b-f811-405c-9eeb-e4c01f97883f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '5abf38af9d8b41dc9871b612a06dfb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2224daefc94f40bb919f8052e55a8fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:44.432383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e558473b-f811-405c-9eeb-e4c01f97883f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.433323 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e558473b-f811-405c-9eeb-e4c01f97883f tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.008859 May 07 21:45:44.434079 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 23/57] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:44 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:45:44.442229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a215e06-1ed4-434a-b37a-b85bbc8561c0 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.443350 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.443350 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:44.469030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a215e06-1ed4-434a-b37a-b85bbc8561c0 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.030454 May 07 21:45:44.469709 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 35/58] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:44 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:45:44.479380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c58d5b25-b42d-4019-aba5-3bb319fd8a98 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.492734 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c58d5b25-b42d-4019-aba5-3bb319fd8a98 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 07 21:45:44.493342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c58d5b25-b42d-4019-aba5-3bb319fd8a98 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.494250 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c58d5b25-b42d-4019-aba5-3bb319fd8a98 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018751 May 07 21:45:44.494688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 24/59] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:45:44 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:45:44.503782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e39764da-19ed-4b81-a8cf-c6a4f0329b15 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1823894994"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:44.505294 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.505294 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:44.506191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-e39764da-19ed-4b81-a8cf-c6a4f0329b15 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid 9fda9c70-3368-4564-bf61-804dcd1a8bbe for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:45:44.527643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e39764da-19ed-4b81-a8cf-c6a4f0329b15 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.027488 May 07 21:45:44.528549 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 36/60] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:44.539305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be66f190-354d-4c68-aed7-fac72090f21b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.540350 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.540350 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.541452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-be66f190-354d-4c68-aed7-fac72090f21b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '5abf38af9d8b41dc9871b612a06dfb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2224daefc94f40bb919f8052e55a8fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:44.542130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be66f190-354d-4c68-aed7-fac72090f21b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.543144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be66f190-354d-4c68-aed7-fac72090f21b tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] 10.222.0.32 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.008457 May 07 21:45:44.543655 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 25/61] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 21:45:44 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:45:44.551780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-53e14043-8d95-4159-a745-b62165d2ed60 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.552661 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.552661 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:44.573024 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-53e14043-8d95-4159-a745-b62165d2ed60 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.024904 May 07 21:45:44.573862 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 37/62] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:44 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:45:44.584295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30d05ffd-95df-49c3-911b-93cb3dba09ee tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.592457 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-30d05ffd-95df-49c3-911b-93cb3dba09ee tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 07 21:45:44.593394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30d05ffd-95df-49c3-911b-93cb3dba09ee tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.594379 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-30d05ffd-95df-49c3-911b-93cb3dba09ee tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015429 May 07 21:45:44.595097 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 26/63] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:45:44 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:45:44.604260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0875870-baf1-4d8f-a7df-838c2118a941 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:44.605008 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:44.605008 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:44.606122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0875870-baf1-4d8f-a7df-838c2118a941 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '5abf38af9d8b41dc9871b612a06dfb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2224daefc94f40bb919f8052e55a8fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:44.606976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0875870-baf1-4d8f-a7df-838c2118a941 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:45:44.607952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0875870-baf1-4d8f-a7df-838c2118a941 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.007330 May 07 21:45:44.608603 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 27/64] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:45:44 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:45:45.289934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-239231980", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "availability_zone": "tempest-test_az-4362714"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:45.318397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:45.319065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:45.320045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:45.320532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:46.176777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:45:46.443941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:45:46.445041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:45:46.445485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:45:46.445981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:45:46.446832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:45:46.456377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:46.457377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:46.458445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:46.458925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:46.481729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Getting quotas for project 4a5c3e72c1f943bcb6256ddf95978995. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:46.485798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Getting quotas for user e0e9f1939f084da58fc8a612ef31f6b2 and project 4a5c3e72c1f943bcb6256ddf95978995. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:46.511145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:45:46.511145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:45:46.563310 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-459db484-4085-4819-8d2c-e10bb0f3e4e2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.970335 May 07 21:45:46.564224 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 38/65] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:45:46.575597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6b99b1e4-5e64-4e33-a9fb-9a4e43f15687 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:46.576222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6b99b1e4-5e64-4e33-a9fb-9a4e43f15687 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:46.675005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6b99b1e4-5e64-4e33-a9fb-9a4e43f15687 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:46.690313 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6b99b1e4-5e64-4e33-a9fb-9a4e43f15687 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1239 microversion: 2.1 time: 0.119553 May 07 21:45:46.690914 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 39/66] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:46 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:46.921731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61b45fcb-2e26-4e72-b93b-3a2230d01802 tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-494193048", "id": 1153823008, "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:46.923285 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:46.923285 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:46.941036 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61b45fcb-2e26-4e72-b93b-3a2230d01802 tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.440410 May 07 21:45:46.942148 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 28/67] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:45:46 2022] POST /compute/v2.1/flavors => generated 470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:46.953967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f4548089-f885-4de8-9279-c0fb2392406b tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:46.955361 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:46.955361 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:46.970155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cbe8c70f-a18d-4a3f-ad0b-0a3367ccca9b tempest-NetworksTest-369281323 tempest-NetworksTest-369281323-project-admin] Calling method '.version_select at 0x7fc41d866160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:47.174674 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f4548089-f885-4de8-9279-c0fb2392406b tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1153823008/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.224321 May 07 21:45:47.176406 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 29/68] 10.222.0.32 () {62 vars in 1264 bytes} [Sat May 7 21:45:46 2022] POST /compute/v2.1/flavors/1153823008/os-extra_specs => generated 62 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:45:47.189066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b2b7346-18d0-41cd-a073-2b82d0b362c3 tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:47.190923 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:47.190923 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:47.227366 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b2b7346-18d0-41cd-a073-2b82d0b362c3 tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1153823008" status: 202 len: 0 microversion: 2.86 time: 0.043930 May 07 21:45:47.227905 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 30/69] 10.222.0.32 () {60 vars in 1201 bytes} [Sat May 7 21:45:47 2022] DELETE /compute/v2.1/flavors/1153823008 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 07 21:45:47.236638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97f1bd5e-16f7-440a-a3fe-94a385e744b9 tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:47.259683 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cbe8c70f-a18d-4a3f-ad0b-0a3367ccca9b tempest-NetworksTest-369281323 tempest-NetworksTest-369281323-project-admin] 10.222.0.32 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.492285 May 07 21:45:47.263729 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 40/70] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:45:46 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:45:47.270716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9178e02-92b3-433b-b40b-55d3d79ff08d tempest-NetworksTest-369281323 tempest-NetworksTest-369281323-project-admin] Calling method '.version_select at 0x7fc41d866f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:47.279312 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97f1bd5e-16f7-440a-a3fe-94a385e744b9 tempest-FlavorMetadataValidation-1001735619 tempest-FlavorMetadataValidation-1001735619-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.044993 May 07 21:45:47.280672 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 31/71] 10.222.0.32 () {60 vars in 1186 bytes} [Sat May 7 21:45:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:45:47.430554 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9178e02-92b3-433b-b40b-55d3d79ff08d tempest-NetworksTest-369281323 tempest-NetworksTest-369281323-project-admin] 10.222.0.32 "GET /compute/v2.1/os-networks/9221b764-ef06-431f-8941-796516ed7c3b" status: 200 len: 652 microversion: 2.1 time: 0.163537 May 07 21:45:47.430554 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 41/72] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 21:45:47 2022] GET /compute/v2.1/os-networks/9221b764-ef06-431f-8941-796516ed7c3b => generated 652 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:47.439379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d43076a-a67e-43ef-9dd7-8b6d095661ee tempest-NetworksTest-369281323 tempest-NetworksTest-369281323-project-admin] Calling method '.version_select at 0x7fc41da08790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:47.708391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e84213bd-5a12-453b-99f7-654db55d535f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:47.710184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e84213bd-5a12-453b-99f7-654db55d535f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:47.785378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e84213bd-5a12-453b-99f7-654db55d535f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:47.797931 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e84213bd-5a12-453b-99f7-654db55d535f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1239 microversion: 2.1 time: 0.093648 May 07 21:45:47.798822 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 42/73] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:47 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:48.454237 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d43076a-a67e-43ef-9dd7-8b6d095661ee tempest-NetworksTest-369281323 tempest-NetworksTest-369281323-project-admin] 10.222.0.32 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 1.018330 May 07 21:45:48.455346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 32/74] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:45:47 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:48.820371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:48.821757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:48.858472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:48.866918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:48.869609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:48.870314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:49.248867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:49.278888 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-59f6bd97-320a-4100-9426-5ee2b3cb1620 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1293 microversion: 2.1 time: 0.466698 May 07 21:45:49.279498 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 33/75] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:48 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1293 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:45:49.297419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-79ee28e7-81c7-4022-b534-61cf490fb3db tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1704638305", "id": 1115077279, "os-flavor-access:is_public": "False"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:49.299925 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:49.299925 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:49.346636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-79ee28e7-81c7-4022-b534-61cf490fb3db tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.644994 May 07 21:45:49.349045 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 43/76] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:45:48 2022] POST /compute/v2.1/flavors => generated 431 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:49.359494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-07b1018c-b54b-4033-9a1a-e4e1e15be00f tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b77b751b750c4c20a0ef1d7630974b65"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:49.361545 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:49.361545 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:49.710056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-70297fe6-82f2-4346-a288-4b221e58709b tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-822798551", "id": 1792691398, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:49.749247 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-70297fe6-82f2-4346-a288-4b221e58709b tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.358690 May 07 21:45:49.763084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 44/77] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:45:49 2022] POST /compute/v2.1/flavors => generated 448 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:49.914227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-07b1018c-b54b-4033-9a1a-e4e1e15be00f tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1115077279/action" status: 200 len: 97 microversion: 2.1 time: 0.559309 May 07 21:45:49.917657 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 34/78] 10.222.0.32 () {60 vars in 1199 bytes} [Sat May 7 21:45:49 2022] POST /compute/v2.1/flavors/1115077279/action => generated 97 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:45:50.333861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc8d959e-aff4-472e-930a-0da5a565848b tempest-FlavorsV255TestJSON-512381603 tempest-FlavorsV255TestJSON-512381603-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:50.358236 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc8d959e-aff4-472e-930a-0da5a565848b tempest-FlavorsV255TestJSON-512381603 tempest-FlavorsV255TestJSON-512381603-project] 10.222.0.32 "GET /compute/v2.1/flavors/1792691398" status: 200 len: 448 microversion: 2.55 time: 0.591296 May 07 21:45:50.372223 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 45/79] 10.222.0.32 () {60 vars in 1198 bytes} [Sat May 7 21:45:49 2022] GET /compute/v2.1/flavors/1792691398 => generated 448 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:50.393411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:50.396383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:50.427127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:50.432366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:50.437003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:50.442240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:50.688494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-65dd0cc7-7046-4b5d-a1c5-d03830ff478c tempest-FlavorsAccessTestJSON-1915524796 tempest-FlavorsAccessTestJSON-1915524796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:50.823817 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-65dd0cc7-7046-4b5d-a1c5-d03830ff478c tempest-FlavorsAccessTestJSON-1915524796 tempest-FlavorsAccessTestJSON-1915524796-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5829 microversion: 2.1 time: 0.886611 May 07 21:45:50.838742 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 35/80] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:45:49 2022] GET /compute/v2.1/flavors/detail => generated 5829 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:50.846037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d90d3c1c-15d0-4cf1-b44a-278ca316af92 tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] Action: 'update', calling method: .version_select at 0x7fc41f827f70>, body: {"flavor": {"description": "new"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:50.879009 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:50.879009 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:50.938049 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d90d3c1c-15d0-4cf1-b44a-278ca316af92 tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/1792691398" status: 200 len: 449 microversion: 2.55 time: 0.108423 May 07 21:45:50.944267 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 36/81] 10.222.0.32 () {62 vars in 1218 bytes} [Sat May 7 21:45:50 2022] PUT /compute/v2.1/flavors/1792691398 => generated 449 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:45:50.958301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-064be6e3-0935-462e-b559-79aa98637510 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b77b751b750c4c20a0ef1d7630974b65"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:50.963614 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:50.963614 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:51.010664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:51.041093 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5925ab4f-e109-4d46-bdf5-a52d90c85ef3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1293 microversion: 2.1 time: 0.665551 May 07 21:45:51.042186 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 46/82] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:50 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1293 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:51.060454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3d3d0fd-554a-4428-bc83-d9ceb565571e tempest-FlavorsV255TestJSON-512381603 tempest-FlavorsV255TestJSON-512381603-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:51.153977 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3d3d0fd-554a-4428-bc83-d9ceb565571e tempest-FlavorsV255TestJSON-512381603 tempest-FlavorsV255TestJSON-512381603-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.102563 May 07 21:45:51.155059 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 47/83] 10.222.0.32 () {60 vars in 1186 bytes} [Sat May 7 21:45:51 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:45:51.172208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93fd7ded-9aa5-4c67-a3f3-957d81dcad39 tempest-FlavorsV255TestJSON-512381603 tempest-FlavorsV255TestJSON-512381603-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:51.238519 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93fd7ded-9aa5-4c67-a3f3-957d81dcad39 tempest-FlavorsV255TestJSON-512381603 tempest-FlavorsV255TestJSON-512381603-project] 10.222.0.32 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.070017 May 07 21:45:51.240580 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 48/84] 10.222.0.32 () {60 vars in 1165 bytes} [Sat May 7 21:45:51 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:45:51.258882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e2ff113b-01ef-4f64-9d81-e1ba8908403e tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:51.266202 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:51.266202 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:51.320782 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e2ff113b-01ef-4f64-9d81-e1ba8908403e tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1792691398" status: 202 len: 0 microversion: 2.55 time: 0.068929 May 07 21:45:51.323364 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 49/85] 10.222.0.32 () {60 vars in 1201 bytes} [Sat May 7 21:45:51 2022] DELETE /compute/v2.1/flavors/1792691398 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:45:51.334406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00df5d8b-222c-40cc-b073-785bd3934fe7 tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:51.392766 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00df5d8b-222c-40cc-b073-785bd3934fe7 tempest-FlavorsV255TestJSON-1863317036 tempest-FlavorsV255TestJSON-1863317036-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.063910 May 07 21:45:51.408790 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 50/86] 10.222.0.32 () {60 vars in 1186 bytes} [Sat May 7 21:45:51 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:45:51.745027 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-064be6e3-0935-462e-b559-79aa98637510 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1115077279/action" status: 200 len: 21 microversion: 2.1 time: 0.796752 May 07 21:45:51.747120 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 37/87] 10.222.0.32 () {60 vars in 1199 bytes} [Sat May 7 21:45:50 2022] POST /compute/v2.1/flavors/1115077279/action => generated 21 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:45:51.764866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-097226fc-a34c-4942-a7a3-9c78aae5a649 tempest-FlavorsAccessTestJSON-1915524796 tempest-FlavorsAccessTestJSON-1915524796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:51.835964 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-097226fc-a34c-4942-a7a3-9c78aae5a649 tempest-FlavorsAccessTestJSON-1915524796 tempest-FlavorsAccessTestJSON-1915524796-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075589 May 07 21:45:51.855982 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 51/88] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:45:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:51.859609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-28985ce0-64f7-4814-8933-533b0048b49b tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:51.860108 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:51.860108 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:51.886307 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-28985ce0-64f7-4814-8933-533b0048b49b tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1115077279" status: 202 len: 0 microversion: 2.1 time: 0.031854 May 07 21:45:51.887492 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 38/89] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:45:51 2022] DELETE /compute/v2.1/flavors/1115077279 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:45:51.900695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb3317ad-9c0e-43e0-a8ed-93cdf11e69ac tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:51.957895 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb3317ad-9c0e-43e0-a8ed-93cdf11e69ac tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063548 May 07 21:45:51.965761 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 52/90] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:45:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:51.974252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc48ff06-dfba-472a-977d-fe4f4b76d864 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-992047336", "id": 1698091396, "os-flavor-access:is_public": "False"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:52.033024 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:52.033024 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:52.058273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:52.058860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:52.069546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:52.069999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:52.070842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:52.084574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:52.111715 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc48ff06-dfba-472a-977d-fe4f4b76d864 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.141135 May 07 21:45:52.115103 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 39/91] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:45:51 2022] POST /compute/v2.1/flavors => generated 430 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:52.137204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52f31be6-90dc-48f9-8c6d-3dbd7a1342a7 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:52.142519 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:52.142519 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:52.182871 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52f31be6-90dc-48f9-8c6d-3dbd7a1342a7 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/1698091396/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.063543 May 07 21:45:52.198671 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 40/92] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 21:45:52 2022] GET /compute/v2.1/flavors/1698091396/os-flavor-access => generated 21 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:45:52.215744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea8570f9-2c88-456b-8f37-ab89d2df939f tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:52.275298 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea8570f9-2c88-456b-8f37-ab89d2df939f tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1698091396" status: 202 len: 0 microversion: 2.1 time: 0.069568 May 07 21:45:52.277593 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 41/93] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:45:52 2022] DELETE /compute/v2.1/flavors/1698091396 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:45:52.303733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1a224ea-7df5-4884-a5ad-a77269edac30 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:52.419439 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1a224ea-7df5-4884-a5ad-a77269edac30 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.127409 May 07 21:45:52.424606 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 42/94] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:45:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:53.104200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:53.115438 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-743a2837-685a-4cf9-84cb-152048b111f3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 1.060912 May 07 21:45:53.123129 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 53/95] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:52 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:45:54.138650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:54.139384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:54.147933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:54.151198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:54.152273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:54.154034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:55.020186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:55.029725 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-031d148b-3c28-4e96-aca3-0eccba85112f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.895832 May 07 21:45:55.030913 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 43/96] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:54 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:56.047779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:56.048239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:56.061981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:56.062811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:56.063781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:56.064472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:56.572434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:56.585851 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d4f63aee-d71b-47ee-adbd-dfed4ce85cdf tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.542152 May 07 21:45:56.588620 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 54/97] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:56 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:57.397974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e54171d2-ba5b-4acd-85a2-624b63597299 req-340e22a7-a8d8-427d-92b7-41e2954280f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b", "tag": "0f88893d-5e1f-48e6-a69a-132a1aa16a37"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:57.414495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e54171d2-ba5b-4acd-85a2-624b63597299 req-340e22a7-a8d8-427d-92b7-41e2954280f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:57.436902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e54171d2-ba5b-4acd-85a2-624b63597299 req-340e22a7-a8d8-427d-92b7-41e2954280f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:57.559883 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e54171d2-ba5b-4acd-85a2-624b63597299 req-340e22a7-a8d8-427d-92b7-41e2954280f0 service nova] Creating event network-changed:0f88893d-5e1f-48e6-a69a-132a1aa16a37 for instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b on nch1-master-1 May 07 21:45:57.560791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e54171d2-ba5b-4acd-85a2-624b63597299 req-340e22a7-a8d8-427d-92b7-41e2954280f0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:45:57.568320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eea124ac-bfbb-405d-be78-38a62167e8cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:57.569236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eea124ac-bfbb-405d-be78-38a62167e8cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:57.571353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eea124ac-bfbb-405d-be78-38a62167e8cf None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:57.572305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eea124ac-bfbb-405d-be78-38a62167e8cf None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:57.600905 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.compute.rpcapi [None req-eea124ac-bfbb-405d-be78-38a62167e8cf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 07 21:45:57.602429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eea124ac-bfbb-405d-be78-38a62167e8cf None None] Releasing lock "compute-rpcapi-router" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:45:57.605220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:57.605932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:57.622709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:57.628932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:57.629982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:57.630507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:57.661295 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eea124ac-bfbb-405d-be78-38a62167e8cf None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.149997 May 07 21:45:57.664878 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 44/98] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:58.377006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-888cf545-d86b-4fb3-bb6b-351e8f3bdfb9 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d874160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:58.383051 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:58.383051 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:58.389492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888cf545-d86b-4fb3-bb6b-351e8f3bdfb9 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:58.393422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888cf545-d86b-4fb3-bb6b-351e8f3bdfb9 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:58.399463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888cf545-d86b-4fb3-bb6b-351e8f3bdfb9 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:58.401293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888cf545-d86b-4fb3-bb6b-351e8f3bdfb9 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:58.458541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:45:58.471503 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67d622b0-bc35-428b-b67c-588e050c31d3 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.871364 May 07 21:45:58.486623 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 55/99] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:57 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:45:58.487572 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-888cf545-d86b-4fb3-bb6b-351e8f3bdfb9 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.820179 May 07 21:45:58.507468 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 45/100] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:45:57 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:58.513981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-591c3fd3-87f9-446a-9bb9-cc097753428d tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d88e940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:58.515349 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:58.515349 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:45:58.516836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-591c3fd3-87f9-446a-9bb9-cc097753428d tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:58.517493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-591c3fd3-87f9-446a-9bb9-cc097753428d tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:58.519793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-591c3fd3-87f9-446a-9bb9-cc097753428d tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:58.521174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-591c3fd3-87f9-446a-9bb9-cc097753428d tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:58.618959 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-591c3fd3-87f9-446a-9bb9-cc097753428d tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 398 microversion: 2.1 time: 0.109672 May 07 21:45:58.627238 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 56/101] 10.222.0.32 () {58 vars in 1138 bytes} [Sat May 7 21:45:58 2022] GET /compute/v2.1/os-hosts?zone= => generated 398 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:45:58.634980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-93607f57-df3a-40c6-9350-726d78d009c8 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d8cc670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:58.636980 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:58.636980 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:45:58.640549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93607f57-df3a-40c6-9350-726d78d009c8 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:58.641091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93607f57-df3a-40c6-9350-726d78d009c8 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:58.642243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93607f57-df3a-40c6-9350-726d78d009c8 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:58.642685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93607f57-df3a-40c6-9350-726d78d009c8 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:58.734240 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-93607f57-df3a-40c6-9350-726d78d009c8 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.101951 May 07 21:45:58.736757 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 46/102] 10.222.0.32 () {58 vars in 1144 bytes} [Sat May 7 21:45:58 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:45:59.341594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-393196049", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "38d1a38e-1f99-466b-bf7f-940113b4b6ed"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:59.367423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2060345100", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": "none"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:45:59.496657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] validate_networks() for [('38d1a38e-1f99-466b-bf7f-940113b4b6ed', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:45:59.571471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:45:59.572096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:45:59.572440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:45:59.573168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:45:59.573624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:45:59.601926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:59.602511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:59.603449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:59.603919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:59.686587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Getting quotas for project e319fb6c72864e1997a9f30a5f09f36c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:45:59.694908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Getting quotas for user f7c66dcdb16748bd900fb2a0501d7d72 and project e319fb6c72864e1997a9f30a5f09f36c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:45:59.728818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:45:59.755193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:45:59.914214 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8387c1bf-c7c2-4348-b366-62cc5ebd36a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.812142 May 07 21:45:59.916547 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 47/103] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 07 21:45:59.933670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:45:59.960741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:45:59.960741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:59.960741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:45:59.960741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:45:59.962155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:00.279062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:00.294697 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e9a1937-649f-4a48-9d26-ccc264638da6 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.374363 May 07 21:46:00.298653 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 48/104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:45:59 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:00.312931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27b525a8-d743-45c2-9815-fc3d8d6b8b26 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:00.314445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27b525a8-d743-45c2-9815-fc3d8d6b8b26 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:00.511707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27b525a8-d743-45c2-9815-fc3d8d6b8b26 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:00.527967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27b525a8-d743-45c2-9815-fc3d8d6b8b26 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:00.529518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27b525a8-d743-45c2-9815-fc3d8d6b8b26 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:00.573841 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27b525a8-d743-45c2-9815-fc3d8d6b8b26 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "PUT /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1359 microversion: 2.75 time: 0.272744 May 07 21:46:00.592534 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 49/105] 10.222.0.32 () {62 vars in 1296 bytes} [Sat May 7 21:46:00 2022] PUT /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:00.606418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e0e2730e-6808-4d29-82f7-4d1403e9ac21 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:00.607076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e0e2730e-6808-4d29-82f7-4d1403e9ac21 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:00.730040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e0e2730e-6808-4d29-82f7-4d1403e9ac21 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:00.737958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e0e2730e-6808-4d29-82f7-4d1403e9ac21 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:00.748831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e0e2730e-6808-4d29-82f7-4d1403e9ac21 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:00.758421 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e0e2730e-6808-4d29-82f7-4d1403e9ac21 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1359 microversion: 2.75 time: 0.163783 May 07 21:46:00.776573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 50/106] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:00 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:01.318497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:01.319104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:01.348175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:01.350485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:01.352671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:01.355274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:02.023612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:02.034013 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b41cc1ee-d87c-4748-b814-3e4c6408867a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.721258 May 07 21:46:02.036265 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 51/107] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:01 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:02.046603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:02.047947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:02.055817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:02.056538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:02.059570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:02.060676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:02.248740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:02.266926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:02.270148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:02.277681 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ad842e65-02d9-4884-87f2-5ca2a4d7138e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1355 microversion: 2.75 time: 0.238453 May 07 21:46:02.291435 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 52/108] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:02 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1355 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:02.709879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-660863150", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:02.777795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:02.792688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:02.793270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:02.793574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:02.794616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:02.795234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:02.812196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:02.812635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:02.813456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:02.813900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:02.847867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:02.852127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for user 99e9b91d4fb949f18cc61bf2bbd63ab6 and project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:02.865076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:02.867911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:02.929855 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3324ca17-004f-44c2-a810-9364104aafd2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.834399 May 07 21:46:02.931718 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 57/109] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 07 21:46:02.962012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5fcc8e30-fbb5-4880-afe5-39763f3c8332 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:02.963326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5fcc8e30-fbb5-4880-afe5-39763f3c8332 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:03.104965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5fcc8e30-fbb5-4880-afe5-39763f3c8332 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:03.121286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5fcc8e30-fbb5-4880-afe5-39763f3c8332 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:03.129527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5fcc8e30-fbb5-4880-afe5-39763f3c8332 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:03.130715 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5fcc8e30-fbb5-4880-afe5-39763f3c8332 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1261 microversion: 2.25 time: 0.193059 May 07 21:46:03.131317 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 58/110] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:02 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:03.157063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:03.159186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:03.179536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:03.180002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:03.180801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:03.181246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:03.316886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:03.318266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:03.319063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:03.319635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:03.320192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:03.334535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:03.335025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:03.335992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:03.336598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:03.386534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Getting quotas for project 95946c2e9a5c4a72905d75010a9bb7a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:03.392010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Getting quotas for user e1333f2166c947a4a37dd6865f532f24 and project 95946c2e9a5c4a72905d75010a9bb7a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:03.413408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:03.438315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:03.555959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-088a2e9e-622e-41b9-be69-1528e9fb7151 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131734 May 07 21:46:03.560779 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 53/111] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:46:03.566691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:03.577387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:03.597588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:03.598045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:03.599085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:03.599620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:03.721774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:03.725002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:03.738150 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64e5125f-9236-4846-9b68-18256a617adc tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.596226 May 07 21:46:03.747687 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 59/112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:03 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:03.747809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:03.747809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:03.756865 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b017310f-3b45-4059-82af-8774ffaeec0f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.194537 May 07 21:46:03.771557 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 54/113] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:03 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:03.803420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1896615234", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:03.916207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:03.985771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d989f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:03.989113 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:03.989113 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:03.990521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:03.991124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.018871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.020252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.036913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.037633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.044851 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c2be52b-9e94-4ab1-94c8-83e2b3073604 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.298272 May 07 21:46:04.046052 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 60/114] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:46:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:04.056710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d8cc940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.057524 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.057524 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:04.062633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.063325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.123064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.138060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.159903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.160777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.172408 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d4ee8b0-de06-4229-9c21-7c87b15883f7 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.119293 May 07 21:46:04.182905 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 61/115] 10.222.0.32 () {58 vars in 1166 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:04.188322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.189189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:04.200166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:04.201159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:04.201884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:04.202514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:04.203280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:04.206531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.207154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.208070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.208686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.224037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.225246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.227774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.228423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.277158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Getting quotas for project 95946c2e9a5c4a72905d75010a9bb7a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:04.284614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Getting quotas for user e1333f2166c947a4a37dd6865f532f24 and project 95946c2e9a5c4a72905d75010a9bb7a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:04.291171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.301712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.308477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.311735 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-01b63ace-d52e-43f5-ae17-e7c8a79f4f57 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1265 microversion: 2.25 time: 0.127443 May 07 21:46:04.311871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:04.313108 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 62/116] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:04.314944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:04.322059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d88edc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.323435 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.323435 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:04.324939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.325587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.359115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.360115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.385150 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2b589bec-bb41-4d10-8a74-0bc99e0c72b3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602202 May 07 21:46:04.387147 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 55/117] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:46:04.388376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.390190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.401879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-41054f38-f04e-4fa2-9090-2976d62c6a7c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.402815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-41054f38-f04e-4fa2-9090-2976d62c6a7c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:04.406872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bf353bfa-6b86-4bab-8f9b-d0811b369c12 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092037 May 07 21:46:04.413672 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 63/118] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:04.420614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5d9b3f69-6b22-47fd-87ee-cb044f588e55 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d80c160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.421612 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.421612 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:04.423420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d9b3f69-6b22-47fd-87ee-cb044f588e55 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.424387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d9b3f69-6b22-47fd-87ee-cb044f588e55 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.445090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d9b3f69-6b22-47fd-87ee-cb044f588e55 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.445873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d9b3f69-6b22-47fd-87ee-cb044f588e55 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.453397 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5d9b3f69-6b22-47fd-87ee-cb044f588e55 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.038431 May 07 21:46:04.465973 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 64/119] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:04.470273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ae09a6e-db00-4d38-abc2-cbde93cb793e tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d8f3820>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.471106 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.471106 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:04.472776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ae09a6e-db00-4d38-abc2-cbde93cb793e tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.473233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ae09a6e-db00-4d38-abc2-cbde93cb793e tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.492648 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ae09a6e-db00-4d38-abc2-cbde93cb793e tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.025765 May 07 21:46:04.496621 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 65/120] 10.222.0.32 () {58 vars in 1178 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:04.505299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-41054f38-f04e-4fa2-9090-2976d62c6a7c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.509726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d80c0d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.510462 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.510462 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:04.511907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.512507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.513836 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-41054f38-f04e-4fa2-9090-2976d62c6a7c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1214 microversion: 2.1 time: 0.119726 May 07 21:46:04.514422 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 56/121] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:04.535239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.535880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.547460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.547908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.564092 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-361b5d9a-85c1-4777-b17e-cc8a6f32e2d6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050076 May 07 21:46:04.565402 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 66/122] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:04.576674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f03fe67-a401-4da1-9a28-f4483366c666 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d752670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.578116 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.578116 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:04.579599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f03fe67-a401-4da1-9a28-f4483366c666 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.580131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f03fe67-a401-4da1-9a28-f4483366c666 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.602194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f03fe67-a401-4da1-9a28-f4483366c666 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.602764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f03fe67-a401-4da1-9a28-f4483366c666 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.611467 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f03fe67-a401-4da1-9a28-f4483366c666 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.039981 May 07 21:46:04.612084 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 57/123] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:04.626535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-99e6df0a-6fd5-4382-a46c-4ff9d4c065e6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d88ea60>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.627891 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.627891 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:04.630048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99e6df0a-6fd5-4382-a46c-4ff9d4c065e6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.630516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99e6df0a-6fd5-4382-a46c-4ff9d4c065e6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.643859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99e6df0a-6fd5-4382-a46c-4ff9d4c065e6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.644504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99e6df0a-6fd5-4382-a46c-4ff9d4c065e6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.654427 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-99e6df0a-6fd5-4382-a46c-4ff9d4c065e6 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.033798 May 07 21:46:04.655574 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 67/124] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:04.667278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Calling method '.version_select at 0x7fc41d7521f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.668381 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:04.668381 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:04.670070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.670750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.691654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.692193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.703948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.703948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.755409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.756033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:04.763341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.763999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.765019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.765729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.769733 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-613f10a3-43b2-4ce0-b7f6-e8b30edeb602 tempest-HypervisorAdminTestJSON-395710688 tempest-HypervisorAdminTestJSON-395710688-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.105424 May 07 21:46:04.777431 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 58/125] 10.222.0.32 () {58 vars in 1172 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:04.794427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:04.795324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:04.803602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.804447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.806896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:04.808463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:04.926310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.945758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.948294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.957322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:04.964677 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-350024b0-f381-486a-8c8d-7af8ea2044a6 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.174693 May 07 21:46:04.970245 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-60bc14de-16ac-4e66-9cba-48f805715584 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.218434 May 07 21:46:04.970245 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 68/126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:04.982093 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 59/127] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:04 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:05.334382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:05.342822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:05.358423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:05.358998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:05.360702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:05.360702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:05.492954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:05.505864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:05.512959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:05.514133 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85343463-4a5e-430d-b1fc-17c7d7608390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1265 microversion: 2.25 time: 0.184795 May 07 21:46:05.515042 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 69/128] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:05 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:05.533312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:05.534978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:05.544797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:05.545722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:05.546863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:05.547505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:05.681758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:05.702241 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29270da4-134d-467d-8486-a05e08d9303a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1218 microversion: 2.1 time: 0.175002 May 07 21:46:05.712032 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 60/129] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:05 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1218 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:05.989800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:05.990709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:06.005688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.006345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:06.007064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:06.007782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.007899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:06.009346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:06.048524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.049012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:06.051194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.052538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:06.153835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:06.166826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:06.168789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:06.192253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a38f24f-e19e-40ea-b323-715a71a9de20 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.191784 May 07 21:46:06.193534 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 61/130] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:05 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:06.462608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:06.472123 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ed3b8f1-f096-4fdf-9eb9-1938a2ba76b2 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.486756 May 07 21:46:06.472987 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 70/131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:05 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:06.536232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:06.537853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:06.547329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.548550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:06.551908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.552641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:06.686335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:06.700669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:06.702703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:06.705186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0740e965-e0f3-4531-9ec7-c3ce29bbe039 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1265 microversion: 2.25 time: 0.173684 May 07 21:46:06.706138 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 62/132] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:06 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:06.720373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:06.721006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:06.729786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.732278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:06.733293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:06.733738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:07.155468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.165885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dca79eba-261b-49b1-9f4d-a77f66b7e43b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1218 microversion: 2.1 time: 0.450037 May 07 21:46:07.167141 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 71/133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:06 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1218 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:07.220058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:07.221018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:07.230697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:07.231214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:07.232024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:07.232493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:07.332298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.343197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.345491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.361711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8bcb4676-f6a4-41c7-9562-a33544d11be1 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.151275 May 07 21:46:07.362667 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 63/134] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:07 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:07.501025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:07.501542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:07.508875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:07.513590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:07.516775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:07.517545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:07.723661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:07.725040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:07.748047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:07.769269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:07.770351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:07.771049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:07.925905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.954268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.954268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.954268 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91066814-2f63-4d25-a1f1-f991947ab479 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1265 microversion: 2.25 time: 0.228124 May 07 21:46:07.959545 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 64/135] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:07 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:07.989777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:07.999790 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-51ef3751-5fb1-4607-b467-d664e5ed806d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.502814 May 07 21:46:08.009519 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 72/136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:07 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:08.184250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:08.184908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:08.200946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:08.201392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:08.202203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:08.211024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:08.317156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:08.334954 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63903569-f0a8-4444-b536-75e0dc6e51de tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1218 microversion: 2.1 time: 0.155002 May 07 21:46:08.338863 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 65/137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:08 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:08.391086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:08.400121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:08.421172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:08.421865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:08.422922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:08.423592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:08.625379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:08.638027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:08.639915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:08.651952 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-930ce698-3fd8-43b9-a8b6-1f0babd2b05f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.265359 May 07 21:46:08.653051 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 73/138] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:08 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:08.969226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:08.971847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:08.988838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:08.989484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:08.990430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:08.991206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:09.017143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:09.018379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:09.029682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:09.030139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:09.031169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:09.031616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:09.075207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.087063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.090296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.091493 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e9de18df-b9e7-4974-a51e-0f9fde33da09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1257 microversion: 2.25 time: 0.126927 May 07 21:46:09.094273 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 66/139] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:08 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1257 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:09.289905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.302788 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9190c6a8-756f-41b6-b43a-a52505666f44 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.289177 May 07 21:46:09.304458 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 74/140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:09 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:09.352134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:09.352779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:09.371961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:09.380404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:09.381508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:09.382105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:09.648201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.657229 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31cbdaf5-857f-40e8-8ab1-129994cf13b2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1266 microversion: 2.1 time: 0.308936 May 07 21:46:09.671959 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 67/141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:09 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:09.677945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:09.678870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:09.689089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:09.689554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:09.694846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:09.695317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:09.798063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.809387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.813487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:09.821934 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-18834291-596d-44f2-9fc4-907fb3abb25b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.148014 May 07 21:46:09.823931 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 75/142] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:09 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:10.076595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e630254b-6537-4d90-af88-ffc5363c1802 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d6b3ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:10.111219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:10.112091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:10.123422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.135647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.137115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.137579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.247000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e630254b-6537-4d90-af88-ffc5363c1802 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.247450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e630254b-6537-4d90-af88-ffc5363c1802 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.248264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e630254b-6537-4d90-af88-ffc5363c1802 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.248708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e630254b-6537-4d90-af88-ffc5363c1802 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.252730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:10.263595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:10.267879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:10.271891 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0afebb9c-62cb-4e86-8415-3eca69d8cfeb tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1313 microversion: 2.25 time: 0.166293 May 07 21:46:10.283603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 76/143] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:10 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:10.320129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:10.321016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:10.331221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.336366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.337346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.337902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.405650 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e630254b-6537-4d90-af88-ffc5363c1802 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd" status: 200 len: 240 microversion: 2.36 time: 0.564497 May 07 21:46:10.406950 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 68/144] 10.222.0.32 () {62 vars in 1302 bytes} [Sat May 7 21:46:09 2022] PUT /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd => generated 240 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:10.428530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-709c37e8-e5cd-4ab5-927f-322edce419eb tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Calling method '.version_select at 0x7fc41d79dd30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:10.601620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-709c37e8-e5cd-4ab5-927f-322edce419eb tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.603935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-709c37e8-e5cd-4ab5-927f-322edce419eb tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.605099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-709c37e8-e5cd-4ab5-927f-322edce419eb tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.607313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-709c37e8-e5cd-4ab5-927f-322edce419eb tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.694625 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-709c37e8-e5cd-4ab5-927f-322edce419eb tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd/detail" status: 200 len: 672 microversion: 2.36 time: 0.268878 May 07 21:46:10.705378 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 69/145] 10.222.0.32 () {60 vars in 1303 bytes} [Sat May 7 21:46:10 2022] GET /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd/detail => generated 672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:10.813920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cbd40a58-daad-42b1-9f79-c7e5f282103f req-ba3aa01b-78e5-4ac3-b246-e8638e9848bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b", "name": "network-vif-plugged", "status": "completed", "tag": "0f88893d-5e1f-48e6-a69a-132a1aa16a37"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:10.829778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cbd40a58-daad-42b1-9f79-c7e5f282103f req-ba3aa01b-78e5-4ac3-b246-e8638e9848bc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.830460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cbd40a58-daad-42b1-9f79-c7e5f282103f req-ba3aa01b-78e5-4ac3-b246-e8638e9848bc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.845850 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cbd40a58-daad-42b1-9f79-c7e5f282103f req-ba3aa01b-78e5-4ac3-b246-e8638e9848bc service nova] Creating event network-vif-plugged:0f88893d-5e1f-48e6-a69a-132a1aa16a37 for instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b on nch1-master-1 May 07 21:46:10.852169 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cbd40a58-daad-42b1-9f79-c7e5f282103f req-ba3aa01b-78e5-4ac3-b246-e8638e9848bc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144495 May 07 21:46:10.853536 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 70/146] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:10.862219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:10.863875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:10.877464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.879164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:10.881478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:10.882086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.025474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.040055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44e69234-cb47-476e-a07c-112d269c553f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.724515 May 07 21:46:11.041114 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 77/147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:10 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:11.048078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:11.049321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:11.058034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.059327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.061562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.062090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.225584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.236795 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4ca4a333-3e8a-4bde-be42-af2941e20b08 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1272 microversion: 2.1 time: 0.380651 May 07 21:46:11.238871 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 71/148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:10 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1272 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:11.248185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d73c670>, body: {"quota_set": {"ram": "2048"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:11.313667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.339711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.344560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.373409 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb163007-2263-4fe9-a165-c9ab8492bc39 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.330347 May 07 21:46:11.373912 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 78/149] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:11 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:11.382378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:11.383035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:11.399552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.400019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.402013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.402482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.403289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.403463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.403910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.404543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.529816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.530584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.531696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:11.534221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:11.644122 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9676403d-bfff-4e2e-8311-3b570d73cf1e tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd?user_id=2f2ed2a9ee54442bbdeeebb35d99ec9f" status: 200 len: 240 microversion: 2.36 time: 0.404125 May 07 21:46:11.651521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 72/150] 10.222.0.32 () {62 vars in 1383 bytes} [Sat May 7 21:46:11 2022] PUT /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd?user_id=2f2ed2a9ee54442bbdeeebb35d99ec9f => generated 240 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:11.656677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02f7e8a0-33f3-44e8-98d6-ee8d64b38c60 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Calling method '.version_select at 0x7fc41d67e3a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:11.657843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.666565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.667704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:11.668829 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eca5c705-6aff-4794-8b2a-1dffec33787f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1319 microversion: 2.25 time: 0.293975 May 07 21:46:11.669381 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 79/151] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:11 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:11.763660 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-02f7e8a0-33f3-44e8-98d6-ee8d64b38c60 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd?user_id=2f2ed2a9ee54442bbdeeebb35d99ec9f" status: 200 len: 282 microversion: 2.36 time: 0.110785 May 07 21:46:11.770997 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 73/152] 10.222.0.32 () {60 vars in 1363 bytes} [Sat May 7 21:46:11 2022] GET /compute/v2.1/os-quota-sets/2d38ca0e7b5444e28aec5bbc4b370ecd?user_id=2f2ed2a9ee54442bbdeeebb35d99ec9f => generated 282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:12.062265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:12.063336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:12.090282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.095541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.098963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.100227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.257302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:12.258635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:12.277914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.278691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.281350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.282032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.461709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.470044 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5983e9d-b902-4b20-b15f-10c60de516af tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.416261 May 07 21:46:12.477583 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 80/153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:12 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:12.498947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:12.501988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:12.512454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.513139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.514084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.514523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.627033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.646040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.657506 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-95715743-5368-4fed-baca-63e8711983f4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1272 microversion: 2.1 time: 0.405315 May 07 21:46:12.658632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.670545 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 74/154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:12 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1272 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:12.671290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.687968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:12.688599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:12.696095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d36a492-5a48-4ed4-974b-cc290c8879c5 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1417 microversion: 2.75 time: 0.213216 May 07 21:46:12.698109 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 81/155] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:12 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1417 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:12.706181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.706653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.713580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:12.714332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:12.848898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.859680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.869496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:12.872864 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27e9444a-9aa3-495c-87ef-26e1739ed2f0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1319 microversion: 2.25 time: 0.189067 May 07 21:46:12.876411 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 75/156] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:12 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:13.494273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:13.495262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:13.502306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:13.505094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:13.510320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:13.513878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:13.679290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:13.680969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:13.695970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:13.698304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:13.701408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:13.702283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:13.818643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:13.832205 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d4a0a8d1-313e-4662-917c-c38b04b09f5d tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1335 microversion: 2.1 time: 0.341917 May 07 21:46:13.833953 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 82/157] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:13 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1335 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:13.845401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:13.846282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:13.860763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:13.861468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:13.863669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:13.864283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:13.995090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:14.008110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:14.012534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:14.019230 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4611c92d-55e6-4408-a04e-3a05d9fe2169 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1438 microversion: 2.75 time: 0.183888 May 07 21:46:14.020004 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 83/158] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:13 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1438 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:14.025222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:14.026274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:14.036437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:14.037116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:14.038655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:14.040897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:14.292865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:14.310072 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f119477-c40b-41c6-af11-e1dce170f184 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1314 microversion: 2.1 time: 0.636278 May 07 21:46:14.311333 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 76/159] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:13 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:14.328856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:14.331276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:14.342423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:14.343172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:14.344521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:14.345131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:14.364317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:14.372642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:14.374179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:14.390019 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7391b83-1eeb-421d-af4a-51a04b9fbba7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.368618 May 07 21:46:14.390844 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 84/160] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:14 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:14.504975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:14.505718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:14.506370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:14.506974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:14.507694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:14.654963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:14.663414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:14.664184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:14.665057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:14.665590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:14.992506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1b49517c-145d-4e9a-bed2-570d612a17c1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:15.005283 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1b49517c-145d-4e9a-bed2-570d612a17c1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.415516 May 07 21:46:15.012496 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 85/161] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:46:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:15.018640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e3ac0a9b-95c8-4374-9f0a-39572c16ac12 req-e1ae418f-f45d-4b98-a925-3fde6227b020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79018bd-9790-48c1-a26f-590908b011db", "tag": "030cf429-3843-4968-ac82-75d806b69b77"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:15.032830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e3ac0a9b-95c8-4374-9f0a-39572c16ac12 req-e1ae418f-f45d-4b98-a925-3fde6227b020 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.033537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e3ac0a9b-95c8-4374-9f0a-39572c16ac12 req-e1ae418f-f45d-4b98-a925-3fde6227b020 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.041326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.051762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.061366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.074866 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-518bd570-3141-4270-9c14-bd1c76a9516a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "POST /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f/action" status: 202 len: 1495 microversion: 2.75 time: 0.759304 May 07 21:46:15.077949 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 77/162] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:46:14 2022] POST /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f/action => generated 1495 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 07 21:46:15.089378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:15.090530 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e3ac0a9b-95c8-4374-9f0a-39572c16ac12 req-e1ae418f-f45d-4b98-a925-3fde6227b020 service nova] Creating event network-changed:030cf429-3843-4968-ac82-75d806b69b77 for instance e79018bd-9790-48c1-a26f-590908b011db on nch2-master-1 May 07 21:46:15.091267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e3ac0a9b-95c8-4374-9f0a-39572c16ac12 req-e1ae418f-f45d-4b98-a925-3fde6227b020 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:46:15.091423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:15.094398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-323eba07-30fa-4237-ab37-b8d254cf3b1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.098107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-323eba07-30fa-4237-ab37-b8d254cf3b1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.099371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-323eba07-30fa-4237-ab37-b8d254cf3b1e None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.102294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-323eba07-30fa-4237-ab37-b8d254cf3b1e None None] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.107693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.109111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.111220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.114906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.128262 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.rpcapi [None req-323eba07-30fa-4237-ab37-b8d254cf3b1e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 07 21:46:15.129478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-323eba07-30fa-4237-ab37-b8d254cf3b1e None None] Releasing lock "compute-rpcapi-router" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:46:15.181897 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-323eba07-30fa-4237-ab37-b8d254cf3b1e None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167817 May 07 21:46:15.183113 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 86/163] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:15.281799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-96fcc17b-d704-44d4-8ce0-57d00f1bdef1 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1088295327", "id": 150453885, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:15.283454 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:15.283454 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:15.336818 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-96fcc17b-d704-44d4-8ce0-57d00f1bdef1 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.148639 May 07 21:46:15.339584 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 87/164] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:15 2022] POST /compute/v2.1/flavors => generated 422 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:15.363341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:15.364086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:15.400050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.400918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.404848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.407376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.423263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.451385 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be8c8aca-fbf5-44a6-8330-63e0b1ac775f tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1485 microversion: 2.1 time: 0.368393 May 07 21:46:15.452619 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 78/165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:15 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1485 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:15.474866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:15.475848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:15.485638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.486405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.487922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.488503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.551779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.566714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.568871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.576693 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-24e37048-27a6-4574-b728-6a55b735b85d tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.229777 May 07 21:46:15.579303 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 88/166] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:15 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:15.589729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-224f70a0-b173-49f4-b1bd-c60e87f50cfc tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:15.609092 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-224f70a0-b173-49f4-b1bd-c60e87f50cfc tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028379 May 07 21:46:15.611544 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 89/167] 10.222.0.32 () {58 vars in 1181 bytes} [Sat May 7 21:46:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:15.623677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:15.625003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:15.635175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.635918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.637049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.637802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.882624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.895577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.898143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:15.899656 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6450da5-8dbc-40e3-a821-140122b4d4a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.285978 May 07 21:46:15.900579 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 90/168] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:15 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:15.906538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6021d88-843b-4cfe-983b-b8f3b6c3f2a2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:15.907415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6021d88-843b-4cfe-983b-b8f3b6c3f2a2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:15.917109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6021d88-843b-4cfe-983b-b8f3b6c3f2a2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.917697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6021d88-843b-4cfe-983b-b8f3b6c3f2a2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.921529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6021d88-843b-4cfe-983b-b8f3b6c3f2a2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:15.922175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6021d88-843b-4cfe-983b-b8f3b6c3f2a2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:15.992268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:16.014181 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1f45a4de-6f24-44db-84e1-57d52e0d1210 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1314 microversion: 2.1 time: 0.551269 May 07 21:46:16.017924 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 79/169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:15 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:16.030230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eae13858-5d4e-4555-84c8-23f5c4bcb1b2 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1647777473", "id": 798756080, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:16.039075 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:16.039075 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:16.078388 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eae13858-5d4e-4555-84c8-23f5c4bcb1b2 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.055082 May 07 21:46:16.085455 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 80/170] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:16 2022] POST /compute/v2.1/flavors => generated 422 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:16.101843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-954e21e8-60a4-4436-9596-5ae50a0a05ad tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:16.146740 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-954e21e8-60a4-4436-9596-5ae50a0a05ad tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.060074 May 07 21:46:16.147356 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 81/171] 10.222.0.32 () {58 vars in 1181 bytes} [Sat May 7 21:46:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:16.162816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b56a3ea-3729-4619-801c-1c28c356adb6 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Action: 'create', calling method: .version_select at 0x7fc41d6cfca0>, body: {"keypair": {"name": "tempest-keypair-1545647605"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:16.205124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3b56a3ea-3729-4619-801c-1c28c356adb6 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:16.222124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3b56a3ea-3729-4619-801c-1c28c356adb6 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for user 85eeaeaf9f1c464f8d45eff93bab41cb and project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:16.423903 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6021d88-843b-4cfe-983b-b8f3b6c3f2a2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1636 microversion: 2.1 time: 0.521919 May 07 21:46:16.426172 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 91/172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:15 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1636 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:16.460868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:16.462211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:16.481012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.481651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:16.483795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.485437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:16.545197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3b56a3ea-3729-4619-801c-1c28c356adb6 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:16.550576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3b56a3ea-3729-4619-801c-1c28c356adb6 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for user 85eeaeaf9f1c464f8d45eff93bab41cb and project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:16.567927 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b56a3ea-3729-4619-801c-1c28c356adb6 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.412541 May 07 21:46:16.568969 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 82/173] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:46:16 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:16.569928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:46:16.604803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:16.605745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:16.613798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.614857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:16.621189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.622311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:16.802712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:16.812945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:16.821721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:16.847279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b567cad5-c8a7-44fa-9178-e82e02cce849 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.245889 May 07 21:46:16.848346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 83/174] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:16 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:16.917643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b477d689-4b7e-4bab-b1a1-a7549743ccde tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 204 len: 0 microversion: 2.1 time: 0.479372 May 07 21:46:16.918639 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 92/175] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:46:16 2022] DELETE /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:46:16.928423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:16.930947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:16.933735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:16.934639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:16.948912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.952498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:16.954428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.957587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.958222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:16.964321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:16.965439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:16.965992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:17.251617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:17.263495 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-014d12f3-a60f-495d-b7a9-711bfe1a6c80 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1491 microversion: 2.1 time: 0.339672 May 07 21:46:17.272832 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 93/176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:16 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1491 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:17.510729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-710c22ed-5bb4-4c45-93fb-0e3ace543668 req-a0b239f5-c1fe-4325-87e5-6959ca53a179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52713c0c-6d75-42a3-96ac-5a93b17ef0b1", "tag": "8fc97b61-6eb0-420e-adf9-104bdbfbc835"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:17.520370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-710c22ed-5bb4-4c45-93fb-0e3ace543668 req-a0b239f5-c1fe-4325-87e5-6959ca53a179 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:17.520827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-710c22ed-5bb4-4c45-93fb-0e3ace543668 req-a0b239f5-c1fe-4325-87e5-6959ca53a179 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:17.532441 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-710c22ed-5bb4-4c45-93fb-0e3ace543668 req-a0b239f5-c1fe-4325-87e5-6959ca53a179 service nova] Creating event network-changed:8fc97b61-6eb0-420e-adf9-104bdbfbc835 for instance 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 on nch2-master-1 May 07 21:46:17.537851 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-710c22ed-5bb4-4c45-93fb-0e3ace543668 req-a0b239f5-c1fe-4325-87e5-6959ca53a179 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272602 May 07 21:46:17.538474 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 94/177] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:17.545783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:17.546524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:17.550456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:17.554146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:17.555036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:17.555978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:17.556567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:17.559743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:17.565324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:17.566714 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb875aa1-284a-46d6-9b2a-1160b8261b27 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.651925 May 07 21:46:17.578559 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 84/178] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:16 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:17.750787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:17.759931 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c15b45fa-7053-4fa0-a45c-2853e41a2684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1314 microversion: 2.1 time: 0.219150 May 07 21:46:17.761231 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 95/179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:17 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:17.871799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:17.872448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:17.880096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:17.880547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:17.881327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:17.881760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:17.990602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:18.018261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:18.022980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:18.029300 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7aacada7-580d-4a3d-baee-319e39b5d021 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.165647 May 07 21:46:18.030155 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 85/180] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:17 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:18.160023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-80c72376-e23b-437b-a30a-4efb4811860a tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:18.161329 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:18.161329 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:18.162870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80c72376-e23b-437b-a30a-4efb4811860a tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.163948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80c72376-e23b-437b-a30a-4efb4811860a tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.164933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80c72376-e23b-437b-a30a-4efb4811860a tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.165537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80c72376-e23b-437b-a30a-4efb4811860a tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.196733 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-80c72376-e23b-437b-a30a-4efb4811860a tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.169122 May 07 21:46:18.198177 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 96/181] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:46:18 2022] GET /compute/v2.1/os-services => generated 966 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:18.210001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5b29b1d-89db-4582-9381-5aff39a10fba tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:18.211886 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:18.211886 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:18.213617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b29b1d-89db-4582-9381-5aff39a10fba tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.214308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b29b1d-89db-4582-9381-5aff39a10fba tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.215400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b29b1d-89db-4582-9381-5aff39a10fba tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.216111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b29b1d-89db-4582-9381-5aff39a10fba tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.243947 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5b29b1d-89db-4582-9381-5aff39a10fba tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.038660 May 07 21:46:18.244748 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 86/182] 10.222.0.32 () {58 vars in 1173 bytes} [Sat May 7 21:46:18 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:18.257296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89f0426c-65d0-4d1b-8136-f8d1da864059 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:18.258631 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:18.258631 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:18.260101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f0426c-65d0-4d1b-8136-f8d1da864059 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.260562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f0426c-65d0-4d1b-8136-f8d1da864059 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.261382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f0426c-65d0-4d1b-8136-f8d1da864059 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.261826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f0426c-65d0-4d1b-8136-f8d1da864059 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.281909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:18.282711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:18.290742 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-89f0426c-65d0-4d1b-8136-f8d1da864059 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 399 microversion: 2.1 time: 0.037919 May 07 21:46:18.291397 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 97/183] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:46:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 399 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:18.298130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.299025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.300561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.301134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.303506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ebba9aea-5915-4400-bc4c-27de7c321ee1 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:18.304721 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:18.304721 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:18.306811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebba9aea-5915-4400-bc4c-27de7c321ee1 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.308055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebba9aea-5915-4400-bc4c-27de7c321ee1 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.308946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebba9aea-5915-4400-bc4c-27de7c321ee1 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.309396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebba9aea-5915-4400-bc4c-27de7c321ee1 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.337005 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ebba9aea-5915-4400-bc4c-27de7c321ee1 tempest-ServicesAdminTestJSON-387234963 tempest-ServicesAdminTestJSON-387234963-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.037696 May 07 21:46:18.344092 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 98/184] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:46:18 2022] GET /compute/v2.1/os-services => generated 966 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:18.472308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:18.481373 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-44aa7ac6-46d2-4397-943f-2cc0d385487a tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1491 microversion: 2.1 time: 0.203782 May 07 21:46:18.482575 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 87/185] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:18 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1491 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:18.598328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:18.599754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:18.607920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.608649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.609742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.610337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.787251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:18.788081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:18.795878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.796484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:18.797975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:18.798706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:19.007558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.020309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.021825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.023194 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b12b738-b520-490f-8f5f-96c24f69f3f3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.430856 May 07 21:46:19.024071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 99/186] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:18 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:19.049839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:19.050629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:19.058619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:19.059230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:19.060028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:19.060498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:19.173508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.189497 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-866c3ff7-2a10-431b-b62d-25818f267697 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1314 microversion: 2.1 time: 0.415987 May 07 21:46:19.190426 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 88/187] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:18 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:19.231114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.242066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.243924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.250750 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1277e2ab-a1d6-4623-8252-6335ec9686d2 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.204782 May 07 21:46:19.251639 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 100/188] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:19 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:19.499769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:19.500681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:19.507465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:19.507928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:19.508710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:19.509149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:19.596744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e4b2e900-08cd-44af-89c0-b6fe460b68fd req-17ef674e-4efd-45f3-acef-38849397a136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0284aa35-4e58-4e15-a194-a500996ed82e", "tag": "149155db-c2db-4827-9746-fffdb2d0018e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:19.605358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e4b2e900-08cd-44af-89c0-b6fe460b68fd req-17ef674e-4efd-45f3-acef-38849397a136 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:19.606496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e4b2e900-08cd-44af-89c0-b6fe460b68fd req-17ef674e-4efd-45f3-acef-38849397a136 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:19.612211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e9f1939f084da58fc8a612ef31f6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a5c3e72c1f943bcb6256ddf95978995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:19.621158 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e4b2e900-08cd-44af-89c0-b6fe460b68fd req-17ef674e-4efd-45f3-acef-38849397a136 service nova] Creating event network-changed:149155db-c2db-4827-9746-fffdb2d0018e for instance 0284aa35-4e58-4e15-a194-a500996ed82e on nch2-master-1 May 07 21:46:19.622390 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87ee0307-5989-414a-bc24-71c7c0e99f55 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 200 len: 1449 microversion: 2.1 time: 0.126464 May 07 21:46:19.624153 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 89/189] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:19 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 1449 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:19.631517 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e4b2e900-08cd-44af-89c0-b6fe460b68fd req-17ef674e-4efd-45f3-acef-38849397a136 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038470 May 07 21:46:19.632601 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 101/190] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:19.720073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2d14c88b-0227-4b53-ad61-b6a64e78a28d req-1ec9673e-10a5-4e66-aef6-6436bd12a85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b", "name": "network-vif-deleted", "tag": "0f88893d-5e1f-48e6-a69a-132a1aa16a37"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:19.742838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2d14c88b-0227-4b53-ad61-b6a64e78a28d req-1ec9673e-10a5-4e66-aef6-6436bd12a85b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:19.743256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2d14c88b-0227-4b53-ad61-b6a64e78a28d req-1ec9673e-10a5-4e66-aef6-6436bd12a85b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:19.758956 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2d14c88b-0227-4b53-ad61-b6a64e78a28d req-1ec9673e-10a5-4e66-aef6-6436bd12a85b service nova] Creating event network-vif-deleted:0f88893d-5e1f-48e6-a69a-132a1aa16a37 for instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b on nch1-master-1 May 07 21:46:19.766918 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2d14c88b-0227-4b53-ad61-b6a64e78a28d req-1ec9673e-10a5-4e66-aef6-6436bd12a85b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050710 May 07 21:46:19.771930 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 90/191] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:20.047513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:20.051446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:20.061759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.062218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.075811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.079920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.122499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-506045496", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "798756080", "adminPass": "***", "networks": [{"uuid": "849ca462-b333-410b-8c4a-24e67429a8f8"}], "security_groups": [{"name": "tempest-securitygroup--867261986"}], "key_name": "tempest-keypair-1545647605", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:20.320816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:20.334329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:20.336701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:20.338418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef34e12b-5443-4b69-ae63-81fdb39ca3c1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.300723 May 07 21:46:20.339783 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 102/192] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:20 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:20.345336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:20.345972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:20.352872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.353314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.354246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.354904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.481608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] validate_networks() for [('849ca462-b333-410b-8c4a-24e67429a8f8', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:20.615881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:20.623797 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7cee4656-0122-46ee-9db5-3752bf4787ca tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1314 microversion: 2.1 time: 0.282392 May 07 21:46:20.624562 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 103/193] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:20 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:20.629847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:20.630503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:20.639613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.640080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.640865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.641428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.736621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:20.748292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:20.750504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:20.759642 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bef26ee2-2e54-484d-835c-2e9b95865726 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.133886 May 07 21:46:20.760472 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 104/194] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:20 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:20.769899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:20.771881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:20.791055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.793208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.794999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.795637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.816181 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] HTTP exception thrown: Instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b could not be found. May 07 21:46:20.816792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Returning 404 to user: Instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:20.817977 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9027005-cff7-48ae-b4b6-3478d9a0e1e4 tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 404 len: 111 microversion: 2.1 time: 0.056033 May 07 21:46:20.819492 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 105/195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:20 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:20.828245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eeb16723-7f88-45d1-a45d-dafaff3ef51d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:20.830396 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:20.830396 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:20.838343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eeb16723-7f88-45d1-a45d-dafaff3ef51d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:20.838928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eeb16723-7f88-45d1-a45d-dafaff3ef51d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:20.996685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eeb16723-7f88-45d1-a45d-dafaff3ef51d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 294 microversion: 2.1 time: 0.172054 May 07 21:46:20.999727 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 106/196] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:46:20 2022] POST /compute/v2.1/os-aggregates/4/action => generated 294 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:21.012031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a58e0e91-2b7c-462a-8a18-8ff29dd39960 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:21.015481 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.015481 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.040795 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a58e0e91-2b7c-462a-8a18-8ff29dd39960 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.034786 May 07 21:46:21.041799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 107/197] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:21 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:21.057746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bac967f8-1289-4af7-84c2-6790cfb04bf7 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2106161442"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.059220 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.059220 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.060323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-bac967f8-1289-4af7-84c2-6790cfb04bf7 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid 27225527-2e44-42e9-91fd-0b84f805e2c7 for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:21.087221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bac967f8-1289-4af7-84c2-6790cfb04bf7 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.035304 May 07 21:46:21.088147 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 108/198] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:21.101873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a4e3ab2-5aa5-419f-915e-97ed272abc61 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.103192 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.103192 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.113250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a4e3ab2-5aa5-419f-915e-97ed272abc61 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.113804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a4e3ab2-5aa5-419f-915e-97ed272abc61 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.248557 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a4e3ab2-5aa5-419f-915e-97ed272abc61 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.154452 May 07 21:46:21.250344 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 109/199] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:21.260653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d53cd9b3-460c-4f0b-9c10-ce71e7e74251 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.262229 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.262229 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.262740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d53cd9b3-460c-4f0b-9c10-ce71e7e74251 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '5abf38af9d8b41dc9871b612a06dfb05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2224daefc94f40bb919f8052e55a8fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:21.263396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d53cd9b3-460c-4f0b-9c10-ce71e7e74251 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:21.264221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d53cd9b3-460c-4f0b-9c10-ce71e7e74251 tempest-AggregatesAdminNegativeTestJSON-1055515333 tempest-AggregatesAdminNegativeTestJSON-1055515333-project] 10.222.0.32 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.008070 May 07 21:46:21.264734 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 110/200] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:21.273536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-118a1c7f-dcfe-47b2-b588-ea8679527a3b tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.283550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-118a1c7f-dcfe-47b2-b588-ea8679527a3b tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.284659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-118a1c7f-dcfe-47b2-b588-ea8679527a3b tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.398008 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-118a1c7f-dcfe-47b2-b588-ea8679527a3b tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.127804 May 07 21:46:21.399192 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 111/201] 10.222.0.32 () {60 vars in 1190 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:21.407376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:21.408275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:21.412457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:21.412980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:21.413360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:21.413769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:21.414357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:21.415390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.415839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.420414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.421062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.424282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.424792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.425768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.426261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.443886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:21.448439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for user 85eeaeaf9f1c464f8d45eff93bab41cb and project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:21.460298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:21.462691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:21.511020 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a313ce00-828d-49bf-b3de-a517632b554c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.394884 May 07 21:46:21.511832 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 91/202] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:46:21.522337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4637b3e0-50b5-4c57-adee-52c11f7dd01e tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:21.523223 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.523223 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:21.554918 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4637b3e0-50b5-4c57-adee-52c11f7dd01e tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.036020 May 07 21:46:21.556148 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 92/203] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:21 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:21.563419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-056108cc-5307-4462-a0ba-6ade81b784fe tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:21.564588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-056108cc-5307-4462-a0ba-6ade81b784fe tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:21.590406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:21.603463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:21.606239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:21.607746 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3ca1722b-4a4d-4625-ae2f-49fd10d6a7fd tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.207266 May 07 21:46:21.608701 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 112/204] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:21 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:21.614155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-18efe377-f2d9-4c1d-b87b-a1753e27a627 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-12215877"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.615523 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.615523 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.616635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-18efe377-f2d9-4c1d-b87b-a1753e27a627 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Generated uuid 70703398-35b3-412f-9350-79912d507aef for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:21.638736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-056108cc-5307-4462-a0ba-6ade81b784fe tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:21.642294 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-18efe377-f2d9-4c1d-b87b-a1753e27a627 tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.032561 May 07 21:46:21.649998 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 113/205] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:21.650222 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-056108cc-5307-4462-a0ba-6ade81b784fe tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1262 microversion: 2.1 time: 0.092334 May 07 21:46:21.650811 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 93/206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:21 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:21.657575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:21.658204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:21.665024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.665477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.665585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-150933b0-1f44-45d9-8577-838f94cda262 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1905974647"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.666298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.666736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.669122 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.669122 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.670061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-150933b0-1f44-45d9-8577-838f94cda262 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid 1ee1b9fe-2684-46b9-a693-b5271c909297 for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:21.699582 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-150933b0-1f44-45d9-8577-838f94cda262 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050955 May 07 21:46:21.701292 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 114/207] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:21.707624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.709121 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.709121 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.725080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.725728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.733855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.734391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.765242 ncdv-master-1 devstack@n-api.service[136682]: ERROR nova.api.openstack.compute.aggregates [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 07 21:46:21.765906 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 May 07 21:46:21.766514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:21.767404 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da68add6-7dc9-4d45-94cc-789b2b7fd08d tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.065061 May 07 21:46:21.771015 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 115/208] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:21.772589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e16429f-c9ea-4970-b66d-e9d8ee72f2d2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:21.773950 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.773950 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:21.786469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e16429f-c9ea-4970-b66d-e9d8ee72f2d2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.786908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e16429f-c9ea-4970-b66d-e9d8ee72f2d2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.831751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:21.844178 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd91bc68-92e4-47bb-870b-003d395f44d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1314 microversion: 2.1 time: 0.191615 May 07 21:46:21.848999 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 94/209] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:21 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:21.861067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52c02cba-9373-4163-ad51-5651425857da tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:21.862471 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:21.862471 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:21.889678 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52c02cba-9373-4163-ad51-5651425857da tempest-AggregatesAdminNegativeTestJSON-106464193 tempest-AggregatesAdminNegativeTestJSON-106464193-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.038985 May 07 21:46:21.890201 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 95/210] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:21 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:21.899139 ncdv-master-1 devstack@n-api.service[136682]: WARNING nova.scheduler.client.report [None req-7e16429f-c9ea-4970-b66d-e9d8ee72f2d2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] [req-62135a0e-8790-48a3-b4d0-9ed6c8b673ff] Failed to update aggregates to [1ee1b9fe-2684-46b9-a693-b5271c909297] for resource provider with UUID f8e950aa-c8c5-4687-8cf7-7b3317ffd96c. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-62135a0e-8790-48a3-b4d0-9ed6c8b673ff"}]} May 07 21:46:21.903680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:21.913827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:21.922255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.922688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:21.923524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:21.923974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.011372 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7e16429f-c9ea-4970-b66d-e9d8ee72f2d2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.242149 May 07 21:46:22.013280 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 116/211] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:21 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.029956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6bad510d-4ddd-4132-8672-365abcdb6228 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:22.033029 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:22.033029 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:22.037873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:22.050623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6bad510d-4ddd-4132-8672-365abcdb6228 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 243 microversion: 2.1 time: 0.028128 May 07 21:46:22.051533 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 117/212] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:22 2022] GET /compute/v2.1/os-aggregates/11 => generated 243 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.052454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:22.054009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:22.065303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dca30a19-aa12-49f1-924a-4dacf4054c32 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:22.065981 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5938b0b2-396e-44ef-bfaf-595985f570cc tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.174700 May 07 21:46:22.069627 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:22.069627 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:22.069878 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 96/213] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:21 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:22.086498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dca30a19-aa12-49f1-924a-4dacf4054c32 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.087165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dca30a19-aa12-49f1-924a-4dacf4054c32 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.271067 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dca30a19-aa12-49f1-924a-4dacf4054c32 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.212503 May 07 21:46:22.271732 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 118/214] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:22 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.285432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8abb0578-ef6d-4747-8b98-f835ec45b68b tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:22.286505 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:22.286505 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:22.320774 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8abb0578-ef6d-4747-8b98-f835ec45b68b tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.041162 May 07 21:46:22.322238 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 97/215] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:22 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 07 21:46:22.335076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d5aff187-d149-4368-98c9-ba8a40a08f9b tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1395359248"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:22.336384 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:22.336384 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:22.337253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-d5aff187-d149-4368-98c9-ba8a40a08f9b tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid 5f1e7057-3a6b-4be6-8c1c-b1e1051f141d for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:22.384409 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d5aff187-d149-4368-98c9-ba8a40a08f9b tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052989 May 07 21:46:22.385235 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 119/216] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:22 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.397802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8d991018-3ea5-4812-80e7-32778c7b2dc9 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:22.399615 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:22.399615 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:22.410679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d991018-3ea5-4812-80e7-32778c7b2dc9 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.411183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d991018-3ea5-4812-80e7-32778c7b2dc9 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.583903 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8d991018-3ea5-4812-80e7-32778c7b2dc9 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.191304 May 07 21:46:22.585978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 98/217] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.598464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90fa9bfe-885e-4fb9-9daa-caff0c08936f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:22.599928 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:22.599928 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:22.612580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90fa9bfe-885e-4fb9-9daa-caff0c08936f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.019280 May 07 21:46:22.613818 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 120/218] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:46:22 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.629837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0bf2dc9f-5f67-44a9-9645-1be0bc7962f4 req-622f9a56-1b40-4b11-91ba-71111a5874f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79018bd-9790-48c1-a26f-590908b011db", "name": "network-vif-plugged", "status": "completed", "tag": "030cf429-3843-4968-ac82-75d806b69b77"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:22.648593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb347c88-21ad-4d27-bd21-e467879ca420 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:22.649154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0bf2dc9f-5f67-44a9-9645-1be0bc7962f4 req-622f9a56-1b40-4b11-91ba-71111a5874f5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.649563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0bf2dc9f-5f67-44a9-9645-1be0bc7962f4 req-622f9a56-1b40-4b11-91ba-71111a5874f5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.651287 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:22.651287 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:22.669167 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0bf2dc9f-5f67-44a9-9645-1be0bc7962f4 req-622f9a56-1b40-4b11-91ba-71111a5874f5 service nova] Creating event network-vif-plugged:030cf429-3843-4968-ac82-75d806b69b77 for instance e79018bd-9790-48c1-a26f-590908b011db on nch2-master-1 May 07 21:46:22.675509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb347c88-21ad-4d27-bd21-e467879ca420 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.675976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb347c88-21ad-4d27-bd21-e467879ca420 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.677582 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0bf2dc9f-5f67-44a9-9645-1be0bc7962f4 req-622f9a56-1b40-4b11-91ba-71111a5874f5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057062 May 07 21:46:22.679237 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 99/219] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.686729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:22.687478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:22.694579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.695106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.696051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.696809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.918752 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb347c88-21ad-4d27-bd21-e467879ca420 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.278761 May 07 21:46:22.919664 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 121/220] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:22.938361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:22.947263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:22.953982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.956661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:22.958956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:22.960886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.151409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.161417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.163134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.164423 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94deac94-7074-4fea-973e-5203da1d95b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.483929 May 07 21:46:23.165136 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 100/221] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:22 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:23.170485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:23.171538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:23.179093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.179600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.180387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.180830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.209298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.222760 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b3d5704-6a9a-4b41-89b2-1253d849341c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1322 microversion: 2.1 time: 0.301529 May 07 21:46:23.224604 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 122/222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:22 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:23.239667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff6ff1c8-4bf7-4795-8f2c-dde3163b2136 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:23.240996 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:23.240996 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:23.270674 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff6ff1c8-4bf7-4795-8f2c-dde3163b2136 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.044202 May 07 21:46:23.277708 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 123/223] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:23 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:23.548093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.558678 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61a9d7b8-60dc-4388-b918-091af7c8217a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1314 microversion: 2.1 time: 0.392243 May 07 21:46:23.559573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 101/224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:23 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:23.576573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:23.577218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:23.592215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.595794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.599205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.599656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.707872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-58d59adc-195f-4a5e-8bc8-e3de771b2e57 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:23.709581 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:23.709581 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:23.711414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d59adc-195f-4a5e-8bc8-e3de771b2e57 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.711889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d59adc-195f-4a5e-8bc8-e3de771b2e57 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.713256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d59adc-195f-4a5e-8bc8-e3de771b2e57 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.716977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.721304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d59adc-195f-4a5e-8bc8-e3de771b2e57 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.726826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.731201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:23.742927 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d545c2ea-c244-4c7f-a4dd-89f428db0687 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.170365 May 07 21:46:23.743531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 102/225] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:23 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:23.755671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee816395-d8dc-486c-8f41-27b7aa9dc804 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1909803245"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:23.765309 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:23.765309 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:23.766697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.aggregate [None req-ee816395-d8dc-486c-8f41-27b7aa9dc804 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid b923a6b3-772b-4eff-8703-7ea9e93de641 for aggregate {{(pid=136681) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:23.783841 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-58d59adc-195f-4a5e-8bc8-e3de771b2e57 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.510298 May 07 21:46:23.786579 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 124/226] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:46:23 2022] GET /compute/v2.1/os-services => generated 947 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:23.802018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3c2e5bf7-a5a7-49d3-92c9-7768ade24dbc tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:23.804666 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:23.804666 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:23.806247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c2e5bf7-a5a7-49d3-92c9-7768ade24dbc tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.806704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c2e5bf7-a5a7-49d3-92c9-7768ade24dbc tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.807151 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee816395-d8dc-486c-8f41-27b7aa9dc804 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059592 May 07 21:46:23.807977 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 103/227] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:23.808683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c2e5bf7-a5a7-49d3-92c9-7768ade24dbc tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.809288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c2e5bf7-a5a7-49d3-92c9-7768ade24dbc tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.818682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b9fbc7e-8a9c-4b68-baf0-aef4d9a53573 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:23.821640 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:23.821640 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:23.838074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b9fbc7e-8a9c-4b68-baf0-aef4d9a53573 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.838543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b9fbc7e-8a9c-4b68-baf0-aef4d9a53573 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.864276 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3c2e5bf7-a5a7-49d3-92c9-7768ade24dbc tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.069626 May 07 21:46:23.864905 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 125/228] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 21:46:23 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:23.881308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-514a5465-2558-4a6b-b027-8b9e1597e1e7 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:23.883018 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:23.883018 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:23.886457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514a5465-2558-4a6b-b027-8b9e1597e1e7 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.886962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514a5465-2558-4a6b-b027-8b9e1597e1e7 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.887791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514a5465-2558-4a6b-b027-8b9e1597e1e7 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.888262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514a5465-2558-4a6b-b027-8b9e1597e1e7 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.927678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-514a5465-2558-4a6b-b027-8b9e1597e1e7 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.053972 May 07 21:46:23.934147 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 126/229] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:46:23 2022] GET /compute/v2.1/os-services => generated 947 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:23.951910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4999078a-c263-4208-afb3-daa12536a0ce tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:23.954097 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:23.954097 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:23.956148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4999078a-c263-4208-afb3-daa12536a0ce tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.956931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4999078a-c263-4208-afb3-daa12536a0ce tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.957801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4999078a-c263-4208-afb3-daa12536a0ce tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:23.958323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4999078a-c263-4208-afb3-daa12536a0ce tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:23.993954 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4999078a-c263-4208-afb3-daa12536a0ce tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.048627 May 07 21:46:23.996055 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 127/230] 10.222.0.32 () {58 vars in 1195 bytes} [Sat May 7 21:46:23 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:24.008398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4c0af0e2-e529-4945-9e02-9623de4f29a2 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.009594 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.009594 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:24.010823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c0af0e2-e529-4945-9e02-9623de4f29a2 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.011284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c0af0e2-e529-4945-9e02-9623de4f29a2 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.021662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b9fbc7e-8a9c-4b68-baf0-aef4d9a53573 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.207192 May 07 21:46:24.022844 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 104/231] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:23 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:24.023392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c0af0e2-e529-4945-9e02-9623de4f29a2 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.023856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c0af0e2-e529-4945-9e02-9623de4f29a2 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.033013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06a4e31f-8bca-4661-b81c-39d2650e3cad tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:24.035636 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.035636 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:24.051606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06a4e31f-8bca-4661-b81c-39d2650e3cad tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.052933 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4c0af0e2-e529-4945-9e02-9623de4f29a2 tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.048626 May 07 21:46:24.053776 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 128/232] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/os-services => generated 947 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:24.055413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06a4e31f-8bca-4661-b81c-39d2650e3cad tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.065429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-391b2203-fb39-4e13-aeef-782abbf5693d tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.066851 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.066851 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:24.068314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-391b2203-fb39-4e13-aeef-782abbf5693d tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.068812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-391b2203-fb39-4e13-aeef-782abbf5693d tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.069796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-391b2203-fb39-4e13-aeef-782abbf5693d tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.070323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-391b2203-fb39-4e13-aeef-782abbf5693d tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.106685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-391b2203-fb39-4e13-aeef-782abbf5693d tempest-ServicesAdminNegativeTestJSON-2102211676 tempest-ServicesAdminNegativeTestJSON-2102211676-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.034646 May 07 21:46:24.107423 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 129/233] 10.222.0.32 () {58 vars in 1197 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:24.191288 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06a4e31f-8bca-4661-b81c-39d2650e3cad tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.162348 May 07 21:46:24.192669 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 105/234] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:24 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:24.205343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.206751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:24.226342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.226854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.227969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.229483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.422321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:24.436362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:24.441653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:24.446345 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ccee69c8-0bd2-489a-9a57-98ef22f785c8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.249479 May 07 21:46:24.447722 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 106/235] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:24.463721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69be51ad-642c-4282-b14f-ff00960850d6 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.464709 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.464709 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:24.495887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63c311eb-83b7-42cb-9494-a5a933ff5439 tempest-ServicesAdminNegativeTestJSON-1904451864 tempest-ServicesAdminNegativeTestJSON-1904451864-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.497510 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.497510 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:24.498919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-63c311eb-83b7-42cb-9494-a5a933ff5439 tempest-ServicesAdminNegativeTestJSON-1904451864 tempest-ServicesAdminNegativeTestJSON-1904451864-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3ef5431cd2d34b1a846598c1ae459342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada8a5cee4dd4a8fb2b722d3aded1b0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:24.499988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63c311eb-83b7-42cb-9494-a5a933ff5439 tempest-ServicesAdminNegativeTestJSON-1904451864 tempest-ServicesAdminNegativeTestJSON-1904451864-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:24.501615 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63c311eb-83b7-42cb-9494-a5a933ff5439 tempest-ServicesAdminNegativeTestJSON-1904451864 tempest-ServicesAdminNegativeTestJSON-1904451864-project] 10.222.0.32 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.384077 May 07 21:46:24.511938 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-69be51ad-642c-4282-b14f-ff00960850d6 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.061493 May 07 21:46:24.519194 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 130/236] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/os-services => generated 112 bytes in 402 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:24.524685 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 107/237] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:24 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:24.535175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d154ab24-78ab-4d9c-9fec-4b13bc524096 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1747129942"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:24.536582 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.536582 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:24.538830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.aggregate [None req-d154ab24-78ab-4d9c-9fec-4b13bc524096 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid cb6f2bf2-84a7-4c21-8356-812b2eac2f2a for aggregate {{(pid=136681) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:24.544498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.546165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:24.568100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.568741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.571411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.572091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.597809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d154ab24-78ab-4d9c-9fec-4b13bc524096 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067188 May 07 21:46:24.600194 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 108/238] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:24 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:24.605065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b2dcf1a3-6c8d-4465-877e-830a31925469 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d5f4790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.607325 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.607325 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:24.609790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dcf1a3-6c8d-4465-877e-830a31925469 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.610534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dcf1a3-6c8d-4465-877e-830a31925469 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.611696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dcf1a3-6c8d-4465-877e-830a31925469 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.612410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dcf1a3-6c8d-4465-877e-830a31925469 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.648033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b2dcf1a3-6c8d-4465-877e-830a31925469 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.046499 May 07 21:46:24.648937 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 109/239] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:24.655511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.656169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:24.663242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.663698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.668268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.668732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.910693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:24.918382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:24.919175 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6dc6f22-e344-497a-b635-c1b92f4aa153 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1387 microversion: 2.1 time: 0.395205 May 07 21:46:24.922587 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 131/240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1387 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:24.927829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fd1fe6eb-4de7-4986-bd0b-7931fbe07d2f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.928586 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.928586 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:24.940427 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea1f3eb7-7c82-4c5c-abbd-b6b10676dba7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1464 microversion: 2.1 time: 0.288932 May 07 21:46:24.942754 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 110/241] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1464 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:24.954948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c1d0df66-9f1c-4608-beb0-200901105d54 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d6dc430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.957798 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:24.957798 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:24.959914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1d0df66-9f1c-4608-beb0-200901105d54 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.960880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1d0df66-9f1c-4608-beb0-200901105d54 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.962433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1d0df66-9f1c-4608-beb0-200901105d54 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:24.963665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1d0df66-9f1c-4608-beb0-200901105d54 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:24.980787 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fd1fe6eb-4de7-4986-bd0b-7931fbe07d2f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.057070 May 07 21:46:24.981368 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 132/242] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:24 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:24.991063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:24.993992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:25.010754 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c1d0df66-9f1c-4608-beb0-200901105d54 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.066128 May 07 21:46:25.012001 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 111/243] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.014310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.014823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.015637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.016083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.020605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c7f990ec-b258-4795-9a8e-3706ffb647b8 req-034a5253-90f3-4d4b-80a0-bf0ac9a3dc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52713c0c-6d75-42a3-96ac-5a93b17ef0b1", "name": "network-vif-plugged", "status": "completed", "tag": "8fc97b61-6eb0-420e-adf9-104bdbfbc835"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:25.035227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c7f990ec-b258-4795-9a8e-3706ffb647b8 req-034a5253-90f3-4d4b-80a0-bf0ac9a3dc38 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.037062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c7f990ec-b258-4795-9a8e-3706ffb647b8 req-034a5253-90f3-4d4b-80a0-bf0ac9a3dc38 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.050936 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c7f990ec-b258-4795-9a8e-3706ffb647b8 req-034a5253-90f3-4d4b-80a0-bf0ac9a3dc38 service nova] Creating event network-vif-plugged:8fc97b61-6eb0-420e-adf9-104bdbfbc835 for instance 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 on nch2-master-1 May 07 21:46:25.058887 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c7f990ec-b258-4795-9a8e-3706ffb647b8 req-034a5253-90f3-4d4b-80a0-bf0ac9a3dc38 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045132 May 07 21:46:25.059946 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 112/244] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.066692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.067864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:25.077144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.078187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.079230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.079901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.093154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:25.106938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:25.120005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:25.134045 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c1c3db8-64a1-4e9e-8149-b2dd4a28aa5f tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.148021 May 07 21:46:25.135329 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 133/245] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:24 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:25.167542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ec588f40-c309-4f9f-b515-d14c72686d47 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.175178 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.175178 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:25.193298 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ec588f40-c309-4f9f-b515-d14c72686d47 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 07 21:46:25.196838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ec588f40-c309-4f9f-b515-d14c72686d47 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:25.202194 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ec588f40-c309-4f9f-b515-d14c72686d47 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.065169 May 07 21:46:25.208996 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 134/246] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:25.214404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6753c897-ac57-4dea-be01-b8fd32d80ceb tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d5a2f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.216068 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.216068 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:25.217873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6753c897-ac57-4dea-be01-b8fd32d80ceb tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.218566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6753c897-ac57-4dea-be01-b8fd32d80ceb tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.219682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6753c897-ac57-4dea-be01-b8fd32d80ceb tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.220490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6753c897-ac57-4dea-be01-b8fd32d80ceb tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.251198 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6753c897-ac57-4dea-be01-b8fd32d80ceb tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.040886 May 07 21:46:25.253688 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 135/247] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.258412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a074a0d-24aa-4f5f-b7c0-be2c92bd4750 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.260079 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.260079 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:25.273487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-4a074a0d-24aa-4f5f-b7c0-be2c92bd4750 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 07 21:46:25.274327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a074a0d-24aa-4f5f-b7c0-be2c92bd4750 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:25.275341 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a074a0d-24aa-4f5f-b7c0-be2c92bd4750 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.020456 May 07 21:46:25.275972 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 136/248] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:25 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:25.285165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d384eecc-ffd0-48c6-b532-235b554927d5 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d601670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.286029 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.286029 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:25.293074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d384eecc-ffd0-48c6-b532-235b554927d5 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.293624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d384eecc-ffd0-48c6-b532-235b554927d5 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.306807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d384eecc-ffd0-48c6-b532-235b554927d5 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.307351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d384eecc-ffd0-48c6-b532-235b554927d5 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.329962 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d384eecc-ffd0-48c6-b532-235b554927d5 tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.048903 May 07 21:46:25.335379 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 137/249] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.336937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b46f374-bcb4-4e3b-bdd9-a346c5410320 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-694741855", "name": "tempest-test_aggregate-1832939327"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:25.338869 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.338869 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:25.341619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-3b46f374-bcb4-4e3b-bdd9-a346c5410320 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid 38fc0bb7-9e7c-40fe-9e56-daf646ce777c for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:25.382943 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b46f374-bcb4-4e3b-bdd9-a346c5410320 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.048975 May 07 21:46:25.390362 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 138/250] 10.222.0.32 () {60 vars in 1164 bytes} [Sat May 7 21:46:25 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.397457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0f87d7a-6661-466a-99cc-9bfcff927cce tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Calling method '.version_select at 0x7fc41d479dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.399900 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.399900 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:25.408722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0f87d7a-6661-466a-99cc-9bfcff927cce tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.409729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0f87d7a-6661-466a-99cc-9bfcff927cce tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.428744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0f87d7a-6661-466a-99cc-9bfcff927cce tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.429599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0f87d7a-6661-466a-99cc-9bfcff927cce tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.459660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0f87d7a-6661-466a-99cc-9bfcff927cce tempest-HostsAdminTestJSON-467815417 tempest-HostsAdminTestJSON-467815417-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.068010 May 07 21:46:25.460780 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 139/251] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.465912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8d8598c2-bbd0-45f5-99fe-7e75ec47642d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.467380 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.467380 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:25.505227 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8d8598c2-bbd0-45f5-99fe-7e75ec47642d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.042791 May 07 21:46:25.507328 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 140/252] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:25.523163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.524869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:25.538493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.538983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.543092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:25.543571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:25.632980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:25.640389 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81a25b63-6be6-4942-bb56-0812aef2b1a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1313 microversion: 2.1 time: 0.578986 May 07 21:46:25.640984 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 113/253] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:25.651135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-818ea877-8eba-40b7-8574-61594907047d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.654130 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.654130 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:25.667119 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-818ea877-8eba-40b7-8574-61594907047d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] HTTP exception thrown: Aggregate 15 could not be found. May 07 21:46:25.670029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-818ea877-8eba-40b7-8574-61594907047d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:25.671268 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-818ea877-8eba-40b7-8574-61594907047d tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.025247 May 07 21:46:25.673183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 114/254] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:25.682805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ffe44bb5-5c99-4529-993e-f7e564d96f6f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.683837 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.683837 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:25.702159 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ffe44bb5-5c99-4529-993e-f7e564d96f6f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] HTTP exception thrown: Aggregate 15 could not be found. May 07 21:46:25.703208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ffe44bb5-5c99-4529-993e-f7e564d96f6f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:25.712616 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ffe44bb5-5c99-4529-993e-f7e564d96f6f tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.033418 May 07 21:46:25.713539 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 115/255] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:25.722937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ebc33b22-a1c1-4271-a8b0-67cfa9d13dc1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-632637034"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:25.724471 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.724471 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:25.725629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.aggregate [None req-ebc33b22-a1c1-4271-a8b0-67cfa9d13dc1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid 11772211-feed-488c-99f0-a23029d5d4ee for aggregate {{(pid=136681) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:25.777895 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ebc33b22-a1c1-4271-a8b0-67cfa9d13dc1 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055799 May 07 21:46:25.784416 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 116/256] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.808506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-089010be-a9f3-422d-83d3-081d2c08f15a tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.811013 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.811013 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:25.824968 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-089010be-a9f3-422d-83d3-081d2c08f15a tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 227 microversion: 2.1 time: 0.033188 May 07 21:46:25.832443 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 117/257] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/os-aggregates/16 => generated 227 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.838214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-af4dc576-316f-407f-85b4-62771e09a2f9 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:25.840981 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.840981 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:25.886069 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-af4dc576-316f-407f-85b4-62771e09a2f9 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 265 microversion: 2.1 time: 0.048112 May 07 21:46:25.894794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 118/258] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 21:46:25 2022] POST /compute/v2.1/os-aggregates/16/action => generated 265 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.904232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1829a289-52ea-4fc5-a957-deaf224095e7 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.906536 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.906536 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:25.926682 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1829a289-52ea-4fc5-a957-deaf224095e7 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 241 microversion: 2.1 time: 0.029943 May 07 21:46:25.937129 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 119/259] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/os-aggregates/16 => generated 241 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:25.945690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-38c110b2-4383-48da-80d1-99817e385bca tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:25.950053 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:25.950053 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:25.981935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.014914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.025195 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-38c110b2-4383-48da-80d1-99817e385bca tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.086979 May 07 21:46:26.030629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 120/260] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:25 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:26.039031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.041049 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-362a57e9-df38-40fe-8056-289430baad65 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1361 microversion: 2.25 time: 0.528385 May 07 21:46:26.041875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:26.042511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:26.042968 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 141/261] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:25 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1361 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:26.050008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-54c1cb54-44bd-4e51-8fad-71713e4136dc req-d43b909b-e5dc-4eb5-be3d-94f5998345d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51", "tag": "940b7f63-241e-47cd-901d-cf63ff106764"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:26.063831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-54c1cb54-44bd-4e51-8fad-71713e4136dc req-d43b909b-e5dc-4eb5-be3d-94f5998345d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.064833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-54c1cb54-44bd-4e51-8fad-71713e4136dc req-d43b909b-e5dc-4eb5-be3d-94f5998345d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.082252 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-54c1cb54-44bd-4e51-8fad-71713e4136dc req-d43b909b-e5dc-4eb5-be3d-94f5998345d2 service nova] Creating event network-changed:940b7f63-241e-47cd-901d-cf63ff106764 for instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 on nch1-master-1 May 07 21:46:26.084012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.085760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.086617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.091888 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-54c1cb54-44bd-4e51-8fad-71713e4136dc req-d43b909b-e5dc-4eb5-be3d-94f5998345d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046746 May 07 21:46:26.093064 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 142/262] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:26.100606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d591272-c4c1-4288-9759-1e071f138185 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1515204164", "availability_zone": "tempest-test_az-1293472431"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:26.101963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.102704 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:26.102704 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:26.103956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-4d591272-c4c1-4288-9759-1e071f138185 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid ff64cddd-3d07-4af5-9697-3814cf202c43 for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:26.166614 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d591272-c4c1-4288-9759-1e071f138185 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.071996 May 07 21:46:26.167179 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 143/263] 10.222.0.32 () {60 vars in 1164 bytes} [Sat May 7 21:46:26 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:26.180436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:26.182978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:26.193720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.194182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.195467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.195467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.382279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.391907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.394623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.400528 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-33740df0-db89-4099-8484-472fbe53cfe7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.224166 May 07 21:46:26.401311 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 144/264] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:26 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:26.408475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5509fd02-9201-48d8-9579-59c4ccb984e6 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1515204164_new", "availability_zone": "tempest-test_az-1293472431_new"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:26.409938 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:26.409938 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:26.426464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.436591 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-384608cf-f403-4683-8aa2-c2d55c60ca5a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1387 microversion: 2.1 time: 0.404855 May 07 21:46:26.437512 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 121/265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:26 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1387 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:26.472588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5509fd02-9201-48d8-9579-59c4ccb984e6 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.472974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5509fd02-9201-48d8-9579-59c4ccb984e6 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.547305 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5509fd02-9201-48d8-9579-59c4ccb984e6 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 337 microversion: 2.1 time: 0.143480 May 07 21:46:26.548319 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 145/266] 10.222.0.32 () {60 vars in 1172 bytes} [Sat May 7 21:46:26 2022] PUT /compute/v2.1/os-aggregates/17 => generated 337 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:26.560390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88472850-5fc8-4850-ba3b-83593ccf4ba2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:26.564137 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:26.564137 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:26.581693 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88472850-5fc8-4850-ba3b-83593ccf4ba2 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.026460 May 07 21:46:26.588292 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 122/267] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:46:26 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:26.593229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce6adb77-62d8-4de2-9544-abe911dfc204 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:26.593993 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:26.593993 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:26.645297 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce6adb77-62d8-4de2-9544-abe911dfc204 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.055695 May 07 21:46:26.646198 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 123/268] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:26 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:26.657573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:26.658193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:26.675587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.676035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.677015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:26.677591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:26.956871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:26.982388 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-850d8f2f-3a55-42be-b56b-6b09b7b6283b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1313 microversion: 2.1 time: 0.328674 May 07 21:46:26.983104 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 124/269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:26 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:26.988301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f06f253-2ce2-4142-8fee-298d8af4b997 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1119791214"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:26.989864 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:26.989864 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:26.991130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.aggregate [None req-3f06f253-2ce2-4142-8fee-298d8af4b997 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Generated uuid e3772b2f-373f-4e0e-a21b-dd757426c70b for aggregate {{(pid=136681) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 21:46:27.023233 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f06f253-2ce2-4142-8fee-298d8af4b997 tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038996 May 07 21:46:27.024341 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 125/270] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 21:46:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:27.042277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-33abce2f-0f48-417a-bb16-1f05681fa0cd tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:27.043453 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:27.043453 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:27.053770 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-33abce2f-0f48-417a-bb16-1f05681fa0cd tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.022458 May 07 21:46:27.057324 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 126/271] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:46:27 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:27.066703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:27.067846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:27.080779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1272591787", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:27.085149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.085617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.086894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.088157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.189372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:27.294166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:27.306352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:27.308406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:27.310109 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8402eea9-f962-49b1-ac45-8d8bf9242047 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1557 microversion: 2.25 time: 0.251312 May 07 21:46:27.310938 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 127/272] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:27 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1557 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:27.317521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-549b421b-ba09-4e72-8a3f-c85dda75941a tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:27.318910 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:27.318910 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:27.348598 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-549b421b-ba09-4e72-8a3f-c85dda75941a tempest-AggregatesAdminTestJSON-703493066 tempest-AggregatesAdminTestJSON-703493066-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.035913 May 07 21:46:27.349408 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 128/273] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:46:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:27.356078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bdc969a8-3c15-4634-accd-144112e8d7ba req-7fd644f7-64f4-44c6-947d-40cfa7e9f892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0284aa35-4e58-4e15-a194-a500996ed82e", "name": "network-vif-plugged", "status": "completed", "tag": "149155db-c2db-4827-9746-fffdb2d0018e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:27.365674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bdc969a8-3c15-4634-accd-144112e8d7ba req-7fd644f7-64f4-44c6-947d-40cfa7e9f892 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.366458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bdc969a8-3c15-4634-accd-144112e8d7ba req-7fd644f7-64f4-44c6-947d-40cfa7e9f892 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.377123 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bdc969a8-3c15-4634-accd-144112e8d7ba req-7fd644f7-64f4-44c6-947d-40cfa7e9f892 service nova] Creating event network-vif-plugged:149155db-c2db-4827-9746-fffdb2d0018e for instance 0284aa35-4e58-4e15-a194-a500996ed82e on nch2-master-1 May 07 21:46:27.382555 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bdc969a8-3c15-4634-accd-144112e8d7ba req-7fd644f7-64f4-44c6-947d-40cfa7e9f892 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031494 May 07 21:46:27.383267 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 129/274] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:27.489492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:27.490048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:27.490593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:27.491115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:27.491592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:27.513690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.517365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.520507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.522020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.551614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Getting quotas for project 3a25839617304e069e93d96029612c18. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:27.557991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Getting quotas for user e9d562828c3241d0a5d0f2253205c12f and project 3a25839617304e069e93d96029612c18. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:27.572616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:27.575604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:27.639893 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea72d0dc-4595-4817-9760-def360857d80 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077538 May 07 21:46:27.640972 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 146/275] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:46:27.646803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:27.647529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:27.655470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.656186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.657371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.658245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.667839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:27.669832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:27.678900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.679442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.681360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.682508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.684471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] HTTP exception thrown: Instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b could not be found. May 07 21:46:27.685081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Returning 404 to user: Instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:27.685919 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e81199f9-ed8a-4a27-b95c-74b9483833bb tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 404 len: 111 microversion: 2.1 time: 0.043795 May 07 21:46:27.691459 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 147/276] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:46:27 2022] DELETE /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:27.697105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:27.697993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:27.704665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.705120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.706466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.706943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.880521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:27.890891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:27.892834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:27.898917 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5cabe3b-deb8-4cd1-a2cf-1dde3ce7f317 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.206342 May 07 21:46:27.899819 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 148/277] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:27 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:27.911036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:27.914405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:27.926317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.927178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:27.930062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:27.930388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.079535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:28.124567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:28.137412 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7e189171-14ea-4cb1-b496-ba3491d94bc0 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1387 microversion: 2.1 time: 0.236632 May 07 21:46:28.138432 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 149/278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:27 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1387 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:28.143986 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05fbf1cd-51db-4257-8b0a-2f5f715314a0 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 2049 microversion: 2.25 time: 0.759211 May 07 21:46:28.144687 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 130/279] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:27 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 2049 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:28.156174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52bf11f2-d662-4835-a87e-b735f4a4966b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:28.156174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52bf11f2-d662-4835-a87e-b735f4a4966b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:28.163634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:28.164519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] [instance: 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:28.171709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.201045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.203137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.203137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.236265 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] HTTP exception thrown: Instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b could not be found. May 07 21:46:28.237393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] Returning 404 to user: Instance 936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:28.238238 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-46b920b8-5cdc-433f-af02-5e2e63f992ce tempest-AggregatesAdminTestJSON-5216341 tempest-AggregatesAdminTestJSON-5216341-project] 10.222.0.32 "GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b" status: 404 len: 111 microversion: 2.1 time: 0.080576 May 07 21:46:28.238816 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 131/280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:28 2022] GET /compute/v2.1/servers/936ab95e-ea34-4de7-8ee6-3c1b8bc0a64b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:28.247401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:28.248302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:28.258603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.259352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.260318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.260909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.291286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-52bf11f2-d662-4835-a87e-b735f4a4966b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:28.297968 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52bf11f2-d662-4835-a87e-b735f4a4966b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1220 microversion: 2.1 time: 0.157626 May 07 21:46:28.307852 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 150/281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:28 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:28.307852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:28.307852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:28.324245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.324708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.325503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.325947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.477098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:28.487989 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0d9417f1-375a-4b2c-b7bd-6ec3239f997a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1313 microversion: 2.1 time: 0.244220 May 07 21:46:28.490222 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 132/282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:28 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:28.606214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:28.691682 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-70e95f03-19ef-49cb-9c43-c2c5e3e68ac6 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 2049 microversion: 2.25 time: 0.389082 May 07 21:46:28.692269 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 151/283] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:28 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 2049 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:28.710115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-74c6e5fa-6498-4fde-9c33-9177522e142c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:28.712199 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:28.712199 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:28.713436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74c6e5fa-6498-4fde-9c33-9177522e142c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.714490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74c6e5fa-6498-4fde-9c33-9177522e142c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.715494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74c6e5fa-6498-4fde-9c33-9177522e142c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.716119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74c6e5fa-6498-4fde-9c33-9177522e142c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.742288 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-74c6e5fa-6498-4fde-9c33-9177522e142c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036704 May 07 21:46:28.749712 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 133/284] 10.222.0.32 () {60 vars in 1216 bytes} [Sat May 7 21:46:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:28.754460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:28.755764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:28.761887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.762348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.763155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.763594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.866442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'flavor' on Instance uuid 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:28.919401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:28.920324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:28.931700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.932501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.934543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:28.937937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:28.949607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Going to try to live migrate instance to nch1-master-1 {{(pid=136682) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:46:29.167628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:29.186348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:29.196973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:29.209177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a0dfb355-bf3c-48b2-8592-d582e32c7fb8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.294025 May 07 21:46:29.220468 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 134/285] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:28 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:29.226012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:29.234694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:29.244266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:29.246516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:29.248367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:29.249157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:29.572648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:29.586028 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a33cde98-bbc8-4e00-8feb-d208322c6bd1 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1387 microversion: 2.1 time: 0.363665 May 07 21:46:29.586828 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 135/286] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:29 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1387 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:29.602334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:29.603079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:29.613023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:29.613764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:29.615398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:29.616269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:29.723521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:29.736287 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-962823a0-db6f-4bc3-bfb8-f7d1e0bb294d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1278 microversion: 2.1 time: 0.148047 May 07 21:46:29.748712 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 136/287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:29 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:29.760739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:29.762653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:29.777226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:29.778861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:29.779877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:29.781647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:30.128623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:30.137494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-105706ee-3598-4f11-aa10-4ee4ba9e8ce0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1462 microversion: 2.1 time: 0.387043 May 07 21:46:30.140922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 137/288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:29 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1462 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:30.236194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:30.237354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:30.251021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:30.253797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:30.255360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:30.255969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:30.438051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:30.477053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:30.485725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:30.510022 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed58c6c7-f039-4a83-9e49-a9fecc10fd3c tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.279331 May 07 21:46:30.517197 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 138/289] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:30 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:30.534747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-306603525", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0284aa35-4e58-4e15-a194-a500996ed82e"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:30.647341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:31.236095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:31.236764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:31.237012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:31.246285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:31.247087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:31.279384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:31.280705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:31.286033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:31.286791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:31.309753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Getting quotas for project 95946c2e9a5c4a72905d75010a9bb7a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:31.315379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Getting quotas for user e1333f2166c947a4a37dd6865f532f24 and project 95946c2e9a5c4a72905d75010a9bb7a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:31.333678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:31.336696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:31.405586 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b49d4918-d135-435b-b09d-118f0a674823 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884826 May 07 21:46:31.409418 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 139/290] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:46:31.420911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:31.422160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:31.433405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:31.433940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:31.434739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:31.451411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:31.763442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:31.776005 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ae0b5f49-558c-4be9-aa39-7ae7a9fd0737 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1387 microversion: 2.1 time: 0.365320 May 07 21:46:31.777726 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 140/291] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:31 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1387 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:31.783821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:31.784941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:31.792253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:31.792705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:31.793563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:31.794012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.202661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:32.215384 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-25cec0d2-2e97-4b5f-aac5-290fb2a3f954 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1320 microversion: 2.1 time: 0.435035 May 07 21:46:32.224608 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 141/292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:31 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:32.498933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8248ac9b-df4b-4a91-86eb-494b81173dd8 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Calling method '.version_select at 0x7fc41d4793a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:32.500178 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:32.500178 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:32.501331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8248ac9b-df4b-4a91-86eb-494b81173dd8 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.501785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8248ac9b-df4b-4a91-86eb-494b81173dd8 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.502757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8248ac9b-df4b-4a91-86eb-494b81173dd8 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.503749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8248ac9b-df4b-4a91-86eb-494b81173dd8 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.534329 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8248ac9b-df4b-4a91-86eb-494b81173dd8 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.307690 May 07 21:46:32.535302 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 142/293] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:46:32 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:32.540665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:32.541489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:32.547676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.548427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.549468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.550098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.634709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:32.645672 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-39ac131a-61b2-473a-9524-b10e56497c31 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1265 microversion: 2.1 time: 0.109075 May 07 21:46:32.646467 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 143/294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:32 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:32.660647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:32.661344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:32.667979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.668517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.669378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.669959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.750568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:32.760926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:32.762906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:32.768690 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e87dc765-5386-4258-831d-578a33b401a3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.112889 May 07 21:46:32.779383 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 144/295] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:32 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:32.853257 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ad5c058a-13ab-4e61-b369-bb2fb386fc00 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1/action" status: 202 len: 0 microversion: 2.25 time: 4.102995 May 07 21:46:32.854286 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 152/296] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:46:28 2022] POST /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1/action => generated 0 bytes in 4105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:46:32.860124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b296835c-5ad7-41af-a0c0-bded9a47ae64 req-4bd52047-f62b-408c-800a-078585cbf0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51", "name": "network-vif-plugged", "status": "completed", "tag": "940b7f63-241e-47cd-901d-cf63ff106764"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:32.878341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b296835c-5ad7-41af-a0c0-bded9a47ae64 req-4bd52047-f62b-408c-800a-078585cbf0be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.882920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b296835c-5ad7-41af-a0c0-bded9a47ae64 req-4bd52047-f62b-408c-800a-078585cbf0be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.902695 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b296835c-5ad7-41af-a0c0-bded9a47ae64 req-4bd52047-f62b-408c-800a-078585cbf0be service nova] Creating event network-vif-plugged:940b7f63-241e-47cd-901d-cf63ff106764 for instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 on nch1-master-1 May 07 21:46:32.908994 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b296835c-5ad7-41af-a0c0-bded9a47ae64 req-4bd52047-f62b-408c-800a-078585cbf0be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052685 May 07 21:46:32.910068 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 153/297] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:32.920963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-18ece145-4b6d-4739-bc6f-4bccc764ed01 req-392584e3-6991-42d8-85e4-3ffb332269d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5158d992-548d-41d0-a26a-a1dae158fea9", "tag": "4640c625-b0a9-4880-8c33-cabac320668c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:32.935348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-18ece145-4b6d-4739-bc6f-4bccc764ed01 req-392584e3-6991-42d8-85e4-3ffb332269d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:32.937491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-18ece145-4b6d-4739-bc6f-4bccc764ed01 req-392584e3-6991-42d8-85e4-3ffb332269d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:32.962549 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-18ece145-4b6d-4739-bc6f-4bccc764ed01 req-392584e3-6991-42d8-85e4-3ffb332269d2 service nova] Creating event network-changed:4640c625-b0a9-4880-8c33-cabac320668c for instance 5158d992-548d-41d0-a26a-a1dae158fea9 on nch1-master-1 May 07 21:46:32.972797 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-18ece145-4b6d-4739-bc6f-4bccc764ed01 req-392584e3-6991-42d8-85e4-3ffb332269d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058553 May 07 21:46:32.973713 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 154/298] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:33.031059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2055758870", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "d3775254-6c3d-4b27-a2f1-ae073d9f981d"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:33.107804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] validate_networks() for [('d3775254-6c3d-4b27-a2f1-ae073d9f981d', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:33.233864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ab61ee6-a5fd-4fc7-b22e-f5e59cc2e335 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Calling method '.version_select at 0x7fc41d323d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:33.235237 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:33.235237 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:33.236508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ab61ee6-a5fd-4fc7-b22e-f5e59cc2e335 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '29af2195a7f94f5a8762b462d22d778e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bcaac9caa425f8f2149045d4ae170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:33.237213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ab61ee6-a5fd-4fc7-b22e-f5e59cc2e335 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:33.238090 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1ab61ee6-a5fd-4fc7-b22e-f5e59cc2e335 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.259744 May 07 21:46:33.238682 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 155/299] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:46:32 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 264 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:33.246833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:33.247643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:33.253861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.254381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.255276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.255783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.390064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:33.398332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd76f704-c98b-4669-8b32-479dfecf0bfc tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1387 microversion: 2.1 time: 0.158607 May 07 21:46:33.399153 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 156/300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:33 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1387 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:33.403474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:33.404315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:33.410639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.411391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.412189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.412624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.541707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:33.551430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:33.553358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:33.554539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-35b638a2-811e-489d-82e7-df8cd2cf2889 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.154651 May 07 21:46:33.555892 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 157/301] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:33 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:33.620055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bbdbd846-5726-408e-89b4-9e7b850c1067 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-109492140", "ram": 512, "vcpus": 1, "disk": 10, "id": 764831143, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:33.622243 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:33.622243 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:33.640723 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bbdbd846-5726-408e-89b4-9e7b850c1067 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.083392 May 07 21:46:33.641792 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 158/302] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:33 2022] POST /compute/v2.1/flavors => generated 412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:33.656490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:33.657328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:33.675195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.675837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.677398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.677858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.774853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:33.775300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:33.775732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:33.776894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:33.777385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:33.791316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.791768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.792821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:33.793251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:33.816801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:33.825768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for user c562e7dec6d34cd0a7fc7cea14fa5e74 and project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:33.839897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:33.845879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:33.901952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fb21e2cb-44c6-4453-98f7-3ae5253afc90 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121212 May 07 21:46:33.912218 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 145/303] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:46:33.918042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c72f2a9-58bf-466a-9aec-70dc394af21e tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Calling method '.version_select at 0x7fc41d478790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:33.919164 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:33.919164 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:33.920700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5c72f2a9-58bf-466a-9aec-70dc394af21e tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '29af2195a7f94f5a8762b462d22d778e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bcaac9caa425f8f2149045d4ae170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:33.921724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c72f2a9-58bf-466a-9aec-70dc394af21e tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:33.922719 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5c72f2a9-58bf-466a-9aec-70dc394af21e tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009322 May 07 21:46:33.923794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 146/304] 10.222.0.32 () {58 vars in 1190 bytes} [Sat May 7 21:46:33 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:33.936313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-756e9f11-b4bc-40d5-bd17-d2b7414e350a tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:33.938111 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:33.938111 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:33.985464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-756e9f11-b4bc-40d5-bd17-d2b7414e350a tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/764831143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059627 May 07 21:46:33.986577 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 147/305] 10.222.0.32 () {60 vars in 1220 bytes} [Sat May 7 21:46:33 2022] POST /compute/v2.1/flavors/764831143/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:33.997064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:33.997064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:34.012714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.013542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.014473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.015084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.177561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.187053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.187661 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27ec10ec-7cb7-46ad-80f0-ac2b83990d2b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1271 microversion: 2.1 time: 0.197936 May 07 21:46:34.187949 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 148/306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:33 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:34.196426 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-40eae895-09cc-4324-aa10-6f9e7438d8ab tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1320 microversion: 2.1 time: 0.552475 May 07 21:46:34.209265 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 159/307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:33 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1320 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:34.213027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.217732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:34.223121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7285c9ce-7188-4ec7-8398-0a4c909c4e9d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.223846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7285c9ce-7188-4ec7-8398-0a4c909c4e9d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:34.246508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.247537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.248711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.249478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.306069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7285c9ce-7188-4ec7-8398-0a4c909c4e9d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.313471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7285c9ce-7188-4ec7-8398-0a4c909c4e9d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1208 microversion: 2.1 time: 0.102866 May 07 21:46:34.314408 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 160/308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:34.319717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e7ae3fa-8a62-49db-bba2-98f4e9f8b7a4 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Calling method '.version_select at 0x7fc41d2c6ee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.320570 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.320570 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:34.328812 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-6e7ae3fa-8a62-49db-bba2-98f4e9f8b7a4 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 07 21:46:34.329636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e7ae3fa-8a62-49db-bba2-98f4e9f8b7a4 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.331297 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e7ae3fa-8a62-49db-bba2-98f4e9f8b7a4 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.015270 May 07 21:46:34.336297 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 161/309] 10.222.0.32 () {58 vars in 1211 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:34.363911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.374893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.378538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.393679 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8c6dee9d-0353-4a37-9a49-9ecdb873f1f8 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.198374 May 07 21:46:34.406807 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 149/310] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:34.418938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d450b5af-c4b1-4e1f-adeb-edf01ab9d0b3 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Calling method '.version_select at 0x7fc41d5f4040>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.422827 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.422827 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:34.424679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d450b5af-c4b1-4e1f-adeb-edf01ab9d0b3 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '29af2195a7f94f5a8762b462d22d778e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bcaac9caa425f8f2149045d4ae170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.428367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d450b5af-c4b1-4e1f-adeb-edf01ab9d0b3 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.430601 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d450b5af-c4b1-4e1f-adeb-edf01ab9d0b3 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.023960 May 07 21:46:34.432922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 150/311] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:34.449031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.450322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:34.473149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.474466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.478560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.480263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.571253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cbd19989-bf13-446c-b7b7-4f35ed8dcf09 tempest-FlavorsExtraSpecsTestJSON-2101855452 tempest-FlavorsExtraSpecsTestJSON-2101855452-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.606752 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cbd19989-bf13-446c-b7b7-4f35ed8dcf09 tempest-FlavorsExtraSpecsTestJSON-2101855452 tempest-FlavorsExtraSpecsTestJSON-2101855452-project] 10.222.0.32 "GET /compute/v2.1/flavors/764831143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.268846 May 07 21:46:34.608306 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 162/312] 10.222.0.32 () {58 vars in 1199 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/flavors/764831143/os-extra_specs => generated 66 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:34.615934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4773d192-ffb7-4339-9622-8fa6da79c064 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Calling method '.version_select at 0x7fc41d323b80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.617026 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.617026 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:34.627526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-4773d192-ffb7-4339-9622-8fa6da79c064 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 07 21:46:34.629071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4773d192-ffb7-4339-9622-8fa6da79c064 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.630765 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4773d192-ffb7-4339-9622-8fa6da79c064 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020712 May 07 21:46:34.639968 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 163/313] 10.222.0.32 () {58 vars in 1190 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:34.648243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.648931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:34.659920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.660722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.661728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:34.662368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:34.756817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.764355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f679c7cd-0c4f-4768-964f-73ad9d92218f tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1387 microversion: 2.1 time: 0.327275 May 07 21:46:34.764935 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 151/314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1387 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:34.773156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-471b23f1-7073-42ef-be7c-ccf4e5b17ecd tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.774666 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.774666 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:34.796888 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-471b23f1-7073-42ef-be7c-ccf4e5b17ecd tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/764831143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027747 May 07 21:46:34.799702 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 152/315] 10.222.0.32 () {60 vars in 1220 bytes} [Sat May 7 21:46:34 2022] POST /compute/v2.1/flavors/764831143/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:34.805208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39674580-84c9-416b-ad59-35d0c79940b1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Calling method '.version_select at 0x7fc41d752790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.806267 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.806267 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:34.807408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-39674580-84c9-416b-ad59-35d0c79940b1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '29af2195a7f94f5a8762b462d22d778e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bcaac9caa425f8f2149045d4ae170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.808055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39674580-84c9-416b-ad59-35d0c79940b1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.808882 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-39674580-84c9-416b-ad59-35d0c79940b1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.007963 May 07 21:46:34.813700 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 153/316] 10.222.0.32 () {58 vars in 1196 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:34.820503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0460942-7e8a-42d8-ab26-c313e14ee009 tempest-FlavorsExtraSpecsTestJSON-2101855452 tempest-FlavorsExtraSpecsTestJSON-2101855452-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.831623 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f0460942-7e8a-42d8-ab26-c313e14ee009 tempest-FlavorsExtraSpecsTestJSON-2101855452 tempest-FlavorsExtraSpecsTestJSON-2101855452-project] 10.222.0.32 "GET /compute/v2.1/flavors/764831143/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016810 May 07 21:46:34.832191 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 154/317] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/flavors/764831143/os-extra_specs/hw:numa_nodes => generated 22 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:34.838067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64739fc6-7ce1-41b9-a3b1-a8a07a674cb6 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Calling method '.version_select at 0x7fc41d4785e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.847651 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-64739fc6-7ce1-41b9-a3b1-a8a07a674cb6 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 07 21:46:34.847814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64739fc6-7ce1-41b9-a3b1-a8a07a674cb6 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.848564 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-64739fc6-7ce1-41b9-a3b1-a8a07a674cb6 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.015290 May 07 21:46:34.849687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.853616 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 155/318] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:34.859057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0cbad15b-e52c-41dc-9881-c925edb7037e tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.864058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.866319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.867775 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-def28404-0e96-46f5-935d-9234c550a577 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.226615 May 07 21:46:34.868988 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 164/319] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:34.875793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7db01999-af8f-4a6d-8d41-1910ff139fd1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Calling method '.version_select at 0x7fc41d4033a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.877981 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.877981 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:34.881191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7db01999-af8f-4a6d-8d41-1910ff139fd1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '29af2195a7f94f5a8762b462d22d778e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bcaac9caa425f8f2149045d4ae170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.882063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7db01999-af8f-4a6d-8d41-1910ff139fd1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.883229 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7db01999-af8f-4a6d-8d41-1910ff139fd1 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.012746 May 07 21:46:34.884554 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 165/320] 10.222.0.32 () {58 vars in 1193 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:34.894529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57ddeefe-f0c4-42cc-8299-b436df033d38 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Calling method '.version_select at 0x7fc41d2c6160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.905218 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-57ddeefe-f0c4-42cc-8299-b436df033d38 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 07 21:46:34.906488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57ddeefe-f0c4-42cc-8299-b436df033d38 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.907508 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57ddeefe-f0c4-42cc-8299-b436df033d38 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017807 May 07 21:46:34.909059 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 166/321] 10.222.0.32 () {58 vars in 1214 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:34.914998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0cbad15b-e52c-41dc-9881-c925edb7037e tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/764831143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.060108 May 07 21:46:34.919479 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 156/322] 10.222.0.32 () {60 vars in 1220 bytes} [Sat May 7 21:46:34 2022] POST /compute/v2.1/flavors/764831143/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:34.927777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ffe4b7a9-c1b6-472d-9702-2713031ff45c tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d732550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.930408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ffe4b7a9-c1b6-472d-9702-2713031ff45c tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.931941 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ffe4b7a9-c1b6-472d-9702-2713031ff45c tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.018139 May 07 21:46:34.932763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06947f5e-23b3-4ef8-ad47-a6cba9a3221a tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:34.933154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 167/323] 10.222.0.32 () {60 vars in 1189 bytes} [Sat May 7 21:46:34 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 07 21:46:34.943353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-825fe4a1-6012-4323-9507-90a95e814149 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d2c6550>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.944722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-825fe4a1-6012-4323-9507-90a95e814149 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.946236 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-825fe4a1-6012-4323-9507-90a95e814149 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.008513 May 07 21:46:34.947726 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 168/324] 10.222.0.32 () {60 vars in 1189 bytes} [Sat May 7 21:46:34 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 07 21:46:34.948429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06947f5e-23b3-4ef8-ad47-a6cba9a3221a tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/764831143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027440 May 07 21:46:34.955026 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 157/325] 10.222.0.32 () {58 vars in 1199 bytes} [Sat May 7 21:46:34 2022] GET /compute/v2.1/flavors/764831143/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 07 21:46:34.963139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9336321c-1252-4832-9abf-ae3194716211 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Action: 'update', calling method: .version_select at 0x7fc41d403f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.964579 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.964579 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:34.966686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-042a9a97-064b-42db-8d37-d047caf3b07a tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.967171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9336321c-1252-4832-9abf-ae3194716211 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '29af2195a7f94f5a8762b462d22d778e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bcaac9caa425f8f2149045d4ae170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:34.969237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9336321c-1252-4832-9abf-ae3194716211 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.969973 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:34.969973 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:34.970655 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9336321c-1252-4832-9abf-ae3194716211 tempest-HostsAdminNegativeTestJSON-1784737444 tempest-HostsAdminNegativeTestJSON-1784737444-project] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.012199 May 07 21:46:34.972101 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 169/326] 10.222.0.32 () {60 vars in 1189 bytes} [Sat May 7 21:46:34 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:34.981764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-42abdc57-89f1-4bb4-bd30-cee32b67cf7b tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d323b80>, body: {"status": null, "maintenance_mode": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.983186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-42abdc57-89f1-4bb4-bd30-cee32b67cf7b tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:34.984150 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-42abdc57-89f1-4bb4-bd30-cee32b67cf7b tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.006418 May 07 21:46:34.985771 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 170/327] 10.222.0.32 () {60 vars in 1189 bytes} [Sat May 7 21:46:34 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:46:34.994915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88287929-af8d-439d-9df5-9fc3e9d7c0b9 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d80cf70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:34.998370 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.hosts [None req-88287929-af8d-439d-9df5-9fc3e9d7c0b9 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Enabling host nonexistent_hostname. May 07 21:46:35.012289 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-88287929-af8d-439d-9df5-9fc3e9d7c0b9 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 07 21:46:35.014336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88287929-af8d-439d-9df5-9fc3e9d7c0b9 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:35.015479 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88287929-af8d-439d-9df5-9fc3e9d7c0b9 tempest-HostsAdminNegativeTestJSON-1718348176 tempest-HostsAdminNegativeTestJSON-1718348176-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024045 May 07 21:46:35.016741 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 171/328] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:46:34 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:46:35.028885 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-042a9a97-064b-42db-8d37-d047caf3b07a tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/764831143/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.070048 May 07 21:46:35.033375 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 158/329] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:46:34 2022] PUT /compute/v2.1/flavors/764831143/os-extra_specs/hw:numa_nodes => generated 22 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:35.040151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3ca969b1-c01f-4726-bb7c-b5bf947d35e9 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.051088 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3ca969b1-c01f-4726-bb7c-b5bf947d35e9 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/764831143/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016143 May 07 21:46:35.051901 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 172/330] 10.222.0.32 () {58 vars in 1199 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/flavors/764831143/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:35.062101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f22c4213-49c3-4539-a7e3-3fb0df971022 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.062942 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:35.062942 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:35.128022 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f22c4213-49c3-4539-a7e3-3fb0df971022 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/764831143/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.070326 May 07 21:46:35.131026 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 159/331] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 21:46:35 2022] DELETE /compute/v2.1/flavors/764831143/os-extra_specs/hw:numa_nodes => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 21:46:35.139893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed98a917-b0df-4644-aeaf-5f5a5baa7f3e tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.141088 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:35.141088 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:35.167675 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed98a917-b0df-4644-aeaf-5f5a5baa7f3e tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/764831143/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.033505 May 07 21:46:35.171675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 173/332] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 21:46:35 2022] DELETE /compute/v2.1/flavors/764831143/os-extra_specs/hw:cpu_policy => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 07 21:46:35.177729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-09549a23-f4cb-4144-92c3-f46d0e1b8cb4 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.189053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-09549a23-f4cb-4144-92c3-f46d0e1b8cb4 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/764831143/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015634 May 07 21:46:35.189581 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 160/333] 10.222.0.32 () {58 vars in 1199 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/flavors/764831143/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:35.201642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd67ce61-fc84-40d0-8e1d-56f49e88fc85 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.203056 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:35.203056 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:46:35.204649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.205322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:35.220501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.221537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.222396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.223110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.239979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd67ce61-fc84-40d0-8e1d-56f49e88fc85 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/764831143" status: 202 len: 0 microversion: 2.1 time: 0.043849 May 07 21:46:35.244917 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 174/334] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:46:35 2022] DELETE /compute/v2.1/flavors/764831143 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:46:35.250872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.251578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:35.258609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.259329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.260119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.260788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.416792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:35.425433 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-429dc15b-8972-4d62-a5ec-28c49f178cce tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1320 microversion: 2.1 time: 0.179322 May 07 21:46:35.426020 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 175/335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:35.431454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b05f4f60-f68c-466f-9256-7abf61e7d553 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.464938 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b05f4f60-f68c-466f-9256-7abf61e7d553 tempest-FlavorsExtraSpecsTestJSON-1864698941 tempest-FlavorsExtraSpecsTestJSON-1864698941-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.037658 May 07 21:46:35.473270 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 176/336] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:35.473270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.473270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:35.479104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.479564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.480351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.480793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.496904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:35.510964 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb8f9509-5e62-4195-b9d2-86e16463d692 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1313 microversion: 2.1 time: 0.304472 May 07 21:46:35.511631 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 161/337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:35.520163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.520163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:35.535194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.535517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.536371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.536812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.583313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:35.599205 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2a7af765-0797-4023-8087-b681d8c239cf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1260 microversion: 2.1 time: 0.132140 May 07 21:46:35.602355 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 177/338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1260 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:35.710084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:35.731686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:35.736784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:35.754378 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff894ca3-ec1c-4bcb-9716-7f02ef33e20a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.241591 May 07 21:46:35.769410 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 162/339] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:35.782317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.783149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:35.801376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.802673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.804212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.805871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.887595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:35.889950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:35.900969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.901425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:35.919992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:35.920985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.360387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:36.371352 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f655b44b-43c6-4737-b5a0-5a7c9b33b236 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1586 microversion: 2.1 time: 0.593699 May 07 21:46:36.372616 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 178/340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1586 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:36.378399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dcfc59cf-5256-4a12-881b-bd21df90be37 req-c03b5f97-907f-4b9f-a20b-24d166b1401d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9c13b6-ebdb-426f-81a7-663cba33645a", "tag": "1f353eba-6503-4549-810d-34664c1775fa"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:36.392118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dcfc59cf-5256-4a12-881b-bd21df90be37 req-c03b5f97-907f-4b9f-a20b-24d166b1401d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.393017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dcfc59cf-5256-4a12-881b-bd21df90be37 req-c03b5f97-907f-4b9f-a20b-24d166b1401d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.413563 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dcfc59cf-5256-4a12-881b-bd21df90be37 req-c03b5f97-907f-4b9f-a20b-24d166b1401d service nova] Creating event network-changed:1f353eba-6503-4549-810d-34664c1775fa for instance ad9c13b6-ebdb-426f-81a7-663cba33645a on nch2-master-1 May 07 21:46:36.423383 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dcfc59cf-5256-4a12-881b-bd21df90be37 req-c03b5f97-907f-4b9f-a20b-24d166b1401d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048169 May 07 21:46:36.425904 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 179/341] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:36.433442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cda1e92e-30ee-4a7d-afbd-ef6da948c045 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:36.434275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cda1e92e-30ee-4a7d-afbd-ef6da948c045 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:36.446071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cda1e92e-30ee-4a7d-afbd-ef6da948c045 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.447932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cda1e92e-30ee-4a7d-afbd-ef6da948c045 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.449420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cda1e92e-30ee-4a7d-afbd-ef6da948c045 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.449879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cda1e92e-30ee-4a7d-afbd-ef6da948c045 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.485656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:36.495190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:36.497010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:36.498489 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b70cfa05-a253-473e-8f1b-4d82aeb27390 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.615243 May 07 21:46:36.499216 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 163/342] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:35 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:36.504744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:36.506233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:36.523916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.524646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.525605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.526228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.563031 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cda1e92e-30ee-4a7d-afbd-ef6da948c045 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135482 May 07 21:46:36.563618 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 180/343] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:46:36 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:36.575589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:36.575589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:36.582360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.582862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.583650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.584084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.862481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:36.875434 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4231f02d-744f-45fe-b8c4-a8318b758b61 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1320 microversion: 2.1 time: 0.374282 May 07 21:46:36.876562 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 164/344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:36 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1320 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:36.882169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:36.883198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:36.890910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.892394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:36.896742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:36.896742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.015979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.025015 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-466260f3-09a4-4722-b8b3-a8c8371de548 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1313 microversion: 2.1 time: 0.458287 May 07 21:46:37.031590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 181/345] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:36 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:37.031590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:37.031590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:37.039550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.040325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.041267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.042570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.051281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.060390 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d373d879-d6d6-49a4-9197-8682be2c4af2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1266 microversion: 2.1 time: 0.182505 May 07 21:46:37.061299 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 165/346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:36 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:37.066672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d020c628-adf7-48eb-873e-1320136de439 req-06bd633b-490c-4b55-b589-526701fdface service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52713c0c-6d75-42a3-96ac-5a93b17ef0b1", "name": "network-vif-unplugged", "status": "completed", "tag": "8fc97b61-6eb0-420e-adf9-104bdbfbc835"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:37.076047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d020c628-adf7-48eb-873e-1320136de439 req-06bd633b-490c-4b55-b589-526701fdface service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.076785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d020c628-adf7-48eb-873e-1320136de439 req-06bd633b-490c-4b55-b589-526701fdface service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.089501 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d020c628-adf7-48eb-873e-1320136de439 req-06bd633b-490c-4b55-b589-526701fdface service nova] Creating event network-vif-unplugged:8fc97b61-6eb0-420e-adf9-104bdbfbc835 for instance 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 on nch2-master-1 May 07 21:46:37.103633 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d020c628-adf7-48eb-873e-1320136de439 req-06bd633b-490c-4b55-b589-526701fdface service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032823 May 07 21:46:37.104286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 166/347] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:37.148819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.164456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.167126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.174811 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d43360c0-f306-4a21-985f-7b54d76328ac tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.147575 May 07 21:46:37.182561 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 182/348] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:37 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:37.520338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:37.520945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:37.527830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.528411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.529425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.529945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.854197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.866706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.872350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:37.876127 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b598c43d-081c-4bb6-a8d9-6535cb004ac4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.361799 May 07 21:46:37.880066 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 167/349] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:37 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:37.898421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:37.899924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:37.908017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.912862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-506f480d-9fdb-485d-ad81-fd89cef0eb69 req-8155c9ef-ea60-42c9-8065-24099d6328cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5158d992-548d-41d0-a26a-a1dae158fea9", "name": "network-vif-plugged", "status": "completed", "tag": "4640c625-b0a9-4880-8c33-cabac320668c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:37.916637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.917671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.918126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:37.924662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-506f480d-9fdb-485d-ad81-fd89cef0eb69 req-8155c9ef-ea60-42c9-8065-24099d6328cc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:37.926128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-506f480d-9fdb-485d-ad81-fd89cef0eb69 req-8155c9ef-ea60-42c9-8065-24099d6328cc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.012354 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-506f480d-9fdb-485d-ad81-fd89cef0eb69 req-8155c9ef-ea60-42c9-8065-24099d6328cc service nova] Creating event network-vif-plugged:4640c625-b0a9-4880-8c33-cabac320668c for instance 5158d992-548d-41d0-a26a-a1dae158fea9 on nch1-master-1 May 07 21:46:38.036460 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-506f480d-9fdb-485d-ad81-fd89cef0eb69 req-8155c9ef-ea60-42c9-8065-24099d6328cc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131152 May 07 21:46:38.037535 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 168/350] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:38.056253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:38.065926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:38.094133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.095856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.096713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.097162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.495152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:38.506366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-104a41a3-1a07-4776-bb85-45be0240ac1f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1320 microversion: 2.1 time: 0.612675 May 07 21:46:38.507320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 183/351] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:37 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1320 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:38.514158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:38.516573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:38.523701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.524430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.525437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.526056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.669664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:38.681503 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc08132a-4fc2-40d2-87cd-a8fb1b9eb91c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1313 microversion: 2.1 time: 0.628614 May 07 21:46:38.682358 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 169/352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:38 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:38.699795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:38.715048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:38.722948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.723486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.724592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.725141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.734900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:38.744303 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c1cbd00d-3e6f-4ba8-b622-028d54d0b391 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1308 microversion: 2.1 time: 0.235758 May 07 21:46:38.746522 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 184/353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:38 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:38.844886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:38.857808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:38.860821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:38.867502 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3f49a21-914c-428f-991b-2457a343ce98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.174187 May 07 21:46:38.868563 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 170/354] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:38 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:38.899465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:38.900151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:38.908788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.910340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.912298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.913454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.936154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:38.937216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:38.950965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.952186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:38.954162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:38.955455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:39.243361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:39.254447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:39.257162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:39.260458 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-65bd270a-faf9-499e-995f-d74276ec0536 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.365123 May 07 21:46:39.274957 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 185/355] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:38 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:39.285938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8630d700-a2b7-475b-88db-df0006c7c854 req-a500eef7-767f-4878-9d60-0bf1f2f4e56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52713c0c-6d75-42a3-96ac-5a93b17ef0b1", "tag": "8fc97b61-6eb0-420e-adf9-104bdbfbc835"}, {"name": "network-changed", "server_uuid": "ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51", "tag": "940b7f63-241e-47cd-901d-cf63ff106764"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:39.301364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8630d700-a2b7-475b-88db-df0006c7c854 req-a500eef7-767f-4878-9d60-0bf1f2f4e56d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:39.301934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8630d700-a2b7-475b-88db-df0006c7c854 req-a500eef7-767f-4878-9d60-0bf1f2f4e56d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:39.357755 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8630d700-a2b7-475b-88db-df0006c7c854 req-a500eef7-767f-4878-9d60-0bf1f2f4e56d service nova] Creating event network-changed:8fc97b61-6eb0-420e-adf9-104bdbfbc835 for instance 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 on nch2-master-1 May 07 21:46:39.358311 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8630d700-a2b7-475b-88db-df0006c7c854 req-a500eef7-767f-4878-9d60-0bf1f2f4e56d service nova] Creating event network-changed:940b7f63-241e-47cd-901d-cf63ff106764 for instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 on nch1-master-1 May 07 21:46:39.395661 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8630d700-a2b7-475b-88db-df0006c7c854 req-a500eef7-767f-4878-9d60-0bf1f2f4e56d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.117572 May 07 21:46:39.399257 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 186/356] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:39.507966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:39.521313 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9fcffd6c-3555-4de1-a4f3-bf21e9960590 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 200 len: 1586 microversion: 2.1 time: 0.589122 May 07 21:46:39.522934 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 171/357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:38 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 1586 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:39.524383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:39.525103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:39.553876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:39.557053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:39.558956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:39.559598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:39.701007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:39.702589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:39.711604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:39.713657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:39.715878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:39.716495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.046270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:40.057775 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-feb34f2f-a464-4824-a7ce-4b0bce6b3f6c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1313 microversion: 2.1 time: 0.360801 May 07 21:46:40.060843 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 172/358] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:39 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:40.072464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:40.073583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:40.102330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:40.104135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.105476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:40.107171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.549852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:40.558731 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1d1be75-ca51-4fea-a70a-525681d67a64 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1308 microversion: 2.1 time: 0.496015 May 07 21:46:40.560758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:40.565683 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 173/359] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:40 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:40.569526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3dcf7c1b-360f-4d08-a566-f016b395f524 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1320 microversion: 2.1 time: 1.049568 May 07 21:46:40.570108 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 187/360] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:39 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1320 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:40.583808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-bb2ba00b-0c16-4749-80b4-2a35e1ff8cb3 req-310ab3c2-1e75-4e3b-8449-d4d6901a0ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63bd05ee-f966-4884-89dc-17c61c1942fe", "tag": "1520ea65-2c7b-46a7-8360-d42695eee536"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:40.587384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:40.606243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:40.608036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:40.611178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bb2ba00b-0c16-4749-80b4-2a35e1ff8cb3 req-310ab3c2-1e75-4e3b-8449-d4d6901a0ac4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:40.611840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bb2ba00b-0c16-4749-80b4-2a35e1ff8cb3 req-310ab3c2-1e75-4e3b-8449-d4d6901a0ac4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.616666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.620032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:40.620623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.634926 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-bb2ba00b-0c16-4749-80b4-2a35e1ff8cb3 req-310ab3c2-1e75-4e3b-8449-d4d6901a0ac4 service nova] Creating event network-changed:1520ea65-2c7b-46a7-8360-d42695eee536 for instance 63bd05ee-f966-4884-89dc-17c61c1942fe on nch1-master-1 May 07 21:46:40.640594 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-bb2ba00b-0c16-4749-80b4-2a35e1ff8cb3 req-310ab3c2-1e75-4e3b-8449-d4d6901a0ac4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065018 May 07 21:46:40.644173 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 188/361] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:40.664009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:40.664713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:40.676637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:40.677681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.682404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:40.682404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:40.747762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:40.759395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:40.766830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:40.779034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61a14b91-e5d9-4078-bdf3-4a7c5e14a270 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.211830 May 07 21:46:40.780365 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 174/362] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:40 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:41.026817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1500935267", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:41.055087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:41.065649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:41.068027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:41.070631 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b760d746-da13-410d-ba69-38c3e97944e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.425266 May 07 21:46:41.073496 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 189/363] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:40 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:41.082097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:41.082721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:41.088330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:41.096866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.109561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.110471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.110957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.292607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:41.303935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7090cfc2-4d7c-4184-b911-bab19ea0c015 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1313 microversion: 2.1 time: 0.227155 May 07 21:46:41.305089 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 190/364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:41 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:41.333003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:41.333445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:41.333929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:41.334381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:41.334827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:41.344403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.344850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.346208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.346664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.365750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:41.369749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for user 3eb85bfb49aa4a519099c6f43ac77099 and project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:41.381168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:41.385920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:41.429515 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d2a46402-cbe9-455b-bc1b-2885fd70e197 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646814 May 07 21:46:41.430142 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 175/365] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:46:41.439986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4f509f4-2e8c-49d9-a72b-48480d3cb80c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:41.440817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4f509f4-2e8c-49d9-a72b-48480d3cb80c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:41.506154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4f509f4-2e8c-49d9-a72b-48480d3cb80c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:41.513525 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4f509f4-2e8c-49d9-a72b-48480d3cb80c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1213 microversion: 2.1 time: 0.077373 May 07 21:46:41.514300 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 191/366] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:41 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:41.582474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:41.583244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:41.589416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.589871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.590630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.591100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.684525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d58f6d19-67aa-49b4-ab2d-fd127f5362ae tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1834301600", "id": 588835728, "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:41.686190 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:41.686190 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:41.709575 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d58f6d19-67aa-49b4-ab2d-fd127f5362ae tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.157459 May 07 21:46:41.710067 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 176/367] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:46:41 2022] POST /compute/v2.1/flavors => generated 465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:41.715368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:41.715985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:41.733322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.733322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.734010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:41.734458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:41.782665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:41.796649 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d823019c-6674-46a4-bdcc-76aae9537355 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1308 microversion: 2.1 time: 0.219264 May 07 21:46:41.806921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 192/368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:41 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:41.982307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:41.998116 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b146cb89-6953-49b6-8bda-12bb10137c38 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1470 microversion: 2.1 time: 0.286371 May 07 21:46:41.998952 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 177/369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:41 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1470 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:42.012023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.012895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:42.034517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.035013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.036818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.037619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.037821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce0d2df6-ee6a-44da-bf87-06fa59ea8850 tempest-FlavorsV261TestJSON-399243316 tempest-FlavorsV261TestJSON-399243316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.052198 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce0d2df6-ee6a-44da-bf87-06fa59ea8850 tempest-FlavorsV261TestJSON-399243316 tempest-FlavorsV261TestJSON-399243316-project] 10.222.0.32 "GET /compute/v2.1/flavors/588835728" status: 200 len: 465 microversion: 2.61 time: 0.241479 May 07 21:46:42.060285 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 193/370] 10.222.0.32 () {60 vars in 1195 bytes} [Sat May 7 21:46:41 2022] GET /compute/v2.1/flavors/588835728 => generated 465 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:42.149338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.158040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.159826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.165526 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa4ca41c-8544-4220-ae64-309c6f17fde9 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.165445 May 07 21:46:42.166721 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 178/371] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:41 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:42.171396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0f65842-756f-4441-8a18-1ec6babad2ef tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:42.173190 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:42.173190 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:42.202705 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0f65842-756f-4441-8a18-1ec6babad2ef tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/588835728" status: 200 len: 466 microversion: 2.61 time: 0.034882 May 07 21:46:42.204398 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 179/372] 10.222.0.32 () {62 vars in 1215 bytes} [Sat May 7 21:46:42 2022] PUT /compute/v2.1/flavors/588835728 => generated 466 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:42.211800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.212856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:42.224280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.224492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.224796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.225320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:42.225647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.226098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.238116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.239078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.240632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.241239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.271110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:46:42.366029 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b2908f98-39f5-45cc-b963-24bb1b1995d6 tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] 10.222.0.32 "DELETE /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 204 len: 0 microversion: 2.1 time: 0.304346 May 07 21:46:42.370433 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 194/373] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:46:42 2022] DELETE /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:46:42.376275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1d9ea26-6cee-472d-8f15-930308542702 tempest-FlavorsV261TestJSON-399243316 tempest-FlavorsV261TestJSON-399243316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.401417 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b1d9ea26-6cee-472d-8f15-930308542702 tempest-FlavorsV261TestJSON-399243316 tempest-FlavorsV261TestJSON-399243316-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 7151 microversion: 2.61 time: 0.029414 May 07 21:46:42.402435 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 195/374] 10.222.0.32 () {60 vars in 1186 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/flavors/detail => generated 7151 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:42.407326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.408083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:42.414239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.414927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.415723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.416169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.426532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.437159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.438835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.441638 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a27f462d-6f21-4a69-b5de-af55b194cf36 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.235252 May 07 21:46:42.442336 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 180/375] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:42.447879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.448760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:42.455908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.456468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.457434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.458034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.583155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.594365 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82c47594-8ece-4f51-929f-51dab1a964a2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1313 microversion: 2.1 time: 0.190588 May 07 21:46:42.595145 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 196/376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:42.600645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc09ed2e-1678-4760-b291-c46617f434af tempest-FlavorsV261TestJSON-399243316 tempest-FlavorsV261TestJSON-399243316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.621163 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc09ed2e-1678-4760-b291-c46617f434af tempest-FlavorsV261TestJSON-399243316 tempest-FlavorsV261TestJSON-399243316-project] 10.222.0.32 "GET /compute/v2.1/flavors" status: 200 len: 3678 microversion: 2.61 time: 0.024439 May 07 21:46:42.621853 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 197/377] 10.222.0.32 () {60 vars in 1165 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/flavors => generated 3678 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:42.626196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3688234d-b477-4af5-b403-1451eaf94467 req-6accdd2f-347a-4d6c-b7d8-057ef086a251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9c13b6-ebdb-426f-81a7-663cba33645a", "name": "network-vif-plugged", "status": "completed", "tag": "1f353eba-6503-4549-810d-34664c1775fa"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:42.634486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3688234d-b477-4af5-b403-1451eaf94467 req-6accdd2f-347a-4d6c-b7d8-057ef086a251 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.635175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3688234d-b477-4af5-b403-1451eaf94467 req-6accdd2f-347a-4d6c-b7d8-057ef086a251 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.646514 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3688234d-b477-4af5-b403-1451eaf94467 req-6accdd2f-347a-4d6c-b7d8-057ef086a251 service nova] Creating event network-vif-plugged:1f353eba-6503-4549-810d-34664c1775fa for instance ad9c13b6-ebdb-426f-81a7-663cba33645a on nch2-master-1 May 07 21:46:42.651553 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3688234d-b477-4af5-b403-1451eaf94467 req-6accdd2f-347a-4d6c-b7d8-057ef086a251 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028549 May 07 21:46:42.652144 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 198/378] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:42.657548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.658273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:42.667656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.669116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.669737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.670985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.671130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.676307 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91733b1c-81f9-421f-a425-2584a3bccae3 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1476 microversion: 2.1 time: 0.232369 May 07 21:46:42.677180 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 181/379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:42.684013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-656f8e6b-a49a-42b4-b715-b935bb145bdd tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.685071 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:46:42.685071 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:46:42.706652 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-656f8e6b-a49a-42b4-b715-b935bb145bdd tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/588835728" status: 202 len: 0 microversion: 2.61 time: 0.027150 May 07 21:46:42.707374 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 182/380] 10.222.0.32 () {60 vars in 1198 bytes} [Sat May 7 21:46:42 2022] DELETE /compute/v2.1/flavors/588835728 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:46:42.715126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-37c85410-b57f-4372-9271-e5b21b7367b1 tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.736552 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-37c85410-b57f-4372-9271-e5b21b7367b1 tempest-FlavorsV261TestJSON-11049495 tempest-FlavorsV261TestJSON-11049495-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 6695 microversion: 2.61 time: 0.024809 May 07 21:46:42.737181 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 183/381] 10.222.0.32 () {60 vars in 1186 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/flavors/detail => generated 6695 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:42.737823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.745646 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15fd5408-d4f3-4e70-a1b4-b1f69cc64e4b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1273 microversion: 2.1 time: 0.092006 May 07 21:46:42.746274 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 199/382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:42.816250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:42.817030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:42.823827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.824279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.825063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:42.825469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:42.958227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:42.965505 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-69c697e4-1f69-46ea-a9f5-4ab537c6613b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1308 microversion: 2.1 time: 0.153717 May 07 21:46:42.966087 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 184/383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:42 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:43.185805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:43.186427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:43.193609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.194525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.195471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.195925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.272462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.280318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.281847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.286690 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64ee23f9-d8c4-4218-b56d-b12f3744cc98 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.104968 May 07 21:46:43.287300 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 200/384] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:43 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:43.459662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:43.460287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:43.466104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.466576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.467350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.467775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.596924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.604980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.606503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.607801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-18fafbdc-48fe-4963-855c-4dfc4863e271 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.152162 May 07 21:46:43.608422 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 185/385] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:43 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:43.611910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:43.612534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:43.618712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.619464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.620311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.620753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.694239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:43.695215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:43.703193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.703956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.705483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.706074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.830420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.838895 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aa82d15b-c084-41ea-973f-49bbad7dcf0a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1313 microversion: 2.1 time: 0.231861 May 07 21:46:43.852900 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 201/386] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:43 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:43.866718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:43.867683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:43.883369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.884669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.885551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:43.886003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:43.942894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:43.951152 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23a4ee71-4f84-404a-afc7-d51d6bda58c8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1476 microversion: 2.1 time: 0.261377 May 07 21:46:43.955812 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 186/387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:43 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:43.981328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:43.982048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:43.998869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.000215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.001134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.001658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.001847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.013315 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cab61106-3ace-4267-98de-28b2ddb695e0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1271 microversion: 2.1 time: 0.158494 May 07 21:46:44.014417 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 202/388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:43 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:44.195959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.213334 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5be2fd59-b6ae-44cd-be27-fb43cb011a6a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1308 microversion: 2.1 time: 0.235573 May 07 21:46:44.222626 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 187/389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:43 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:44.307494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:44.308118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:44.325691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.328283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.333233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.334458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.475976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.484739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.491449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.497617 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-32fc0b50-5bde-4942-9f90-8aa33a4f27bf tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.194320 May 07 21:46:44.500604 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 203/390] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:44 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:44.629542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:44.630168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:44.638299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.638761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.639571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.640008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.712240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c838e59e-a6bd-44d0-9bbb-c0c0fe26d38c req-ab3e9bf0-4f3e-46fb-9516-a83bd37d896e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5158d992-548d-41d0-a26a-a1dae158fea9", "name": "network-vif-deleted", "tag": "4640c625-b0a9-4880-8c33-cabac320668c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:44.722542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c838e59e-a6bd-44d0-9bbb-c0c0fe26d38c req-ab3e9bf0-4f3e-46fb-9516-a83bd37d896e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.723867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c838e59e-a6bd-44d0-9bbb-c0c0fe26d38c req-ab3e9bf0-4f3e-46fb-9516-a83bd37d896e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.741247 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c838e59e-a6bd-44d0-9bbb-c0c0fe26d38c req-ab3e9bf0-4f3e-46fb-9516-a83bd37d896e service nova] Creating event network-vif-deleted:4640c625-b0a9-4880-8c33-cabac320668c for instance 5158d992-548d-41d0-a26a-a1dae158fea9 on nch1-master-1 May 07 21:46:44.747312 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c838e59e-a6bd-44d0-9bbb-c0c0fe26d38c req-ab3e9bf0-4f3e-46fb-9516-a83bd37d896e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040349 May 07 21:46:44.748049 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 204/391] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:44.861988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:44.863316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:44.889368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.889867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.890676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:44.893229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:44.975587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.989492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.992056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:44.993820 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6a7b118-3847-466a-86ff-2adbb2562b8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.369093 May 07 21:46:44.995253 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 188/392] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:44 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:45.009762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:45.010639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:45.019067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.019822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.020998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.021452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.063072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.063851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.065100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lazy-loading 'fault' on Instance uuid 5158d992-548d-41d0-a26a-a1dae158fea9 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:45.082174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:45.090055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9d39ccc-c7c4-43a0-9caf-f40dab16f4d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1462 microversion: 2.1 time: 0.233586 May 07 21:46:45.102499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 205/393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:44 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1462 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:45.102499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:45.102499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:45.103126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.103255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.104220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.104810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.144744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:45.152675 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b84d96b8-66b5-4c5b-a1f6-5074ed2642f9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 200 len: 1310 microversion: 2.1 time: 0.150562 May 07 21:46:45.154006 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 189/394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:44 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 1310 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:45.273021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:45.282258 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-648b3d78-287a-45fc-8a3a-ce397eb00251 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.190180 May 07 21:46:45.286447 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 206/395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:45 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:45.291613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:45.295132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:45.307004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.307734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.308730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.309351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.476098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:45.484659 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d50b83f9-8281-4219-b119-a5d2c3ac6356 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1308 microversion: 2.1 time: 0.196584 May 07 21:46:45.485219 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 207/396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:45 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:45.520188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:45.520830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:45.527233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.528224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.529181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.529771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.580103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7d467752-14a4-43cf-823e-6df39b191c92 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:45.583845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7d467752-14a4-43cf-823e-6df39b191c92 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Searching by: {'deleted': False, 'project_id': '3f76a01201d14762b196350691f865bf'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:45.590009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d467752-14a4-43cf-823e-6df39b191c92 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.590456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d467752-14a4-43cf-823e-6df39b191c92 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.591274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d467752-14a4-43cf-823e-6df39b191c92 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.591706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d467752-14a4-43cf-823e-6df39b191c92 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.603947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:45.613690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:45.615562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:45.620671 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-80255de9-edc3-4f2f-964e-8b94105e0cc3 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.104717 May 07 21:46:45.621464 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 208/397] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:45 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:45.695320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7d467752-14a4-43cf-823e-6df39b191c92 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.530979 May 07 21:46:45.696891 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 190/398] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:46:45 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:45.712142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:45.717421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Searching by: {'deleted': False} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:45.724233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.725219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.726230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.727052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.859668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:46:45.882033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ffa82824-4fa2-4d56-ab8c-df545493e059 req-b68963cb-1c87-4ca8-b4f5-753bdf76626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63bd05ee-f966-4884-89dc-17c61c1942fe", "name": "network-vif-plugged", "status": "completed", "tag": "1520ea65-2c7b-46a7-8360-d42695eee536"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:45.906742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ffa82824-4fa2-4d56-ab8c-df545493e059 req-b68963cb-1c87-4ca8-b4f5-753bdf76626f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:45.907275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ffa82824-4fa2-4d56-ab8c-df545493e059 req-b68963cb-1c87-4ca8-b4f5-753bdf76626f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:45.935079 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ffa82824-4fa2-4d56-ab8c-df545493e059 req-b68963cb-1c87-4ca8-b4f5-753bdf76626f service nova] Creating event network-vif-plugged:1520ea65-2c7b-46a7-8360-d42695eee536 for instance 63bd05ee-f966-4884-89dc-17c61c1942fe on nch1-master-1 May 07 21:46:45.959270 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ffa82824-4fa2-4d56-ab8c-df545493e059 req-b68963cb-1c87-4ca8-b4f5-753bdf76626f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080854 May 07 21:46:45.961027 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 191/399] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:46.016857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:46.019105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:46.039259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.040107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.041150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.042270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.062036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.062394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.390687 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-071d3d3d-0040-4580-afcb-b68f3a068a4e tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12685 microversion: 2.1 time: 0.682170 May 07 21:46:46.391339 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 209/400] 10.222.0.32 () {58 vars in 1170 bytes} [Sat May 7 21:46:45 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12685 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:46.396241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:46.396780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:46.402763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.403250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.404025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.404473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.420249 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] HTTP exception thrown: Instance 5158d992-548d-41d0-a26a-a1dae158fea9 could not be found. May 07 21:46:46.420843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Returning 404 to user: Instance 5158d992-548d-41d0-a26a-a1dae158fea9 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:46:46.421675 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cc89fb5a-eef8-4f5a-ae4b-ffc95d2069cc tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 404 len: 111 microversion: 2.1 time: 0.029328 May 07 21:46:46.422382 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 210/401] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:46 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:46:46.438648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:46.439343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:46.446427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.446871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.448191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.448390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.620222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:46.630635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:46.632193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:46.633373 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f972de67-aaba-4f17-8766-b0d711fe87e8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.621683 May 07 21:46:46.638434 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 192/402] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:46 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:46.647957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d17413a3-c2b5-4112-bc67-59fb7375c621 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:46.654869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d17413a3-c2b5-4112-bc67-59fb7375c621 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Searching by: {'deleted': False, 'project_id': '3f76a01201d14762b196350691f865bf'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:46.660580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d17413a3-c2b5-4112-bc67-59fb7375c621 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.660857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d17413a3-c2b5-4112-bc67-59fb7375c621 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.661684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d17413a3-c2b5-4112-bc67-59fb7375c621 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.662129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d17413a3-c2b5-4112-bc67-59fb7375c621 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.663379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:46.672380 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b2e4b0fa-b142-4ced-9542-7afb921d4f1b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.248467 May 07 21:46:46.673131 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 211/403] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:46 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:46.678685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c87b1c44-2542-4dc8-9b83-93d0e3d1ddec req-2198553e-1003-4841-91f5-e1d718b122af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12135950-7d5e-4835-8fe5-31c8e5e9c986", "tag": "f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:46.687317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c87b1c44-2542-4dc8-9b83-93d0e3d1ddec req-2198553e-1003-4841-91f5-e1d718b122af service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.687779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c87b1c44-2542-4dc8-9b83-93d0e3d1ddec req-2198553e-1003-4841-91f5-e1d718b122af service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.693705 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d17413a3-c2b5-4112-bc67-59fb7375c621 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?tenant_id=95946c2e9a5c4a72905d75010a9bb7a5" status: 200 len: 15 microversion: 2.1 time: 0.054135 May 07 21:46:46.694880 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 193/404] 10.222.0.32 () {58 vars in 1230 bytes} [Sat May 7 21:46:46 2022] GET /compute/v2.1/servers/detail?tenant_id=95946c2e9a5c4a72905d75010a9bb7a5 => generated 15 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:46.699875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:46.701140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:46.708613 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c87b1c44-2542-4dc8-9b83-93d0e3d1ddec req-2198553e-1003-4841-91f5-e1d718b122af service nova] Creating event network-changed:f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9 for instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 on nch1-master-1 May 07 21:46:46.710238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.710713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.711566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.712012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.719069 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c87b1c44-2542-4dc8-9b83-93d0e3d1ddec req-2198553e-1003-4841-91f5-e1d718b122af service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043043 May 07 21:46:46.719841 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 212/405] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:46.726236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1037461853", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:46.782479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:46.899041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:46.907755 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88be6826-b1fc-49b9-91e9-277628543cbe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1308 microversion: 2.1 time: 0.210917 May 07 21:46:46.909405 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 194/406] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:46 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:46.914539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:46.915244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:46.921570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.922286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:46.923295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:46.923775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.029345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:47.030536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:47.031249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:47.031675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:47.032097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:47.042278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.042742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.043958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.044411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.067946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:47.085666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Getting quotas for project 3a25839617304e069e93d96029612c18. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:47.086885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:47.090206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:47.095050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Getting quotas for user e9d562828c3241d0a5d0f2253205c12f and project 3a25839617304e069e93d96029612c18. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:47.095998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15548370-d74a-438c-8912-a74f76179c83 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1447 microversion: 2.75 time: 0.185139 May 07 21:46:47.096837 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 195/407] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:46 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:47.109344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:47.112297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:47.134083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:47.140608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Searching by: {'tenant_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'deleted': False} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:47.146903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.147598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.148661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.150270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.172030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce09cdcc-bc23-4632-a4aa-d1af564e1a83 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449879 May 07 21:46:47.174830 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 213/408] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:46:47.186122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e5b452c-0219-4317-ad90-9e7f9257b75b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:47.187164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e5b452c-0219-4317-ad90-9e7f9257b75b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:47.203401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:46:47.354430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e5b452c-0219-4317-ad90-9e7f9257b75b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:47.361873 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e5b452c-0219-4317-ad90-9e7f9257b75b tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1220 microversion: 2.1 time: 0.180863 May 07 21:46:47.363604 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 214/409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:47 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1220 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:47.479425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.479573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.658288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:47.659055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:47.669448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.670110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.671072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.672635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.757057 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-28d9cfac-7c13-4874-a1f6-cfaf96dc2cb8 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=95946c2e9a5c4a72905d75010a9bb7a5" status: 200 len: 4824 microversion: 2.1 time: 0.634303 May 07 21:46:47.757883 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 196/410] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 21:46:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=95946c2e9a5c4a72905d75010a9bb7a5 => generated 4824 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:47.775273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:47.775964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:47.799174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.799681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.800511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.805095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.895427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:47.907457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:47.909740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:47.911308 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4f39365-689b-4e35-b290-db431accdc11 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.258539 May 07 21:46:47.912317 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 215/411] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:47 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:47.917278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc50b64f-4475-4c09-8828-ff323f2cf4f7 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:47.922663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc50b64f-4475-4c09-8828-ff323f2cf4f7 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Searching by: {'tenant_id': '3f76a01201d14762b196350691f865bf', 'deleted': False} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:47.929390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc50b64f-4475-4c09-8828-ff323f2cf4f7 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.929846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc50b64f-4475-4c09-8828-ff323f2cf4f7 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.930650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc50b64f-4475-4c09-8828-ff323f2cf4f7 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:47.931132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc50b64f-4475-4c09-8828-ff323f2cf4f7 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:47.996175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.004091 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-16caff1c-0329-4a5c-8232-19180a29d864 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.244905 May 07 21:46:48.004667 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 197/412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:47 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:48.010214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.011386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.019514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.020040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.021066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.021670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.027902 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc50b64f-4475-4c09-8828-ff323f2cf4f7 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3f76a01201d14762b196350691f865bf" status: 200 len: 15 microversion: 2.1 time: 0.114516 May 07 21:46:48.028670 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 216/413] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 21:46:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3f76a01201d14762b196350691f865bf => generated 15 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:48.045279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44cc0d37-5098-4b33-ac05-73dad0fee9b9 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.049727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44cc0d37-5098-4b33-ac05-73dad0fee9b9 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008042 May 07 21:46:48.050251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 217/414] 10.222.0.32 () {58 vars in 1188 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 07 21:46:48.066564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-37e75ecd-991e-4d07-bb8a-54fcd9131d18 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:48.067593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-37e75ecd-991e-4d07-bb8a-54fcd9131d18 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.073938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e75ecd-991e-4d07-bb8a-54fcd9131d18 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.074527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e75ecd-991e-4d07-bb8a-54fcd9131d18 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.075433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e75ecd-991e-4d07-bb8a-54fcd9131d18 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.075945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e75ecd-991e-4d07-bb8a-54fcd9131d18 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.182932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.186368 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-37e75ecd-991e-4d07-bb8a-54fcd9131d18 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action" status: 202 len: 0 microversion: 2.1 time: 0.123486 May 07 21:46:48.190880 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 218/415] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:46:48 2022] POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:46:48.193535 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2aa0867-8a0a-44ac-adf9-da1f910cc4bf tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1488 microversion: 2.1 time: 0.187173 May 07 21:46:48.197475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.198173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.201113 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 198/416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1488 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:48.208091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.208629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.209502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.210010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.222439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.226491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.227542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:48.235012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.235926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.238646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.239372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.311573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.320460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.322297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.328097 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7e8187a4-a328-4240-945c-c80d56a47681 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1453 microversion: 2.75 time: 0.135947 May 07 21:46:48.328472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:46:48.328683 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 219/417] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:48.333963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f251306f-1420-4af8-a05e-712d2e4d5ed3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:48.334508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f251306f-1420-4af8-a05e-712d2e4d5ed3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.351548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f251306f-1420-4af8-a05e-712d2e4d5ed3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.352059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f251306f-1420-4af8-a05e-712d2e4d5ed3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.352958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f251306f-1420-4af8-a05e-712d2e4d5ed3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.353438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f251306f-1420-4af8-a05e-712d2e4d5ed3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.393939 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dcff36f2-d39d-4d7c-872a-b72f7fd78df3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.191534 May 07 21:46:48.394547 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 199/418] 10.222.0.32 () {58 vars in 1149 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:48.399499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.400134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.406585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.407220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.408590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.409092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.437339 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f251306f-1420-4af8-a05e-712d2e4d5ed3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe/action" status: 202 len: 0 microversion: 2.1 time: 0.107331 May 07 21:46:48.437978 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 220/419] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:46:48 2022] POST /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:46:48.443854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e169d641-6297-42ea-8f22-b01b6b4cc211 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:48.444947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e169d641-6297-42ea-8f22-b01b6b4cc211 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.451580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e169d641-6297-42ea-8f22-b01b6b4cc211 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.452034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e169d641-6297-42ea-8f22-b01b6b4cc211 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.452817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e169d641-6297-42ea-8f22-b01b6b4cc211 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.453266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e169d641-6297-42ea-8f22-b01b6b4cc211 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.473490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.481463 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a00e1fcd-3ff6-4a3c-b19c-112f8f4c268c tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1224 microversion: 2.1 time: 0.085656 May 07 21:46:48.482812 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 200/420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:48.490961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.491658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.497928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.498379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.499237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.499618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.547774 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e169d641-6297-42ea-8f22-b01b6b4cc211 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action" status: 202 len: 0 microversion: 2.1 time: 0.106144 May 07 21:46:48.547774 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 221/421] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:46:48 2022] POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:46:48.556509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-78ec4a03-2e7e-4f05-b776-6514e723818d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.557278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-78ec4a03-2e7e-4f05-b776-6514e723818d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.564735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78ec4a03-2e7e-4f05-b776-6514e723818d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.565354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78ec4a03-2e7e-4f05-b776-6514e723818d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.566267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78ec4a03-2e7e-4f05-b776-6514e723818d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.566862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78ec4a03-2e7e-4f05-b776-6514e723818d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.666950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:48.674386 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e5048b5c-b536-493c-b9d2-d9ba2565b54f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1493 microversion: 2.1 time: 0.191367 May 07 21:46:48.675142 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 201/422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1493 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:48.766746 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-78ec4a03-2e7e-4f05-b776-6514e723818d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1613 microversion: 2.1 time: 0.214029 May 07 21:46:48.767999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 222/423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1613 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:48.784177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c20103b9-fec9-42aa-af2e-88fb8999c594 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.784803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c20103b9-fec9-42aa-af2e-88fb8999c594 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.790629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c20103b9-fec9-42aa-af2e-88fb8999c594 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.791128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c20103b9-fec9-42aa-af2e-88fb8999c594 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.791916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c20103b9-fec9-42aa-af2e-88fb8999c594 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.792362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c20103b9-fec9-42aa-af2e-88fb8999c594 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.932600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:48.934556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:48.944486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.945355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:48.946385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:48.947416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.074261 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c20103b9-fec9-42aa-af2e-88fb8999c594 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1613 microversion: 2.1 time: 0.293944 May 07 21:46:49.086414 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 202/424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1613 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:49.087724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:49.088343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:49.102357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.102863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.103635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.104078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.317030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.336919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.340257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.343201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da891e8b-a972-47f1-a98d-2fbfe3964945 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.417289 May 07 21:46:49.354246 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 223/425] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:48 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:49.358344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:49.363501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:49.371330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.371818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.372811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.373265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.423907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.432353 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0805ec21-4c97-4cbd-8c68-ea6aec8770bf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.348281 May 07 21:46:49.433300 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 203/426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:49 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:49.440033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:49.440937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:49.448283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.449084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.450120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.450865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.466649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:46:49.519865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.526301 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0141b1b5-9745-41ae-963a-9fa2df4979bc tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 1649 microversion: 2.1 time: 0.172755 May 07 21:46:49.527071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 224/427] 10.222.0.32 () {58 vars in 1189 bytes} [Sat May 7 21:46:49 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 1649 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:49.529516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.531240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.537606 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4731cd04-0832-4e35-b581-31238e814e48 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1438 microversion: 2.75 time: 0.102809 May 07 21:46:49.542899 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 204/428] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:49 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:49.547519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:49.548134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:49.562693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.563269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.564597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.565196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.675001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:49.682946 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d6b5821a-aa92-4dfc-9c6f-a2b7493dce72 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1272 microversion: 2.1 time: 0.138925 May 07 21:46:49.694350 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 205/429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:49 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:49.694350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7fc7c9b4-7263-4998-b11b-885d484d23c0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:49.697438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7fc7c9b4-7263-4998-b11b-885d484d23c0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:46:49.703944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fc7c9b4-7263-4998-b11b-885d484d23c0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.704407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fc7c9b4-7263-4998-b11b-885d484d23c0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.705767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fc7c9b4-7263-4998-b11b-885d484d23c0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.706205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fc7c9b4-7263-4998-b11b-885d484d23c0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.737315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1075469346", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "28405dfe-908d-4039-91f6-1d02165b34cd"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:49.824609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] validate_networks() for [('28405dfe-908d-4039-91f6-1d02165b34cd', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:49.839153 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7fc7c9b4-7263-4998-b11b-885d484d23c0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.153700 May 07 21:46:49.840472 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 206/430] 10.222.0.32 () {58 vars in 1195 bytes} [Sat May 7 21:46:49 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:46:49.974309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:49.975954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:49.982027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.982538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:49.983419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:49.983929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.070474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:50.070934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:50.071419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:50.072156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:50.072578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:50.173082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:50.180186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.180685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.181835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.181949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.307470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:50.335224 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-537c65b4-9d87-42e8-bf7f-6de9548fc9c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f/action" status: 202 len: 1942 microversion: 2.75 time: 0.493464 May 07 21:46:50.336077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 207/431] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:46:49 2022] POST /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f/action => generated 1942 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 07 21:46:50.340517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:50.341052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:50.348658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.349118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.349986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.350396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.511624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:50.521010 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0672f813-fedc-4c60-bb46-436b1cb3b199 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 200 len: 1473 microversion: 2.1 time: 0.184051 May 07 21:46:50.521795 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 208/432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:50 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:50.526743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-581ac59f-cd77-4712-9f07-db8030612d5a tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:50.527814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-581ac59f-cd77-4712-9f07-db8030612d5a tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:50.535174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-581ac59f-cd77-4712-9f07-db8030612d5a tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.535633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-581ac59f-cd77-4712-9f07-db8030612d5a tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.536422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-581ac59f-cd77-4712-9f07-db8030612d5a tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.536866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-581ac59f-cd77-4712-9f07-db8030612d5a tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.616678 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-581ac59f-cd77-4712-9f07-db8030612d5a tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action" status: 202 len: 0 microversion: 2.1 time: 0.093948 May 07 21:46:50.620305 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 209/433] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:46:50 2022] POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:46:50.621902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:50.622521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:50.628234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.628695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.629509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.630090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.700857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:50.721016 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b2600cf5-1cc1-488c-86a1-2bed8ae36aba tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.101935 May 07 21:46:50.721717 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 210/434] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:50 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:50.727977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:50.728600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:50.735094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.735552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.736386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.736827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.878846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:50.879376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:50.880223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:50.880881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:50.881484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:50.882090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:50.892060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:50.892945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.893398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.894383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.894634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:50.894991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.896086 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4994e87a-9fae-41ce-b30e-d027e3195e77 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1567 microversion: 2.25 time: 0.172274 May 07 21:46:50.897056 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 211/435] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:50 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:50.905255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:50.906151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:50.913362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.913866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.914937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.915112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:50.915689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:50.919284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for user 7dd9c30816a7410f94b10294234c1dc2 and project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:50.930478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:50.932854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:50.984110 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-155e7e5f-d803-4c3a-9e97-4321c4137676 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456203 May 07 21:46:50.985086 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 225/436] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:46:50.990263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2ccf692-6a73-43c3-b82a-5aa31d75277a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-277968327"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:50.991379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a2ccf692-6a73-43c3-b82a-5aa31d75277a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:50.998947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2ccf692-6a73-43c3-b82a-5aa31d75277a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:50.999583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2ccf692-6a73-43c3-b82a-5aa31d75277a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.000522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2ccf692-6a73-43c3-b82a-5aa31d75277a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.001186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2ccf692-6a73-43c3-b82a-5aa31d75277a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.078026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:51.087211 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ad948af4-260a-40a4-a051-7d8e4963a131 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.188176 May 07 21:46:51.096220 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 212/437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:50 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:51.096220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:51.096220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:51.103183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.103325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.104110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.105284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.211365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:51.211784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:51.212252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:51.212657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:51.213075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:51.305887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:51.314000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.314670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.315827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.316373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.348208 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d77d8dbf-a552-491f-9f9b-9557650db42b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action" status: 202 len: 1066 microversion: 2.1 time: 0.259115 May 07 21:46:51.350320 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 213/438] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:46:51 2022] POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action => generated 1066 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 07 21:46:51.355117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:51.355847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:51.363964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.364561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.365460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.365992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.432577 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2ccf692-6a73-43c3-b82a-5aa31d75277a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe/action" status: 202 len: 0 microversion: 2.1 time: 0.445974 May 07 21:46:51.433285 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 226/439] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:46:50 2022] POST /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 21:46:51.442216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1779092-4f6d-43b6-9a8d-349a109efe48 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:51.443652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1779092-4f6d-43b6-9a8d-349a109efe48 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:51.540127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:51.549447 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bdab7778-b231-4906-84b1-6793a37d294e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.197857 May 07 21:46:51.560651 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 214/440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:51 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:51.567026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1779092-4f6d-43b6-9a8d-349a109efe48 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:51.567225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:51.567865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:51.575492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.575873 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1779092-4f6d-43b6-9a8d-349a109efe48 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1211 microversion: 2.1 time: 0.140613 May 07 21:46:51.576084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.576953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.577553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.587508 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 227/441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:51 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:51.593345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cca23243-0e36-47fa-bda3-4cf4bf3562f6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d0a3430>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:51.711448 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cca23243-0e36-47fa-bda3-4cf4bf3562f6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.122358 May 07 21:46:51.717520 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 228/442] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:51 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:51.741219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:51.746042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:51.792980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.795663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.797432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.800407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.818536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:51.830417 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0db40dbd-646b-4bcf-a41d-225956357de1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.269093 May 07 21:46:51.832409 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 215/443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:51 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:51.915737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:51.916446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:51.927153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.930896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.932019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:51.932663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:51.999905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:52.047374 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b46721c-ec27-4fb0-894b-fb3504b58fc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.309932 May 07 21:46:52.050016 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 229/444] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:51 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:52.112104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:52.112738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:52.125007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.126008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.127565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.128172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.170759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:52.179247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:52.180772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:52.181940 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-389b7324-cacd-4f85-b488-3671ef631713 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1557 microversion: 2.25 time: 0.270496 May 07 21:46:52.182516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 216/445] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:51 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1557 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:52.204623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-683c12e5-720a-4f7c-8553-5eb36ff38829 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '.version_select at 0x7fc41d113af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:52.207201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-683c12e5-720a-4f7c-8553-5eb36ff38829 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.207650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-683c12e5-720a-4f7c-8553-5eb36ff38829 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.222406 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-683c12e5-720a-4f7c-8553-5eb36ff38829 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.021468 May 07 21:46:52.223259 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 217/446] 10.222.0.32 () {60 vars in 1183 bytes} [Sat May 7 21:46:52 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:46:52.234412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:52.235280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:52.241839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.242297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.243086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.243523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.333005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:52.366070 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a14dba8e-9e5f-4db4-b0e0-594313d08a46 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.262667 May 07 21:46:52.367586 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 230/447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:52 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:52.403312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:52.425502 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a61eea66-90c3-43c4-9618-66cf0fab2af3 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 2049 microversion: 2.25 time: 0.194512 May 07 21:46:52.426926 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 218/448] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:52 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 2049 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:52.570688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:52.572505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:52.585854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.586629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.587825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.588488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.593432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:52.594048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:52.635446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.636501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.637489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:52.638198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:52.758528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:52.771116 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5a0db87d-8893-4225-861b-25f5ce6335dc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1271 microversion: 2.1 time: 0.181347 May 07 21:46:52.771945 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 219/449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:52 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:52.788644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-69456025", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "38d1a38e-1f99-466b-bf7f-940113b4b6ed"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:52.864636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] validate_networks() for [('38d1a38e-1f99-466b-bf7f-940113b4b6ed', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:46:52.988825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:52.999590 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3360e6d7-48bf-48dd-99ae-d6cb8bbefc42 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.434288 May 07 21:46:53.000649 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 231/450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:52 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:53.007530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-97dac027-1eba-4fb0-a05f-ac14f7b34ca4 req-09e9733c-b700-40a0-812e-41ccb2ac4fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13072f18-5487-409a-85d7-832cf25c5fa5", "tag": "a2215f38-3e54-40f3-9b36-b7cc264d5495"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:53.023589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-97dac027-1eba-4fb0-a05f-ac14f7b34ca4 req-09e9733c-b700-40a0-812e-41ccb2ac4fdf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.024220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-97dac027-1eba-4fb0-a05f-ac14f7b34ca4 req-09e9733c-b700-40a0-812e-41ccb2ac4fdf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.035583 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-97dac027-1eba-4fb0-a05f-ac14f7b34ca4 req-09e9733c-b700-40a0-812e-41ccb2ac4fdf service nova] Creating event network-changed:a2215f38-3e54-40f3-9b36-b7cc264d5495 for instance 13072f18-5487-409a-85d7-832cf25c5fa5 on nch1-master-1 May 07 21:46:53.040466 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-97dac027-1eba-4fb0-a05f-ac14f7b34ca4 req-09e9733c-b700-40a0-812e-41ccb2ac4fdf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037357 May 07 21:46:53.041322 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 232/451] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:53.056828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9674e12d-86c7-4cc0-a682-b4c772a41695 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d0a3670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:53.109197 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9674e12d-86c7-4cc0-a682-b4c772a41695 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.066366 May 07 21:46:53.109770 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 233/452] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:53 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:53.119359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:53.120276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:53.128989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.129444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.130220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.130656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.281507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:46:53.281978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:46:53.283086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:46:53.283575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:46:53.284214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:46:53.294191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.294741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.295685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.296202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.313947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:46:53.318201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for user 99e9b91d4fb949f18cc61bf2bbd63ab6 and project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:46:53.330761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:46:53.333012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:46:53.378041 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a558abd1-d17a-49f8-b349-7aec5c168315 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.593687 May 07 21:46:53.378739 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 220/453] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:46:53.388783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:53.389263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:53.395444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.395904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.396686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.397646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.427804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:53.437321 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e375eec8-12a1-4d66-99de-0f3a30d4e62d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.325900 May 07 21:46:53.438147 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 234/454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:53 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:53.444958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:53.445585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:53.472564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.473263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.474278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.474694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.515335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:53.550577 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4a27b83f-ea3f-4c7d-867b-3cbde6caabdc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.165027 May 07 21:46:53.551390 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 221/455] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:53 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:53.556580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dc235dc6-9f55-4b69-ae95-38ccbad9a91e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:53.557195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dc235dc6-9f55-4b69-ae95-38ccbad9a91e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:53.625566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc235dc6-9f55-4b69-ae95-38ccbad9a91e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:53.636853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc235dc6-9f55-4b69-ae95-38ccbad9a91e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:53.638546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc235dc6-9f55-4b69-ae95-38ccbad9a91e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:53.640225 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dc235dc6-9f55-4b69-ae95-38ccbad9a91e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1260 microversion: 2.25 time: 0.087949 May 07 21:46:53.640882 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 222/456] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:53 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1260 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:53.759408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:53.766664 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e71281f9-1189-411e-b1e9-484144f1eab9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.327171 May 07 21:46:53.779679 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 235/457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:53 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:53.798171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:53.799084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:53.808310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.808773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.809741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:53.810200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:53.894231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:53.903811 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2302a45-5d42-4e7e-90f5-fdb089959691 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1269 microversion: 2.1 time: 0.109902 May 07 21:46:53.904503 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 223/458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:53 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:54.008016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-29f6bc83-6b89-4214-ad87-ce98b263b0f6 req-3a7cce24-a8be-49cb-b39b-1d7e040125be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12135950-7d5e-4835-8fe5-31c8e5e9c986", "name": "network-vif-plugged", "status": "completed", "tag": "f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:54.020510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:54.021400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:54.021521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-29f6bc83-6b89-4214-ad87-ce98b263b0f6 req-3a7cce24-a8be-49cb-b39b-1d7e040125be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.022092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-29f6bc83-6b89-4214-ad87-ce98b263b0f6 req-3a7cce24-a8be-49cb-b39b-1d7e040125be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.031207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.032076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.033064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.033709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.044271 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-29f6bc83-6b89-4214-ad87-ce98b263b0f6 req-3a7cce24-a8be-49cb-b39b-1d7e040125be service nova] Creating event network-vif-plugged:f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9 for instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 on nch1-master-1 May 07 21:46:54.050237 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-29f6bc83-6b89-4214-ad87-ce98b263b0f6 req-3a7cce24-a8be-49cb-b39b-1d7e040125be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045972 May 07 21:46:54.051187 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 236/459] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:54.126092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4027247b-0df3-45b8-b827-77d325abb239 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d0a35e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:54.188163 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4027247b-0df3-45b8-b827-77d325abb239 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.067545 May 07 21:46:54.189673 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 237/460] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:54 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:54.215003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:54.225436 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ef3adf28-44d0-4bd4-a17f-99703207fa1e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.210912 May 07 21:46:54.225984 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 224/461] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:54 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:54.456823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:54.457498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:54.463984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.464442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.465214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.465656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.570654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:54.571507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:54.578347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.579369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.580920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.581664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.659191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:54.677876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:54.678071 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f4bd7a3c-d7e9-4fee-9589-079885090cd2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.111787 May 07 21:46:54.678939 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 225/462] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:54 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:54.689944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:54.691057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:54.693435 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ec60abf-136e-4f68-806e-8412c87587d2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.242558 May 07 21:46:54.694021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 238/463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:54 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:54.697277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.697730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.698533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.699362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.762828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:54.771277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:54.772789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:54.773887 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ade43949-e8a5-4817-b0ca-12f6df95fa94 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1318 microversion: 2.25 time: 0.094290 May 07 21:46:54.774453 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 226/464] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:54 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:54.796049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:54.796761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:54.802878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.803440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.804299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.804748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.920829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:54.921492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:54.928463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.928930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:54.929745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:54.930188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.105162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:55.108751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:55.117779 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-767b3dde-23d0-4330-94ff-80ecddcc3bcf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.325372 May 07 21:46:55.119516 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 239/465] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:54 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:55.125640 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bb89806-a604-467f-9297-2fa2e3c029e1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.208560 May 07 21:46:55.137198 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 227/466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:54 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:55.202957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f35b6edf-6224-4799-adb8-8562b4229183 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cee44c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:55.242263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:55.243228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:55.249194 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f35b6edf-6224-4799-adb8-8562b4229183 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.050583 May 07 21:46:55.249564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:55.250095 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 240/467] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:55 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:55.250529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.251453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:55.252119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.385499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:55.395615 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1ef53872-3d31-4683-9eb4-f0b16e3e47ec tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.157679 May 07 21:46:55.396501 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 228/468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:55 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:55.699343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:55.700457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:55.712085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:55.714148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:55.724933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:55.727294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.728368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:55.728704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:55.729639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.730109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.735282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:55.736987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.918076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:55.955179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-082a38f4-3261-46ef-84f5-66a42a26c83f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.260679 May 07 21:46:55.968777 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 241/469] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:55 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:55.977194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:55.986911 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-72a15d61-9467-4dc7-9c22-f0272c7bdaa0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.279240 May 07 21:46:55.996047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:55.996047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:55.996403 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 229/470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:55 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:55.997614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:55.998069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:55.999723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.000167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:56.138527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:56.139567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:56.148368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.149143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:56.150151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.150795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:56.399172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:56.418348 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3cefdcd0-c8f6-4eab-a9ec-a15e9d467aae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1313 microversion: 2.1 time: 0.286494 May 07 21:46:56.420228 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 230/471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:56 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:56.442339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:56.444525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:56.453538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.454106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:56.455590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.456276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:56.488835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:56.499639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:56.501194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:56.509716 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1cd087e9-652f-41de-8f87-d60530435323 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.518819 May 07 21:46:56.520422 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 242/472] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:55 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:56.528952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-db3c9a5c-0d9e-420d-92bb-0f4c93ede911 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cf0aee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:56.620589 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-db3c9a5c-0d9e-420d-92bb-0f4c93ede911 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.100113 May 07 21:46:56.621425 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 243/473] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:56 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:56.630011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:56.634239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:56.649257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.649968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:56.651581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.652244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:56.694016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:56.703769 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ebc854fd-4166-4d6b-8393-abc60fa0a9c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.281501 May 07 21:46:56.705714 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 231/474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:56 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:56.975397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-39ecf2db-17d1-4a15-a336-ae6ca09b91c2 req-8fb931e0-1c3a-4116-9f6f-6b09837d2576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88890ab3-196b-48f2-85db-aacd17e27ba5", "tag": "1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:56.994335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-39ecf2db-17d1-4a15-a336-ae6ca09b91c2 req-8fb931e0-1c3a-4116-9f6f-6b09837d2576 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:56.996056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-39ecf2db-17d1-4a15-a336-ae6ca09b91c2 req-8fb931e0-1c3a-4116-9f6f-6b09837d2576 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.008455 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-39ecf2db-17d1-4a15-a336-ae6ca09b91c2 req-8fb931e0-1c3a-4116-9f6f-6b09837d2576 service nova] Creating event network-changed:1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952 for instance 88890ab3-196b-48f2-85db-aacd17e27ba5 on nch1-master-1 May 07 21:46:57.015220 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-39ecf2db-17d1-4a15-a336-ae6ca09b91c2 req-8fb931e0-1c3a-4116-9f6f-6b09837d2576 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045581 May 07 21:46:57.016220 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 232/475] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:46:57.022743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:57.024017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:57.033525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.033982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.034816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.035416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.086556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:57.099494 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-42d9c0fa-1ef5-44d7-9126-6f67bf7e2a20 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.476423 May 07 21:46:57.100857 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 244/476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:56 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:57.109942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:57.111282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:57.118943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.120163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.122667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.123326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.132857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:57.161554 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cbc6781c-3f4a-44eb-b717-13c923e0f86e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.142990 May 07 21:46:57.162470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 233/477] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:57 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:57.441197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:57.441823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:57.448414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.448882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.449659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.450102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.458226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:57.473452 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69ac4165-ec47-415a-b308-47d3dfe566f2 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.370919 May 07 21:46:57.474228 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 245/478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:57 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:57.528190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:57.530221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:57.543938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.544803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.545826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.547707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.639306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:57.648584 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-825de319-0469-49af-83c4-478cdd7f2f3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1462 microversion: 2.1 time: 0.211650 May 07 21:46:57.650820 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 234/479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:57 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1462 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:46:57.656391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15662689-084f-44f8-afba-d752cb327101 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d088a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:57.726694 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15662689-084f-44f8-afba-d752cb327101 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.076187 May 07 21:46:57.727508 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 235/480] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:57 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:57.900571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f907c60c-8103-4117-9ec5-3b427db3f2ad tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:57.901175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f907c60c-8103-4117-9ec5-3b427db3f2ad tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:57.908146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f907c60c-8103-4117-9ec5-3b427db3f2ad tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.908905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f907c60c-8103-4117-9ec5-3b427db3f2ad tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.910267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f907c60c-8103-4117-9ec5-3b427db3f2ad tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:57.910835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f907c60c-8103-4117-9ec5-3b427db3f2ad tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:57.973134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:57.981784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:57.983331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:57.984455 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4d7a049-e855-440b-bc20-d138e398165e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.460095 May 07 21:46:57.985021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 246/481] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:57 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:46:57.996079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:57.996698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:58.018620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.019449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.020317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.020734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.252699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:58.260805 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-695e1c29-ba51-44eb-a57b-eaee7eeb4613 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.274210 May 07 21:46:58.261605 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 247/482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:57 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:58.261831 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f907c60c-8103-4117-9ec5-3b427db3f2ad tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1613 microversion: 2.1 time: 0.531201 May 07 21:46:58.273800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 236/483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:57 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1613 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:58.273800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:58.273800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:58.274335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b23a0b26-fc5b-4760-b79d-af798422c20a req-785e80c6-3fcb-4cbc-a157-750cbb3e8019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63bd05ee-f966-4884-89dc-17c61c1942fe", "name": "network-vif-plugged", "status": "completed", "tag": "1520ea65-2c7b-46a7-8360-d42695eee536"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:58.278255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.280354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.281152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.282658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.291643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b23a0b26-fc5b-4760-b79d-af798422c20a req-785e80c6-3fcb-4cbc-a157-750cbb3e8019 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.292094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b23a0b26-fc5b-4760-b79d-af798422c20a req-785e80c6-3fcb-4cbc-a157-750cbb3e8019 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.317207 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b23a0b26-fc5b-4760-b79d-af798422c20a req-785e80c6-3fcb-4cbc-a157-750cbb3e8019 service nova] Creating event network-vif-plugged:1520ea65-2c7b-46a7-8360-d42695eee536 for instance 63bd05ee-f966-4884-89dc-17c61c1942fe on nch1-master-1 May 07 21:46:58.328789 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b23a0b26-fc5b-4760-b79d-af798422c20a req-785e80c6-3fcb-4cbc-a157-750cbb3e8019 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066148 May 07 21:46:58.338615 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 248/484] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:58.349216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:58.352828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:58.364383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.365252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.366822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.366822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.481278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:58.493192 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e2cb315c-1adb-4570-a2ed-c63a3fa21f70 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.227870 May 07 21:46:58.493525 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 237/485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:58 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:58.498302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:58.498885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:58.509448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.509913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.510710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.511179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.546144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:46:58.574122 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-041a0714-c163-4da6-8b6e-9d18159990d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.229738 May 07 21:46:58.577018 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 249/486] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:58 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:58.583382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:58.584494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:58.591258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.592674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.593731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:58.594382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:58.642220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a6edc155dc2646fbb81df7bb279aeee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d958787dd43a0be6c8221f003c8f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:58.643032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] flavor_id is None. Assuming migration. {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4142}} May 07 21:46:58.643565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 21:46:58.800714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:58.810745 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1741782c-46b2-4bb5-b97b-41fd9af2508c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.231871 May 07 21:46:58.811593 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 250/487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:58 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:58.817085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-313e0509-ed37-49df-9fe2-99f1b4a2f13d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cee4f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:58.894327 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-313e0509-ed37-49df-9fe2-99f1b4a2f13d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.081608 May 07 21:46:58.895636 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 251/488] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:58 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:59.007159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:59.008165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:59.018492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.019037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.020095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.020674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.414631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:59.423375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:59.425031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:59.426380 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-760d6239-e5dc-411c-9768-72344003bffe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.427375 May 07 21:46:59.436945 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 252/489] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:46:58 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:46:59.442500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f59166c7-87ed-4cad-b75d-cb7982dfde32 req-5423eca9-9a41-43b3-864c-760a41748a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa51d13-aa03-48ef-9aea-32ae407e5d9d", "tag": "aac6c92e-cff2-4454-9401-e05c725747f7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:46:59.454111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f59166c7-87ed-4cad-b75d-cb7982dfde32 req-5423eca9-9a41-43b3-864c-760a41748a5d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.459300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f59166c7-87ed-4cad-b75d-cb7982dfde32 req-5423eca9-9a41-43b3-864c-760a41748a5d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.500704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5460cd8e-542d-46e8-87ba-729ceba53972 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986/action" status: 202 len: 0 microversion: 2.1 time: 1.005834 May 07 21:46:59.506071 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 238/490] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:46:58 2022] POST /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986/action => generated 0 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:46:59.511760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:59.512640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:59.521992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.522464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.524150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.524366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.675544 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f59166c7-87ed-4cad-b75d-cb7982dfde32 req-5423eca9-9a41-43b3-864c-760a41748a5d service nova] Creating event network-changed:aac6c92e-cff2-4454-9401-e05c725747f7 for instance bfa51d13-aa03-48ef-9aea-32ae407e5d9d on nch2-master-1 May 07 21:46:59.680614 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f59166c7-87ed-4cad-b75d-cb7982dfde32 req-5423eca9-9a41-43b3-864c-760a41748a5d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242266 May 07 21:46:59.681518 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 253/491] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:46:59.686595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:59.687405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:59.696295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.697051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.700212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.700661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.763358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:46:59.773842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7229b6c-08ba-4964-a32b-20a6280d2403 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.265758 May 07 21:46:59.775230 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 239/492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:59 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:46:59.784936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:46:59.787761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:46:59.805534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.807043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:46:59.809814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:46:59.812308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.050896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:00.062363 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56d220e9-d1ee-4f69-aca7-78bbeaaead41 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1471 microversion: 2.1 time: 0.285758 May 07 21:47:00.063092 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 240/493] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:59 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:00.079124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:00.080106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:00.087110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.087800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.088836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.089427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.120766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:00.132346 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d4d418a1-acd4-418a-8bf4-fb7b31bdb845 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.448297 May 07 21:47:00.132953 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 254/494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:46:59 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:00.149903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:00.150532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:00.156888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.158087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.168035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.171336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.205363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:00.238445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7026e274-b89f-4539-9f7b-d5355ef19843 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.163773 May 07 21:47:00.239184 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 241/495] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:00 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:00.256841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce71c9f4-2264-42a3-9ef5-ba9a5149abcd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d0bb550>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:00.319132 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce71c9f4-2264-42a3-9ef5-ba9a5149abcd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.078801 May 07 21:47:00.325351 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 242/496] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:00 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:00.356506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cd8d4e90-e07a-48c5-809c-52b3acab4afb req-264c26e2-f793-4091-a357-a70a730caaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13072f18-5487-409a-85d7-832cf25c5fa5", "name": "network-vif-plugged", "status": "completed", "tag": "a2215f38-3e54-40f3-9b36-b7cc264d5495"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:00.369200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cd8d4e90-e07a-48c5-809c-52b3acab4afb req-264c26e2-f793-4091-a357-a70a730caaa9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.369564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cd8d4e90-e07a-48c5-809c-52b3acab4afb req-264c26e2-f793-4091-a357-a70a730caaa9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.384256 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cd8d4e90-e07a-48c5-809c-52b3acab4afb req-264c26e2-f793-4091-a357-a70a730caaa9 service nova] Creating event network-vif-plugged:a2215f38-3e54-40f3-9b36-b7cc264d5495 for instance 13072f18-5487-409a-85d7-832cf25c5fa5 on nch1-master-1 May 07 21:47:00.389921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cd8d4e90-e07a-48c5-809c-52b3acab4afb req-264c26e2-f793-4091-a357-a70a730caaa9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039494 May 07 21:47:00.390864 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 243/497] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:47:00.460652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:00.462591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:00.484916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.486519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.487962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.488746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.494403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:00.507172 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3ad4e45-8e26-4e98-9c0c-7014c8088bf8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.359778 May 07 21:47:00.508827 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 255/498] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:00 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:00.693736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:00.705398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:00.707148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:00.708643 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-04932abf-04ca-46ae-8c8c-956498e19014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.259861 May 07 21:47:00.718486 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 244/499] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:00 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:00.791210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:00.792664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:00.824586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.825585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:00.826642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:00.827391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.082275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:01.082811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:01.088957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.089405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.096378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.100003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.108440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:01.116619 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3253f11-9f38-4d14-9bc3-d749b0090e3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.329399 May 07 21:47:01.130245 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 256/500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:00 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:01.151042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:01.156969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:01.174058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.174891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.175889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.178050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.567309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:01.581250 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6179b516-5da8-4b8c-9fb8-a24afa7a367d tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1320 microversion: 2.1 time: 0.435208 May 07 21:47:01.592676 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 257/501] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:01 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1320 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:01.599933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:01.600872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:01.607621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.608369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.609975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.610658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.622464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:01.632057 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e66478be-d093-42dd-92ff-10da2c9335d6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1471 microversion: 2.1 time: 0.554819 May 07 21:47:01.632654 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 245/502] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:01 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:01.641520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eea3f575-a782-4546-a52e-3fff41714f43 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d113e50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:01.706566 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eea3f575-a782-4546-a52e-3fff41714f43 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.072830 May 07 21:47:01.709631 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 246/503] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:01 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:01.743643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:01.748847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:01.749753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:01.780133 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a258354d-1beb-49f1-b306-3814011d3cd6 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.185534 May 07 21:47:01.782503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.783673 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 258/504] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:01 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:01.784034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.788231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.789970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.791977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:01.793124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:01.800067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.800743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:01.801727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:01.802339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.029956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:02.039496 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1dc5c9d5-b897-419c-9b01-f631abfa694b tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.328700 May 07 21:47:02.052179 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 247/505] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:01 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:02.067294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:02.084402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:02.086314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:02.087717 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48b45792-6679-44fa-ab98-fc34a6848208 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.302711 May 07 21:47:02.101612 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 259/506] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:01 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:02.148290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:02.149071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:02.155340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.156071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.166750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.170158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.364903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:02.373925 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d6ac12db-7e3d-414f-a64b-2589adfa97e4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.229820 May 07 21:47:02.386556 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 248/507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:02 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:02.601848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:02.604162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:02.620348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.621154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.622201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.623268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.648961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:02.649606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:02.655980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.656438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.657346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.658308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.842513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:02.860859 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-525141d9-cf55-4fc0-ba74-edc717d2c5c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1471 microversion: 2.1 time: 0.215559 May 07 21:47:02.861733 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 249/508] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:02 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:02.869209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7570f05-9167-403d-b5ed-a2eb0d194c22 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d088430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:02.922462 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7570f05-9167-403d-b5ed-a2eb0d194c22 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.059884 May 07 21:47:02.923346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 250/509] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:02 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:02.929263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:02.930722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:02.939088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.940294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.941344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.942107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.942301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:02.951055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d0cee3f6-c86a-4cbf-b3ad-b8eb231547c4 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1469 microversion: 2.1 time: 0.354231 May 07 21:47:02.952272 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 260/510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:02 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1469 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:02.967965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-400efa57-dc8a-44e9-a76b-e1fbee20456b tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:02.968994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-400efa57-dc8a-44e9-a76b-e1fbee20456b tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:02.985444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400efa57-dc8a-44e9-a76b-e1fbee20456b tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.986338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400efa57-dc8a-44e9-a76b-e1fbee20456b tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:02.987481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400efa57-dc8a-44e9-a76b-e1fbee20456b tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:02.988125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400efa57-dc8a-44e9-a76b-e1fbee20456b tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.036166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:03.061693 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a499f9ea-33c2-4e35-9f71-7672f96207d3 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.137131 May 07 21:47:03.062332 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 251/511] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:02 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:03.069131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.069809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:03.087570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.088035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.089120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.089579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.116897 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-400efa57-dc8a-44e9-a76b-e1fbee20456b tempest-DeleteServersAdminTestJSON-1608777675 tempest-DeleteServersAdminTestJSON-1608777675-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5/action" status: 202 len: 0 microversion: 2.1 time: 0.152494 May 07 21:47:03.120479 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 261/512] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:02 2022] POST /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:03.122887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.123512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:03.136584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.137052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.137851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.138296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.292090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:03.309165 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d88338a5-61a7-4dbc-8fc4-19caf661b814 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1470 microversion: 2.1 time: 0.245570 May 07 21:47:03.311270 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 252/513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:03 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:03.322210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.322903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:03.337313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.338094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.340556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.341223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.355146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:03.366101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:03.371793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:03.373018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c543467-fcf9-447f-9765-9822226d9d02 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.253848 May 07 21:47:03.373611 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 262/514] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:03 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:03.384097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.385230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.385824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lazy-loading 'fault' on Instance uuid 13072f18-5487-409a-85d7-832cf25c5fa5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:03.398448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.399298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:03.406163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.406924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.408290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.408910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.504032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:03.513072 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e9df720f-fbb1-4f39-bce9-624a3fb2e19e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1452 microversion: 2.1 time: 0.199455 May 07 21:47:03.524555 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 253/515] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:03 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:03.530182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.530729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:03.539664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.540445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.540815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.541256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.559742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:03.568862 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95b7d4e9-22d7-43a7-a224-98f78f89204f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.179753 May 07 21:47:03.578325 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 263/516] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:03 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:03.585061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:47:03.706193 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-919c7d98-5124-4e55-a5f6-03b9f1e21db8 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "DELETE /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 204 len: 0 microversion: 2.1 time: 0.179578 May 07 21:47:03.707570 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 254/517] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:47:03 2022] DELETE /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 21:47:03.716498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.717134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:03.724606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.725108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.726495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.726988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.775836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.778430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.778430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lazy-loading 'fault' on Instance uuid 13072f18-5487-409a-85d7-832cf25c5fa5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:03.900454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.901986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:03.911946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:03.918249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.918703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.919526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:03.919967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:03.926807 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8521e15c-f7b4-4f5b-a46b-6dbeb1d731f7 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1458 microversion: 2.1 time: 0.215161 May 07 21:47:03.928022 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 264/518] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:03 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1458 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:03.935147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a09787ac-3e27-4961-96ca-5bfbbf3007ee tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d0e5700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:03.997191 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a09787ac-3e27-4961-96ca-5bfbbf3007ee tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.065911 May 07 21:47:03.998559 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 265/519] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:03 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:04.003826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-06d30c55-1c65-4f4c-b345-4dca163c1cfd req-236eef3b-5f65-4d9e-ba7c-02575de3ea22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88890ab3-196b-48f2-85db-aacd17e27ba5", "name": "network-vif-plugged", "status": "completed", "tag": "1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:04.013642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-06d30c55-1c65-4f4c-b345-4dca163c1cfd req-236eef3b-5f65-4d9e-ba7c-02575de3ea22 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.016883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-06d30c55-1c65-4f4c-b345-4dca163c1cfd req-236eef3b-5f65-4d9e-ba7c-02575de3ea22 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.033671 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-06d30c55-1c65-4f4c-b345-4dca163c1cfd req-236eef3b-5f65-4d9e-ba7c-02575de3ea22 service nova] Creating event network-vif-plugged:1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952 for instance 88890ab3-196b-48f2-85db-aacd17e27ba5 on nch1-master-1 May 07 21:47:04.041706 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-06d30c55-1c65-4f4c-b345-4dca163c1cfd req-236eef3b-5f65-4d9e-ba7c-02575de3ea22 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041690 May 07 21:47:04.042682 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 266/520] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:04.084419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:04.085555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:04.097702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.098316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.100413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.101464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.123391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:04.134699 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c7cb4b27-247f-418a-86ee-979a63bcaa36 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.252970 May 07 21:47:04.145635 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 255/521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:03 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:04.221407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:04.244881 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03030835-284d-43c4-a0d8-6dbd9836f7c7 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.165736 May 07 21:47:04.245668 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 267/522] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:04 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:04.327236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:04.327865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:04.334635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.335068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.335861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.336335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.399226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:04.399863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:04.411806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.413973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.414883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.415334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.551731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:04.561895 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61d98dfe-3801-40ea-9837-979bbacb39a7 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1476 microversion: 2.1 time: 0.237227 May 07 21:47:04.575004 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 256/523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:04 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:04.587978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:04.588530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:04.594571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.595216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.595987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.596440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.642487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:04.653586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:04.655244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:04.657053 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa5510cc-0d93-44eb-8950-a5e1e8685db9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.267862 May 07 21:47:04.667375 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 268/524] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:04 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:04.782838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:04.791665 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6a4859f-b5d3-48af-b64b-f4c74aeb4856 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.207618 May 07 21:47:04.793070 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 257/525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:04 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:04.945271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:04.945818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:04.952496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.952959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.953746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.954228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.993012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:04.993470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:04.993929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lazy-loading 'fault' on Instance uuid 13072f18-5487-409a-85d7-832cf25c5fa5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:05.011436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e926944-f214-4f10-846e-60503098848c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d478af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:05.072834 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e926944-f214-4f10-846e-60503098848c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.065767 May 07 21:47:05.073574 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 258/526] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:05 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:05.153217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:05.153978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:05.164507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.165082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.166539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.167090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.180929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:05.195943 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c433ea79-7bca-41b3-a5c7-29e724786d3e tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1458 microversion: 2.1 time: 0.254408 May 07 21:47:05.199116 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 269/527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:04 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1458 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:05.265941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:05.266682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:05.273159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.273696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.274564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.275241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.359035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:05.365202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:05.373846 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2af7c09b-b075-4be5-ac15-812fef57fab8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.224961 May 07 21:47:05.374750 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 259/528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:05 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:05.389189 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-626e64d5-422b-4512-ad74-3ee698ea71c8 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.127429 May 07 21:47:05.389886 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 270/529] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:05 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:05.582255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:05.582914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:05.590274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.595453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.597536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.598478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.676814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:05.677452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:05.686560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.687052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.689873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.690327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.765042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:05.773758 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89564b69-7168-4193-9b4e-70beb26b8f06 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1476 microversion: 2.1 time: 0.196102 May 07 21:47:05.774750 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 260/530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:05 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1476 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:05.813303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:05.814671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:05.822219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.822780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.823650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:05.824098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:05.965908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:05.976424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:05.981413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:05.983549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:05.984999 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-676d98c9-3c74-4ccb-ae2e-6bd1c782b7f6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.313886 May 07 21:47:05.985482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e2266d41-6007-42ab-95bd-7787b7a27fa1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1311 microversion: 2.1 time: 0.178211 May 07 21:47:05.995680 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 271/531] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:05 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:47:05.996303 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 261/532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:05 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1311 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:06.065287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5c7775aa-66d7-4a8a-8c75-e7c583c456c8 req-b4860264-648c-4d0e-9fb5-768355f17dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa51d13-aa03-48ef-9aea-32ae407e5d9d", "name": "network-vif-plugged", "status": "completed", "tag": "aac6c92e-cff2-4454-9401-e05c725747f7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:06.087936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e3b53e8c-c74f-423d-b06f-fd5137e66586 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d38b1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:06.089170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5c7775aa-66d7-4a8a-8c75-e7c583c456c8 req-b4860264-648c-4d0e-9fb5-768355f17dbb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.089810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5c7775aa-66d7-4a8a-8c75-e7c583c456c8 req-b4860264-648c-4d0e-9fb5-768355f17dbb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.105847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5c7775aa-66d7-4a8a-8c75-e7c583c456c8 req-b4860264-648c-4d0e-9fb5-768355f17dbb service nova] Creating event network-vif-plugged:aac6c92e-cff2-4454-9401-e05c725747f7 for instance bfa51d13-aa03-48ef-9aea-32ae407e5d9d on nch2-master-1 May 07 21:47:06.111314 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5c7775aa-66d7-4a8a-8c75-e7c583c456c8 req-b4860264-648c-4d0e-9fb5-768355f17dbb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052606 May 07 21:47:06.112422 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 272/533] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:06.150694 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e3b53e8c-c74f-423d-b06f-fd5137e66586 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.067747 May 07 21:47:06.156681 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 262/534] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:06 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:06.156858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c91641c6-bb82-4d1b-b8f4-32069a36428a req-839b74fb-b84d-4493-9b5b-0f5074d0bb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13072f18-5487-409a-85d7-832cf25c5fa5", "name": "network-vif-deleted", "tag": "a2215f38-3e54-40f3-9b36-b7cc264d5495"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:06.171965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c91641c6-bb82-4d1b-b8f4-32069a36428a req-839b74fb-b84d-4493-9b5b-0f5074d0bb2f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.172438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c91641c6-bb82-4d1b-b8f4-32069a36428a req-839b74fb-b84d-4493-9b5b-0f5074d0bb2f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.185821 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c91641c6-bb82-4d1b-b8f4-32069a36428a req-839b74fb-b84d-4493-9b5b-0f5074d0bb2f service nova] Creating event network-vif-deleted:a2215f38-3e54-40f3-9b36-b7cc264d5495 for instance 13072f18-5487-409a-85d7-832cf25c5fa5 on nch1-master-1 May 07 21:47:06.198313 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c91641c6-bb82-4d1b-b8f4-32069a36428a req-839b74fb-b84d-4493-9b5b-0f5074d0bb2f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049434 May 07 21:47:06.199258 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 273/535] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:47:06.215185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:06.216142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:06.222664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.223453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.224643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.225343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.292289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.292936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.293513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lazy-loading 'fault' on Instance uuid 13072f18-5487-409a-85d7-832cf25c5fa5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:06.348006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d562828c3241d0a5d0f2253205c12f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a25839617304e069e93d96029612c18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:06.356965 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14560a9d-c321-4342-a0e7-f07516f8ae00 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 200 len: 1288 microversion: 2.1 time: 0.145961 May 07 21:47:06.364489 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 263/536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:06 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 1288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:06.393101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:06.393922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:06.400803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.403109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.408965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:06.409834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:06.417140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.417568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.418273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.421505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.422554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.425118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.551798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:06.573096 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b686e378-6ffe-4e08-bb61-1014ab26af55 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.168511 May 07 21:47:06.585873 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 264/537] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:06 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:06.791399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:06.791632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:06.798423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.798836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.799638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:06.800087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:06.859375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:06.872377 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c787321-0def-4bb9-8669-8e1dc9909291 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.483130 May 07 21:47:06.885193 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 274/538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:06 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:06.975689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:06.983438 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-013ba3ed-e0fd-4418-a91b-9ba91b4f8e83 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1476 microversion: 2.1 time: 0.196424 May 07 21:47:06.985854 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 265/539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:06 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:07.002833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.003440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.006390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.007196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.015293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.016525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.017382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.017824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.020392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.020825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.021617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.022358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.183396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:07.198234 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6593e1ea-6cf3-433c-8da8-186a7c6884e8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1495 microversion: 2.1 time: 0.199868 May 07 21:47:07.201038 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 275/540] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:06 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1495 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:07.207942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9d2a238-2344-49d0-9fe4-9cd038a5843b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cee4700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.244720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:07.256520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:07.258044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:07.259201 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-039d3f96-9465-450b-beee-bb4eaebd891e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1360 microversion: 2.25 time: 0.258747 May 07 21:47:07.259768 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 266/541] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:06 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1360 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:47:07.263565 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9d2a238-2344-49d0-9fe4-9cd038a5843b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.060535 May 07 21:47:07.264215 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 276/542] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:07.322498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6431d8dc-1ae0-4f14-82f5-85d0fc63d464 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.323401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6431d8dc-1ae0-4f14-82f5-85d0fc63d464 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.334009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6431d8dc-1ae0-4f14-82f5-85d0fc63d464 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.334499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6431d8dc-1ae0-4f14-82f5-85d0fc63d464 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.335344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6431d8dc-1ae0-4f14-82f5-85d0fc63d464 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.335794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6431d8dc-1ae0-4f14-82f5-85d0fc63d464 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.382701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.383610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.391060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.391560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.392364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.392809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.416370 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] HTTP exception thrown: Instance 13072f18-5487-409a-85d7-832cf25c5fa5 could not be found. May 07 21:47:07.416991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Returning 404 to user: Instance 13072f18-5487-409a-85d7-832cf25c5fa5 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:07.418296 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f181d15e-966b-4f37-92e3-2783dc15046f tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 404 len: 111 microversion: 2.1 time: 0.039693 May 07 21:47:07.418903 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 277/543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:07.431752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.432271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.438540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.439045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.439852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.440303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.464702 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] HTTP exception thrown: Instance 13072f18-5487-409a-85d7-832cf25c5fa5 could not be found. May 07 21:47:07.465344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Returning 404 to user: Instance 13072f18-5487-409a-85d7-832cf25c5fa5 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:07.466205 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1973d708-2d9d-4c82-a23e-b6e88511df01 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "DELETE /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 404 len: 111 microversion: 2.1 time: 0.038408 May 07 21:47:07.466816 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 278/544] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:47:07 2022] DELETE /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:07.475514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.476417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 13072f18-5487-409a-85d7-832cf25c5fa5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.483425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.484275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.485793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.486445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.497247 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6431d8dc-1ae0-4f14-82f5-85d0fc63d464 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1646 microversion: 2.1 time: 0.236421 May 07 21:47:07.497989 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 267/545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1646 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:07.505758 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] HTTP exception thrown: Instance 13072f18-5487-409a-85d7-832cf25c5fa5 could not be found. May 07 21:47:07.506606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Returning 404 to user: Instance 13072f18-5487-409a-85d7-832cf25c5fa5 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:07.507601 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0073daad-aae7-4b39-a090-c9fd474da8da tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5" status: 404 len: 111 microversion: 2.1 time: 0.035974 May 07 21:47:07.508255 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 279/546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/servers/13072f18-5487-409a-85d7-832cf25c5fa5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:07.515736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.516236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.522527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.523398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.524021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.524829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.537503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d560f133-a290-4dff-9b77-2f41ce832a1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.539406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d560f133-a290-4dff-9b77-2f41ce832a1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.551565 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] HTTP exception thrown: Instance 5158d992-548d-41d0-a26a-a1dae158fea9 could not be found. May 07 21:47:07.552177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Returning 404 to user: Instance 5158d992-548d-41d0-a26a-a1dae158fea9 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:07.553000 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2660e42a-d225-47d0-84fc-b992a5b0eda6 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 404 len: 111 microversion: 2.1 time: 0.040949 May 07 21:47:07.553742 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 280/547] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:47:07 2022] DELETE /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:07.553856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d560f133-a290-4dff-9b77-2f41ce832a1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.554430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d560f133-a290-4dff-9b77-2f41ce832a1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.555466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d560f133-a290-4dff-9b77-2f41ce832a1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.556909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d560f133-a290-4dff-9b77-2f41ce832a1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.562506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.563840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] [instance: 5158d992-548d-41d0-a26a-a1dae158fea9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.574035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.574035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.574035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.574035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.595844 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] HTTP exception thrown: Instance 5158d992-548d-41d0-a26a-a1dae158fea9 could not be found. May 07 21:47:07.596451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] Returning 404 to user: Instance 5158d992-548d-41d0-a26a-a1dae158fea9 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:07.597311 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f89086a3-7e68-48a7-a6c0-2c8596cdf0e9 tempest-DeleteServersAdminTestJSON-39229404 tempest-DeleteServersAdminTestJSON-39229404-project] 10.222.0.32 "GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9" status: 404 len: 111 microversion: 2.1 time: 0.038966 May 07 21:47:07.598096 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 281/548] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/servers/5158d992-548d-41d0-a26a-a1dae158fea9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:07.602819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.603426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.609582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.610042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.612053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.612510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.699911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:07.737094 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d560f133-a290-4dff-9b77-2f41ce832a1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1646 microversion: 2.1 time: 0.226479 May 07 21:47:07.738247 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 268/549] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1646 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:07.752953 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44a90684-c9c0-47e2-802c-05a487129e7f tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.153933 May 07 21:47:07.757800 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 282/550] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:07.763270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-992f4709-efcb-4bbc-b05f-b9ae3dd7bb65 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.767991 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:07.767991 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:07.769705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992f4709-efcb-4bbc-b05f-b9ae3dd7bb65 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.770541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992f4709-efcb-4bbc-b05f-b9ae3dd7bb65 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.771444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992f4709-efcb-4bbc-b05f-b9ae3dd7bb65 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.771938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992f4709-efcb-4bbc-b05f-b9ae3dd7bb65 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.806019 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-992f4709-efcb-4bbc-b05f-b9ae3dd7bb65 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054289 May 07 21:47:07.807172 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 269/551] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:07.819766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:07.829966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.845388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.847504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.848450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.851831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.890954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lazy-loading 'flavor' on Instance uuid 88890ab3-196b-48f2-85db-aacd17e27ba5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:07.896548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:07.896548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:07.905359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.905594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Going to try to live migrate instance to nch2-master-1 {{(pid=136682) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:47:07.905736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:07.906542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:07.907041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.118121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:08.127284 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ccd3ab70-e6ef-4ddc-abb5-9e9a98c20435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.236733 May 07 21:47:08.137983 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 270/552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:07 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:08.143526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:08.144149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:08.151650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.152106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.152899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.153390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.338871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:08.351137 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ca8ce4a4-685f-439d-896e-d420ba50a14a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1476 microversion: 2.1 time: 0.211838 May 07 21:47:08.352058 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 271/553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:08 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:08.356633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eeff2e08-7eae-4447-801c-90eab46a19cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d4ebc10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:08.404282 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eeff2e08-7eae-4447-801c-90eab46a19cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1411 microversion: 2.1 time: 0.051160 May 07 21:47:08.406350 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 272/554] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:08 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1411 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:08.411138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:08.411994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:08.421113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.421682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.422707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.423235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.608786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:08.618526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:08.620097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:08.621438 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec32c2f9-89cd-43a5-80fd-6319c7486014 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1556 microversion: 2.25 time: 0.214035 May 07 21:47:08.624089 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 273/555] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:08 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:08.644849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:08.645608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:08.652467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.652922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.653739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.654171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.813249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid bfa51d13-aa03-48ef-9aea-32ae407e5d9d {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:08.830561 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c58096f-b661-4009-9f7a-10531df62c4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 2047 microversion: 2.25 time: 0.191393 May 07 21:47:08.841985 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 274/556] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:08 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 2047 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:08.847505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a3198d5f-d309-4a04-b50d-2b72b66c2c46 req-831e6f3b-c3e3-4852-95c7-0e8d9567d81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0284aa35-4e58-4e15-a194-a500996ed82e", "name": "network-vif-plugged", "status": "completed", "tag": "149155db-c2db-4827-9746-fffdb2d0018e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:08.855602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a3198d5f-d309-4a04-b50d-2b72b66c2c46 req-831e6f3b-c3e3-4852-95c7-0e8d9567d81d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.856065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a3198d5f-d309-4a04-b50d-2b72b66c2c46 req-831e6f3b-c3e3-4852-95c7-0e8d9567d81d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.868261 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a3198d5f-d309-4a04-b50d-2b72b66c2c46 req-831e6f3b-c3e3-4852-95c7-0e8d9567d81d service nova] Creating event network-vif-plugged:149155db-c2db-4827-9746-fffdb2d0018e for instance 0284aa35-4e58-4e15-a194-a500996ed82e on nch2-master-1 May 07 21:47:08.873124 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a3198d5f-d309-4a04-b50d-2b72b66c2c46 req-831e6f3b-c3e3-4852-95c7-0e8d9567d81d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029895 May 07 21:47:08.874072 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 275/557] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:08.879162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:08.879825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:08.886182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.886643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.887541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:08.888075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:08.989011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:09.012417 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8128248-657f-4c47-85f4-5fc986628fad tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.137089 May 07 21:47:09.018945 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 276/558] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:08 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:09.022942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.025873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:09.032921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.033402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.034156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.034590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.290376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid bfa51d13-aa03-48ef-9aea-32ae407e5d9d {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:09.315345 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-021b5430-4396-4588-9b48-31d2ce63b61e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 2047 microversion: 2.25 time: 0.300316 May 07 21:47:09.327733 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 277/559] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 2047 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:09.327733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.327733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:09.330038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.330506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.331335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.331789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.504557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:09.513266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b27d6d64-a40b-4061-bf53-6b83805f9cb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.195705 May 07 21:47:09.514106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 278/560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:09.519657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6cd867b2-f650-4d2a-982c-c9fb05fe14e8 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.521284 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:09.521284 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:09.522576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd867b2-f650-4d2a-982c-c9fb05fe14e8 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.523182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd867b2-f650-4d2a-982c-c9fb05fe14e8 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.523992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd867b2-f650-4d2a-982c-c9fb05fe14e8 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.524435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd867b2-f650-4d2a-982c-c9fb05fe14e8 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.527010 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2b4b5bd-1f51-4eaf-b090-076e59a34bfb tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5/action" status: 202 len: 0 microversion: 2.1 time: 1.712205 May 07 21:47:09.531164 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 283/561] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:07 2022] POST /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5/action => generated 0 bytes in 1717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:09.536808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.540392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:09.548864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.549621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.550641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.551172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.551337 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6cd867b2-f650-4d2a-982c-c9fb05fe14e8 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036270 May 07 21:47:09.552986 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 279/562] 10.222.0.32 () {60 vars in 1216 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:47:09.559219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5202c207-1873-4d72-a02c-8fa5e3a5c8ca tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d4423a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.628510 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5202c207-1873-4d72-a02c-8fa5e3a5c8ca tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1420 microversion: 2.1 time: 0.074242 May 07 21:47:09.629850 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 280/563] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:09.637632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.638251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:09.645057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.646152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.646964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.647413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.728234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:09.737919 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0ea6990-bb71-4527-9f0a-deccaede5842 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1476 microversion: 2.1 time: 0.205488 May 07 21:47:09.738826 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 284/564] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1476 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:09.744181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7abe131c-16e6-4bb2-a904-81285c79c6f5 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:09.745090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7abe131c-16e6-4bb2-a904-81285c79c6f5 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:09.752181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abe131c-16e6-4bb2-a904-81285c79c6f5 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.753505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abe131c-16e6-4bb2-a904-81285c79c6f5 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.754998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abe131c-16e6-4bb2-a904-81285c79c6f5 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.755442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abe131c-16e6-4bb2-a904-81285c79c6f5 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.787347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:09.795384 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-35fed73e-5b40-44b9-a810-06c88581314b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.164222 May 07 21:47:09.795986 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 281/565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:09.801573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f99b13aa-d3b0-4405-b8cd-6ac5ee73a0ae tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d14b9d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.842046 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7abe131c-16e6-4bb2-a904-81285c79c6f5 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d/action" status: 202 len: 0 microversion: 2.25 time: 0.101583 May 07 21:47:09.842958 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 285/566] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:47:09 2022] POST /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:47:09.853177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:09.854581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:09.858489 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f99b13aa-d3b0-4405-b8cd-6ac5ee73a0ae tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 200 len: 1420 microversion: 2.1 time: 0.060995 May 07 21:47:09.859666 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 282/567] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:09.862936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.863389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.864210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:09.864650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:09.874449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94d96b16-60a1-4b39-9125-f8ce927c3670 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d227a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:10.034102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid bfa51d13-aa03-48ef-9aea-32ae407e5d9d {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:10.048268 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86bf028e-96f9-459b-a8e5-d086c14f441c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 2052 microversion: 2.25 time: 0.200353 May 07 21:47:10.048853 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 286/568] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:09 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 2052 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:47:10.053724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:10.054239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:10.060300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.060758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.061937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.062027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.141151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:10.160228 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-df92144d-1e98-4978-842d-416b4bcf9b08 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.110097 May 07 21:47:10.173919 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 287/569] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:10 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:10.532490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:10.533206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:10.542248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.545667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.547113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.547852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.753708 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94d96b16-60a1-4b39-9125-f8ce927c3670 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 204 len: 0 microversion: 2.1 time: 0.885823 May 07 21:47:10.754301 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 283/570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:09 2022] DELETE /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 0 bytes in 887 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 21:47:10.759186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:10.759817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:10.768165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.768635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.769434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.769882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.825452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:10.833334 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b5120bb-40e0-4631-8ecd-78d2d2bdce2c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.305499 May 07 21:47:10.833905 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 288/571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:10 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:10.844276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:10.854008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:10.859967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.861026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.861822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.862267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.903165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:47:10.955639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:10.963164 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-155457e0-17bb-4058-87a0-1a0e1fe4e9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1462 microversion: 2.1 time: 0.207807 May 07 21:47:10.963737 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 284/572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:10 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1462 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:10.968494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:10.969106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:10.976333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.976822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:10.977592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:10.978027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.000558 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 204 len: 0 microversion: 2.1 time: 0.159701 May 07 21:47:11.001742 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 289/573] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:47:10 2022] DELETE /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:47:11.002929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:11.004111 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0ce5a6a7-4be8-4e82-9512-d97e8d0b5157 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001516 May 07 21:47:11.004988 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 290/574] 10.222.0.32 () {56 vars in 885 bytes} [Sat May 7 21:47:11 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 07 21:47:11.028284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:11.037470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:11.053616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.055233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.058219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.058680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.163451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:11.171603 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-541fc1ec-9775-4bac-a0fe-00d006bf9944 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.206685 May 07 21:47:11.172280 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 285/575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:10 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:11.179030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:11.180157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:11.187104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.187632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.188540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.189186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.311361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:11.321694 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4701fbe-f026-43f7-958a-f0991479fe81 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1462 microversion: 2.1 time: 0.315138 May 07 21:47:11.324096 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 291/576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:11 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1462 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:11.329640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1839668839", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "d3775254-6c3d-4b27-a2f1-ae073d9f981d"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:11.349607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid bfa51d13-aa03-48ef-9aea-32ae407e5d9d {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:11.384689 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-811123b0-3177-416f-a1b5-db39fac50c53 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 2032 microversion: 2.25 time: 0.210099 May 07 21:47:11.385816 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 286/577] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:11 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 2032 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:11.390921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:11.391862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:11.402047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.407574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.407709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] validate_networks() for [('d3775254-6c3d-4b27-a2f1-ae073d9f981d', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:11.408760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.409392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.500254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:11.519254 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea296528-f9f4-4b72-b5f5-83dc9bfb74f5 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.131744 May 07 21:47:11.522913 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 287/578] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:11 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:11.535717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:11.539777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:11.551542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.552201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.553092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.553643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.656200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:11.657546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:11.658824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:11.660182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:11.660724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:11.733506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:11.740056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.748463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.750160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.750993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.790737 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a0e6fb2-2b2a-46fe-a5f3-c8aacf490fed tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action" status: 202 len: 1066 microversion: 2.1 time: 0.266203 May 07 21:47:11.792504 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 288/579] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:11 2022] POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action => generated 1066 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 07 21:47:11.798190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:11.799600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:11.811033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.811956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.813065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:11.814231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:11.912040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'flavor' on Instance uuid bfa51d13-aa03-48ef-9aea-32ae407e5d9d {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:11.970579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Going to try to live migrate instance to nch1-master-1 {{(pid=136681) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:47:12.112030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:12.113045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:12.113751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:12.114424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:12.115130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:12.133165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.133685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.134681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.135153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.154510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:12.159334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for user c562e7dec6d34cd0a7fc7cea14fa5e74 and project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:12.180050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:47:12.182566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:47:12.242021 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a4c1521-13e3-4c9d-b480-463fa1a844ac tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916401 May 07 21:47:12.243277 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 292/580] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:47:12.250194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-cd61b627-b09b-4961-a504-a6a810c36802 req-d8fe7506-a5fa-4639-9e02-b33c7c834d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88890ab3-196b-48f2-85db-aacd17e27ba5", "name": "network-vif-unplugged", "status": "completed", "tag": "1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:12.259981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-cd61b627-b09b-4961-a504-a6a810c36802 req-d8fe7506-a5fa-4639-9e02-b33c7c834d32 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.260854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-cd61b627-b09b-4961-a504-a6a810c36802 req-d8fe7506-a5fa-4639-9e02-b33c7c834d32 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.283865 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-cd61b627-b09b-4961-a504-a6a810c36802 req-d8fe7506-a5fa-4639-9e02-b33c7c834d32 service nova] Creating event network-vif-unplugged:1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952 for instance 88890ab3-196b-48f2-85db-aacd17e27ba5 on nch1-master-1 May 07 21:47:12.290406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-cd61b627-b09b-4961-a504-a6a810c36802 req-d8fe7506-a5fa-4639-9e02-b33c7c834d32 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045648 May 07 21:47:12.296120 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 293/581] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:12.303163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:12.304150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:12.317257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.320395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.322743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.323303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.538003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:12.546551 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5972bc80-abf7-4f0e-80df-7999441a1a62 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.247818 May 07 21:47:12.548460 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 294/582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:12 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:12.554102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:12.554996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:12.561851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.562377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.563847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.564486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.737033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:12.746912 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5f41ae3-259b-43d7-bdd5-9b5f90fbcc22 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.196569 May 07 21:47:12.747863 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 295/583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:12 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:12.752805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:12.753523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:12.759485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.760023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.760870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.761518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.903829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:12.911738 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21d65f8c-30c9-4ba3-b90d-aed5bda3d530 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.162705 May 07 21:47:12.912312 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 296/584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:12 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:12.916939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:12.917721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:12.924146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.924600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.925372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:12.925814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:12.987345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:12.994617 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7f4ee6af-2f70-4286-bbb7-7ee00db9abe7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1212 microversion: 2.1 time: 0.081200 May 07 21:47:12.995257 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 297/585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:12 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1212 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:12.999917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:13.000610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:13.006359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:13.006851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:13.007633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:13.008109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:13.088220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:13.105962 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2fb730ab-43e2-4e05-9f24-bae6055828dc tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.109709 May 07 21:47:13.106547 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 298/586] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:12 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:13.564737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:13.565361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:13.571874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:13.572718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:13.573512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:13.574233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:13.800335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:13.811013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-823c19c7-67cd-4bb8-afe6-e2ff2d8cd81c tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.250582 May 07 21:47:13.811926 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 299/587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:13 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:13.818722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:13.820161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:13.828437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:13.829225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:13.830830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:13.831473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.079630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:14.093023 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5821e70-e595-4ae7-9980-f6f96883d0ac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.279376 May 07 21:47:14.095807 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 300/588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:13 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:14.104245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:14.105548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:14.112535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.113343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.119010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.119534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.202889 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-063984f6-682e-4d8f-97dc-60ad2fafdf4c tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d/action" status: 202 len: 0 microversion: 2.25 time: 2.409260 May 07 21:47:14.203468 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 289/589] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:47:11 2022] POST /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d/action => generated 0 bytes in 2411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:47:14.221197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:14.221825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:14.229354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.229830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.230633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.231104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.271294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:14.279252 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f3a6e92-cd3c-426b-87ef-4e8d8da60a34 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.181573 May 07 21:47:14.279847 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 301/590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:14 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:14.306324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:14.313977 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-72c32d54-ee2a-4a51-b9e0-a0d6eb682598 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1266 microversion: 2.1 time: 0.109394 May 07 21:47:14.314556 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 290/591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:14 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:14.319261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:14.319877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:14.325947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.326410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.327274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.327917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.413339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:14.439574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Calling method '.version_select at 0x7fc41d0e55e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:14.440478 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:14.440478 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:47:14.442150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.442625 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4bf6cfc-b94e-43ac-a9f7-c6935210d0a2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.126838 May 07 21:47:14.442738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.443278 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 291/592] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:14 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:14.459251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.459942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.463099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:14.464041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:14.472086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.472769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.478917 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4f1d026-ca5b-495d-b2d5-f9afbd47b94c tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.197934 May 07 21:47:14.479638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.479961 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 302/593] 10.222.0.32 () {60 vars in 1186 bytes} [Sat May 7 21:47:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:47:14.480765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.481820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.482327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.485235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-73d1dae1-6439-4a14-95e5-2380f79e0887 req-e5914974-9aeb-4894-8a56-5cd698f0d9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88890ab3-196b-48f2-85db-aacd17e27ba5", "tag": "1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952"}, {"server_uuid": "63bd05ee-f966-4884-89dc-17c61c1942fe", "name": "network-vif-deleted", "tag": "1520ea65-2c7b-46a7-8360-d42695eee536"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:14.494519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-73d1dae1-6439-4a14-95e5-2380f79e0887 req-e5914974-9aeb-4894-8a56-5cd698f0d9ef service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.495241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-73d1dae1-6439-4a14-95e5-2380f79e0887 req-e5914974-9aeb-4894-8a56-5cd698f0d9ef service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.512467 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-73d1dae1-6439-4a14-95e5-2380f79e0887 req-e5914974-9aeb-4894-8a56-5cd698f0d9ef service nova] Creating event network-changed:1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952 for instance 88890ab3-196b-48f2-85db-aacd17e27ba5 on nch1-master-1 May 07 21:47:14.513651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-73d1dae1-6439-4a14-95e5-2380f79e0887 req-e5914974-9aeb-4894-8a56-5cd698f0d9ef service nova] Creating event network-vif-deleted:1520ea65-2c7b-46a7-8360-d42695eee536 for instance 63bd05ee-f966-4884-89dc-17c61c1942fe on nch1-master-1 May 07 21:47:14.522113 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-73d1dae1-6439-4a14-95e5-2380f79e0887 req-e5914974-9aeb-4894-8a56-5cd698f0d9ef service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040753 May 07 21:47:14.524921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 303/594] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:14.531431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bbb3e1b3-b6bb-445e-a6f1-b3e8071bcd30 tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Calling method '.version_select at 0x7fc41d3233a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:14.533368 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:14.533368 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:47:14.535262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb3e1b3-b6bb-445e-a6f1-b3e8071bcd30 tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.535729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb3e1b3-b6bb-445e-a6f1-b3e8071bcd30 tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.553273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb3e1b3-b6bb-445e-a6f1-b3e8071bcd30 tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.554041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb3e1b3-b6bb-445e-a6f1-b3e8071bcd30 tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.561149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bbb3e1b3-b6bb-445e-a6f1-b3e8071bcd30 tempest-HypervisorAdminV228Test-1413428491 tempest-HypervisorAdminV228Test-1413428491-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.034648 May 07 21:47:14.561992 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 304/595] 10.222.0.32 () {60 vars in 1192 bytes} [Sat May 7 21:47:14 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:47:14.747413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:14.758294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:14.760421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:14.761978 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c46b8f4-2aef-41ae-877c-0c5f21a03ebf tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.316956 May 07 21:47:14.765483 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 292/596] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:14 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:14.830720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:14.832666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:14.839395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.840107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:14.841096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:14.841872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.112747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:15.113703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:15.122104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.122560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.123632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.124586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.167875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:15.175924 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-79dc54b9-51be-44e8-ac11-7cec77ad9805 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.350227 May 07 21:47:15.176814 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 305/597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:14 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:15.296784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:15.297941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:15.320062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.320910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.323055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.323793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.401115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:15.409682 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2bf39757-0308-435d-8d4e-507b3d61f079 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.301364 May 07 21:47:15.410600 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 293/598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:15 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:15.415602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:15.416377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:15.425295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.425846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.426711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.427251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.497864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:15.507727 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-11a24595-46ea-496c-9fe7-92c56ac1d5c5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1266 microversion: 2.1 time: 0.095685 May 07 21:47:15.508329 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 294/599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:15 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:15.513436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:15.514287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:15.524754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.524754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.524754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.524754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.622656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:15.647942 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9fd9cefe-8a76-457e-8649-f06a97cc1dc2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.138167 May 07 21:47:15.649745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 295/600] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:15 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:15.684940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:15.697287 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ad792e8-29ad-4fca-a6ef-da76290e880d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.402284 May 07 21:47:15.702488 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 306/601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:15 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:15.784716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:15.784879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:15.791163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.791686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.792467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:15.792903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:15.924223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:15.932132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:15.933632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:15.934811 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0d492870-a998-4b28-8bfe-bee92a786936 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.155547 May 07 21:47:15.935570 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 296/602] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:15 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:16.193400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:16.195336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:16.202404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.202663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.203486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.204445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.427399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:16.427905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:16.435702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.436930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.438473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.439179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.532087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:16.541253 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ca8cffde-f80e-4112-801b-816de86a72a8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.351853 May 07 21:47:16.551433 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 307/603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:16 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:16.556875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:16.558052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:16.565802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.566599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.567646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.568277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.694571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:16.708252 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3f5673b-7d7e-40a0-bdca-1e947d10c05c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.283238 May 07 21:47:16.708252 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 297/604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:16 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:16.720734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-db6fae89-bc5b-4e14-8da4-fbcfb0d87448 req-b1ee5746-b0c1-4164-9a69-8195921788dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa51d13-aa03-48ef-9aea-32ae407e5d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "aac6c92e-cff2-4454-9401-e05c725747f7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:16.732360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-db6fae89-bc5b-4e14-8da4-fbcfb0d87448 req-b1ee5746-b0c1-4164-9a69-8195921788dd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.733232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-db6fae89-bc5b-4e14-8da4-fbcfb0d87448 req-b1ee5746-b0c1-4164-9a69-8195921788dd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.746828 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-db6fae89-bc5b-4e14-8da4-fbcfb0d87448 req-b1ee5746-b0c1-4164-9a69-8195921788dd service nova] Creating event network-vif-unplugged:aac6c92e-cff2-4454-9401-e05c725747f7 for instance bfa51d13-aa03-48ef-9aea-32ae407e5d9d on nch2-master-1 May 07 21:47:16.753243 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-db6fae89-bc5b-4e14-8da4-fbcfb0d87448 req-b1ee5746-b0c1-4164-9a69-8195921788dd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044178 May 07 21:47:16.754112 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 298/605] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:16.760035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:16.760943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:16.768177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.768722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.770182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.770643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.850054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:16.871820 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d7334cb-e30f-4efa-b9dc-8b3b81d57d26 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.115606 May 07 21:47:16.872810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 299/606] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:16 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:16.887355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:16.892537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:16.892941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:16.897449 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0effc2c-9e75-47b8-8eca-dfdfce7097c8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1308 microversion: 2.1 time: 0.344661 May 07 21:47:16.900321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.900848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.901433 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 308/607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:16 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:16.902653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.903187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.953927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:16.955212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:16.976219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.977590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:16.978684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:16.979494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.084830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:17.093449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-19e7e23c-8c52-43b2-a2ff-24599378fa61 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.206002 May 07 21:47:17.094802 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 300/608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:16 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:17.334416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:17.342421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:17.344163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:17.345885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-812cd06b-f3df-4601-9ae9-05b4bf3ad14f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.397506 May 07 21:47:17.357098 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 309/609] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:16 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:47:17.557585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:17.558204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:17.564830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.565396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.566264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.566706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.714070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:17.724634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:17.725248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:17.731290 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87ec4dfc-0884-46a8-9125-c79eb66065c9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.177616 May 07 21:47:17.731879 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 301/610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:17 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:17.735259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.735712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.736513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.736946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.885242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:17.893606 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a9293a2-7130-450a-86bc-1b8cf9f2fc43 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.173087 May 07 21:47:17.893770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:17.894186 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 310/611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:17 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:17.894357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:17.901295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.901948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.903195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.903942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.921181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:17.921897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:17.928388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.928999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.929983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:17.930494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:17.990913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:18.009552 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81ee7c03-77bc-4137-b7fd-5114957ab3fa tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.120292 May 07 21:47:18.010550 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 302/612] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:17 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:47:18.070759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.085215 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ec451db6-f161-4920-8adb-cbb942f0e4b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1308 microversion: 2.1 time: 0.169033 May 07 21:47:18.085799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 311/613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:17 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:18.111271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.112002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:18.117730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.118170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.118969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.119406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.244532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f033e3e-5e53-49b6-af59-f44e10cb4c25 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Calling method '.version_select at 0x7fc41d6419d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.245493 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:18.245493 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:18.246739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1f033e3e-5e53-49b6-af59-f44e10cb4c25 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '53b47423fc234f879da69fd46934687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d023c7f4a049c2b0369dff8942e141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.247482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f033e3e-5e53-49b6-af59-f44e10cb4c25 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:18.248634 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1f033e3e-5e53-49b6-af59-f44e10cb4c25 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.170589 May 07 21:47:18.249161 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 303/614] 10.222.0.32 () {58 vars in 1166 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:18.250315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.258808 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c01b5d4d-946b-4bcf-8e61-0a508791731a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.151403 May 07 21:47:18.258968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb62eebc-2575-474c-8619-8de189efaff6 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Calling method '.version_select at 0x7fc41d594af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.259529 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 312/615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:18.259627 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:18.259627 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:18.260716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb62eebc-2575-474c-8619-8de189efaff6 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '53b47423fc234f879da69fd46934687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d023c7f4a049c2b0369dff8942e141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.261480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb62eebc-2575-474c-8619-8de189efaff6 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:18.262290 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb62eebc-2575-474c-8619-8de189efaff6 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.007282 May 07 21:47:18.262814 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 304/616] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:18.272572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-996e213b-3e91-4e92-b250-3133e2723621 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Calling method '.version_select at 0x7fc41d972ca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.273370 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:18.273370 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:47:18.274466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-996e213b-3e91-4e92-b250-3133e2723621 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '53b47423fc234f879da69fd46934687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d023c7f4a049c2b0369dff8942e141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.275220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-996e213b-3e91-4e92-b250-3133e2723621 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:18.276028 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-996e213b-3e91-4e92-b250-3133e2723621 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.007076 May 07 21:47:18.276530 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 313/617] 10.222.0.32 () {58 vars in 1178 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:18.340772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Calling method '.version_select at 0x7fc41d14b430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.342736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.343207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.358953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.359402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.364551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.365173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:18.369579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.370026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.372107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.372551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.373331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.373777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.376329 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-19daf870-c772-4e58-9179-4e5f3b29aca7 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.094794 May 07 21:47:18.376902 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 305/618] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:18.386332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee3bc533-7daa-4406-a7d0-bc5283450b5e tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Calling method '.version_select at 0x7fc41d594940>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.387146 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:18.387146 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:18.388247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee3bc533-7daa-4406-a7d0-bc5283450b5e tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '53b47423fc234f879da69fd46934687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d023c7f4a049c2b0369dff8942e141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.388857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee3bc533-7daa-4406-a7d0-bc5283450b5e tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:18.389646 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee3bc533-7daa-4406-a7d0-bc5283450b5e tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.006931 May 07 21:47:18.390140 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 306/619] 10.222.0.32 () {58 vars in 1172 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:18.398232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea9a52fd-8cd5-4a0b-8604-50efccb4730a tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Calling method '.version_select at 0x7fc41d67e160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.399827 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ea9a52fd-8cd5-4a0b-8604-50efccb4730a tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] HTTP exception thrown: Hypervisor with ID '28cec74e-0a06-4839-acdb-f840b6789bae' could not be found. May 07 21:47:18.400363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea9a52fd-8cd5-4a0b-8604-50efccb4730a tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Returning 404 to user: Hypervisor with ID '28cec74e-0a06-4839-acdb-f840b6789bae' could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:18.401138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea9a52fd-8cd5-4a0b-8604-50efccb4730a tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/28cec74e-0a06-4839-acdb-f840b6789bae/uptime" status: 404 len: 123 microversion: 2.1 time: 0.006210 May 07 21:47:18.401622 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 307/620] 10.222.0.32 () {58 vars in 1277 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors/28cec74e-0a06-4839-acdb-f840b6789bae/uptime => generated 123 bytes in 7 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:18.409287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Calling method '.version_select at 0x7fc41d8dd670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.410582 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:18.410582 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:18.411777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.412227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.425942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.426391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.436112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.436566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.443231 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-021dd790-0caf-4119-a2f3-c1a758014325 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.037084 May 07 21:47:18.443975 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 308/621] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:47:18.453136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3301698-7631-4602-9a9b-44afd3915953 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Calling method '.version_select at 0x7fc41d67e310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.453987 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:18.453987 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:18.455079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3301698-7631-4602-9a9b-44afd3915953 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '53b47423fc234f879da69fd46934687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5d023c7f4a049c2b0369dff8942e141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.455704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3301698-7631-4602-9a9b-44afd3915953 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:18.456487 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3301698-7631-4602-9a9b-44afd3915953 tempest-HypervisorAdminNegativeTestJSON-1633247851 tempest-HypervisorAdminNegativeTestJSON-1633247851-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.006963 May 07 21:47:18.457119 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 309/622] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:18.464851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bbce4f3-ee73-4c3f-b9e0-abd5e5e6bbf9 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Calling method '.version_select at 0x7fc41d6cfca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.466418 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5bbce4f3-ee73-4c3f-b9e0-abd5e5e6bbf9 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] HTTP exception thrown: Hypervisor with ID 'fc364f60-ecbc-4ba6-909a-4e4b4c445505' could not be found. May 07 21:47:18.466994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bbce4f3-ee73-4c3f-b9e0-abd5e5e6bbf9 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] Returning 404 to user: Hypervisor with ID 'fc364f60-ecbc-4ba6-909a-4e4b4c445505' could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:18.467771 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bbce4f3-ee73-4c3f-b9e0-abd5e5e6bbf9 tempest-HypervisorAdminNegativeTestJSON-1620323231 tempest-HypervisorAdminNegativeTestJSON-1620323231-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/fc364f60-ecbc-4ba6-909a-4e4b4c445505" status: 404 len: 123 microversion: 2.1 time: 0.006145 May 07 21:47:18.468407 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 310/623] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/os-hypervisors/fc364f60-ecbc-4ba6-909a-4e4b4c445505 => generated 123 bytes in 7 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:18.508547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.516910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.518702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:18.519927 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fcd272bc-60e2-4d64-ab8c-311157bf13c5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.159876 May 07 21:47:18.520490 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 314/624] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:47:18.646636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.647186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:18.652926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.653376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.654142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.654583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.680393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:47:18.749639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.750846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:18.768820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.771331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.771907 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-649bdf90-9c28-4de2-82a9-ec3caed2b37a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 204 len: 0 microversion: 2.1 time: 0.130442 May 07 21:47:18.772554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.772853 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 311/625] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:47:18 2022] DELETE /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:47:18.773108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.798410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-51e88729-26d3-49af-9124-4b878dfcdb0f req-7d0e567e-2808-4a8c-b2af-54c202ceed64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a792c3-0086-43d1-8995-7d56146f84b2", "tag": "85df8e70-88cc-4aed-a304-7a9a475aa9c1"}, {"name": "network-changed", "server_uuid": "bfa51d13-aa03-48ef-9aea-32ae407e5d9d", "tag": "aac6c92e-cff2-4454-9401-e05c725747f7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:18.813722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-51e88729-26d3-49af-9124-4b878dfcdb0f req-7d0e567e-2808-4a8c-b2af-54c202ceed64 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.814177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-51e88729-26d3-49af-9124-4b878dfcdb0f req-7d0e567e-2808-4a8c-b2af-54c202ceed64 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.828742 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-51e88729-26d3-49af-9124-4b878dfcdb0f req-7d0e567e-2808-4a8c-b2af-54c202ceed64 service nova] Creating event network-changed:85df8e70-88cc-4aed-a304-7a9a475aa9c1 for instance 12a792c3-0086-43d1-8995-7d56146f84b2 on nch1-master-1 May 07 21:47:18.829264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-51e88729-26d3-49af-9124-4b878dfcdb0f req-7d0e567e-2808-4a8c-b2af-54c202ceed64 service nova] Creating event network-changed:aac6c92e-cff2-4454-9401-e05c725747f7 for instance bfa51d13-aa03-48ef-9aea-32ae407e5d9d on nch2-master-1 May 07 21:47:18.839107 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-51e88729-26d3-49af-9124-4b878dfcdb0f req-7d0e567e-2808-4a8c-b2af-54c202ceed64 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050545 May 07 21:47:18.840161 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 312/626] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:18.915782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:18.916506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:18.923351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.923983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:18.924977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:18.925421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.098470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:19.107173 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-edb89adc-b2c2-4694-8f8f-dcca40cdb079 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.362082 May 07 21:47:19.108507 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 315/627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:19.114519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-194138683", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "150453885", "adminPass": "***", "networks": [{"uuid": "849ca462-b333-410b-8c4a-24e67429a8f8"}], "security_groups": [{"name": "tempest-securitygroup--867261986"}], "key_name": "tempest-keypair-1545647605", "user_data": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:19.146148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:19.154129 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c11f483-a593-4cef-967a-5c1b6744ad64 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.243169 May 07 21:47:19.157367 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 313/628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:18 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:19.175242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:19.175242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:19.182830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.183376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.184243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.184757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.272871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:19.292302 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5347379f-f79d-4c51-9ff1-f32bff809677 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.124275 May 07 21:47:19.304596 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 314/629] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:19 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:19.304596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:19.304596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:19.305863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.306321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.307301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.307816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.317812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] validate_networks() for [('849ca462-b333-410b-8c4a-24e67429a8f8', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:19.470032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:19.478023 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2723ff0b-c6ac-453a-ba88-74300e744e01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1308 microversion: 2.1 time: 0.183478 May 07 21:47:19.478607 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 315/630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:19 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:19.487459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:19.487459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:19.490026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.490488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.491354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.491797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.643010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:19.652668 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ccd2d7b7-dc30-4f5a-b217-8b0071b3fa76 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.172890 May 07 21:47:19.653947 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 316/631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:19 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:19.661854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:19.663105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:19.670079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.670535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.671369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:19.671820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:19.878540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:19.905118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:19.915606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:19.918175 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c3f33f8-f962-4385-b6d9-06ef606c66b4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.261244 May 07 21:47:19.927444 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 317/632] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:19 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:20.125181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:20.126115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:20.133368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.134116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.135044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.135778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.316536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:20.327381 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b1c2163-adef-4757-b2f8-18df5af97639 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.206180 May 07 21:47:20.337364 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 318/633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:20 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:20.342607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:20.343264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:20.353402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.353866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.354871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.355499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.520801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:20.528459 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b8e4d01d-c317-468c-8019-d2bbb4d8325c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.189602 May 07 21:47:20.529268 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 319/634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:20 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:20.534850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:20.535773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:20.542466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.542983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.543780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.544231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.626259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:20.651352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:20.651842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:20.652383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:20.652801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:20.653362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:20.665304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.665569 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dc313249-0288-4025-a72b-a51601e4d760 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.134953 May 07 21:47:20.666054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.666581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.667027 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 320/635] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:20 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:20.671683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.680645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:20.681684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:20.692546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.694013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.695409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:20.696023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.696967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.699817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Getting quotas for user 85eeaeaf9f1c464f8d45eff93bab41cb and project d7a25055f3544e5c95bacd3a07611e1d. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:20.713423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:47:20.715968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:47:20.801819 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-109d70b8-894f-4f3a-bf33-b85bc8b5c477 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.691775 May 07 21:47:20.802498 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 316/636] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:47:20.817935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:20.820686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:20.834458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.834944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.835871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:20.836310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:20.928106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:20.940705 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ab11869-baa6-449d-845c-bce373d6cba7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1308 microversion: 2.1 time: 0.271568 May 07 21:47:20.941632 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 321/637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:20 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:20.947861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab8cc95e-637f-42da-ab46-469f94f6099e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:20.948574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ab8cc95e-637f-42da-ab46-469f94f6099e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:21.030180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab8cc95e-637f-42da-ab46-469f94f6099e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:21.038582 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ab8cc95e-637f-42da-ab46-469f94f6099e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1262 microversion: 2.1 time: 0.095731 May 07 21:47:21.039316 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 322/638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:20 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:21.048301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:21.048301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:21.051785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.052361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.053140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.054069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.231386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:21.233277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:21.239476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee214596-44f0-4071-a166-4eae5315f51b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.434207 May 07 21:47:21.245475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:21.247804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:21.251392 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 317/639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:20 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:21.251673 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51f15584-9e99-4a76-8b79-363f819962ad tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.210251 May 07 21:47:21.252710 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 323/640] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:21 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:21.344725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:21.345574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:21.351842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.352386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.353316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.353850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.551347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:21.552029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:21.564279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.564730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.565579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.566215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.600587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:21.610906 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-514965d5-eb71-4414-9589-98b4f5a86684 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.267557 May 07 21:47:21.611693 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 318/641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:21 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:21.692860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:21.694165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:21.700890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.701598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.702582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.703278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.721675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:21.740842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1588674a-44de-4c07-b87f-48ec0e5928f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.198582 May 07 21:47:21.751830 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 324/642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:21 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:21.809822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:21.834213 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76c06fe8-a6a0-45a1-ae1e-476345ac5e0e tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1929 microversion: 2.75 time: 0.144466 May 07 21:47:21.847520 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 319/643] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:21 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:47:21.949604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Calling method '.version_select at 0x7fc41d227dc0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:21.950730 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:21.950730 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:21.955678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.956144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.958963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:21.961060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:21.971345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.971802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.972583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.979896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:21.995950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:21.996672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:22.030813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:22.031424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:22.042303 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15cb8f5a-b00e-41aa-8cd0-755ed5a6f273 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.295569 May 07 21:47:22.044347 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 325/644] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:47:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:22.272362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a8218b68-c90c-4e5a-84ea-201fd3355243 tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] Calling method '.version_select at 0x7fc41d573ee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:22.273429 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:22.273429 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:22.274906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a8218b68-c90c-4e5a-84ea-201fd3355243 tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '6ae1efbac3a54474af8b01eb9371abba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5a6610ec304bcd8a796cf709fb33b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:22.275806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a8218b68-c90c-4e5a-84ea-201fd3355243 tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:22.278394 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a8218b68-c90c-4e5a-84ea-201fd3355243 tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.227216 May 07 21:47:22.286731 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 326/645] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 21:47:22 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:22.292245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:22.298166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:22.333297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:22.333749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:22.337409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:22.338088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:22.696826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:22.720968 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-acf116ce-e256-44ac-8572-0d5fa3a5c2e4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1320 microversion: 2.1 time: 0.432410 May 07 21:47:22.722113 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 327/646] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:22 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:22.732307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:22.733272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:22.744937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:22.745395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:22.746184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:22.746628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:22.806917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:22.817802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f739d499-0d33-4485-a55a-9140f64f163c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1308 microversion: 2.1 time: 0.864143 May 07 21:47:22.830178 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 320/647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:21 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1308 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:22.846216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:22.849144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:22.870195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:22.873894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:22.876019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:22.876758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.117516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:23.127556 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee2e23e8-e975-4730-9f50-7b3a47358017 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.403697 May 07 21:47:23.138572 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 328/648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:22 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:23.150162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f60aa923-a1c4-4792-bd8f-a0e164d55562 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Calling method '.version_select at 0x7fc41cf49a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:23.153816 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:23.153816 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:23.157166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f60aa923-a1c4-4792-bd8f-a0e164d55562 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.158047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f60aa923-a1c4-4792-bd8f-a0e164d55562 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.178207 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-f60aa923-a1c4-4792-bd8f-a0e164d55562 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 07 21:47:23.182902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f60aa923-a1c4-4792-bd8f-a0e164d55562 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:23.184122 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f60aa923-a1c4-4792-bd8f-a0e164d55562 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.043975 May 07 21:47:23.184720 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 329/649] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:47:23 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:23.203225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:23.204752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:23.216126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.222548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.224731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:23.225375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.225869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.234633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:23.256916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:23.266797 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b68b8332-101a-40a2-9284-dad13efca421 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.429649 May 07 21:47:23.285799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 321/650] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:22 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:23.298419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:23.299801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:23.310449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.311297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.312515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.314244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.509000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:23.536931 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1dc8e374-09f9-4af5-a5ab-2f9ca0c50ea9 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.340466 May 07 21:47:23.546521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 330/651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:23 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:23.546521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e1009af2-093c-4b1e-aae1-0bbacb33d92b req-bf3d8762-e181-425c-9159-67bbbb4e37c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51", "name": "network-vif-deleted", "tag": "940b7f63-241e-47cd-901d-cf63ff106764"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:23.566419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e1009af2-093c-4b1e-aae1-0bbacb33d92b req-bf3d8762-e181-425c-9159-67bbbb4e37c5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.566903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e1009af2-093c-4b1e-aae1-0bbacb33d92b req-bf3d8762-e181-425c-9159-67bbbb4e37c5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.602549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e1009af2-093c-4b1e-aae1-0bbacb33d92b req-bf3d8762-e181-425c-9159-67bbbb4e37c5 service nova] Creating event network-vif-deleted:940b7f63-241e-47cd-901d-cf63ff106764 for instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 on nch1-master-1 May 07 21:47:23.614234 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e1009af2-093c-4b1e-aae1-0bbacb33d92b req-bf3d8762-e181-425c-9159-67bbbb4e37c5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073363 May 07 21:47:23.617656 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 331/652] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:23.622989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:23.623884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:23.630964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.631636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.632891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.633964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.714678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:23.737033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8f2caa6b-5520-41b4-831b-07a158ed3ef2 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1935 microversion: 2.75 time: 0.117788 May 07 21:47:23.738325 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 332/653] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:23 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1935 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:23.753441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Calling method '.version_select at 0x7fc41d695e50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:23.761961 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:23.761961 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:23.764742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.765212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.792225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.793030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.823188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.824199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.835951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:23.837690 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa5f4240-0ed8-4d60-824f-bef3882ce904 tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.089016 May 07 21:47:23.838521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 333/654] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:47:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:23.848685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6a80b6e-43be-4a26-a5a4-2fb0664c3dfb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.561515 May 07 21:47:23.849279 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 322/655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:23 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:23.858696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:23.858696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:23.866951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:23.867786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:23.882239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.882973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.884115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.885180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.888116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.888519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.889299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:23.889737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:23.993684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:24.001893 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89c564ad-c013-4f48-83e9-444f8d37e8a2 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1320 microversion: 2.1 time: 0.162495 May 07 21:47:24.011445 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 334/656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:23 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1320 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:24.016485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e4de755-e177-4f08-b09b-fd8147dd1dee tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] Calling method '.version_select at 0x7fc41cf49280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:24.017287 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:24.017287 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:24.018460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2e4de755-e177-4f08-b09b-fd8147dd1dee tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '6ae1efbac3a54474af8b01eb9371abba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c5a6610ec304bcd8a796cf709fb33b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:24.019130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e4de755-e177-4f08-b09b-fd8147dd1dee tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:24.019959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2e4de755-e177-4f08-b09b-fd8147dd1dee tempest-HypervisorAdminNegativeUnderV252Test-1251963351 tempest-HypervisorAdminNegativeUnderV252Test-1251963351-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.007448 May 07 21:47:24.024379 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 335/657] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:47:24 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:24.033150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6deabb1d-f43d-4e23-8fa2-302cc78365fa tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Calling method '.version_select at 0x7fc41cf49040>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:24.036968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6deabb1d-f43d-4e23-8fa2-302cc78365fa tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.038416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6deabb1d-f43d-4e23-8fa2-302cc78365fa tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:24.046642 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6deabb1d-f43d-4e23-8fa2-302cc78365fa tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] HTTP exception thrown: No hypervisor matching '5a8abe1f-ecf1-4cf3-8ddd-399ebe24f7f3' could be found. May 07 21:47:24.048066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6deabb1d-f43d-4e23-8fa2-302cc78365fa tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] Returning 404 to user: No hypervisor matching '5a8abe1f-ecf1-4cf3-8ddd-399ebe24f7f3' could be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:24.049065 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6deabb1d-f43d-4e23-8fa2-302cc78365fa tempest-HypervisorAdminNegativeUnderV252Test-1142177210 tempest-HypervisorAdminNegativeUnderV252Test-1142177210-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/5a8abe1f-ecf1-4cf3-8ddd-399ebe24f7f3/servers" status: 404 len: 123 microversion: 2.1 time: 0.021038 May 07 21:47:24.057896 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 336/658] 10.222.0.32 () {58 vars in 1280 bytes} [Sat May 7 21:47:24 2022] GET /compute/v2.1/os-hypervisors/5a8abe1f-ecf1-4cf3-8ddd-399ebe24f7f3/servers => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:24.144822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:24.145613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:24.153298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.153758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:24.161148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.161620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:24.399669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:24.416148 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-451526d4-2cd9-45dd-92d9-3dc4b53cbe4b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1308 microversion: 2.1 time: 0.565794 May 07 21:47:24.417089 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 323/659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:23 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:24.429542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a7ee99ab-a166-42fb-b950-da0ea1c1a5cc req-687f1008-b3c4-4ba1-8e16-4eb38944ec29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a792c3-0086-43d1-8995-7d56146f84b2", "name": "network-vif-plugged", "status": "completed", "tag": "85df8e70-88cc-4aed-a304-7a9a475aa9c1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:24.448819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a7ee99ab-a166-42fb-b950-da0ea1c1a5cc req-687f1008-b3c4-4ba1-8e16-4eb38944ec29 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.449274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a7ee99ab-a166-42fb-b950-da0ea1c1a5cc req-687f1008-b3c4-4ba1-8e16-4eb38944ec29 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:24.461729 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a7ee99ab-a166-42fb-b950-da0ea1c1a5cc req-687f1008-b3c4-4ba1-8e16-4eb38944ec29 service nova] Creating event network-vif-plugged:85df8e70-88cc-4aed-a304-7a9a475aa9c1 for instance 12a792c3-0086-43d1-8995-7d56146f84b2 on nch1-master-1 May 07 21:47:24.476631 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a7ee99ab-a166-42fb-b950-da0ea1c1a5cc req-687f1008-b3c4-4ba1-8e16-4eb38944ec29 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058175 May 07 21:47:24.480654 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 324/660] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:24.486203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:24.486944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:24.503889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.504266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:24.505045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.508042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:24.749105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:24.764524 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b76d2701-4ddf-4293-b85d-41d2349bf4e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1505 microversion: 2.1 time: 0.623791 May 07 21:47:24.776447 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 337/661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:24 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:24.785893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:24.786747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:24.798443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.799187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:24.800264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:24.803737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.086840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.098215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.100215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.101709 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94e29989-42f2-4b96-9c88-92db4d7c1e9a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.619769 May 07 21:47:25.102514 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 325/662] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:24 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:25.103536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.107638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:25.108602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:25.115350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.115740 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c1df68f-9efa-47b2-b3bf-01933f3848c4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.333003 May 07 21:47:25.116285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.116401 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 338/663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:24 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:25.117853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.118549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.157625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:25.158276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:25.174336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.175271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.176441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.177204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.236934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] Lazy-loading 'services' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:25.267858 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5da97d43-0de8-4d4e-9c65-367efc6e8766 tempest-ServersAdmin275Test-1136333951 tempest-ServersAdmin275Test-1136333951-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1920 microversion: 2.75 time: 0.163201 May 07 21:47:25.269532 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 326/664] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:25 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1920 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:25.275305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:25.276294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:25.292712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.293559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.294619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.295505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.480493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.488037 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-954a6aff-9888-40cb-880d-2335336ccc0d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.365813 May 07 21:47:25.488620 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 339/665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:25 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:25.501669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:25.507423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:25.517036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.518477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.523745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.524389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.565327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:47:25.646657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.658176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-df4527cd-0549-41bf-a66b-2a800931a302 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1387 microversion: 2.1 time: 0.387205 May 07 21:47:25.666800 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 327/666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:25 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1387 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:25.673285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:25.673908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:25.683772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.684236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.685030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.685475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.686155 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89753bd6-d1dd-4240-98ae-939079c2070e tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 204 len: 0 microversion: 2.75 time: 0.192768 May 07 21:47:25.687131 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 340/667] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:25 2022] DELETE /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:47:25.704180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:25.704974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:25.723327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.725427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.728586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.728586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.862961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.896120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.905982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:25.921145 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4977d974-cf57-4124-9c97-6fc956fd5aa7 tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1444 microversion: 2.75 time: 0.228202 May 07 21:47:25.924625 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 341/668] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:25 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1444 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:25.937104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:25.940122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:25.953608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.955658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:25.958619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:25.959248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.336137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:26.347717 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b51511a-c5e6-42d6-a0ff-3aa60905f150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1495 microversion: 2.1 time: 0.420199 May 07 21:47:26.360582 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 342/669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:25 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1495 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:26.367444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:26.368227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:26.375689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.376253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.377124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.377684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.505370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:26.514363 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e25a430c-14b2-47e4-96eb-87c8f54f2c1e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1308 microversion: 2.1 time: 0.854090 May 07 21:47:26.515523 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 328/670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:25 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1308 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:26.528795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:26.529596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:26.538042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.545390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.546453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.547195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.581011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:26.595343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:26.598945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:26.600895 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c5d8dd41-ded6-47cc-ba14-2fe440f7f508 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1566 microversion: 2.25 time: 0.238679 May 07 21:47:26.601725 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 343/671] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:26 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:26.608157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cce3c045-eaf1-4e84-a572-a6a948156035 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '.version_select at 0x7fc41cea9820>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:26.612139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cce3c045-eaf1-4e84-a572-a6a948156035 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.612801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cce3c045-eaf1-4e84-a572-a6a948156035 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.625974 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cce3c045-eaf1-4e84-a572-a6a948156035 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 1557 microversion: 2.1 time: 0.022868 May 07 21:47:26.627287 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 344/672] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:47:26 2022] GET /compute/v2.1/os-migrations => generated 1557 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:26.633423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:26.634275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:26.643118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.643906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.644930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.646022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.830352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:26.845145 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5ec7c874-b341-4523-a926-80c7fc91bbb4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.216621 May 07 21:47:26.846033 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 345/673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:26 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:26.851523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fea08fb8-7db1-404a-845d-8439af3af918 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:26.852173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fea08fb8-7db1-404a-845d-8439af3af918 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:26.860091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fea08fb8-7db1-404a-845d-8439af3af918 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.860552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fea08fb8-7db1-404a-845d-8439af3af918 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:26.861849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fea08fb8-7db1-404a-845d-8439af3af918 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:26.862301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fea08fb8-7db1-404a-845d-8439af3af918 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.021957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:27.041165 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-446d1376-5fd2-4b79-9969-81890057ea07 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.523690 May 07 21:47:27.044362 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 329/674] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:26 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:27.053361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:27.053988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:27.098462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.099004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.099876 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fea08fb8-7db1-404a-845d-8439af3af918 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1646 microversion: 2.1 time: 0.233892 May 07 21:47:27.100943 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 346/675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:26 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1646 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:27.102277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.109398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:27.119331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.119459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:27.140235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.141390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.142048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.148423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.269661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:27.289817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:27.299937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:27.321669 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-087c2db2-48d3-47fc-9f7c-2e6f0f5e6c2a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1444 microversion: 2.75 time: 0.219751 May 07 21:47:27.326041 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 347/676] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:27 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1444 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:27.349236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-59377e8e-1b17-40ff-8ae9-9ae5d97d4940 req-7e3708db-d747-4744-b525-16e994166770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0", "tag": "41742b2f-f351-48d6-994b-cf147d81966f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:27.377312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-59377e8e-1b17-40ff-8ae9-9ae5d97d4940 req-7e3708db-d747-4744-b525-16e994166770 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.377761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-59377e8e-1b17-40ff-8ae9-9ae5d97d4940 req-7e3708db-d747-4744-b525-16e994166770 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.396953 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-59377e8e-1b17-40ff-8ae9-9ae5d97d4940 req-7e3708db-d747-4744-b525-16e994166770 service nova] Creating event network-changed:41742b2f-f351-48d6-994b-cf147d81966f for instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 on nch1-master-1 May 07 21:47:27.411799 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-59377e8e-1b17-40ff-8ae9-9ae5d97d4940 req-7e3708db-d747-4744-b525-16e994166770 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079849 May 07 21:47:27.412840 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 348/677] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:27.422963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1883987407", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "28405dfe-908d-4039-91f6-1d02165b34cd"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:27.509085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] validate_networks() for [('28405dfe-908d-4039-91f6-1d02165b34cd', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:27.717874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:27.729380 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8af11f0a-90a0-4bca-a664-3c9e0cb41c0a tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1387 microversion: 2.1 time: 0.683759 May 07 21:47:27.739305 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 330/678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:27 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1387 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:27.739305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:27.739305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:27.751666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.752164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.752982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.753485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.904762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:27.924060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91d28d24-350a-45f2-b811-022b881756dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1488 microversion: 2.1 time: 0.192845 May 07 21:47:27.929590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 331/679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:27 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1488 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:27.934587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:27.935232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:27.953961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.954738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.956007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.957104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.976871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:27.977852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:27.978049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:27.978581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:27.979137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:27.994916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.995381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:27.996192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:27.997795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.017772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:28.022098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for user 7dd9c30816a7410f94b10294234c1dc2 and project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:28.034247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:47:28.036910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:47:28.096615 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29623a73-da6b-4817-8fb8-bac9db6bf97f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682448 May 07 21:47:28.098512 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 349/680] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:47:28.106800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.108635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:28.116087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.117064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.118401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.119539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.315395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.326668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.328861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.329922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.331168 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a432cf42-8cf8-49da-ad9d-f725bf62d782 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1541 microversion: 2.25 time: 0.400392 May 07 21:47:28.343324 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 332/681] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:27 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1541 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:28.346293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e40f53c2-e22a-4d74-a429-b04d5fce667c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.247458 May 07 21:47:28.349189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2182a999-9083-4add-b961-3cc437aa6126 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:28.350476 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 350/682] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:28.358097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2182a999-9083-4add-b961-3cc437aa6126 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.363767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2182a999-9083-4add-b961-3cc437aa6126 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.367237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.369701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:28.390435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.400003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.401480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.403630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.435366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2182a999-9083-4add-b961-3cc437aa6126 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 21:47:28.497247 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2182a999-9083-4add-b961-3cc437aa6126 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2/action" status: 202 len: 0 microversion: 2.1 time: 0.152127 May 07 21:47:28.498213 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 333/683] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:28 2022] POST /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:28.506131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7c91cdcc-da05-4f94-a854-fe3eb5aa7e00 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.507255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7c91cdcc-da05-4f94-a854-fe3eb5aa7e00 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:28.587749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7c91cdcc-da05-4f94-a854-fe3eb5aa7e00 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.598095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7c91cdcc-da05-4f94-a854-fe3eb5aa7e00 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1211 microversion: 2.1 time: 0.097949 May 07 21:47:28.604070 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 334/684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:28.615380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.617733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:28.627238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.635851 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c89996e6-a4c8-405d-bdb5-9010528a8055 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.281966 May 07 21:47:28.637020 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 351/685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:28.639471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.640078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.641562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.642121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.643515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c70b098-18ee-408c-afb7-f875d0370b1e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '.version_select at 0x7fc41cf490d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.646731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c70b098-18ee-408c-afb7-f875d0370b1e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.647213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c70b098-18ee-408c-afb7-f875d0370b1e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.661193 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c70b098-18ee-408c-afb7-f875d0370b1e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 2188 microversion: 2.25 time: 0.022647 May 07 21:47:28.670045 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 352/686] 10.222.0.32 () {60 vars in 1183 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/os-migrations => generated 2188 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:28.675446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.676273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:28.679855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.680615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.681165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lazy-loading 'fault' on Instance uuid c5339211-223c-48cb-9652-201c790b2f4f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:28.685723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.686400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.687251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.688390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.760713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.772037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.774708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f7c66dcdb16748bd900fb2a0501d7d72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e319fb6c72864e1997a9f30a5f09f36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.781313 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7fb9cc5a-f8f7-4556-8981-cab457cf8a7a tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 200 len: 1449 microversion: 2.75 time: 0.175428 May 07 21:47:28.790918 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 335/687] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 1449 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:28.805731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.807224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:28.816675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.817289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.818079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.818686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.851588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:28.860897 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-64792d65-f813-4184-8638-10c588aec8f5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.189555 May 07 21:47:28.861566 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 353/688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:28.866131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:28.867532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:28.874599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.875768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:28.879167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:28.879699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.033951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid bfa51d13-aa03-48ef-9aea-32ae407e5d9d {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:29.044102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:29.057391 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a465a723-c7bd-4564-8210-6031c887e636 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1387 microversion: 2.1 time: 0.194640 May 07 21:47:29.059481 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 354/689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1387 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:29.067200 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-66d5a4a0-409f-485a-8311-8987478b17c9 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 2032 microversion: 2.25 time: 0.273413 May 07 21:47:29.067938 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 336/690] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:28 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 2032 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:29.212848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1098392232", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "38d1a38e-1f99-466b-bf7f-940113b4b6ed"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:29.280416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] validate_networks() for [('38d1a38e-1f99-466b-bf7f-940113b4b6ed', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:29.366983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:29.367662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:29.373966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.374421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.375267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.375715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.514648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:29.524439 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-880997fd-8ed1-4cc6-9f04-358f01d89834 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.161508 May 07 21:47:29.525239 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 337/691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:29 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:29.616232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:29.617588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:29.624680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.625491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.626501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.627512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.715988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:29.728246 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be704fcb-9d91-4626-88fc-7aec7682fdb4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1263 microversion: 2.1 time: 0.114651 May 07 21:47:29.729830 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 338/692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:29 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1263 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:29.743042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:29.748732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:29.762086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.762711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.763362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.763851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.841764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:29.842210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:29.842678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:29.843407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:29.844024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:29.874315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.876144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.880149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:29.880620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:29.924993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:29.929828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for user 99e9b91d4fb949f18cc61bf2bbd63ab6 and project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:29.987269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:47:29.992333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:47:30.054212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:30.064373 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a567a327-b2ad-4b2c-8ab1-9be624cf33ef tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.333352 May 07 21:47:30.074047 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 339/693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:29 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:30.074047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:30.078002 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f59b2977-d89f-4b6b-9e5c-4dad55df4d68 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.865452 May 07 21:47:30.084551 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 355/694] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:47:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:47:30.087546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] [instance: c5339211-223c-48cb-9652-201c790b2f4f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:30.088326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:30.088958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:30.095944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.096588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.097521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.097972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.100283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.101106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.101638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.101967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.117826 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] HTTP exception thrown: Instance c5339211-223c-48cb-9652-201c790b2f4f could not be found. May 07 21:47:30.118494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] Returning 404 to user: Instance c5339211-223c-48cb-9652-201c790b2f4f could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:30.120462 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a33f6544-2d52-4f67-a49e-20e9e372426b tempest-ServersAdmin275Test-2110418138 tempest-ServersAdmin275Test-2110418138-project] 10.222.0.32 "GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f" status: 404 len: 111 microversion: 2.75 time: 0.053686 May 07 21:47:30.121559 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 340/695] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:30 2022] GET /compute/v2.1/servers/c5339211-223c-48cb-9652-201c790b2f4f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:47:30.127699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:30.128512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:30.135857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.137157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.138144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.138593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.408894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:30.417331 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e537c53f-1a9a-4958-ac63-2d055519e5d9 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1387 microversion: 2.1 time: 0.294518 May 07 21:47:30.425227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:30.431995 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 341/696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:30 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1387 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:30.441833 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-308d38ba-6981-4443-9348-f2d5fc296cce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.360993 May 07 21:47:30.442148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b8f2c5db-c2a0-483a-b9fd-aa2f20e561d3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:30.442864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b8f2c5db-c2a0-483a-b9fd-aa2f20e561d3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:30.455470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 356/697] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:30 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:30.542323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:30.543380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:30.557317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.558241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.559937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.561852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.562305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b8f2c5db-c2a0-483a-b9fd-aa2f20e561d3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:30.570362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b8f2c5db-c2a0-483a-b9fd-aa2f20e561d3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:30.572202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b8f2c5db-c2a0-483a-b9fd-aa2f20e561d3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:30.573368 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b8f2c5db-c2a0-483a-b9fd-aa2f20e561d3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1262 microversion: 2.25 time: 0.140308 May 07 21:47:30.579108 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 342/698] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:30 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:30.747467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:30.748489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:30.758600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.759370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.761177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:30.761857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:30.858736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:30.875901 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f07f9623-50c3-4ac8-a0df-81a409e9e27f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1269 microversion: 2.1 time: 0.133512 May 07 21:47:30.876589 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 343/699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:30 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:31.065990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:31.079564 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dbb4a62c-d5f0-4491-bc0d-1907641742be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1476 microversion: 2.1 time: 0.541925 May 07 21:47:31.082533 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 357/700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:30 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1476 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:31.100376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:31.101576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:31.114036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.116105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.117386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.118824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.427923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:31.436180 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-08c34d08-b011-4f24-8aa6-86928e444451 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.358335 May 07 21:47:31.437362 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 344/701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:31 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:31.439104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:31.439875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:31.446389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.446906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.447695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.448141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.461638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:31.462614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:31.469071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.469732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.470701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.471361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.819036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:31.839147 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b843ac5a-696a-4f40-8fbe-152536ea0c36 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.377502 May 07 21:47:31.841656 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 345/702] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:31 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:31.852747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:31.861205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:31.861860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:31.862026 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6857fb31-78c9-4662-8a1a-5ae6083096ff tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1387 microversion: 2.1 time: 0.427335 May 07 21:47:31.863979 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 358/703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:31 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1387 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:31.894503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:31.895154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:31.897797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.902241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.903842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.904950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.913959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.914697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:31.915681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:31.916279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.097566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:32.119319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:32.120949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:32.122229 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d3185629-1a68-4c49-adeb-0ce10b270e41 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1320 microversion: 2.25 time: 0.279104 May 07 21:47:32.135075 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 346/704] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:31 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:32.140259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:32.140932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:32.168632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.169471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.170538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.171230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.279242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:32.287335 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-abf86049-c7be-4cfd-8863-c8a880417735 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1311 microversion: 2.1 time: 0.396602 May 07 21:47:32.307231 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 359/705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:31 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1311 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:32.456423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:32.457669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:32.465239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.472008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.473299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.473903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.869759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:32.885503 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-495229fb-4708-49c0-bea9-106d0930dc3f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1475 microversion: 2.1 time: 0.749190 May 07 21:47:32.886675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 347/706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:32 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1475 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:32.893531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:32.894534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:32.902093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.903220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.904471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.905145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.959176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:32.971981 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9eef55a9-a390-4cff-9fd2-9bac3d151d0f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.521896 May 07 21:47:32.973348 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 360/707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:32 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:32.980865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:32.987657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:32.993850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.994384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:32.995343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:32.995846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.259003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:33.273929 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f26a39f8-fedf-49ea-9203-53ebdfabc627 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.385575 May 07 21:47:33.284176 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 348/708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:32 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:33.289675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:33.290369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:33.299485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.300362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.301995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.302669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.367303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:33.392776 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eabfdb5a-f19b-4e5b-9d0b-cf7691a22db8 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1387 microversion: 2.1 time: 0.417083 May 07 21:47:33.393390 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 361/709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:32 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1387 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:33.401478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-b563c00a-c0d3-40de-841a-8c24118786cb req-9b2e5787-d3b7-4b47-9789-b2e930886a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12135950-7d5e-4835-8fe5-31c8e5e9c986", "name": "network-vif-unplugged", "status": "completed", "tag": "f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:33.410602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b563c00a-c0d3-40de-841a-8c24118786cb req-9b2e5787-d3b7-4b47-9789-b2e930886a3f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.411319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b563c00a-c0d3-40de-841a-8c24118786cb req-9b2e5787-d3b7-4b47-9789-b2e930886a3f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.427101 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-b563c00a-c0d3-40de-841a-8c24118786cb req-9b2e5787-d3b7-4b47-9789-b2e930886a3f service nova] Creating event network-vif-unplugged:f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9 for instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 on nch2-master-1 May 07 21:47:33.439241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-b563c00a-c0d3-40de-841a-8c24118786cb req-9b2e5787-d3b7-4b47-9789-b2e930886a3f service nova] Instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:47:33.461449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-b563c00a-c0d3-40de-841a-8c24118786cb req-9b2e5787-d3b7-4b47-9789-b2e930886a3f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064400 May 07 21:47:33.462140 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 362/710] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:33.467693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:33.468402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:33.480081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.480551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.481639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.482092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.486644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:33.496181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:33.498042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:33.499803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2eb6a4c9-6268-4f31-b1e3-8b41d367e807 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1320 microversion: 2.25 time: 0.214017 May 07 21:47:33.512229 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 349/711] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:33 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:33.518479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5ad43f5f-9d30-4f1f-9b78-26ad22caf0a6 req-0d38296c-d7f9-4cf0-ac70-ab4c285ef43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3533de6f-5073-4e2e-9620-5655b2cdcb7f", "tag": "9177df96-b4f9-41db-8806-f7ea5787a4fc"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:33.529479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5ad43f5f-9d30-4f1f-9b78-26ad22caf0a6 req-0d38296c-d7f9-4cf0-ac70-ab4c285ef43b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.530047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5ad43f5f-9d30-4f1f-9b78-26ad22caf0a6 req-0d38296c-d7f9-4cf0-ac70-ab4c285ef43b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.543418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5ad43f5f-9d30-4f1f-9b78-26ad22caf0a6 req-0d38296c-d7f9-4cf0-ac70-ab4c285ef43b service nova] Creating event network-changed:9177df96-b4f9-41db-8806-f7ea5787a4fc for instance 3533de6f-5073-4e2e-9620-5655b2cdcb7f on nch2-master-1 May 07 21:47:33.550222 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5ad43f5f-9d30-4f1f-9b78-26ad22caf0a6 req-0d38296c-d7f9-4cf0-ac70-ab4c285ef43b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036585 May 07 21:47:33.551150 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 350/712] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:33.756295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:33.764649 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-03faea70-8bee-456b-8f87-de15d8a9083d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1311 microversion: 2.1 time: 0.301080 May 07 21:47:33.765320 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 363/713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:33 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:33.905187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:33.905902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:33.913743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.914232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.915672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:33.916124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:33.992511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:33.993831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:34.001153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.001861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.003239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.003873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.182595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:34.191015 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3323a17d-d586-4fae-bb2d-b720a76866d0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.205093 May 07 21:47:34.206501 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 364/714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:33 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:34.213757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-33acc2f8-7ef6-4837-ab39-5a9aa77883ae req-2699deaf-7577-4da1-b0f2-42f2a419d1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0", "name": "network-vif-plugged", "status": "completed", "tag": "41742b2f-f351-48d6-994b-cf147d81966f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:34.225646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-33acc2f8-7ef6-4837-ab39-5a9aa77883ae req-2699deaf-7577-4da1-b0f2-42f2a419d1d4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.226023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-33acc2f8-7ef6-4837-ab39-5a9aa77883ae req-2699deaf-7577-4da1-b0f2-42f2a419d1d4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.238011 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-33acc2f8-7ef6-4837-ab39-5a9aa77883ae req-2699deaf-7577-4da1-b0f2-42f2a419d1d4 service nova] Creating event network-vif-plugged:41742b2f-f351-48d6-994b-cf147d81966f for instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 on nch1-master-1 May 07 21:47:34.243198 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-33acc2f8-7ef6-4837-ab39-5a9aa77883ae req-2699deaf-7577-4da1-b0f2-42f2a419d1d4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034933 May 07 21:47:34.244115 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 365/715] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:34.306756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:34.307945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:34.316114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.316657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.317515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.318043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.494434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:34.509414 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b14c1b8-63d5-4b96-83dd-3f4c59a558ce tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.216116 May 07 21:47:34.519082 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 366/716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:34 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:34.530693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:34.531873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:34.540683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.541148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.544853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.545813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.560597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:34.574091 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47deadd7-577c-46bc-867f-c064f18709c1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1475 microversion: 2.1 time: 0.673794 May 07 21:47:34.577702 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 351/717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:33 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1475 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:34.583478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:34.586890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:34.608397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.610416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.611404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.611858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.785734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:34.801166 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2e1cd0f2-6fec-41b7-bbd4-52886048d943 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1387 microversion: 2.1 time: 0.287281 May 07 21:47:34.815476 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 367/718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:34 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1387 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:34.822053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:34.822907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:34.832818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.833425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.834484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:34.836237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:34.896029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:34.905599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:34.907934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:34.909311 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9e18343-f96d-43be-ab6a-f61ca087a6d5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1362 microversion: 2.25 time: 0.330002 May 07 21:47:34.919899 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 352/719] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:34 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:35.209807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:35.210413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:35.217061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:35.217833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:35.219433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:35.220064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:35.272690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:35.282416 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cbafacd6-486a-45d5-94e6-73ae084b0e62 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1311 microversion: 2.1 time: 0.464810 May 07 21:47:35.291427 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 368/720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:34 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1311 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:35.481297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1b48ef24-0f67-4bb0-a556-b06be028dbdd req-8265cb85-ac75-4762-9799-298567053f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12135950-7d5e-4835-8fe5-31c8e5e9c986", "tag": "f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:35.490958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1b48ef24-0f67-4bb0-a556-b06be028dbdd req-8265cb85-ac75-4762-9799-298567053f34 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:35.491415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1b48ef24-0f67-4bb0-a556-b06be028dbdd req-8265cb85-ac75-4762-9799-298567053f34 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:35.505454 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1b48ef24-0f67-4bb0-a556-b06be028dbdd req-8265cb85-ac75-4762-9799-298567053f34 service nova] Creating event network-changed:f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9 for instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 on nch2-master-1 May 07 21:47:35.511002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-1b48ef24-0f67-4bb0-a556-b06be028dbdd req-8265cb85-ac75-4762-9799-298567053f34 service nova] Instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:47:35.522694 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1b48ef24-0f67-4bb0-a556-b06be028dbdd req-8265cb85-ac75-4762-9799-298567053f34 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044681 May 07 21:47:35.523411 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 369/721] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:47:35.528438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:35.529514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:35.537832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:35.538596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:35.540081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:35.540700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:35.554900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:35.565448 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-209ae689-90ca-4668-ae7b-480afb7693d4 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.359634 May 07 21:47:35.566752 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 353/722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:35 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:35.594599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:35.595342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:35.601885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:35.602316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:35.603710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:35.604175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:36.075638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:36.085269 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8c5076e-79a8-4c61-bc60-ebcac408d91c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.560659 May 07 21:47:36.085863 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 370/723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:35 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:36.096945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-766abcd0-490a-4965-90f5-a1612a2ab3ef tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41cf49b80>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:36.148918 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-766abcd0-490a-4965-90f5-a1612a2ab3ef tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c" status: 200 len: 637 microversion: 2.1 time: 0.061722 May 07 21:47:36.149892 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 371/724] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:36 2022] GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c => generated 637 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:36.156862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:36.158836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:36.166819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:36.169525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:36.171122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:36.172655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:36.300409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:36.311071 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-97ff13ec-082c-4a47-a1b9-9b65b0e837b5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1475 microversion: 2.1 time: 0.720402 May 07 21:47:36.318551 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 354/725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:35 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1475 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:36.324503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:36.325747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:36.340415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:36.341071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:36.341876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:36.342320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:36.456063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:36.475969 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e15da906-e456-4673-8e72-0c1fe8bbbf54 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1586 microversion: 2.1 time: 0.322478 May 07 21:47:36.477373 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 372/726] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:36 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1586 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:36.483932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d945b71a-24fb-4765-885c-80ea965cde3f tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update_all', calling method: .version_select at 0x7fc41cf49310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:36.557388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-d945b71a-24fb-4765-885c-80ea965cde3f tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:36.564874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-d945b71a-24fb-4765-885c-80ea965cde3f tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:36.894018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:36.903014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:36.904620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:36.905836 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2309eff-fab1-4e75-af7c-48ab4ded89b9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1362 microversion: 2.25 time: 0.585903 May 07 21:47:36.915896 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 355/727] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:36 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:36.919441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:36.920326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:36.926702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:36.927527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:36.928537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:36.929192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.006300 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d945b71a-24fb-4765-885c-80ea965cde3f tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.527827 May 07 21:47:37.007187 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 373/728] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:36 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 61 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:37.012438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b9e84f74-0712-43aa-afa7-0f1cf4b5c20e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:37.012865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b9e84f74-0712-43aa-afa7-0f1cf4b5c20e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:37.020430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e84f74-0712-43aa-afa7-0f1cf4b5c20e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.020873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e84f74-0712-43aa-afa7-0f1cf4b5c20e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.021696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e84f74-0712-43aa-afa7-0f1cf4b5c20e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.022277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e84f74-0712-43aa-afa7-0f1cf4b5c20e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.110668 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b9e84f74-0712-43aa-afa7-0f1cf4b5c20e tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102282 May 07 21:47:37.111307 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 374/729] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:47:37 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:37.115820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:37.116437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:37.128914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.129289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.130614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.131270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.402480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:37.416365 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e24eba25-8207-4add-8c69-2577486a2095 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1311 microversion: 2.1 time: 0.500894 May 07 21:47:37.417474 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 356/730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:36 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1311 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:37.425806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7e795e7-0ab7-4b51-b127-70e09af52b61 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41d04b3a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:37.481717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:37.490418 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cf6f2c38-6d9c-463d-8db1-1404f5b81435 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.377852 May 07 21:47:37.491427 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 375/731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:37 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:37.496299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:37.497167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:37.505880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.506645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.507678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.508310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.787182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:37.794610 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb5742c7-0e5e-4f99-ae3f-6e2467baaf60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.301870 May 07 21:47:37.795521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 376/732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:37 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:37.800632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:37.802036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:37.808727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.809188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.809973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.810414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.812043 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7e795e7-0ab7-4b51-b127-70e09af52b61 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "DELETE /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.392737 May 07 21:47:37.813308 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 357/733] 10.222.0.32 () {58 vars in 1295 bytes} [Sat May 7 21:47:37 2022] DELETE /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata/os_version => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:47:37.819969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dfba21e1-bd9d-4e4e-8db0-5ca660590b85 req-deea0cb0-8bfd-4b02-a007-026b93131833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f62982-0b82-42d1-9d49-2b8d8f6ec04f", "tag": "446d2d04-f43a-4396-ae3d-6321f1ea6225"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:37.829327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dfba21e1-bd9d-4e4e-8db0-5ca660590b85 req-deea0cb0-8bfd-4b02-a007-026b93131833 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:37.829889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dfba21e1-bd9d-4e4e-8db0-5ca660590b85 req-deea0cb0-8bfd-4b02-a007-026b93131833 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:37.851193 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dfba21e1-bd9d-4e4e-8db0-5ca660590b85 req-deea0cb0-8bfd-4b02-a007-026b93131833 service nova] Creating event network-changed:446d2d04-f43a-4396-ae3d-6321f1ea6225 for instance f6f62982-0b82-42d1-9d49-2b8d8f6ec04f on nch1-master-1 May 07 21:47:37.856196 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dfba21e1-bd9d-4e4e-8db0-5ca660590b85 req-deea0cb0-8bfd-4b02-a007-026b93131833 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041095 May 07 21:47:37.857037 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 358/734] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:37.863870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-71f76fd5-7697-4ef9-9f14-39a6a8cd92ab tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41d732790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:37.907526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-71f76fd5-7697-4ef9-9f14-39a6a8cd92ab tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 37 microversion: 2.1 time: 0.049068 May 07 21:47:37.908370 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 359/735] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:47:37 2022] GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 37 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:37.920827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d759ba7c-28a7-425f-b32c-7f9417c99d6d tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update_all', calling method: .version_select at 0x7fc41ceb6820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:37.983893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d759ba7c-28a7-425f-b32c-7f9417c99d6d tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:37.987799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d759ba7c-28a7-425f-b32c-7f9417c99d6d tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:38.142961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:38.153319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-167889c6-0c8a-40d9-9b62-6e5c1c81f6e2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1473 microversion: 2.1 time: 0.356608 May 07 21:47:38.162589 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 377/736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:37 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:38.170337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:38.173715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:38.190529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:38.191070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:38.191855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:38.193526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:38.335526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d759ba7c-28a7-425f-b32c-7f9417c99d6d tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.419273 May 07 21:47:38.336225 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 360/737] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:37 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 61 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 07 21:47:38.345969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-11a8493b-3b46-4cdd-84db-4479d1eae9c1 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41d2c41f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:38.392705 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-11a8493b-3b46-4cdd-84db-4479d1eae9c1 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.051128 May 07 21:47:38.394577 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 361/738] 10.222.0.32 () {58 vars in 1289 bytes} [Sat May 7 21:47:38 2022] GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata/os_distro => generated 33 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:38.403815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9a7e6c7d-2600-4b2d-beeb-20c53161cc84 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update_all', calling method: .version_select at 0x7fc41d323a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:38.478417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9a7e6c7d-2600-4b2d-beeb-20c53161cc84 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:38.483061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9a7e6c7d-2600-4b2d-beeb-20c53161cc84 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:38.739767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:38.748863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:38.752929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:38.756021 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f2a6907-923c-42ac-88e4-d29db2ed0767 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1362 microversion: 2.25 time: 0.598907 May 07 21:47:38.757756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 378/739] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:38 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1362 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:38.782088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:38.783169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:38.799046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:38.803006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:38.803957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:38.804518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:38.943038 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9a7e6c7d-2600-4b2d-beeb-20c53161cc84 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.541911 May 07 21:47:38.944296 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 362/740] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:38 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 61 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 07 21:47:38.951464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:38.952221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:38.967857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:38.968330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:38.969164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:38.969611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.083812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:39.097346 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a8c818c2-a9e4-4c42-93bd-da233e3ef95c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1311 microversion: 2.1 time: 0.322262 May 07 21:47:39.098037 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 379/741] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:38 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1311 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:39.103248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:39.104108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:39.110847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.111630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.112627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.113285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.245130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:39.258220 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2bbc028-6380-426d-9cf3-f4967450b6a6 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.312521 May 07 21:47:39.259406 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 363/742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:38 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:39.265224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c5869281-79a4-4852-80a3-23ecb0cc0e65 req-f9c47085-48ca-48b8-920e-ced7f4894f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3533de6f-5073-4e2e-9620-5655b2cdcb7f", "name": "network-vif-plugged", "status": "completed", "tag": "9177df96-b4f9-41db-8806-f7ea5787a4fc"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:39.275399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c5869281-79a4-4852-80a3-23ecb0cc0e65 req-f9c47085-48ca-48b8-920e-ced7f4894f95 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.276422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c5869281-79a4-4852-80a3-23ecb0cc0e65 req-f9c47085-48ca-48b8-920e-ced7f4894f95 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.291972 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c5869281-79a4-4852-80a3-23ecb0cc0e65 req-f9c47085-48ca-48b8-920e-ced7f4894f95 service nova] Creating event network-vif-plugged:9177df96-b4f9-41db-8806-f7ea5787a4fc for instance 3533de6f-5073-4e2e-9620-5655b2cdcb7f on nch2-master-1 May 07 21:47:39.299247 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c5869281-79a4-4852-80a3-23ecb0cc0e65 req-f9c47085-48ca-48b8-920e-ced7f4894f95 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037093 May 07 21:47:39.304985 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 364/743] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:39.329103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59e08587-1819-4739-9c9c-2327c5f948c8 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41d04b940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:39.370727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:39.383528 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59e08587-1819-4739-9c9c-2327c5f948c8 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.075894 May 07 21:47:39.389142 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 365/744] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:47:39 2022] GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 61 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:39.394931 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e1128a5-eb5c-4155-a031-e34e4a5b5a11 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.295563 May 07 21:47:39.404690 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 380/745] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:39 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:39.404877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:39.404877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:39.405401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-277a7988-a354-4b4c-b9fd-3252a0b59592 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update_all', calling method: .version_select at 0x7fc41cec8040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:39.414052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.414521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.415358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.415803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.461563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-277a7988-a354-4b4c-b9fd-3252a0b59592 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:39.466125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-277a7988-a354-4b4c-b9fd-3252a0b59592 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:39.687825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:39.696660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c831e5d-5cc2-4e37-bbb5-ada1c759d4de tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1470 microversion: 2.1 time: 0.311223 May 07 21:47:39.698939 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 366/746] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:39 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:39.705040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:39.705906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:39.712296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.712844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.713703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.714266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.848177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-277a7988-a354-4b4c-b9fd-3252a0b59592 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.449780 May 07 21:47:39.849233 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 381/747] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:39 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 61 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:39.859454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3eca70cb-f70b-40a1-ae80-de59702ad230 req-c0bd6cd9-90cf-4fff-a04b-b95ab702fd5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0", "tag": "41742b2f-f351-48d6-994b-cf147d81966f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:39.873204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3eca70cb-f70b-40a1-ae80-de59702ad230 req-c0bd6cd9-90cf-4fff-a04b-b95ab702fd5a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.873969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3eca70cb-f70b-40a1-ae80-de59702ad230 req-c0bd6cd9-90cf-4fff-a04b-b95ab702fd5a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.879814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:39.890241 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5e30dbce-d6f9-4618-b7c0-163589e78b8c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1586 microversion: 2.1 time: 0.189705 May 07 21:47:39.902798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3eca70cb-f70b-40a1-ae80-de59702ad230 req-c0bd6cd9-90cf-4fff-a04b-b95ab702fd5a service nova] Creating event network-changed:41742b2f-f351-48d6-994b-cf147d81966f for instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 on nch1-master-1 May 07 21:47:39.902798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3eca70cb-f70b-40a1-ae80-de59702ad230 req-c0bd6cd9-90cf-4fff-a04b-b95ab702fd5a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050272 May 07 21:47:39.903446 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 367/748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:39 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1586 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:39.904130 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 382/749] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:39.909624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:39.910669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:39.918358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.918854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.919752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.920195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.929472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-78bebd86-e121-48f8-84d2-79e144e25a19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:39.930913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-78bebd86-e121-48f8-84d2-79e144e25a19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:39.937034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78bebd86-e121-48f8-84d2-79e144e25a19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.938041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78bebd86-e121-48f8-84d2-79e144e25a19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:39.939477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78bebd86-e121-48f8-84d2-79e144e25a19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:39.939912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78bebd86-e121-48f8-84d2-79e144e25a19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.075437 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-78bebd86-e121-48f8-84d2-79e144e25a19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986/action" status: 204 len: 0 microversion: 2.1 time: 0.169960 May 07 21:47:40.076090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 368/750] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:39 2022] POST /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986/action => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:47:40.089019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6da4078c-c3cb-487f-8457-53f8d21f1724 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update_all', calling method: .version_select at 0x7fc41d0f8f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:40.155767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:40.171359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:40.173438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:40.174613 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b81fb21-d6f7-46be-a16c-557b4a353311 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1362 microversion: 2.25 time: 0.269357 May 07 21:47:40.192472 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 383/751] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:39 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:40.229982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6da4078c-c3cb-487f-8457-53f8d21f1724 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:40.240041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6da4078c-c3cb-487f-8457-53f8d21f1724 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:40.395813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e139b5bb-6b6e-46e2-8fbd-a1e5c3dc8c56 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Calling method '.version_select at 0x7fc41cea3c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:40.482925 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e139b5bb-6b6e-46e2-8fbd-a1e5c3dc8c56 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748" status: 200 len: 371 microversion: 2.1 time: 0.288435 May 07 21:47:40.489289 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 384/752] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 21:47:40 2022] GET /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748 => generated 371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:40.490437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:40.491124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:40.497798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.498256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.499207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.499698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.692068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:40.700306 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b4306a4e-8311-4403-8e0b-fa46e7a0200e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1470 microversion: 2.1 time: 0.214665 May 07 21:47:40.703980 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 385/753] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:40 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:40.716973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:40.717863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:40.727134 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6da4078c-c3cb-487f-8457-53f8d21f1724 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.646860 May 07 21:47:40.730935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.731631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.731768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 369/754] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:40 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 64 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:40.732906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.733555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.739231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:40.745658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:40.756952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.758937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.760176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.760823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.912620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:40.922356 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-688ce3a9-fa51-45d4-b9bd-6b57fcd4d185 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1311 microversion: 2.1 time: 0.213583 May 07 21:47:40.923317 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 386/755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:40 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:40.928126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:40.929154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:40.937532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.939389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:40.942324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:40.943456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.106698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:41.119612 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1720c6fa-090d-4014-822f-b964d3e129f8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.194267 May 07 21:47:41.120525 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 387/756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:40 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:41.144450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5e2134c-9771-4261-82ff-4888389de121 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cea38b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:41.156752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:41.185131 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-091e970e-cd93-4404-b6ae-f82815de6efd tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.450659 May 07 21:47:41.185959 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 370/757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:40 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:41.204047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1721a73-2ffe-4319-abb2-43c33198624e tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41cece790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:41.245768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5e2134c-9771-4261-82ff-4888389de121 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.246376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5e2134c-9771-4261-82ff-4888389de121 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.247314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5e2134c-9771-4261-82ff-4888389de121 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.247902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5e2134c-9771-4261-82ff-4888389de121 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.250318 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b1721a73-2ffe-4319-abb2-43c33198624e tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 64 microversion: 2.1 time: 0.062644 May 07 21:47:41.251478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 371/758] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:47:41 2022] GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 64 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:41.259576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:41.260204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:41.266823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.267632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.268574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.269182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.300752 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5e2134c-9771-4261-82ff-4888389de121 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748" status: 200 len: 328 microversion: 2.1 time: 0.167478 May 07 21:47:41.306381 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 388/759] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:41 2022] PUT /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748 => generated 328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:41.306731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b2c0584-5d02-42e6-bf21-ad295f9ea444 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update_all', calling method: .version_select at 0x7fc41ceca160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:41.368931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-6b2c0584-5d02-42e6-bf21-ad295f9ea444 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:41.373485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-6b2c0584-5d02-42e6-bf21-ad295f9ea444 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:41.480451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:41.492928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:41.500895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:41.502083 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e2d8b59c-86d3-48d0-9e6b-ea6d2f796b95 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1362 microversion: 2.25 time: 0.249415 May 07 21:47:41.502851 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 372/760] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:41 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:41.507582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-884791ce-13b4-4451-aec1-f39698152b2a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:41.518322 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-884791ce-13b4-4451-aec1-f39698152b2a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748" status: 202 len: 0 microversion: 2.1 time: 0.014213 May 07 21:47:41.519159 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 373/761] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 21:47:41 2022] DELETE /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748 => generated 0 bytes in 16 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:41.526800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ddf570dd-812c-4e70-b3db-00463192ffe8 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Calling method '.version_select at 0x7fc41cee1ca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:41.597857 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ddf570dd-812c-4e70-b3db-00463192ffe8 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748" status: 200 len: 371 microversion: 2.1 time: 0.074347 May 07 21:47:41.598450 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 374/762] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 21:47:41 2022] GET /compute/v2.1/os-quota-sets/fb511fe759a84587b534f98cfc9e8748 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:47:41.721371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:41.722264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:41.724451 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b2c0584-5d02-42e6-bf21-ad295f9ea444 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.421488 May 07 21:47:41.725044 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 389/763] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:41 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 61 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:41.729626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.730107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.730964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.731425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.733710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-865fcc0a-df7b-4783-82ee-3daf460f4922 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Calling method '.version_select at 0x7fc41cf01c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:41.897413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:41.904928 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c48fe5ac-df7c-4146-92bd-238f5c275fc2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1470 microversion: 2.1 time: 0.187973 May 07 21:47:41.905590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 375/764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:41 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:41.910800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2c264f3-da84-48cd-b55f-a2ec723be6bb tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update', calling method: .version_select at 0x7fc41cece430>, body: {"meta": {"os_version": "alt"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:41.928686 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-865fcc0a-df7b-4783-82ee-3daf460f4922 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.198486 May 07 21:47:41.929260 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 390/765] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:47:41 2022] GET /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d/defaults => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:41.941830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:41.942460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:41.948767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.949394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.950627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:41.951256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:41.963359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a2c264f3-da84-48cd-b55f-a2ec723be6bb tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:41.968262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a2c264f3-da84-48cd-b55f-a2ec723be6bb tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:42.127181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:42.140454 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8d5461b9-e08b-4bb5-9c58-2e942745dcd8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1494 microversion: 2.1 time: 0.202474 May 07 21:47:42.141057 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 391/766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:41 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1494 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:42.148353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:42.149183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:42.157002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.157474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.159960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.160754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.334328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:42.342653 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d4fd302-29ab-430a-ae8b-ad8d1f4a5b8e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.198975 May 07 21:47:42.343259 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 392/767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:42 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:42.350995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-391201d2-79b5-4137-9c04-59ebe14f79f9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:42.351616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-391201d2-79b5-4137-9c04-59ebe14f79f9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:42.359287 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2c264f3-da84-48cd-b55f-a2ec723be6bb tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.451986 May 07 21:47:42.360095 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 376/768] 10.222.0.32 () {60 vars in 1312 bytes} [Sat May 7 21:47:41 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata/os_version => generated 31 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:42.360978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-391201d2-79b5-4137-9c04-59ebe14f79f9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.361445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-391201d2-79b5-4137-9c04-59ebe14f79f9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.362263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-391201d2-79b5-4137-9c04-59ebe14f79f9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.362712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-391201d2-79b5-4137-9c04-59ebe14f79f9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.366208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:42.368744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:42.376313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.376782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.377580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.378031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.513657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:42.517224 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-391201d2-79b5-4137-9c04-59ebe14f79f9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1645 microversion: 2.1 time: 0.172145 May 07 21:47:42.517811 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 393/769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:42 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1645 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:42.522340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-643d341d-830a-4897-bb13-fc08689ed7c4 req-003bdb6f-31a5-4701-9287-f9ce8ae08193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f62982-0b82-42d1-9d49-2b8d8f6ec04f", "name": "network-vif-plugged", "status": "completed", "tag": "446d2d04-f43a-4396-ae3d-6321f1ea6225"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:42.523553 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-308ac25a-be96-441a-a72d-125817b1796f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1471 microversion: 2.1 time: 0.162221 May 07 21:47:42.524225 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 377/770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:42 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:42.529070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fbe35667-3edf-4b66-9eff-4828b048396d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ce94670>, body: {"quota_set": {"ram": "5120"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:42.530534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-643d341d-830a-4897-bb13-fc08689ed7c4 req-003bdb6f-31a5-4701-9287-f9ce8ae08193 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.532920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-643d341d-830a-4897-bb13-fc08689ed7c4 req-003bdb6f-31a5-4701-9287-f9ce8ae08193 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.543129 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-643d341d-830a-4897-bb13-fc08689ed7c4 req-003bdb6f-31a5-4701-9287-f9ce8ae08193 service nova] Creating event network-vif-plugged:446d2d04-f43a-4396-ae3d-6321f1ea6225 for instance f6f62982-0b82-42d1-9d49-2b8d8f6ec04f on nch1-master-1 May 07 21:47:42.551588 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-643d341d-830a-4897-bb13-fc08689ed7c4 req-003bdb6f-31a5-4701-9287-f9ce8ae08193 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031381 May 07 21:47:42.552209 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 394/771] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:42.557556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13cf3664-ec46-4ac1-81fa-5bb95b925efe tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41cec8670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:42.603725 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13cf3664-ec46-4ac1-81fa-5bb95b925efe tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 58 microversion: 2.1 time: 0.050331 May 07 21:47:42.604306 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 395/772] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:47:42 2022] GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 58 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:42.610910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:42.611868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:42.618091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.618548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.619502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.619955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.684665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbe35667-3edf-4b66-9eff-4828b048396d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.685116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbe35667-3edf-4b66-9eff-4828b048396d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.685931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbe35667-3edf-4b66-9eff-4828b048396d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.686558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbe35667-3edf-4b66-9eff-4828b048396d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.764349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:42.766067 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fbe35667-3edf-4b66-9eff-4828b048396d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b" status: 200 len: 328 microversion: 2.1 time: 0.240136 May 07 21:47:42.766849 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 378/773] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:42 2022] PUT /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b => generated 328 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:42.771769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cddb1718-b49b-4516-a68b-1ddc31df7d06 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:42.772589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cddb1718-b49b-4516-a68b-1ddc31df7d06 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:42.772875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:42.774395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:42.775589 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5b6b1f5-4e0c-4fab-be06-82ccc7073dc3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1362 microversion: 2.25 time: 0.170320 May 07 21:47:42.778835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cddb1718-b49b-4516-a68b-1ddc31df7d06 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.779287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cddb1718-b49b-4516-a68b-1ddc31df7d06 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.780079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cddb1718-b49b-4516-a68b-1ddc31df7d06 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.780529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cddb1718-b49b-4516-a68b-1ddc31df7d06 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.786170 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 396/774] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:42 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:42.791175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d158d1a-435a-48f9-a20e-ab3881f1660e tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'update_all', calling method: .version_select at 0x7fc41cf01f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:42.848451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1d158d1a-435a-48f9-a20e-ab3881f1660e tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:42.860356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1d158d1a-435a-48f9-a20e-ab3881f1660e tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:42.927174 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cddb1718-b49b-4516-a68b-1ddc31df7d06 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1645 microversion: 2.1 time: 0.158822 May 07 21:47:42.927764 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 379/775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:42 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1645 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:42.939147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-772a987d-203b-4159-a7ba-7c5e1deb31f0 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Calling method '.version_select at 0x7fc41ce94dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:42.997788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-772a987d-203b-4159-a7ba-7c5e1deb31f0 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:42.998313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-772a987d-203b-4159-a7ba-7c5e1deb31f0 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:42.999233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-772a987d-203b-4159-a7ba-7c5e1deb31f0 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.000374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-772a987d-203b-4159-a7ba-7c5e1deb31f0 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.018163 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-772a987d-203b-4159-a7ba-7c5e1deb31f0 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b/detail" status: 200 len: 916 microversion: 2.1 time: 0.089415 May 07 21:47:43.018941 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 380/776] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:47:42 2022] GET /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b/detail => generated 916 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:43.023935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.024622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:43.031042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.031717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.032678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.033372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.186164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:43.188998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d158d1a-435a-48f9-a20e-ab3881f1660e tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 61 microversion: 2.1 time: 0.401527 May 07 21:47:43.189602 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 397/777] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:42 2022] PUT /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 61 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:43.194305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bdec3c4c-d30f-444d-bd73-60901985c546 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.195690 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:43.195690 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:47:43.197175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdec3c4c-d30f-444d-bd73-60901985c546 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.197634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdec3c4c-d30f-444d-bd73-60901985c546 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.198456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdec3c4c-d30f-444d-bd73-60901985c546 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.198932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdec3c4c-d30f-444d-bd73-60901985c546 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.200739 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-612459b6-3502-40f6-8111-fbac8fffe925 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1462 microversion: 2.1 time: 0.180538 May 07 21:47:43.210925 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 381/778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1462 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:43.210925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d2c6d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:43.224600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bdec3c4c-d30f-444d-bd73-60901985c546 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033898 May 07 21:47:43.225208 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 398/779] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:43.229836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e8dff172-c0d1-4815-a90f-e935b3b91e24 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Action: 'create', calling method: .version_select at 0x7fc41cea33a0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:43.270595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.271096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.271911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.272362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.276523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-e8dff172-c0d1-4815-a90f-e935b3b91e24 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:43.280241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-e8dff172-c0d1-4815-a90f-e935b3b91e24 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Getting quotas for user 145633f5689447bb9c5ad6e31760d688 and project fcb0bde79e814e00a5ac9fcaff43bec3. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:43.304958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.305410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.306268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.306709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.370538 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3075ed9-97fb-42ce-911d-e63792cb5ece tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b?user_id=599a218bd3b846ec8338f095eae1dadf" status: 200 len: 328 microversion: 2.1 time: 0.168043 May 07 21:47:43.376394 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 382/780] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:47:43 2022] PUT /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b?user_id=599a218bd3b846ec8338f095eae1dadf => generated 328 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:43.376394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5100bcf5-0702-49d5-8945-f8719427c4cb tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.376394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5100bcf5-0702-49d5-8945-f8719427c4cb tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:43.381880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5100bcf5-0702-49d5-8945-f8719427c4cb tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.382338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5100bcf5-0702-49d5-8945-f8719427c4cb tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.383139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5100bcf5-0702-49d5-8945-f8719427c4cb tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.383581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5100bcf5-0702-49d5-8945-f8719427c4cb tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.507757 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5100bcf5-0702-49d5-8945-f8719427c4cb tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1613 microversion: 2.1 time: 0.135459 May 07 21:47:43.508333 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 383/781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1613 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:43.515945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-80510cae-80d1-4a96-b1d8-c6186afd542f tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:43.516486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-80510cae-80d1-4a96-b1d8-c6186afd542f tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:43.522506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80510cae-80d1-4a96-b1d8-c6186afd542f tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.525547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80510cae-80d1-4a96-b1d8-c6186afd542f tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.525547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80510cae-80d1-4a96-b1d8-c6186afd542f tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.525547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80510cae-80d1-4a96-b1d8-c6186afd542f tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.598291 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-80510cae-80d1-4a96-b1d8-c6186afd542f tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f/action" status: 202 len: 0 microversion: 2.1 time: 0.085801 May 07 21:47:43.602444 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e8dff172-c0d1-4815-a90f-e935b3b91e24 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "POST /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.375837 May 07 21:47:43.602602 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 384/782] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:43 2022] POST /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:43.607089 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 399/783] 10.222.0.32 () {60 vars in 1280 bytes} [Sat May 7 21:47:43 2022] POST /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 85 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:43.609019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.610251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:43.612875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-751735c0-3fcc-44b8-ba50-ee5fe1ff1644 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Calling method '.version_select at 0x7fc41ceca5e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.617433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.617935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.618759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.619400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.690554 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-751735c0-3fcc-44b8-ba50-ee5fe1ff1644 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b?user_id=599a218bd3b846ec8338f095eae1dadf" status: 200 len: 370 microversion: 2.1 time: 0.082150 May 07 21:47:43.691423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 400/784] 10.222.0.32 () {58 vars in 1322 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/os-quota-sets/65630e5fa2a1482ab04cffe6eaddec5b?user_id=599a218bd3b846ec8338f095eae1dadf => generated 370 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:43.703624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7081ae39-15ae-40a4-975e-9d5f247f2393 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '.version_select at 0x7fc41ce32f70>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.706111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7081ae39-15ae-40a4-975e-9d5f247f2393 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.707250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7081ae39-15ae-40a4-975e-9d5f247f2393 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.717039 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7081ae39-15ae-40a4-975e-9d5f247f2393 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 1561 microversion: 2.1 time: 0.020850 May 07 21:47:43.718018 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 401/785] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/os-migrations => generated 1561 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:43.723478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.724602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:43.738337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.738829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.739628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.740076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.849230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:43.858658 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c382bd1c-6acf-49c2-ab83-d9235248c954 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.253825 May 07 21:47:43.859323 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 385/786] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:43.864205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b357ea28-199f-40de-898d-14d0cbca7d5e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.865011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b357ea28-199f-40de-898d-14d0cbca7d5e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:43.879421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b357ea28-199f-40de-898d-14d0cbca7d5e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.880407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b357ea28-199f-40de-898d-14d0cbca7d5e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.881620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b357ea28-199f-40de-898d-14d0cbca7d5e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:43.882226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b357ea28-199f-40de-898d-14d0cbca7d5e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:43.911192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:43.919101 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cfe6a694-044d-43f2-b9bc-68462bb8ce9e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1477 microversion: 2.1 time: 0.199311 May 07 21:47:43.920405 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 402/787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:43.930968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-20f32f38-634c-4472-8ecd-9a05cd990ee4 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] Calling method '.version_select at 0x7fc41cea3ee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:43.989101 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-20f32f38-634c-4472-8ecd-9a05cd990ee4 tempest-ImagesMetadataTestJSON-855867224 tempest-ImagesMetadataTestJSON-855867224-project] 10.222.0.32 "GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata" status: 200 len: 85 microversion: 2.1 time: 0.067354 May 07 21:47:43.989768 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 403/788] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/images/f9a4b483-4a80-48bb-8036-5e699a34b70c/metadata => generated 85 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:47:44.001905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:44.002527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:44.010008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.010468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:44.011358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.011727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:44.043528 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b357ea28-199f-40de-898d-14d0cbca7d5e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1630 microversion: 2.1 time: 0.182907 May 07 21:47:44.044063 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 386/789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1630 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:44.056447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-291732089", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:44.125863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:44.162830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:44.171597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:44.173159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:44.174340 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3493464a-ce59-409c-8bae-a66118c540a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1558 microversion: 2.25 time: 0.177851 May 07 21:47:44.175094 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 404/790] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:43 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:44.179620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:44.180961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:44.187870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.188324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:44.189107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.189654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:44.218162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lazy-loading 'flavor' on Instance uuid 3533de6f-5073-4e2e-9620-5655b2cdcb7f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:44.233189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Going to try to live migrate instance to nch1-master-1 {{(pid=136681) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:47:44.394930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:44.395746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:44.396739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:44.397291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:44.397868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:44.407527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.407935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:44.409158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.409604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:44.428686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:44.433064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for user 3eb85bfb49aa4a519099c6f43ac77099 and project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:44.447816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:47:44.450306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:47:44.501389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-165f0efb-81b2-4ee1-b155-ebec90d174b6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453706 May 07 21:47:44.502358 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 387/791] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:47:44.507379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3e4cda5-03a5-445e-80cf-ffdf5313982e tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Calling method '.version_select at 0x7fc41d04b160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:44.830898 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3e4cda5-03a5-445e-80cf-ffdf5313982e tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.327329 May 07 21:47:44.831564 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 388/792] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:47:44 2022] GET /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d/defaults => generated 371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:44.841341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:44.841962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:44.854515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.855211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:44.856143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:44.856629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.068500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid f6f62982-0b82-42d1-9d49-2b8d8f6ec04f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:45.089266 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-11b070ff-7750-4488-a610-36ac330dfd8e tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 2051 microversion: 2.25 time: 0.256440 May 07 21:47:45.089752 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 389/793] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:44 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 2051 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:45.095372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:45.096003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:45.105687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.106155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.106975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.107428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.186141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:45.205561 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-675d686f-2408-4b84-b5e1-cbd29437b166 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1208 microversion: 2.1 time: 0.114420 May 07 21:47:45.206844 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 390/794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:45 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1208 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:45.228058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-bdcd109c-7858-4ffc-9dbb-39ef44f46783 req-b266619f-d296-40b2-b5f7-ce6989ea7615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12135950-7d5e-4835-8fe5-31c8e5e9c986", "name": "network-vif-plugged", "status": "completed", "tag": "f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:45.240215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bdcd109c-7858-4ffc-9dbb-39ef44f46783 req-b266619f-d296-40b2-b5f7-ce6989ea7615 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.240680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bdcd109c-7858-4ffc-9dbb-39ef44f46783 req-b266619f-d296-40b2-b5f7-ce6989ea7615 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.252356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-bdcd109c-7858-4ffc-9dbb-39ef44f46783 req-b266619f-d296-40b2-b5f7-ce6989ea7615 service nova] Creating event network-vif-plugged:f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9 for instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 on nch2-master-1 May 07 21:47:45.257414 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-bdcd109c-7858-4ffc-9dbb-39ef44f46783 req-b266619f-d296-40b2-b5f7-ce6989ea7615 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037196 May 07 21:47:45.258036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 391/795] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:45.263096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-efc605b5-e12a-4301-8be9-b2893a1c274b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ceb6af0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:45.439768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efc605b5-e12a-4301-8be9-b2893a1c274b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.440208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efc605b5-e12a-4301-8be9-b2893a1c274b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.441008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efc605b5-e12a-4301-8be9-b2893a1c274b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.441653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efc605b5-e12a-4301-8be9-b2893a1c274b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.710182 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-efc605b5-e12a-4301-8be9-b2893a1c274b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d" status: 200 len: 329 microversion: 2.1 time: 0.449714 May 07 21:47:45.710875 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 392/796] 10.222.0.32 () {60 vars in 1262 bytes} [Sat May 7 21:47:45 2022] PUT /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d => generated 329 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:45.719717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:45.720656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:45.730301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.731067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.732024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.732471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.840102 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3fda1865-9363-4ef1-957b-8cc6d476c1e7 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f/action" status: 202 len: 0 microversion: 2.1 time: 1.663890 May 07 21:47:45.841384 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 405/797] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:44 2022] POST /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f/action => generated 0 bytes in 1666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:45.847577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:45.848398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:45.856393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.857053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:45.858641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:45.859724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.015604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:46.023616 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47044b58-e211-4112-b05a-f4142cc12a4c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.311217 May 07 21:47:46.027515 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 393/798] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:45 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:46.032354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9d1eabc1-c182-4515-bd9f-b97e16868b4b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:46.033949 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:47:46.033949 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:47:46.035528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d1eabc1-c182-4515-bd9f-b97e16868b4b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.036053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d1eabc1-c182-4515-bd9f-b97e16868b4b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.037087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d1eabc1-c182-4515-bd9f-b97e16868b4b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.037596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d1eabc1-c182-4515-bd9f-b97e16868b4b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.050828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:46.058589 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd839c44-5f61-449c-bdb8-3b46695264a1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1477 microversion: 2.1 time: 0.215514 May 07 21:47:46.064569 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 406/799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:45 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:46.079084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e264db3-49ec-4ca7-aff9-95ad82815444 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cf015e0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:46.098581 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9d1eabc1-c182-4515-bd9f-b97e16868b4b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.069633 May 07 21:47:46.099310 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 394/800] 10.222.0.32 () {60 vars in 1216 bytes} [Sat May 7 21:47:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:47:46.108606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:46.109972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:46.117112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.117642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.118549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.119096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.353281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e264db3-49ec-4ca7-aff9-95ad82815444 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.353748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e264db3-49ec-4ca7-aff9-95ad82815444 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.354566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e264db3-49ec-4ca7-aff9-95ad82815444 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.355052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e264db3-49ec-4ca7-aff9-95ad82815444 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.491318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:46.499778 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7256c225-6ede-445e-8991-419f03f27a10 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.399090 May 07 21:47:46.500717 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 395/801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:46 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:46.505892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:46.506970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:46.517338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.518007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.519687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:46.520552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:46.643529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:46.650940 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9053e444-b29a-4704-b323-a6329a7fae91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1270 microversion: 2.1 time: 0.148899 May 07 21:47:46.651523 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 396/802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:46 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:46.769430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fef601af-a305-4049-92cd-ed1bb8b35272 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Calling method '.version_select at 0x7fc41cee1820>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:46.775508 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e264db3-49ec-4ca7-aff9-95ad82815444 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d" status: 200 len: 329 microversion: 2.1 time: 0.709546 May 07 21:47:46.777450 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 407/803] 10.222.0.32 () {60 vars in 1262 bytes} [Sat May 7 21:47:46 2022] PUT /compute/v2.1/os-quota-sets/4b2e6a4e38634967bf1c5631d890654d => generated 329 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:46.803395 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-fef601af-a305-4049-92cd-ed1bb8b35272 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] HTTP exception thrown: Image not found. May 07 21:47:46.803998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fef601af-a305-4049-92cd-ed1bb8b35272 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:46.804998 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fef601af-a305-4049-92cd-ed1bb8b35272 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] 10.222.0.32 "DELETE /compute/v2.1/images/c727db54-6c45-4ad0-9df7-dd5d7b877348/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.152565 May 07 21:47:46.805699 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 397/804] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 21:47:46 2022] DELETE /compute/v2.1/images/c727db54-6c45-4ad0-9df7-dd5d7b877348/metadata/os_distro => generated 62 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:47:46.817073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15b70ac4-b290-46e4-a8f4-d25a5d87cefd tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Calling method '.version_select at 0x7fc41ce368b0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:46.846017 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-15b70ac4-b290-46e4-a8f4-d25a5d87cefd tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] HTTP exception thrown: Image not found. May 07 21:47:46.847492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15b70ac4-b290-46e4-a8f4-d25a5d87cefd tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:46.848878 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15b70ac4-b290-46e4-a8f4-d25a5d87cefd tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] 10.222.0.32 "GET /compute/v2.1/images/f085eecd-800e-4e2b-b56a-39e63fbcae3e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.036270 May 07 21:47:46.849595 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 408/805] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 21:47:46 2022] GET /compute/v2.1/images/f085eecd-800e-4e2b-b56a-39e63fbcae3e/metadata/os_version => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 07 21:47:46.861448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-20fffde1-22f8-4a61-9cf6-bddd915d38a8 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Calling method '.version_select at 0x7fc41ce94d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:46.896598 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-20fffde1-22f8-4a61-9cf6-bddd915d38a8 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] HTTP exception thrown: Image not found. May 07 21:47:46.897360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-20fffde1-22f8-4a61-9cf6-bddd915d38a8 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:46.898351 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-20fffde1-22f8-4a61-9cf6-bddd915d38a8 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] 10.222.0.32 "GET /compute/v2.1/images/b8e20795-2670-437b-9166-a1ca92f3b2c5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041666 May 07 21:47:46.899094 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 398/806] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:47:46 2022] GET /compute/v2.1/images/b8e20795-2670-437b-9166-a1ca92f3b2c5/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:47:46.911305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d58b255-e43a-4144-9933-8010fd938320 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Action: 'update_all', calling method: .version_select at 0x7fc41ce78ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:46.942294 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-1d58b255-e43a-4144-9933-8010fd938320 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] HTTP exception thrown: Image not found. May 07 21:47:46.942928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d58b255-e43a-4144-9933-8010fd938320 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:46.943771 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d58b255-e43a-4144-9933-8010fd938320 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] 10.222.0.32 "PUT /compute/v2.1/images/f6a33782-dea0-4798-83b8-f52935665785/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037543 May 07 21:47:46.950906 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 409/807] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:47:46 2022] PUT /compute/v2.1/images/f6a33782-dea0-4798-83b8-f52935665785/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:47:46.956337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-74faa9a7-7c8c-4b38-bcf8-b8f001c3c7b5 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Action: 'update', calling method: .version_select at 0x7fc41d53e310>, body: {"meta": {"os_distro": "alt"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:46.987481 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-74faa9a7-7c8c-4b38-bcf8-b8f001c3c7b5 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] HTTP exception thrown: Image not found. May 07 21:47:46.988077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-74faa9a7-7c8c-4b38-bcf8-b8f001c3c7b5 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:46.988982 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-74faa9a7-7c8c-4b38-bcf8-b8f001c3c7b5 tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] 10.222.0.32 "PUT /compute/v2.1/images/2fe703c0-21b7-4735-9c76-b95f8d4ca06a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.036769 May 07 21:47:46.989618 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 399/808] 10.222.0.32 () {60 vars in 1309 bytes} [Sat May 7 21:47:46 2022] PUT /compute/v2.1/images/2fe703c0-21b7-4735-9c76-b95f8d4ca06a/metadata/os_distro => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:47:47.001406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2742de6-d9eb-45ff-9656-8c7f73b9b11e tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Action: 'create', calling method: .version_select at 0x7fc41cf01700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:47.045410 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c2742de6-d9eb-45ff-9656-8c7f73b9b11e tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] HTTP exception thrown: Image not found. May 07 21:47:47.046185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2742de6-d9eb-45ff-9656-8c7f73b9b11e tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:47.048548 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2742de6-d9eb-45ff-9656-8c7f73b9b11e tempest-ImagesMetadataNegativeTestJSON-1141494231 tempest-ImagesMetadataNegativeTestJSON-1141494231-project] 10.222.0.32 "POST /compute/v2.1/images/a7a77640-996e-43b7-a86b-2502005506fd/metadata" status: 404 len: 62 microversion: 2.1 time: 0.051020 May 07 21:47:47.048548 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 410/809] 10.222.0.32 () {60 vars in 1280 bytes} [Sat May 7 21:47:46 2022] POST /compute/v2.1/images/a7a77640-996e-43b7-a86b-2502005506fd/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:47:47.051684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:47.052613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:47.064573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.065241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:47.066219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.067040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:47.084281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:47.085395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:47.100158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.100713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:47.103490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.105014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:47.351060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:47.360079 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7b7b934c-822c-4b8f-8742-5fdc25a91818 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1477 microversion: 2.1 time: 0.282651 May 07 21:47:47.362330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 411/810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:47 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:47.519458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:47.520517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:47.533941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.534731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:47.535956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.536790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:47.838295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:47.850967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:47.858617 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3943e4d-5772-4cf5-b60f-38857a91efb4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.818172 May 07 21:47:47.859811 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 400/811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:47 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:47.869845 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fdb3dfb-e41e-43ce-81da-13647c1c7c18 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.355067 May 07 21:47:47.871685 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 412/812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:47 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:47.889041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:47.889398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:47.900595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.901062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:47.902214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:47.902969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.223439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:48.230942 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2dafeefc-8ae3-4ba0-a747-a37bba2ec8d9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.347353 May 07 21:47:48.240990 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 401/813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:47 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:48.256841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed181d26-4047-4e13-b16d-3c51757602c7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3458b74-afb7-4186-a1a5-393c8c9767c1", "device": "/dev/xvdb"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:48.258730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed181d26-4047-4e13-b16d-3c51757602c7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:48.265944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed181d26-4047-4e13-b16d-3c51757602c7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.266734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed181d26-4047-4e13-b16d-3c51757602c7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.267967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed181d26-4047-4e13-b16d-3c51757602c7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.268617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed181d26-4047-4e13-b16d-3c51757602c7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.383885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:48.385860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:48.403093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.405284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.407902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.409625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.731288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:48.743694 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-70bd9995-8c8a-4a1f-847a-94a46e7cd26d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1477 microversion: 2.1 time: 0.365776 May 07 21:47:48.746426 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 402/814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:48 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1477 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:48.758645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8f71c9cc-c0de-4e73-abdb-7c910966a0c1 req-8d06118d-57d4-4d8c-8ab3-c20133c468ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3533de6f-5073-4e2e-9620-5655b2cdcb7f", "name": "network-vif-unplugged", "status": "completed", "tag": "9177df96-b4f9-41db-8806-f7ea5787a4fc"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:48.772316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed181d26-4047-4e13-b16d-3c51757602c7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "POST /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.519180 May 07 21:47:48.780134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8f71c9cc-c0de-4e73-abdb-7c910966a0c1 req-8d06118d-57d4-4d8c-8ab3-c20133c468ee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.781373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8f71c9cc-c0de-4e73-abdb-7c910966a0c1 req-8d06118d-57d4-4d8c-8ab3-c20133c468ee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.789386 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 413/815] 10.222.0.32 () {62 vars in 1363 bytes} [Sat May 7 21:47:48 2022] POST /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments => generated 194 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:47:48.819749 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8f71c9cc-c0de-4e73-abdb-7c910966a0c1 req-8d06118d-57d4-4d8c-8ab3-c20133c468ee service nova] Creating event network-vif-unplugged:9177df96-b4f9-41db-8806-f7ea5787a4fc for instance 3533de6f-5073-4e2e-9620-5655b2cdcb7f on nch2-master-1 May 07 21:47:48.847027 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8f71c9cc-c0de-4e73-abdb-7c910966a0c1 req-8d06118d-57d4-4d8c-8ab3-c20133c468ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094716 May 07 21:47:48.847925 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 403/816] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:48.877407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:48.878173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:48.889546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:48.895113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:48.913517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.926508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.927013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.927645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.928485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.929793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:48.930234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:48.930891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:49.315327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:49.332777 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-46be1baf-0dd9-4825-a5ec-e7e3f79d481e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.460002 May 07 21:47:49.335227 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 414/817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:48 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:49.342272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e06dc4a4-fa8f-497a-b3c7-b41edd42f95b req-1daf3f05-b5ba-4f80-a8ec-a1fe6a88fb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0284aa35-4e58-4e15-a194-a500996ed82e", "name": "network-vif-plugged", "status": "completed", "tag": "149155db-c2db-4827-9746-fffdb2d0018e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:49.354382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e06dc4a4-fa8f-497a-b3c7-b41edd42f95b req-1daf3f05-b5ba-4f80-a8ec-a1fe6a88fb01 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:49.355633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e06dc4a4-fa8f-497a-b3c7-b41edd42f95b req-1daf3f05-b5ba-4f80-a8ec-a1fe6a88fb01 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:49.376244 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e06dc4a4-fa8f-497a-b3c7-b41edd42f95b req-1daf3f05-b5ba-4f80-a8ec-a1fe6a88fb01 service nova] Creating event network-vif-plugged:149155db-c2db-4827-9746-fffdb2d0018e for instance 0284aa35-4e58-4e15-a194-a500996ed82e on nch2-master-1 May 07 21:47:49.383572 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e06dc4a4-fa8f-497a-b3c7-b41edd42f95b req-1daf3f05-b5ba-4f80-a8ec-a1fe6a88fb01 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046609 May 07 21:47:49.385877 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 415/818] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:49.394614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:49.394614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:49.420882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:49.421442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:49.423967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:49.426220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:49.532988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:49.543806 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f0829ea-ae11-4e16-8612-73e88763e330 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.658517 May 07 21:47:49.544942 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 404/819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:48 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:49.788577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:49.800438 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b18d8a92-d390-4c23-965b-c997f1c88d5d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.412646 May 07 21:47:49.801916 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 416/820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:49 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:49.815033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:49.816011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:49.824035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:49.824896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:49.826378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:49.827294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.038152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1623927513", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:50.128764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:50.201316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:50.214793 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a6b5cfb6-599c-46f0-a653-7253d4b6c3ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1477 microversion: 2.1 time: 0.404501 May 07 21:47:50.214793 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 417/821] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:49 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1477 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:50.369734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:50.370378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:50.378492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.379438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.380508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.381365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.398797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:50.399245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:50.399727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:50.400147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:50.400629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:50.411636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.412662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.413986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.414677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.437122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Getting quotas for project 59b4f20214214616967d9d414375248a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:50.448786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Getting quotas for user af32f4f4abc2444fb869076ed80b3a8d and project 59b4f20214214616967d9d414375248a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:50.462813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:47:50.467486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:47:50.527244 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-136db03b-af8f-4c66-891c-5bf46a8b5055 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774981 May 07 21:47:50.527903 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 405/822] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:47:50.540434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57f89854-8e59-49ea-a5fe-39ff0e2a5a51 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:50.542518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57f89854-8e59-49ea-a5fe-39ff0e2a5a51 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:50.590031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:50.601025 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b76538b5-5e56-4715-b13f-ca44e018f520 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.243930 May 07 21:47:50.601638 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 418/823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:50 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:50.614814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:50.616367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:50.622275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57f89854-8e59-49ea-a5fe-39ff0e2a5a51 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:50.626731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.627320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.628109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.628941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.633685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57f89854-8e59-49ea-a5fe-39ff0e2a5a51 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1217 microversion: 2.1 time: 0.097278 May 07 21:47:50.634554 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 406/824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:50 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:50.821224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:50.825103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:50.827784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:50.834796 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-01d7da03-bdd5-4e08-a4ee-38122d965b92 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.230195 May 07 21:47:50.839662 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 419/825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:50 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:50.845060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.845704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.846503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.847069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.877624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-806f2c8d-abfd-476c-a4ed-78c568761943 req-cc36e4c0-55af-49a4-ac0e-5c69d903a78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3533de6f-5073-4e2e-9620-5655b2cdcb7f", "tag": "9177df96-b4f9-41db-8806-f7ea5787a4fc"}, {"name": "network-changed", "server_uuid": "02cc3f76-02bb-44cb-82ab-79a357f42391", "tag": "44436595-8caf-48e5-967e-1749f507e89e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:50.887143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-806f2c8d-abfd-476c-a4ed-78c568761943 req-cc36e4c0-55af-49a4-ac0e-5c69d903a78e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:50.887917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-806f2c8d-abfd-476c-a4ed-78c568761943 req-cc36e4c0-55af-49a4-ac0e-5c69d903a78e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:50.902619 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-806f2c8d-abfd-476c-a4ed-78c568761943 req-cc36e4c0-55af-49a4-ac0e-5c69d903a78e service nova] Creating event network-changed:9177df96-b4f9-41db-8806-f7ea5787a4fc for instance 3533de6f-5073-4e2e-9620-5655b2cdcb7f on nch2-master-1 May 07 21:47:50.903777 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-806f2c8d-abfd-476c-a4ed-78c568761943 req-cc36e4c0-55af-49a4-ac0e-5c69d903a78e service nova] Creating event network-changed:44436595-8caf-48e5-967e-1749f507e89e for instance 02cc3f76-02bb-44cb-82ab-79a357f42391 on nch2-master-1 May 07 21:47:50.911366 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-806f2c8d-abfd-476c-a4ed-78c568761943 req-cc36e4c0-55af-49a4-ac0e-5c69d903a78e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037300 May 07 21:47:50.912804 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 420/826] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:51.038083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:51.051276 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5cfa38eb-6b21-42a0-8549-048bd225cace tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.236564 May 07 21:47:51.055063 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 407/827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:50 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:51.232796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:51.234427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.242255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.243116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.244378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.244991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.455910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:51.465377 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e8c9b30-7242-4daa-af14-5033f2bab498 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1462 microversion: 2.1 time: 0.236815 May 07 21:47:51.466045 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 421/828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:51 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1462 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:51.488595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1324788d-eb50-4fde-9b77-9b8f96f56a4f tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:51.489906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1324788d-eb50-4fde-9b77-9b8f96f56a4f tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.501090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1324788d-eb50-4fde-9b77-9b8f96f56a4f tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.501912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1324788d-eb50-4fde-9b77-9b8f96f56a4f tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.503418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1324788d-eb50-4fde-9b77-9b8f96f56a4f tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.504164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1324788d-eb50-4fde-9b77-9b8f96f56a4f tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.594182 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1324788d-eb50-4fde-9b77-9b8f96f56a4f tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action" status: 202 len: 0 microversion: 2.1 time: 0.109926 May 07 21:47:51.595143 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 408/829] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:51 2022] POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:51.607045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:51.607045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.610657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.611459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.612263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.612801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.617614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:51.618443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.624922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.625388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.626173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.626620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.655262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.655851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.656388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lazy-loading 'fault' on Instance uuid 0284aa35-4e58-4e15-a194-a500996ed82e {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:51.763355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:51.763520 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ad1f8e20-24d9-4f67-8e81-f31d650abfa0 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1596 microversion: 2.1 time: 0.163903 May 07 21:47:51.764029 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 422/830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:51 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1596 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:51.769804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:51.770419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.771693 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-720ab306-670c-4822-a692-0e227bff740a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.157887 May 07 21:47:51.772261 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 409/831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:51 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:51.776575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.777027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.777958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.778500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.844240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:51.851761 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee17ca8a-172c-4099-958b-bc79ce5812c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1269 microversion: 2.1 time: 0.085387 May 07 21:47:51.852648 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 423/832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:51 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:51.857488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1c11b43d-8497-4b4d-b331-734774fb1339 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:51.858459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1c11b43d-8497-4b4d-b331-734774fb1339 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.864376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c11b43d-8497-4b4d-b331-734774fb1339 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.864828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c11b43d-8497-4b4d-b331-734774fb1339 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.865782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c11b43d-8497-4b4d-b331-734774fb1339 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.866226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c11b43d-8497-4b4d-b331-734774fb1339 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.909978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2c2b806-de7f-4e18-ae9b-e8f927859190 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Calling method '.version_select at 0x7fc41ce94550>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:51.940511 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1c11b43d-8497-4b4d-b331-734774fb1339 tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action" status: 202 len: 0 microversion: 2.1 time: 0.086380 May 07 21:47:51.941304 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 424/833] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:51 2022] POST /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:47:51.946029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:51.946643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.952286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.953357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.954119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.954554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.975894 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f2c2b806-de7f-4e18-ae9b-e8f927859190 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 371 microversion: 2.1 time: 0.202341 May 07 21:47:51.976474 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 410/834] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 21:47:51 2022] GET /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:51.980839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6021edd6-f639-4a0d-bcbb-443b86bf483d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:51.981500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6021edd6-f639-4a0d-bcbb-443b86bf483d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:51.991906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6021edd6-f639-4a0d-bcbb-443b86bf483d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.992564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6021edd6-f639-4a0d-bcbb-443b86bf483d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:51.993159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6021edd6-f639-4a0d-bcbb-443b86bf483d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:51.993612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6021edd6-f639-4a0d-bcbb-443b86bf483d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.086876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:52.094281 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-138f9d53-d767-4596-92a1-c9f9d459b6ea tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.151906 May 07 21:47:52.094796 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 425/835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:51 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:52.099054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-407f16c5-717a-4188-a869-b3fb498ae499 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ce78040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:52.122896 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6021edd6-f639-4a0d-bcbb-443b86bf483d tempest-ServersAdminTestJSON-937815902 tempest-ServersAdminTestJSON-937815902-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1613 microversion: 2.1 time: 0.145340 May 07 21:47:52.123539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 411/836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:51 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1613 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:52.134564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:52.135226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:52.142505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.143193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.144028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.144633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.229744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-407f16c5-717a-4188-a869-b3fb498ae499 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.230216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-407f16c5-717a-4188-a869-b3fb498ae499 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.231412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-407f16c5-717a-4188-a869-b3fb498ae499 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.232165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-407f16c5-717a-4188-a869-b3fb498ae499 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.288257 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-407f16c5-717a-4188-a869-b3fb498ae499 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 328 microversion: 2.1 time: 0.192420 May 07 21:47:52.289586 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 426/837] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:52 2022] PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 328 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:52.300745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:52.301850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:52.313055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.314679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.315685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.316283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.353404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:47:52.424488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:52.432988 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8c9817aa-b40f-4398-8523-d96f3e848ab4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.307544 May 07 21:47:52.433569 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 412/838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:52 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:52.451331 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-254596ad-373d-46a9-9dae-727ea49a4d2e tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 204 len: 0 microversion: 2.1 time: 0.159566 May 07 21:47:52.452449 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 427/839] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:47:52 2022] DELETE /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:47:52.463221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:52.463983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:52.471487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.471950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.472767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.473593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.488126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1549535302", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:52.554621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:52.676567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:52.685266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-619284e6-39cc-4bc1-ae1f-e6f081de3bce tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1468 microversion: 2.1 time: 0.228597 May 07 21:47:52.686208 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 428/840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:52 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1468 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:52.788622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:52.789315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:52.795185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.795642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.796444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.796886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.813872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:52.815227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:52.815869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:52.816595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:52.817168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:52.826239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.828586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.829609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.830064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.861228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Getting quotas for project c335f668e1934df38eaeaaf86af96083. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:52.865518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Getting quotas for user 6921f3bc90ae43e4b644e20c0cde1bfd and project c335f668e1934df38eaeaaf86af96083. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:52.877492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.utils [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] cores quota exceeded for c335f668e1934df38eaeaaf86af96083, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136682) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 07 21:47:52.878337 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 07 21:47:52.879161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:52.880296 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d28df092-900f-4fc0-962d-05c986604c8e tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.445527 May 07 21:47:52.880879 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 413/841] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:52 2022] POST /compute/v2.1/servers => generated 111 bytes in 447 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:52.888412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:52.889331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:52.907348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.911147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.911970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:52.912428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:52.956855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:52.964956 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bca16b89-1149-4344-81b5-2d3d07c0ed97 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.180115 May 07 21:47:52.965695 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 429/842] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:52 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:52.970618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f4a6b6d7-4684-4326-8fa2-f4fe6dadb15f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ce481f0>, body: {"quota_set": {"cores": 20}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:52.986021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:52.995558 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44f6fae8-f5aa-456c-922f-4a4c0a9a679c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1275 microversion: 2.1 time: 0.113353 May 07 21:47:52.996229 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 414/843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:52 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:53.032294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4a6b6d7-4684-4326-8fa2-f4fe6dadb15f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.032747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4a6b6d7-4684-4326-8fa2-f4fe6dadb15f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.033554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4a6b6d7-4684-4326-8fa2-f4fe6dadb15f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.033998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4a6b6d7-4684-4326-8fa2-f4fe6dadb15f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.089205 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f4a6b6d7-4684-4326-8fa2-f4fe6dadb15f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 329 microversion: 2.1 time: 0.122432 May 07 21:47:53.089790 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 430/844] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:52 2022] PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 329 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:53.101283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4751556-9953-4192-9436-a7db048eee5b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Calling method '.version_select at 0x7fc41ceb6a60>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:53.114649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:53.115353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:53.122238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.122693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.123557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.123997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.175518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4751556-9953-4192-9436-a7db048eee5b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 371 microversion: 2.1 time: 0.075290 May 07 21:47:53.179967 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 415/845] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 21:47:53 2022] GET /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:53.191318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5667ff9c-959b-4038-b6b8-9a1c8df819b5 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ce36e50>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:53.259652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5667ff9c-959b-4038-b6b8-9a1c8df819b5 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.260379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5667ff9c-959b-4038-b6b8-9a1c8df819b5 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.261192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5667ff9c-959b-4038-b6b8-9a1c8df819b5 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.261642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5667ff9c-959b-4038-b6b8-9a1c8df819b5 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.285514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:53.293823 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a95d75d-cd86-442d-a58e-e338ce3dcfff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.186121 May 07 21:47:53.298841 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 431/846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:53 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:53.346428 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5667ff9c-959b-4038-b6b8-9a1c8df819b5 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 328 microversion: 2.1 time: 0.159635 May 07 21:47:53.347808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 416/847] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:53 2022] PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 328 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:53.397547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2032743819", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:53.451660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:53.452436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:53.459170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.459822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.460613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.461060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.461188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:53.674866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:53.675290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:53.675760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:53.676189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:53.676600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:53.685048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.685498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.686299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.687399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.705420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Getting quotas for project c335f668e1934df38eaeaaf86af96083. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:53.709572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Getting quotas for user 6921f3bc90ae43e4b644e20c0cde1bfd and project c335f668e1934df38eaeaaf86af96083. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:53.717949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:53.720988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.utils [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] instances quota exceeded for c335f668e1934df38eaeaaf86af96083, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136681) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 07 21:47:53.721833 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 07 21:47:53.722964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:53.723811 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e41e747-54d5-4072-b963-5c5b0449b819 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.330531 May 07 21:47:53.724697 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 432/848] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:53 2022] POST /compute/v2.1/servers => generated 119 bytes in 332 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:53.729353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:53.729959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:53.737443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.737900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.738676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.739318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.740651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94461198-4c92-4e16-99f3-586b04422e30 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.293601 May 07 21:47:53.741856 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 417/849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:53 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:53.746559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-25c6f059-d2e6-445f-a461-a37eac7b9468 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ceb6790>, body: {"quota_set": {"instances": 10}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:53.821461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25c6f059-d2e6-445f-a461-a37eac7b9468 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.821461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25c6f059-d2e6-445f-a461-a37eac7b9468 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.822373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25c6f059-d2e6-445f-a461-a37eac7b9468 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:53.822957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25c6f059-d2e6-445f-a461-a37eac7b9468 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:53.888237 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-25c6f059-d2e6-445f-a461-a37eac7b9468 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 329 microversion: 2.1 time: 0.144366 May 07 21:47:53.888872 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 418/850] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:53 2022] PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 329 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:53.895274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:53.900682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b695f50-3244-4da5-9450-b99b7773be6f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Calling method '.version_select at 0x7fc41ceddc10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:53.903079 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-991c98e0-64d9-459b-8bec-e2642f3de54a tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1468 microversion: 2.1 time: 0.177174 May 07 21:47:53.903646 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 433/851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:53 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1468 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:53.989900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:53.992121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:54.007467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.008574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.009321 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b695f50-3244-4da5-9450-b99b7773be6f tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 371 microversion: 2.1 time: 0.112284 May 07 21:47:54.010321 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 419/852] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 21:47:53 2022] GET /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:54.010714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.011766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.047645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:54.048825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:54.080326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.083454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.087731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.088657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.375325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:54.399654 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4b593e73-e929-49af-a2b2-566a1d8dda21 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.419110 May 07 21:47:54.404951 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 434/853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:53 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:54.414099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f311d38e-1760-4253-a8e2-f33d9dd5bf5e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ce784c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:54.428647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:54.438395 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a02ca6d0-a3f2-4a13-aa54-2f6c805dd851 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.418477 May 07 21:47:54.442990 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 420/854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:54 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:54.447591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:54.448428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:54.456250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.456822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.457830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.458355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.505513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f311d38e-1760-4253-a8e2-f33d9dd5bf5e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.506247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f311d38e-1760-4253-a8e2-f33d9dd5bf5e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.507290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f311d38e-1760-4253-a8e2-f33d9dd5bf5e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.507957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f311d38e-1760-4253-a8e2-f33d9dd5bf5e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.575118 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f311d38e-1760-4253-a8e2-f33d9dd5bf5e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 325 microversion: 2.1 time: 0.167641 May 07 21:47:54.575765 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 435/855] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:54 2022] PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:54.625298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-290517445", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:54.701046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:47:54.777790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:54.785507 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b680bcb7-a63b-402d-b3d7-0be25fbc4dbe tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.344921 May 07 21:47:54.786109 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 421/856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:54 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:54.793211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4f855eee-2600-4a68-bcf3-be1aa2ad2105 req-7f914b14-1e05-4516-8447-501df4b83719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ec46f9-84e6-413a-be19-c46548cb31fd", "tag": "04c678a5-64ac-461c-a365-ad4f4e5dd86c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:54.813428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f855eee-2600-4a68-bcf3-be1aa2ad2105 req-7f914b14-1e05-4516-8447-501df4b83719 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.815636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f855eee-2600-4a68-bcf3-be1aa2ad2105 req-7f914b14-1e05-4516-8447-501df4b83719 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.840670 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4f855eee-2600-4a68-bcf3-be1aa2ad2105 req-7f914b14-1e05-4516-8447-501df4b83719 service nova] Creating event network-changed:04c678a5-64ac-461c-a365-ad4f4e5dd86c for instance d0ec46f9-84e6-413a-be19-c46548cb31fd on nch1-master-1 May 07 21:47:54.853026 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4f855eee-2600-4a68-bcf3-be1aa2ad2105 req-7f914b14-1e05-4516-8447-501df4b83719 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065658 May 07 21:47:54.854060 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 422/857] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:54.866043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:54.867183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:54.879921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.882465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:54.886324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:54.886927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.195533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:55.207827 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb355833-0126-49b5-abaf-d4e70e33b1d1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.352233 May 07 21:47:55.218868 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 423/858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:54 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:55.225900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:55.226903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:55.233881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.235083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.236123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.236736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.273752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.274480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.275136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lazy-loading 'fault' on Instance uuid ad9c13b6-ebdb-426f-81a7-663cba33645a {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:55.325016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:55.333943 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12407836-832e-4842-aead-9323ceb5fc7f tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 200 len: 1303 microversion: 2.1 time: 0.112684 May 07 21:47:55.334858 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 424/859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:55 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:55.351644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:47:55.351823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:47:55.352306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:47:55.352872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:47:55.353288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:47:55.363652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.364114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.364932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.365624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.383757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Getting quotas for project c335f668e1934df38eaeaaf86af96083. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:47:55.388697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Getting quotas for user 6921f3bc90ae43e4b644e20c0cde1bfd and project c335f668e1934df38eaeaaf86af96083. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:47:55.401030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.utils [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] ram quota exceeded for c335f668e1934df38eaeaaf86af96083, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136681) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 07 21:47:55.401634 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 07 21:47:55.402419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:55.403841 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a0ee484-4ef4-41b9-a893-6937a47bc957 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.783171 May 07 21:47:55.404611 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 436/860] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:47:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 785 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:55.414313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-23d0a8fa-78e3-44a2-a1ba-ebfbdc1723c4 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cdeb4c0>, body: {"quota_set": {"ram": 51200}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:55.423142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:55.423986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:55.438166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.438631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.439632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.440517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.531399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23d0a8fa-78e3-44a2-a1ba-ebfbdc1723c4 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.532388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23d0a8fa-78e3-44a2-a1ba-ebfbdc1723c4 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.533499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23d0a8fa-78e3-44a2-a1ba-ebfbdc1723c4 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.534070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23d0a8fa-78e3-44a2-a1ba-ebfbdc1723c4 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.629106 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-23d0a8fa-78e3-44a2-a1ba-ebfbdc1723c4 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 200 len: 329 microversion: 2.1 time: 0.219044 May 07 21:47:55.629968 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 425/861] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:55 2022] PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 329 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:55.634911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:55.635771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:55.642706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.643581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.644713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.645344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.708990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:55.716600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-10d8446c-dd52-494e-b311-3ef8420fc5f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.298102 May 07 21:47:55.717806 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 437/862] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:55 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:55.722985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b49a84a9-f81c-435b-867a-c994805102b9 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Action: 'update', calling method: .version_select at 0x7fc41cd72af0>, body: {"quota_set": {"ram": 0}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:55.725576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b49a84a9-f81c-435b-867a-c994805102b9 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '6921f3bc90ae43e4b644e20c0cde1bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c335f668e1934df38eaeaaf86af96083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:55.726463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b49a84a9-f81c-435b-867a-c994805102b9 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:55.727505 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b49a84a9-f81c-435b-867a-c994805102b9 tempest-QuotasAdminNegativeTest-1932326133 tempest-QuotasAdminNegativeTest-1932326133-project] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083" status: 403 len: 116 microversion: 2.1 time: 0.008180 May 07 21:47:55.728021 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 438/863] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:47:55 2022] PUT /compute/v2.1/os-quota-sets/c335f668e1934df38eaeaaf86af96083 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:47:55.801309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:55.801934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:55.806447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:55.810997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.811793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.812596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:55.813049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:55.815354 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d692c91d-1ac4-45ac-a175-e877ce648b66 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.184039 May 07 21:47:55.816362 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 426/864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:55 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:55.953869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:55.962535 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3925ed5c-602b-46b8-a15a-3c5093b5b0da tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.164977 May 07 21:47:55.963195 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 439/865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:55 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:56.225310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:56.226098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:56.232649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.233111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.234543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.234944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.351254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:56.351878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: ad9c13b6-ebdb-426f-81a7-663cba33645a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:56.357832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.358350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.359757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.360208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.373702 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] HTTP exception thrown: Instance ad9c13b6-ebdb-426f-81a7-663cba33645a could not be found. May 07 21:47:56.374305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Returning 404 to user: Instance ad9c13b6-ebdb-426f-81a7-663cba33645a could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:47:56.375177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3079b6ea-6e54-43a5-8f32-50a97a72797d tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a" status: 404 len: 111 microversion: 2.1 time: 0.027877 May 07 21:47:56.375731 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 440/866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:56 2022] GET /compute/v2.1/servers/ad9c13b6-ebdb-426f-81a7-663cba33645a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:47:56.383336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:56.383838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:56.389630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.390090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.390892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.391374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.409884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:56.417060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:47:56.418354 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-acbaf47f-a5ff-493c-9b23-63de7864625e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.196941 May 07 21:47:56.419432 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 427/867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:56 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:56.502241 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05ab24c6-437a-477c-8c50-3e6d6d8363e1 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 204 len: 0 microversion: 2.1 time: 0.121952 May 07 21:47:56.502900 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 441/868] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:47:56 2022] DELETE /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 21:47:56.511290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:56.512044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:56.519259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.519710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.520725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.521169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.658711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:56.666382 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9b1732b3-0b28-450f-90bc-aa7ca99b08c0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1470 microversion: 2.1 time: 0.159048 May 07 21:47:56.667049 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 428/869] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:56 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:56.733854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:56.734572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:56.741327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.741863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.742580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.743060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.833793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:56.833793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:56.840639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.841176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.842207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.842692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.914891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:56.924565 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-77991e64-21ff-4c5c-8abb-c275e8149d00 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1498 microversion: 2.1 time: 0.194861 May 07 21:47:56.930975 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 442/870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:56 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:56.935983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-de6a7cdb-29eb-4e23-b609-70ac6ab8d165 req-aa799239-678f-4e64-9ac0-9bdcc7ffb076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc3f76-02bb-44cb-82ab-79a357f42391", "name": "network-vif-plugged", "status": "completed", "tag": "44436595-8caf-48e5-967e-1749f507e89e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:56.946492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-de6a7cdb-29eb-4e23-b609-70ac6ab8d165 req-aa799239-678f-4e64-9ac0-9bdcc7ffb076 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.947182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-de6a7cdb-29eb-4e23-b609-70ac6ab8d165 req-aa799239-678f-4e64-9ac0-9bdcc7ffb076 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:56.960945 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-de6a7cdb-29eb-4e23-b609-70ac6ab8d165 req-aa799239-678f-4e64-9ac0-9bdcc7ffb076 service nova] Creating event network-vif-plugged:44436595-8caf-48e5-967e-1749f507e89e for instance 02cc3f76-02bb-44cb-82ab-79a357f42391 on nch2-master-1 May 07 21:47:56.966313 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-de6a7cdb-29eb-4e23-b609-70ac6ab8d165 req-aa799239-678f-4e64-9ac0-9bdcc7ffb076 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039669 May 07 21:47:56.967641 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 443/871] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:56.973959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5cb36d04-70f3-4555-a042-b0781d723a29 req-a64f78ce-b419-42cf-87d5-0d435843f682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9c13b6-ebdb-426f-81a7-663cba33645a", "name": "network-vif-deleted", "tag": "1f353eba-6503-4549-810d-34664c1775fa"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:56.990117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5cb36d04-70f3-4555-a042-b0781d723a29 req-a64f78ce-b419-42cf-87d5-0d435843f682 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:56.990568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5cb36d04-70f3-4555-a042-b0781d723a29 req-a64f78ce-b419-42cf-87d5-0d435843f682 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.004004 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5cb36d04-70f3-4555-a042-b0781d723a29 req-a64f78ce-b419-42cf-87d5-0d435843f682 service nova] Creating event network-vif-deleted:1f353eba-6503-4549-810d-34664c1775fa for instance ad9c13b6-ebdb-426f-81a7-663cba33645a on nch2-master-1 May 07 21:47:57.010060 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5cb36d04-70f3-4555-a042-b0781d723a29 req-a64f78ce-b419-42cf-87d5-0d435843f682 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040486 May 07 21:47:57.010858 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 444/872] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:57.018299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:57.019485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:57.027741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.028318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.029714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.030225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.086284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:57.093790 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef591461-d6ea-45d9-8e4b-b1241a639619 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.264459 May 07 21:47:57.094375 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 429/873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:56 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:57.181554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:57.205921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-40cec952-928d-42a0-ae29-3934148afac4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.192081 May 07 21:47:57.211127 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 445/874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:57 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:57.438712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:57.440853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:57.447933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.448686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.449867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.450640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.683380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:57.683995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:57.694490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.695322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.696769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.697512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.901720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:57.910863 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-058da163-339b-4b48-9c63-2f5ff602fd78 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1470 microversion: 2.1 time: 0.231021 May 07 21:47:57.911797 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 446/875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:57 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1470 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:57.920139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:57.921530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:57.929106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.929839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:57.931101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:57.931101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.028737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:58.038825 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f4a64c8f-3d46-4d50-9fd8-093d0e415f85 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1312 microversion: 2.1 time: 0.607196 May 07 21:47:58.039761 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 430/876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:57 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1312 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:47:58.054079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:58.054963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:58.061359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.062101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.063078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.063740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.129033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid f6f62982-0b82-42d1-9d49-2b8d8f6ec04f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:58.144266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6913d08f-8f27-408b-9080-6c3ba9353e4a tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 2129 microversion: 2.25 time: 0.228263 May 07 21:47:58.145211 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 447/877] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:47:57 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 2129 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:47:58.150823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:58.154294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:58.162890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.163756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.164795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.165655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.409060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:58.421459 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af4edb0a-0718-4378-87e0-beae331107a0 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 200 len: 1475 microversion: 2.1 time: 0.379117 May 07 21:47:58.422797 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 431/878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:58 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 1475 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:58.429519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:58.430692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:58.440752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.442231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.443791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.444683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.455160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:58.464644 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d66ecec5-99f6-499b-9feb-5d57ffef6c38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.318078 May 07 21:47:58.465229 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 448/879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:58 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:58.469901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:58.470317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:58.483071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'flavor' on Instance uuid f6f62982-0b82-42d1-9d49-2b8d8f6ec04f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:58.483965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.484421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.485412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.485637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.500747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Going to try to live migrate instance to nch2-master-1 {{(pid=136682) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:47:58.799896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:58.807833 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a4d4fc1-6e1c-4402-997b-636f396d535a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1504 microversion: 2.1 time: 0.341615 May 07 21:47:58.819803 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 449/880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:58 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:58.828974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7504eb9c-a3e7-4a79-a645-4b438e57b412 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1263962576"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:58.828974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7504eb9c-a3e7-4a79-a645-4b438e57b412 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:58.833485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7504eb9c-a3e7-4a79-a645-4b438e57b412 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.833915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7504eb9c-a3e7-4a79-a645-4b438e57b412 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:58.834700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7504eb9c-a3e7-4a79-a645-4b438e57b412 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:58.835413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7504eb9c-a3e7-4a79-a645-4b438e57b412 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.312431 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7504eb9c-a3e7-4a79-a645-4b438e57b412 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2/action" status: 202 len: 0 microversion: 2.1 time: 0.490241 May 07 21:47:59.312688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 450/881] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:58 2022] POST /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 21:47:59.319239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:59.320029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:59.327165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.328293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.329104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.329547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.370042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.370514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.370967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lazy-loading 'fault' on Instance uuid e79018bd-9790-48c1-a26f-590908b011db {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:47:59.425091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:59.433240 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb565934-ee1a-41b9-b45c-b7f6b3300b02 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 200 len: 1304 microversion: 2.1 time: 0.119278 May 07 21:47:59.434338 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 451/882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:59 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:59.440374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e651221b-906a-4a91-beff-c6ee8d57beb2 req-bb0f97cf-028e-45b9-8e12-37be54c2dacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79018bd-9790-48c1-a26f-590908b011db", "name": "network-vif-deleted", "tag": "030cf429-3843-4968-ac82-75d806b69b77"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:59.451199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e651221b-906a-4a91-beff-c6ee8d57beb2 req-bb0f97cf-028e-45b9-8e12-37be54c2dacc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.451943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e651221b-906a-4a91-beff-c6ee8d57beb2 req-bb0f97cf-028e-45b9-8e12-37be54c2dacc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.466312 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e651221b-906a-4a91-beff-c6ee8d57beb2 req-bb0f97cf-028e-45b9-8e12-37be54c2dacc service nova] Creating event network-vif-deleted:030cf429-3843-4968-ac82-75d806b69b77 for instance e79018bd-9790-48c1-a26f-590908b011db on nch2-master-1 May 07 21:47:59.471976 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e651221b-906a-4a91-beff-c6ee8d57beb2 req-bb0f97cf-028e-45b9-8e12-37be54c2dacc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036252 May 07 21:47:59.473497 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 452/883] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:47:59.485058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:59.486407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:59.493727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.494716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.496344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.496794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.660806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:59.668629 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9cef3fb6-7bf3-4f08-a4fa-bc3db2ec152a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1461 microversion: 2.1 time: 0.192267 May 07 21:47:59.669223 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 453/884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:59 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1461 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:59.674499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac70faf6-8695-4d40-aa4d-989948111d0e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cdaa1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:59.726358 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac70faf6-8695-4d40-aa4d-989948111d0e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.056073 May 07 21:47:59.726969 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 454/885] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:59 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:59.732337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:47:59.734661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:59.741574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.742605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.743512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.744200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.894218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:47:59.901549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-623b662e-8e1e-4b96-968d-ea80de5b330d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.173615 May 07 21:47:59.902128 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 455/886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:47:59 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:47:59.911577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:47:59.911577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:47:59.914390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.914891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:47:59.915675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:47:59.916125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.003885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:00.010224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Old instance type m1.heat2, new instance type m1.heat {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 21:48:00.017044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:48:00.017411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:48:00.018034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:48:00.018311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:48:00.018730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:48:00.129211 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb6a627f-c1d9-4c9d-b5e1-eee910fcd700 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391/action" status: 202 len: 0 microversion: 2.1 time: 0.225869 May 07 21:48:00.129745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 456/887] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:47:59 2022] POST /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:00.135484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:00.136102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:00.142285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.142806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.143764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.144143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.326880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:00.341197 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9f620391-d8d3-450c-99eb-e174791436d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1479 microversion: 2.1 time: 0.207941 May 07 21:48:00.343793 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 457/888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:00 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1479 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:00.349740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:00.350372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:00.358066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.358568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.360391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.360614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.644869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:00.652499 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-849b504c-f45b-44ba-8c92-5bde1e0f9f35 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1470 microversion: 2.1 time: 0.307519 May 07 21:48:00.653195 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 458/889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:00 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:00.666190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-401fb5d1-bba0-4cdf-bf20-421d94751f1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '.version_select at 0x7fc41cd48550>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:00.671860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-401fb5d1-bba0-4cdf-bf20-421d94751f1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.672584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-401fb5d1-bba0-4cdf-bf20-421d94751f1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.684606 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-401fb5d1-bba0-4cdf-bf20-421d94751f1e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 2622 microversion: 2.1 time: 0.030059 May 07 21:48:00.693601 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 459/890] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:48:00 2022] GET /compute/v2.1/os-migrations => generated 2622 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:00.699767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:00.700751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: e79018bd-9790-48c1-a26f-590908b011db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:00.708662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.709487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.710454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.711229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.729232 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] HTTP exception thrown: Instance e79018bd-9790-48c1-a26f-590908b011db could not be found. May 07 21:48:00.730111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Returning 404 to user: Instance e79018bd-9790-48c1-a26f-590908b011db could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:00.731308 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-02bc6efa-6645-49bc-932f-f7829647bf49 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db" status: 404 len: 111 microversion: 2.1 time: 0.036451 May 07 21:48:00.733073 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 460/891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:00 2022] GET /compute/v2.1/servers/e79018bd-9790-48c1-a26f-590908b011db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:00.738382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f8fba42-00a7-457c-a0d3-92ecc74ab8b9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:00.739044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6f8fba42-00a7-457c-a0d3-92ecc74ab8b9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:00.745179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8fba42-00a7-457c-a0d3-92ecc74ab8b9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.745643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8fba42-00a7-457c-a0d3-92ecc74ab8b9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.746625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8fba42-00a7-457c-a0d3-92ecc74ab8b9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:00.747498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8fba42-00a7-457c-a0d3-92ecc74ab8b9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:00.969076 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6dc88d4-9ba9-42f9-bd26-151dc0dfaa3b tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/action" status: 202 len: 0 microversion: 2.25 time: 2.545029 May 07 21:48:00.969707 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 432/892] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:47:58 2022] POST /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/action => generated 0 bytes in 2546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:00.975287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7c3d2516-9659-4b0f-b806-632562b266be tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41ce01160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:00.995822 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f8fba42-00a7-457c-a0d3-92ecc74ab8b9 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1630 microversion: 2.1 time: 0.261337 May 07 21:48:00.997619 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 461/893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:00 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1630 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:01.012086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:01.013163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:01.029814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.031100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.032303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.032948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.054874 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7c3d2516-9659-4b0f-b806-632562b266be tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.083939 May 07 21:48:01.055559 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 433/894] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:00 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:01.067897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:01.068673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:01.070811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:48:01.080122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.080594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.081409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.081847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.183066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-20efbd4c-bb3e-49c9-96b1-f9f5e367d9f8 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 204 len: 0 microversion: 2.1 time: 0.184333 May 07 21:48:01.187388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 462/895] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:48:00 2022] DELETE /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:01.192802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:01.193535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:01.201260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.202588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.203563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.204189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.253132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:01.260792 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92a9bfe9-3f65-4119-a65f-101de5c0029b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.203334 May 07 21:48:01.261386 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 434/896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:01 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:01.267751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-36122296", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "28405dfe-908d-4039-91f6-1d02165b34cd"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:01.337539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] validate_networks() for [('28405dfe-908d-4039-91f6-1d02165b34cd', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:48:01.414593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:01.423473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:01.425089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:01.426158 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ab03bd1f-c2e6-46f2-8e90-19b4ed75b52d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.240435 May 07 21:48:01.426729 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 463/897] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:01 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:01.431261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:01.431757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:01.438183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.438646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.439460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.439982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.608838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:01.617120 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-04294033-b066-42b3-8d87-d7aae15c40f0 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1468 microversion: 2.1 time: 0.189371 May 07 21:48:01.617866 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 464/898] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:01 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1468 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:01.669547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:01.670529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:01.679237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.681394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.683884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.684526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.764467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:48:01.764933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:48:01.765652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:48:01.766319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:48:01.766787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:48:01.775746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.776269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.777308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:01.777747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:01.798713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:48:01.802764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for user 7dd9c30816a7410f94b10294234c1dc2 and project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:48:01.815408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:48:01.818104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:48:01.847407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:01.859490 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cce83c94-e573-42d4-b9f2-b64d98fbd31e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1470 microversion: 2.1 time: 0.193906 May 07 21:48:01.860075 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 465/899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:01 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:01.876115 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b767e5c8-e0c8-4454-b301-2ac7d5ed32fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612555 May 07 21:48:01.881625 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 435/900] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:48:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:48:01.888830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-47b99fae-e7e9-4a00-b4c3-40217c7ab335 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:01.889465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-47b99fae-e7e9-4a00-b4c3-40217c7ab335 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:01.948330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-47b99fae-e7e9-4a00-b4c3-40217c7ab335 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:01.958821 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-47b99fae-e7e9-4a00-b4c3-40217c7ab335 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1209 microversion: 2.1 time: 0.074171 May 07 21:48:01.960232 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 466/901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:01 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:02.069129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-edf6a049-bc4a-4192-a1e3-a68ebe7b973b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41ceb6c10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:02.131969 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-edf6a049-bc4a-4192-a1e3-a68ebe7b973b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.067035 May 07 21:48:02.132757 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 436/902] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:02.277811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:02.278436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:02.286089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.286920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:02.288356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.288802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:02.472912 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e032bba6-2049-413a-a199-4b7412b43923 tempest-TenantUsagesNegativeTestJSON-1597048175 tempest-TenantUsagesNegativeTestJSON-1597048175-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-06T21%3A48%3A02.289841&end=2022-05-08T21%3A48%3A02.289841" status: 404 len: 112 microversion: - time: 0.179027 May 07 21:48:02.473463 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 437/903] 10.222.0.32 () {58 vars in 1315 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-06T21%3A48%3A02.289841&end=2022-05-08T21%3A48%3A02.289841 => generated 112 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 07 21:48:02.477276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:02.480018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:02.480650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:02.498427 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fc57701a-83ad-49f5-8489-69b0688518ef tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.222242 May 07 21:48:02.498427 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 467/904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:02.498903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.499342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:02.504981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.505830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:02.513220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cda16293-397f-4e9b-96a7-1e25828a151f tempest-TenantUsagesNegativeTestJSON-1597048175 tempest-TenantUsagesNegativeTestJSON-1597048175-project-admin] Calling method '.version_select at 0x7fc41cc9d5e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:02.520586 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-cda16293-397f-4e9b-96a7-1e25828a151f tempest-TenantUsagesNegativeTestJSON-1597048175 tempest-TenantUsagesNegativeTestJSON-1597048175-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 07 21:48:02.521329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cda16293-397f-4e9b-96a7-1e25828a151f tempest-TenantUsagesNegativeTestJSON-1597048175 tempest-TenantUsagesNegativeTestJSON-1597048175-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:02.522325 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cda16293-397f-4e9b-96a7-1e25828a151f tempest-TenantUsagesNegativeTestJSON-1597048175 tempest-TenantUsagesNegativeTestJSON-1597048175-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/db9bfb87028d4c069dba18e42c7bdf13?start=2022-05-08T21%3A48%3A02.289841&end=2022-05-06T21%3A48%3A02.289841" status: 400 len: 111 microversion: 2.1 time: 0.024401 May 07 21:48:02.523347 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 468/905] 10.222.0.32 () {58 vars in 1411 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/os-simple-tenant-usage/db9bfb87028d4c069dba18e42c7bdf13?start=2022-05-08T21%3A48%3A02.289841&end=2022-05-06T21%3A48%3A02.289841 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:48:02.681368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-00e152ac-e35d-448a-9da7-ff3bc20b175b tempest-TenantUsagesNegativeTestJSON-506106155 tempest-TenantUsagesNegativeTestJSON-506106155-project] Calling method '.version_select at 0x7fc41cd33670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:02.692817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:02.695924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-00e152ac-e35d-448a-9da7-ff3bc20b175b tempest-TenantUsagesNegativeTestJSON-506106155 tempest-TenantUsagesNegativeTestJSON-506106155-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'bb6270f2f93f4f94b70d316baa2fd745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db9bfb87028d4c069dba18e42c7bdf13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:02.704293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-00e152ac-e35d-448a-9da7-ff3bc20b175b tempest-TenantUsagesNegativeTestJSON-506106155 tempest-TenantUsagesNegativeTestJSON-506106155-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:02.705152 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-00e152ac-e35d-448a-9da7-ff3bc20b175b tempest-TenantUsagesNegativeTestJSON-506106155 tempest-TenantUsagesNegativeTestJSON-506106155-project] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-06T21%3A48%3A02.289841&end=2022-05-08T21%3A48%3A02.289841&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.176442 May 07 21:48:02.705290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:02.705745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 469/906] 10.222.0.32 () {58 vars in 1334 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-06T21%3A48%3A02.289841&end=2022-05-08T21%3A48%3A02.289841&detailed=1 => generated 123 bytes in 178 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 07 21:48:02.707093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:02.709187 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-282eb0b4-1d7d-4a56-b374-9bd36aa57f67 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.233789 May 07 21:48:02.709187 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 438/907] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:02.748131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:02.755280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:02.770736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.771789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:02.772799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.773410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:02.877152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:02.878204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:02.887748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.893127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:02.894370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:02.896409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:03.063518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:03.074037 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6c6b04b4-2944-40d1-8032-4163b57951ac tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1468 microversion: 2.1 time: 0.332566 May 07 21:48:03.074635 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 470/908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1468 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:03.080939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:03.081977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:03.112170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:03.112635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:03.113679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:03.113869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:03.228180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:03.236981 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce387f9b-2248-43e4-9478-4ceb16d4864c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1261 microversion: 2.1 time: 0.160290 May 07 21:48:03.237778 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 471/909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:03 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:03.242441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-93563659-e527-4e6b-8211-899e258bef41 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc578b0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:03.291924 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-93563659-e527-4e6b-8211-899e258bef41 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.052923 May 07 21:48:03.293532 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 472/910] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:03 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:03.321143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:03.333057 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57124973-686d-4e60-9d11-67df57e8e3b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1470 microversion: 2.1 time: 0.461029 May 07 21:48:03.336632 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 439/911] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:02 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1470 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:03.516259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:03.516899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:03.523683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:03.524142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:03.525354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:03.525810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:03.726091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ff263e19-f40a-4523-b639-97ef33e0bc8f req-d64e233d-06c1-4dfd-a1a1-b560bc73b95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0284aa35-4e58-4e15-a194-a500996ed82e", "name": "network-vif-deleted", "tag": "149155db-c2db-4827-9746-fffdb2d0018e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:03.756712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ff263e19-f40a-4523-b639-97ef33e0bc8f req-d64e233d-06c1-4dfd-a1a1-b560bc73b95c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:03.764316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ff263e19-f40a-4523-b639-97ef33e0bc8f req-d64e233d-06c1-4dfd-a1a1-b560bc73b95c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:03.832629 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ff263e19-f40a-4523-b639-97ef33e0bc8f req-d64e233d-06c1-4dfd-a1a1-b560bc73b95c service nova] Creating event network-vif-deleted:149155db-c2db-4827-9746-fffdb2d0018e for instance 0284aa35-4e58-4e15-a194-a500996ed82e on nch2-master-1 May 07 21:48:03.853355 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ff263e19-f40a-4523-b639-97ef33e0bc8f req-d64e233d-06c1-4dfd-a1a1-b560bc73b95c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132576 May 07 21:48:03.857486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 440/912] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:03.879856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:03.880591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:03.915049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:03.915611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:03.926058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:03.927361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.007129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:04.016018 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14e3b55b-60c8-4912-abeb-c25bc6ec9752 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.504260 May 07 21:48:04.016671 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 473/913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:03 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:04.103081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:04.103698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:04.116102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.116550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.119487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.119933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.175245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.177009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.177995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lazy-loading 'fault' on Instance uuid 0284aa35-4e58-4e15-a194-a500996ed82e {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:48:04.248011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:04.259777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:04.261460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:04.265155 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a57f1b2-e53d-4b35-90a3-b010beb9ef2b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.403501 May 07 21:48:04.268374 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 441/914] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:03 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:04.283284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:04.283921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:04.293243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.293712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.294503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.294976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.305842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1333f2166c947a4a37dd6865f532f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95946c2e9a5c4a72905d75010a9bb7a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:04.346053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-055bf294-b482-45c9-9bcb-5ea9bf75b8e3 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 200 len: 1303 microversion: 2.1 time: 0.248700 May 07 21:48:04.360648 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 474/915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:04 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 1303 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:04.384361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c291b22d-623b-4d29-a678-190e4941c42d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc75310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:04.539161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:04.554232 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed332af1-94b5-455b-8ee7-a0218f2ad353 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1267 microversion: 2.1 time: 0.284697 May 07 21:48:04.554843 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 442/916] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:04 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:04.559273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:04.559869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:04.560386 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c291b22d-623b-4d29-a678-190e4941c42d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.195076 May 07 21:48:04.560968 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 475/917] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:04 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:04.575904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.578495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.582764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-8832d19c-bae6-4c4f-8416-a84dbe1fddbd req-f4be42a2-91ff-4282-820e-bc719d7190bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a792c3-0086-43d1-8995-7d56146f84b2", "name": "network-vif-plugged", "status": "completed", "tag": "85df8e70-88cc-4aed-a304-7a9a475aa9c1"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:04.583068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.583529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.636497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8832d19c-bae6-4c4f-8416-a84dbe1fddbd req-f4be42a2-91ff-4282-820e-bc719d7190bc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:04.636964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8832d19c-bae6-4c4f-8416-a84dbe1fddbd req-f4be42a2-91ff-4282-820e-bc719d7190bc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:04.701124 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-8832d19c-bae6-4c4f-8416-a84dbe1fddbd req-f4be42a2-91ff-4282-820e-bc719d7190bc service nova] Creating event network-vif-plugged:85df8e70-88cc-4aed-a304-7a9a475aa9c1 for instance 12a792c3-0086-43d1-8995-7d56146f84b2 on nch1-master-1 May 07 21:48:04.734016 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-8832d19c-bae6-4c4f-8416-a84dbe1fddbd req-f4be42a2-91ff-4282-820e-bc719d7190bc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166594 May 07 21:48:04.734927 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 476/918] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:05.003006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:05.010790 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-320fdec2-504b-418d-a624-84874d06c7b2 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1470 microversion: 2.1 time: 0.454908 May 07 21:48:05.011391 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 443/919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:04 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1470 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:05.038083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:05.039102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:05.056861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.057598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.059677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.064177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.287643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:05.288264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:05.300687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.301138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.301937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.302377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.525117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:05.534685 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db404d68-aea3-4bda-90fb-1e113d215886 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.503012 May 07 21:48:05.540083 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 477/920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:05 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:05.552575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:05.553468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] [instance: 0284aa35-4e58-4e15-a194-a500996ed82e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:05.570270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.571399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.573191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.577573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.605398 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] HTTP exception thrown: Instance 0284aa35-4e58-4e15-a194-a500996ed82e could not be found. May 07 21:48:05.607835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] Returning 404 to user: Instance 0284aa35-4e58-4e15-a194-a500996ed82e could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:05.612415 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f0395260-123f-4c6c-a9f4-d605928f0292 tempest-ServersAdminTestJSON-703324321 tempest-ServersAdminTestJSON-703324321-project] 10.222.0.32 "GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e" status: 404 len: 111 microversion: 2.1 time: 0.070953 May 07 21:48:05.613846 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 478/921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:05 2022] GET /compute/v2.1/servers/0284aa35-4e58-4e15-a194-a500996ed82e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:05.628528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b19a9bf-4aa2-49bb-b1b7-b4938cfcc22c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cd48a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:05.704572 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b19a9bf-4aa2-49bb-b1b7-b4938cfcc22c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.089484 May 07 21:48:05.705810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 479/922] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:05 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:05.715042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:05.718966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:05.729083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.729464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.749378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:05.752598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:05.856089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:05.865332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:05.866903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:05.868080 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-288684d8-a641-4640-938b-d4459f735dff tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.585585 May 07 21:48:05.868654 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 444/923] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:05 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:06.031359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:06.041798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:06.079277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:06.079876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:06.080437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:06.083115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:06.083564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:06.089202 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3e12df58-d289-465e-8467-85fb86eb6f9c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.382297 May 07 21:48:06.093911 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 480/924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:05 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:06.349270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:06.365877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4075c5eb-94e4-4a66-8995-2ef7dd1dc844 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.338093 May 07 21:48:06.367012 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 445/925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:06 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:06.555502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:06.556132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:06.576215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:06.576793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:06.577666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:06.578136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:06.720159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da6ab0ce-0b87-4898-a70a-e3e385f99f70 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d2c6700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:06.793090 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da6ab0ce-0b87-4898-a70a-e3e385f99f70 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.079366 May 07 21:48:06.796319 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 446/926] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:06 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:48:06.807249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-967f4731-c800-4a3f-bc59-8efeee9d22ae req-fcccf55f-1a98-4ef5-b900-566985c07ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ec46f9-84e6-413a-be19-c46548cb31fd", "name": "network-vif-plugged", "status": "completed", "tag": "04c678a5-64ac-461c-a365-ad4f4e5dd86c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:06.837491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-967f4731-c800-4a3f-bc59-8efeee9d22ae req-fcccf55f-1a98-4ef5-b900-566985c07ed5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:06.842236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-967f4731-c800-4a3f-bc59-8efeee9d22ae req-fcccf55f-1a98-4ef5-b900-566985c07ed5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:06.879642 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-967f4731-c800-4a3f-bc59-8efeee9d22ae req-fcccf55f-1a98-4ef5-b900-566985c07ed5 service nova] Creating event network-vif-plugged:04c678a5-64ac-461c-a365-ad4f4e5dd86c for instance d0ec46f9-84e6-413a-be19-c46548cb31fd on nch1-master-1 May 07 21:48:06.918206 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-967f4731-c800-4a3f-bc59-8efeee9d22ae req-fcccf55f-1a98-4ef5-b900-566985c07ed5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115794 May 07 21:48:06.919728 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 447/927] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:06.926820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:06.942612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:06.953999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:06.954748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:06.955864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:06.956857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:07.281920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:07.286445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:07.291569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:07.293208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:07.294999 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55eea4bd-15a8-43ec-8530-c3619d3ea027 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.373679 May 07 21:48:07.299215 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2ac28d82-e04c-4b78-9610-582a9cf91084 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.746940 May 07 21:48:07.300386 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 481/928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:06 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:07.303487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 448/929] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:06 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:07.311024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:07.314797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:07.325854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:07.328466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:07.329306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:07.329761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:07.388230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:07.388858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:07.404008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:07.404470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:07.405323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:07.405769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:07.611248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:07.620852 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc716bd8-a5ec-4c45-8c95-45b58f9830fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.319162 May 07 21:48:07.631436 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 482/930] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:07 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:07.636228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a89a084a-27f0-4737-b0d3-89c39824f650 req-090692c8-4352-4ce6-9b0f-9d245d685340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028d626c-306b-45cc-81b8-b73eca1c01c3", "tag": "87c894e0-03dd-4dab-a47b-82dec6ea1485"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:07.661369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a89a084a-27f0-4737-b0d3-89c39824f650 req-090692c8-4352-4ce6-9b0f-9d245d685340 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:07.661930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a89a084a-27f0-4737-b0d3-89c39824f650 req-090692c8-4352-4ce6-9b0f-9d245d685340 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:07.687384 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a89a084a-27f0-4737-b0d3-89c39824f650 req-090692c8-4352-4ce6-9b0f-9d245d685340 service nova] Creating event network-changed:87c894e0-03dd-4dab-a47b-82dec6ea1485 for instance 028d626c-306b-45cc-81b8-b73eca1c01c3 on nch2-master-1 May 07 21:48:07.703869 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a89a084a-27f0-4737-b0d3-89c39824f650 req-090692c8-4352-4ce6-9b0f-9d245d685340 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071112 May 07 21:48:07.704781 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 483/931] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:07.738007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:07.749482 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-349bdf45-d8b8-44d6-a3b8-3b6b36c90962 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.367270 May 07 21:48:07.751156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 449/932] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:07 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:48:07.812628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86e2989d-7a69-4885-95bd-0066a4970da6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc75ca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:07.880538 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-86e2989d-7a69-4885-95bd-0066a4970da6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.072752 May 07 21:48:07.881128 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 484/933] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:07 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:08.316369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:08.317527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:08.317663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:08.318273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:08.324875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.325456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.327703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.327847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.328163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.328306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.329022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.329745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.523483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:08.532899 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-666e4b45-d555-459f-bc7b-42307fe9ae38 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1317 microversion: 2.1 time: 0.219913 May 07 21:48:08.535453 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 485/934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:08 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:08.652713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:08.653444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:08.662464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.664280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.665265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.665863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.692012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:08.705366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:08.707084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:08.709956 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c9dd1cc3-1c89-417f-b6f2-e6801db7b15d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.400129 May 07 21:48:08.711939 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 450/935] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:08 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:08.769062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:08.769754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:08.782786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.795065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.795065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:08.795065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:08.959459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:08.968815 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f5c23a9-ef3d-42db-beb7-e56ae736221c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.318972 May 07 21:48:08.969711 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 486/936] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:08 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:48:08.975945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-07c1a133-86ac-451e-badc-6d0fe34a1614 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc9de50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:09.032837 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-07c1a133-86ac-451e-badc-6d0fe34a1614 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.061561 May 07 21:48:09.033354 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 487/937] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:08 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:09.554153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:09.555179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:09.568158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:09.572929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:09.576245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:09.577264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:09.699435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:09.708045 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-38c91973-d202-4bc6-b8ce-34b43bf9044a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.943317 May 07 21:48:09.713656 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 451/938] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:08 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:48:09.730025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:09.730822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:09.742887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:09.743757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:09.746435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:09.747172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:09.888504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:09.899258 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f0502a3-4165-4d2b-8122-5af8ec1dff5d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1466 microversion: 2.1 time: 0.351556 May 07 21:48:09.900103 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 488/939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:09 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1466 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:09.923135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1605686811", "metadata": {"image_type": "test"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:09.924641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:09.935519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:09.937558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:09.938563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:09.941798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:10.029088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Getting quotas for project 59b4f20214214616967d9d414375248a. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:48:10.037323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Getting quotas for user af32f4f4abc2444fb869076ed80b3a8d and project 59b4f20214214616967d9d414375248a. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:48:10.049334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:10.058703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:10.074586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:10.076337 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-069c6ba1-896c-49f3-a3ce-7ea3cb58d968 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.350807 May 07 21:48:10.080091 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 452/940] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:09 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:10.090370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:10.097387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:10.104183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:10.104895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:10.105864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:10.106486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:10.456317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-258a121f-c17b-470c-af9b-7b838256927b tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "POST /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd/action" status: 202 len: 0 microversion: 2.1 time: 0.533157 May 07 21:48:10.461462 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 489/941] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:48:09 2022] POST /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 07 21:48:10.493004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ef1a704f-d261-473d-adb4-b0c998dc1ca8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc080d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:10.544007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:10.568532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f3578a8-af48-4b2f-9543-fced0c04c42d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.487007 May 07 21:48:10.569388 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 453/942] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:10 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:10.584827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-43d4a6b1-90da-4a48-a43c-5f25372361c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41ce36dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:10.609422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ef1a704f-d261-473d-adb4-b0c998dc1ca8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.131186 May 07 21:48:10.611971 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 490/943] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:10 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:10.687068 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-43d4a6b1-90da-4a48-a43c-5f25372361c4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.114403 May 07 21:48:10.694572 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 454/944] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:10 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:10.733757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:10.735253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:10.752684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:10.754051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:10.756628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:10.757513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:11.068230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:11.081565 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81ee120a-1efe-42b3-88f0-1d8947b07a33 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.352098 May 07 21:48:11.082980 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 491/945] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:10 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:11.098416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:11.099705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:11.106130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:11.106839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:11.108633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:11.109859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:11.585749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:11.586891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:11.600320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:11.600779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:11.601587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:11.602026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:12.008456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:12.019590 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05177c38-22f8-4b47-9707-38077a19c9b9 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.437614 May 07 21:48:12.020470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 492/946] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:11 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:12.033820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9bb636c8-5578-4d9e-8191-c4afad8a1b52 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc30ee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:12.081530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:12.100212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:12.101779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:12.103322 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f4d54213-b54a-4dfa-a0d0-ac05cc6a6c8c tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 1.009176 May 07 21:48:12.104046 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 455/947] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:11 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:12.109365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eafd85ba-52a5-45ae-bf1e-ba4b2b89ef6f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cda9dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:12.143678 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9bb636c8-5578-4d9e-8191-c4afad8a1b52 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.119718 May 07 21:48:12.144729 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 493/948] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:12 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:12.160624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:12.163071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:12.178133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:12.178915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:12.180392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:12.181007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:12.220429 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eafd85ba-52a5-45ae-bf1e-ba4b2b89ef6f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.115148 May 07 21:48:12.222089 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 456/949] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:12 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:12.436365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:12.459500 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-829ec5c3-9eda-4e2a-9a7a-053b638b33c5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.300322 May 07 21:48:12.460463 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 494/950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:12 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:12.775166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-efaec326-34ad-4fbb-8e36-907bc549f250 req-c25800ea-d185-48af-a79c-c454f4196193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f62982-0b82-42d1-9d49-2b8d8f6ec04f", "name": "network-vif-unplugged", "status": "completed", "tag": "446d2d04-f43a-4396-ae3d-6321f1ea6225"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:12.789059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-efaec326-34ad-4fbb-8e36-907bc549f250 req-c25800ea-d185-48af-a79c-c454f4196193 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:12.795268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-efaec326-34ad-4fbb-8e36-907bc549f250 req-c25800ea-d185-48af-a79c-c454f4196193 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:12.825871 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-efaec326-34ad-4fbb-8e36-907bc549f250 req-c25800ea-d185-48af-a79c-c454f4196193 service nova] Creating event network-vif-unplugged:446d2d04-f43a-4396-ae3d-6321f1ea6225 for instance f6f62982-0b82-42d1-9d49-2b8d8f6ec04f on nch1-master-1 May 07 21:48:12.844255 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-efaec326-34ad-4fbb-8e36-907bc549f250 req-c25800ea-d185-48af-a79c-c454f4196193 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071286 May 07 21:48:12.845597 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 457/951] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:13.039989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:13.043010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:13.064886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:13.065793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:13.066868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:13.067624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:13.134245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:13.135124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:13.144357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:13.148361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:13.149352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:13.159229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:13.406732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:13.422016 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-159f57b3-aba1-48db-8cde-9a3c5735cc13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.389241 May 07 21:48:13.422782 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 495/952] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:13 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:13.442059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-41100807-1bdb-4d67-b1dd-85766cfb513d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc030d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:13.513005 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-41100807-1bdb-4d67-b1dd-85766cfb513d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.080277 May 07 21:48:13.514497 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 496/953] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:13 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:13.528011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5ac980e4-f448-4ce1-aeea-049099a33759 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cc035e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:13.599319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5ac980e4-f448-4ce1-aeea-049099a33759 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.083469 May 07 21:48:13.600179 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 497/954] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:13 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:13.605336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:13.608744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:13.623255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:13.623758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:13.624559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:13.625007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:13.822286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:13.833587 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-34f2aec2-c0d9-47d7-ab6d-f0abf9f8ed05 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.232125 May 07 21:48:13.845012 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 498/955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:13 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:14.226099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:14.238447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:14.240632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:14.245699 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e66d0339-ba12-40c2-a793-2d53444620ae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 1.125241 May 07 21:48:14.247821 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 458/956] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:13 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:48:14.441737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:14.442631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:14.459811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:14.461220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:14.463706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:14.465671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:14.528259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8d9ea103-c86c-496e-8f6f-11032693e4bb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cda93a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:14.752168 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8d9ea103-c86c-496e-8f6f-11032693e4bb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1412 microversion: 2.1 time: 0.228399 May 07 21:48:14.753216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 459/957] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:14 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1412 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:14.769694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8631dc13-d730-4ed5-bf15-c4b37a0c9a44 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41ce164c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:14.794710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:14.802154 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1489d522-f42c-4b76-9feb-6a9ee688e8db tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.366608 May 07 21:48:14.802756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 499/958] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:14 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:14.856917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:14.857563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:14.867899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:14.868368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:14.869169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:14.869779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:15.372879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:15.386240 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6dc57b31-55a6-4730-adc2-4ea6a621fe77 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.534305 May 07 21:48:15.387459 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 500/959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:14 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:48:15.403231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:15.405461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:15.434949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:15.435766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:15.439885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:15.440621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:15.943374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:15.953879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:15.958571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:15.961707 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8ede187d-9c79-4db9-8a66-631a4f2d8764 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.572973 May 07 21:48:15.967170 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 501/960] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:15 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:15.985351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a0452d22-4ecc-4d3a-887f-8bb8d68d39e7 req-716e82bd-9db5-452d-9539-cea85cf67e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f62982-0b82-42d1-9d49-2b8d8f6ec04f", "tag": "446d2d04-f43a-4396-ae3d-6321f1ea6225"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:16.020951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a0452d22-4ecc-4d3a-887f-8bb8d68d39e7 req-716e82bd-9db5-452d-9539-cea85cf67e9e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:16.025684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a0452d22-4ecc-4d3a-887f-8bb8d68d39e7 req-716e82bd-9db5-452d-9539-cea85cf67e9e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:16.080145 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a0452d22-4ecc-4d3a-887f-8bb8d68d39e7 req-716e82bd-9db5-452d-9539-cea85cf67e9e service nova] Creating event network-changed:446d2d04-f43a-4396-ae3d-6321f1ea6225 for instance f6f62982-0b82-42d1-9d49-2b8d8f6ec04f on nch1-master-1 May 07 21:48:16.109364 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a0452d22-4ecc-4d3a-887f-8bb8d68d39e7 req-716e82bd-9db5-452d-9539-cea85cf67e9e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133093 May 07 21:48:16.114820 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 502/961] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:16.141055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce74932d-21c4-42cc-9e47-fbef9d0e7eb6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc03820>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:24.191169 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce74932d-21c4-42cc-9e47-fbef9d0e7eb6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1421 microversion: 2.1 time: 8.072814 May 07 21:48:24.191834 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8631dc13-d730-4ed5-bf15-c4b37a0c9a44 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 9.430818 May 07 21:48:24.192631 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 460/962] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:14 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 9439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:24.193067 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 503/963] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:16 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1421 bytes in 8076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:24.200314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:24.218552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:24.236565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:24.237030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:24.239387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:24.240860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:24.249567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:24.255465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:24.261093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:24.276933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:24.278219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:24.280740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:24.631728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:24.644410 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-652a47bd-32d9-42f5-973d-0b19d4fd0e19 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.450096 May 07 21:48:24.646048 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 504/964] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:24 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:24.651930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:24.655941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:24.678588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:24.679535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:24.683750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:24.683750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:24.837196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:24.850249 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af83a8e6-9784-4f09-8052-85cfe9f8993d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1309 microversion: 2.1 time: 0.625801 May 07 21:48:24.851323 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 461/965] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:24 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1309 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:24.857390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-0b64b310-6d16-423f-bcda-48f50d9ab5e3 req-89252640-82e8-449b-830e-449270c90a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028d626c-306b-45cc-81b8-b73eca1c01c3", "name": "network-vif-plugged", "status": "completed", "tag": "87c894e0-03dd-4dab-a47b-82dec6ea1485"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:24.895814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0b64b310-6d16-423f-bcda-48f50d9ab5e3 req-89252640-82e8-449b-830e-449270c90a6c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:24.898028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0b64b310-6d16-423f-bcda-48f50d9ab5e3 req-89252640-82e8-449b-830e-449270c90a6c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:24.938199 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-0b64b310-6d16-423f-bcda-48f50d9ab5e3 req-89252640-82e8-449b-830e-449270c90a6c service nova] Creating event network-vif-plugged:87c894e0-03dd-4dab-a47b-82dec6ea1485 for instance 028d626c-306b-45cc-81b8-b73eca1c01c3 on nch2-master-1 May 07 21:48:24.953833 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-0b64b310-6d16-423f-bcda-48f50d9ab5e3 req-89252640-82e8-449b-830e-449270c90a6c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098796 May 07 21:48:24.958160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 462/966] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:24.974315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:24.975585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:25.001694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:25.003918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:25.008626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:25.014784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:25.129110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:48:25.374995 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9e435df5-5dbb-4395-8639-88c056f5410d tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 204 len: 0 microversion: 2.1 time: 0.412814 May 07 21:48:25.375644 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 463/967] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:48:24 2022] DELETE /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:25.474915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:25.485992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:25.497514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:25.504882 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8b122900-a09b-4209-b92b-663087592802 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1646 microversion: 2.25 time: 0.852236 May 07 21:48:25.506167 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 505/968] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:24 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1646 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:25.544695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b53f6af9-87c7-4177-b22f-2ae1bb940547 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] Calling method '.version_select at 0x7fc41ce16ee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:25.652586 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b53f6af9-87c7-4177-b22f-2ae1bb940547 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.275615 May 07 21:48:25.662300 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 464/969] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 21:48:25 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:48:25.662300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4c4ce76c-85ba-4307-ad71-430b28a0c2a1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41ce16040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:25.678318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7333acf3-675b-4f16-be1c-0cd50337590e tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Action: 'create', calling method: .version_select at 0x7fc41cbeea60>, body: {"pool": null} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:25.759912 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4c4ce76c-85ba-4307-ad71-430b28a0c2a1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 200 len: 1421 microversion: 2.1 time: 0.105170 May 07 21:48:25.776005 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 465/970] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:25 2022] GET /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 1421 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:25.791605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c320d047-a850-472b-b2d0-afdc6563c23f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41ce161f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:25.863835 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c320d047-a850-472b-b2d0-afdc6563c23f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.086673 May 07 21:48:25.864431 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 466/971] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:25 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:25.869746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:25.870642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:25.880210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:25.880887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:25.884918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:25.885458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:26.093009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:26.104579 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-364d034e-6d4e-49d5-b009-b7e4365a5f5c tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1711 microversion: 2.1 time: 0.238597 May 07 21:48:26.105248 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 467/972] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:25 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1711 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:26.110721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:26.111441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:26.127643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:26.128109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:26.128910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:26.129357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:26.447318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:26.459730 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-307fd835-3cc0-41c5-9957-0008a5fa6d28 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.353039 May 07 21:48:26.470360 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 468/973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:26 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:26.478387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2af1ce1-0b43-4380-af33-4644e2b34de4 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] Action: 'create', calling method: .version_select at 0x7fc41ce16310>, body: {"pool": "non_exist_pool"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:26.526270 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a2af1ce1-0b43-4380-af33-4644e2b34de4 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] HTTP exception thrown: Floating IP pool not found. May 07 21:48:26.526935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2af1ce1-0b43-4380-af33-4644e2b34de4 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] Returning 404 to user: Floating IP pool not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:26.527858 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2af1ce1-0b43-4380-af33-4644e2b34de4 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.055857 May 07 21:48:26.545981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 469/974] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:48:26 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:48:26.555464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21d95d8a-0c0c-4baf-b994-2d5263bda020 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41d2c6d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:27.989526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21d95d8a-0c0c-4baf-b994-2d5263bda020 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 204 len: 0 microversion: 2.1 time: 1.440399 May 07 21:48:27.996159 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 470/975] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:26 2022] DELETE /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 0 bytes in 1443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:28.004477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:28.007549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:28.030847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:28.031555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:28.032578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:28.033454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:28.573609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:28.583308 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-255b1e55-dfa6-48cd-87e7-88aa805c5897 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1492 microversion: 2.1 time: 0.585281 May 07 21:48:28.585002 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 471/976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:27 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1492 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:28.600791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:28.601579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:28.612339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:28.613109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:28.614114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:28.616098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:29.009144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7333acf3-675b-4f16-be1c-0cd50337590e tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.473075 May 07 21:48:29.010849 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 506/977] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:48:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:29.020370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-60ca4d0c-c724-43bc-815f-2f858b337a30 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] Calling method '.version_select at 0x7fc41cd489d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:29.182600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-60ca4d0c-c724-43bc-815f-2f858b337a30 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a9b3822c-9821-4b31-a511-170e41a57997 could not be found", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:48:29.183370 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-60ca4d0c-c724-43bc-815f-2f858b337a30 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] HTTP exception thrown: Floating IP not found for ID a9b3822c-9821-4b31-a511-170e41a57997 May 07 21:48:29.184881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-60ca4d0c-c724-43bc-815f-2f858b337a30 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] Returning 404 to user: Floating IP not found for ID a9b3822c-9821-4b31-a511-170e41a57997 {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:29.186461 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-60ca4d0c-c724-43bc-815f-2f858b337a30 tempest-FloatingIPsNegativeTestJSON-1589524165 tempest-FloatingIPsNegativeTestJSON-1589524165-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/a9b3822c-9821-4b31-a511-170e41a57997" status: 404 len: 111 microversion: 2.1 time: 0.173969 May 07 21:48:29.188607 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 507/978] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:48:29 2022] DELETE /compute/v2.1/os-floating-ips/a9b3822c-9821-4b31-a511-170e41a57997 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:29.213857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2390196-da29-4409-ad3e-15c4528e7c45 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cbba9d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:29.301501 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2390196-da29-4409-ad3e-15c4528e7c45 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.110423 May 07 21:48:29.303460 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 508/979] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:29 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:29.310364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:29.312548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:29.334563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:29.335654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:29.337295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:29.338134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:29.435992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85eeaeaf9f1c464f8d45eff93bab41cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a25055f3544e5c95bacd3a07611e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:29.453518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-00035335-a01d-4e2a-8038-74d00848aabb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 200 len: 1644 microversion: 2.1 time: 0.148728 May 07 21:48:29.454133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 509/980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:29 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 1644 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:29.503778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-20e22c63-d051-4e1c-9655-a86ed9910f7c req-ded5fe59-aafb-49b0-a9e3-f55531c68460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ec46f9-84e6-413a-be19-c46548cb31fd", "name": "network-vif-plugged", "status": "completed", "tag": "04c678a5-64ac-461c-a365-ad4f4e5dd86c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:29.527957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-20e22c63-d051-4e1c-9655-a86ed9910f7c req-ded5fe59-aafb-49b0-a9e3-f55531c68460 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:29.530694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-20e22c63-d051-4e1c-9655-a86ed9910f7c req-ded5fe59-aafb-49b0-a9e3-f55531c68460 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:29.583809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-20e22c63-d051-4e1c-9655-a86ed9910f7c req-ded5fe59-aafb-49b0-a9e3-f55531c68460 service nova] Creating event network-vif-plugged:04c678a5-64ac-461c-a365-ad4f4e5dd86c for instance d0ec46f9-84e6-413a-be19-c46548cb31fd on nch1-master-1 May 07 21:48:29.594998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-20e22c63-d051-4e1c-9655-a86ed9910f7c req-ded5fe59-aafb-49b0-a9e3-f55531c68460 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106547 May 07 21:48:29.598828 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 510/981] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:29.614642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:29.619279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:29.643667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:29.644391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:29.645524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:29.646246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:29.903127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:29.916894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:29.918437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:29.919674 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc179a7a-5d58-4f5d-9d08-8f543ac87213 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1636 microversion: 2.25 time: 1.333567 May 07 21:48:29.920808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 472/982] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:28 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1636 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:29.942846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:29.944766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:29.957636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:29.960860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:29.961921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:29.963116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:30.057276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:48:30.268030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-58f224b3-e591-4abc-b537-d05e147fa4fc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 204 len: 0 microversion: 2.1 time: 0.344062 May 07 21:48:30.283601 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 473/983] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:48:29 2022] DELETE /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:30.283601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9e54f18e-0b15-487e-b685-b4be375517b1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:30.288074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9e54f18e-0b15-487e-b685-b4be375517b1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:30.306104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e54f18e-0b15-487e-b685-b4be375517b1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:30.306562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e54f18e-0b15-487e-b685-b4be375517b1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:30.308352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e54f18e-0b15-487e-b685-b4be375517b1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:30.308352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e54f18e-0b15-487e-b685-b4be375517b1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:30.429225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:30.437517 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2633bffd-5856-45cb-96ca-2403a30a463f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1475 microversion: 2.1 time: 0.836840 May 07 21:48:30.441890 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 511/984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:29 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1475 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:30.464092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96c9569b-a420-4439-a6d0-c8c02bd65903 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Action: 'create', calling method: .version_select at 0x7fc41cc57790>, body: {"pool": null} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:30.630214 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9e54f18e-0b15-487e-b685-b4be375517b1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1643 microversion: 2.1 time: 0.355156 May 07 21:48:30.630828 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 474/985] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:30 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1643 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:30.651552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90f5d91b-87a4-4d49-a08d-eac8f03d7538 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '.version_select at 0x7fc41cda9040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:30.656227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90f5d91b-87a4-4d49-a08d-eac8f03d7538 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:30.662181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90f5d91b-87a4-4d49-a08d-eac8f03d7538 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:30.697174 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90f5d91b-87a4-4d49-a08d-eac8f03d7538 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.048908 May 07 21:48:30.698871 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 475/986] 10.222.0.32 () {60 vars in 1183 bytes} [Sat May 7 21:48:30 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:30.704068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5baaf5e4-28e2-4c01-8a97-cdf912071732 req-80e1821a-e6ba-43be-b030-ef4dead79526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0", "name": "network-vif-deleted", "tag": "41742b2f-f351-48d6-994b-cf147d81966f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:30.716059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5baaf5e4-28e2-4c01-8a97-cdf912071732 req-80e1821a-e6ba-43be-b030-ef4dead79526 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:30.717972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5baaf5e4-28e2-4c01-8a97-cdf912071732 req-80e1821a-e6ba-43be-b030-ef4dead79526 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:30.739165 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5baaf5e4-28e2-4c01-8a97-cdf912071732 req-80e1821a-e6ba-43be-b030-ef4dead79526 service nova] Creating event network-vif-deleted:41742b2f-f351-48d6-994b-cf147d81966f for instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 on nch1-master-1 May 07 21:48:30.761398 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5baaf5e4-28e2-4c01-8a97-cdf912071732 req-80e1821a-e6ba-43be-b030-ef4dead79526 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060997 May 07 21:48:30.764421 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 476/987] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:30.772959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-242efd6d-6f0f-4333-b566-55cdc42726c7 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cda9dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:30.864872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-242efd6d-6f0f-4333-b566-55cdc42726c7 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.097588 May 07 21:48:30.866719 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 477/988] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:30 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:30.884963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-565397642", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "d3775254-6c3d-4b27-a2f1-ae073d9f981d"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:31.023510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] validate_networks() for [('d3775254-6c3d-4b27-a2f1-ae073d9f981d', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:48:31.607350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:48:31.607690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:48:31.608170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:48:31.608588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:48:31.609007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:48:31.626498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:31.627210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:31.634000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:31.634929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:31.659208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:48:31.665706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for user c562e7dec6d34cd0a7fc7cea14fa5e74 and project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:48:31.691629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:48:31.694229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:48:31.750153 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-43159554-437b-4615-98e7-24435509fc05 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877434 May 07 21:48:31.756074 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 478/989] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:48:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:48:31.761157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:31.761982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:31.788371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:31.789159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:31.790655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:31.791873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:31.821988 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] HTTP exception thrown: Instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 could not be found. May 07 21:48:31.822980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Returning 404 to user: Instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:31.824545 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5ac7d804-84c7-413b-8e34-a94ef68ab30b tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 404 len: 111 microversion: 2.1 time: 0.067285 May 07 21:48:31.827648 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 479/990] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:31 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:31.839383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2034f78a-0165-4e3d-a9bf-b62f3d97cc86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:31.843491 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:48:31.843491 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:48:31.847481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2034f78a-0165-4e3d-a9bf-b62f3d97cc86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:31.848200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2034f78a-0165-4e3d-a9bf-b62f3d97cc86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:31.851423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2034f78a-0165-4e3d-a9bf-b62f3d97cc86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:31.852186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2034f78a-0165-4e3d-a9bf-b62f3d97cc86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:31.920355 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2034f78a-0165-4e3d-a9bf-b62f3d97cc86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.090854 May 07 21:48:31.953726 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 480/991] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:48:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:31.958349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:31.959011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:31.998992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:31.999483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:32.000333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:32.000784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:32.702284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid f6f62982-0b82-42d1-9d49-2b8d8f6ec04f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:48:32.754917 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59d5969d-3bf1-4bbc-99b9-79bf2bc9f76d tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 2129 microversion: 2.25 time: 0.800107 May 07 21:48:32.756075 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 481/992] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:31 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 2129 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:32.764165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:32.765793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:32.774667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:32.775552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:32.776613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:32.777584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:33.375355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:33.383166 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48660cf6-2ea6-4bd9-b68a-f817e10da0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1474 microversion: 2.1 time: 0.625370 May 07 21:48:33.395980 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 482/993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:32 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1474 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:33.395980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7854ac33-28e8-4dad-8dca-b79a0fd49a79 req-24944063-527c-478c-aace-4303ac197358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a792c3-0086-43d1-8995-7d56146f84b2", "name": "network-vif-unplugged", "status": "completed", "tag": "85df8e70-88cc-4aed-a304-7a9a475aa9c1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:33.412937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7854ac33-28e8-4dad-8dca-b79a0fd49a79 req-24944063-527c-478c-aace-4303ac197358 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:33.413395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7854ac33-28e8-4dad-8dca-b79a0fd49a79 req-24944063-527c-478c-aace-4303ac197358 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:33.440910 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7854ac33-28e8-4dad-8dca-b79a0fd49a79 req-24944063-527c-478c-aace-4303ac197358 service nova] Creating event network-vif-unplugged:85df8e70-88cc-4aed-a304-7a9a475aa9c1 for instance 12a792c3-0086-43d1-8995-7d56146f84b2 on nch1-master-1 May 07 21:48:33.457971 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7854ac33-28e8-4dad-8dca-b79a0fd49a79 req-24944063-527c-478c-aace-4303ac197358 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065886 May 07 21:48:33.459042 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 483/994] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:33.469051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:33.474453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:33.485501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:33.490942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:33.494084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:33.494738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:33.708421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:33.719604 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7daabe8-ef9d-4e28-ae28-e3dee8a585cc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1259 microversion: 2.1 time: 0.256586 May 07 21:48:33.720344 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 484/995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:33 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:33.734353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:33.735155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:33.742947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:33.745412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:33.746446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:33.750049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:33.772614 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] HTTP exception thrown: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. May 07 21:48:33.774624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Returning 404 to user: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:33.775864 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76aafa60-e4d7-438c-8817-fa192a3355f4 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 404 len: 111 microversion: 2.1 time: 0.045344 May 07 21:48:33.776964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 485/996] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:48:33 2022] DELETE /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:33.791745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-23e451a0-eea6-4e79-b4a2-a2cc91c81970 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cdb6f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:33.895627 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-23e451a0-eea6-4e79-b4a2-a2cc91c81970 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.117447 May 07 21:48:33.901717 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 486/997] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:33 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:33.907900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:33.908757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:33.916243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:33.917085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:33.918018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:33.919158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:34.475227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid f6f62982-0b82-42d1-9d49-2b8d8f6ec04f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:48:34.511149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef61c7a1-a5dd-44a3-87bb-7b7e4e5b15ae tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 2129 microversion: 2.25 time: 0.608055 May 07 21:48:34.514973 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 487/998] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:48:33 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 2129 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:48:34.521225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:34.522625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:34.538672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:34.539414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:34.542152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:34.543309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:34.566481 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] HTTP exception thrown: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. May 07 21:48:34.567403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Returning 404 to user: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:34.568483 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ed667f6-925e-4080-8e06-75900cc23d97 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 404 len: 111 microversion: 2.1 time: 0.052245 May 07 21:48:34.569618 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 488/999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:34 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:34.579511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8bb93c74-0be0-42f6-9967-fef7c46a147b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6dda630-1042-46d5-94d9-9909cca2be3c", "device": "/dev/xvdb"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:34.581450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8bb93c74-0be0-42f6-9967-fef7c46a147b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:34.588572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8bb93c74-0be0-42f6-9967-fef7c46a147b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:34.589808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8bb93c74-0be0-42f6-9967-fef7c46a147b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:34.590804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8bb93c74-0be0-42f6-9967-fef7c46a147b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:34.591408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8bb93c74-0be0-42f6-9967-fef7c46a147b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:35.271579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96c9569b-a420-4439-a6d0-c8c02bd65903 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.827553 May 07 21:48:35.272743 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 512/1000] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:48:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:35.282132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7f824d5d-a1d5-4131-adf5-038a161b3d9c req-b248af5b-2528-416c-8c79-382e0f246a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a792c3-0086-43d1-8995-7d56146f84b2", "name": "network-vif-deleted", "tag": "85df8e70-88cc-4aed-a304-7a9a475aa9c1"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:35.300980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7f824d5d-a1d5-4131-adf5-038a161b3d9c req-b248af5b-2528-416c-8c79-382e0f246a60 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:35.302162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7f824d5d-a1d5-4131-adf5-038a161b3d9c req-b248af5b-2528-416c-8c79-382e0f246a60 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:35.319712 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8bb93c74-0be0-42f6-9967-fef7c46a147b tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "POST /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747845 May 07 21:48:35.321358 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 489/1001] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 21:48:34 2022] POST /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:35.331349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:35.336108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:35.337308 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7f824d5d-a1d5-4131-adf5-038a161b3d9c req-b248af5b-2528-416c-8c79-382e0f246a60 service nova] Creating event network-vif-deleted:85df8e70-88cc-4aed-a304-7a9a475aa9c1 for instance 12a792c3-0086-43d1-8995-7d56146f84b2 on nch1-master-1 May 07 21:48:35.352246 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7f824d5d-a1d5-4131-adf5-038a161b3d9c req-b248af5b-2528-416c-8c79-382e0f246a60 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077332 May 07 21:48:35.367490 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 513/1002] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:35.369009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:35.372249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:35.380332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:35.383805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:35.392015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-660fdeaa-bf1c-4f17-933b-47e77f9854eb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '.version_select at 0x7fc41cc40e50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:35.474343 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-660fdeaa-bf1c-4f17-933b-47e77f9854eb tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545647605" status: 202 len: 0 microversion: 2.1 time: 0.103916 May 07 21:48:35.482639 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 514/1003] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545647605 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:35.491164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:35.491972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:35.499608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:35.500067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:35.500863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:35.501317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:35.851115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lazy-loading 'services' on Instance uuid f6f62982-0b82-42d1-9d49-2b8d8f6ec04f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:48:36.088662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ddb8552e-00ad-4f57-b39b-b8636e639810 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments/d3458b74-afb7-4186-a1a5-393c8c9767c1" status: 202 len: 0 microversion: 2.25 time: 0.601236 May 07 21:48:36.090906 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 515/1004] 10.222.0.32 () {60 vars in 1456 bytes} [Sat May 7 21:48:35 2022] DELETE /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments/d3458b74-afb7-4186-a1a5-393c8c9767c1 => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:36.099015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:36.101288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:36.109585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:36.111404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:36.112490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:36.113198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:36.116516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:36.127271 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc743ec2-9beb-4829-9bee-1bcbb1804309 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1474 microversion: 2.1 time: 0.803306 May 07 21:48:36.131126 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 490/1005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:35 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1474 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:36.159110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9540618-df8b-450a-85ec-e5b51cede79d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cd3f550>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:36.249421 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9540618-df8b-450a-85ec-e5b51cede79d tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1420 microversion: 2.1 time: 0.116981 May 07 21:48:36.250022 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 491/1006] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:36 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:36.260105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-50f2b3fd-62a4-4248-b8f4-293db8ba1d34 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Action: 'create', calling method: .version_select at 0x7fc41cd3f700>, body: {"pool": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:36.488069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:36.498462 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cae2113e-a364-477f-a9f1-354ccdb24777 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1307 microversion: 2.1 time: 0.403907 May 07 21:48:36.499130 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 516/1007] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:36 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:36.509889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-594c1a4f-788e-4f54-88e8-3fe40affe0d7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:36.511719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-594c1a4f-788e-4f54-88e8-3fe40affe0d7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:36.532392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-594c1a4f-788e-4f54-88e8-3fe40affe0d7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:36.534997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-594c1a4f-788e-4f54-88e8-3fe40affe0d7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:36.536149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-594c1a4f-788e-4f54-88e8-3fe40affe0d7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:36.536927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-594c1a4f-788e-4f54-88e8-3fe40affe0d7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:36.585529 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-594c1a4f-788e-4f54-88e8-3fe40affe0d7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083600 May 07 21:48:36.586695 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 517/1008] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:48:36 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:48:37.148396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:37.149149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:37.164157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:37.164927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:37.167261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:37.173051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:37.453470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:37.461186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05f884eb-fa8e-488a-81be-d481ccd2586c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1472 microversion: 2.1 time: 0.317714 May 07 21:48:37.472186 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 518/1009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:37 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:48:37.477267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-36e1690e-8f82-43f5-9ca6-ffe04b2a1736 req-f3ce1a00-24f7-45c6-9f62-54628520e9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc3f76-02bb-44cb-82ab-79a357f42391", "name": "network-vif-unplugged", "status": "completed", "tag": "44436595-8caf-48e5-967e-1749f507e89e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:37.486464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-36e1690e-8f82-43f5-9ca6-ffe04b2a1736 req-f3ce1a00-24f7-45c6-9f62-54628520e9bf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:37.487182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-36e1690e-8f82-43f5-9ca6-ffe04b2a1736 req-f3ce1a00-24f7-45c6-9f62-54628520e9bf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:37.500008 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-36e1690e-8f82-43f5-9ca6-ffe04b2a1736 req-f3ce1a00-24f7-45c6-9f62-54628520e9bf service nova] Creating event network-vif-unplugged:44436595-8caf-48e5-967e-1749f507e89e for instance 02cc3f76-02bb-44cb-82ab-79a357f42391 on nch2-master-1 May 07 21:48:37.508376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-36e1690e-8f82-43f5-9ca6-ffe04b2a1736 req-f3ce1a00-24f7-45c6-9f62-54628520e9bf service nova] Instance 02cc3f76-02bb-44cb-82ab-79a357f42391 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:48:37.516449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-36e1690e-8f82-43f5-9ca6-ffe04b2a1736 req-f3ce1a00-24f7-45c6-9f62-54628520e9bf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042587 May 07 21:48:37.517515 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 519/1010] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:37.525025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6fc857d6-6719-462e-a730-11221a0a6e7c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cd33820>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:37.587512 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6fc857d6-6719-462e-a730-11221a0a6e7c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1429 microversion: 2.1 time: 0.066606 May 07 21:48:37.589055 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 520/1011] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:37 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1429 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:37.603980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:37.605095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:37.623345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:37.625123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:37.626168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:37.628906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:37.996425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:38.008556 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8726d3a9-480c-4c75-80d0-5e4ba37701dd tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1307 microversion: 2.1 time: 0.416768 May 07 21:48:38.009843 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 521/1012] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:37 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:38.019832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8441daf6-d71c-411f-8a85-8cfa8d549dd1 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cc40670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.081062 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8441daf6-d71c-411f-8a85-8cfa8d549dd1 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 200 len: 1429 microversion: 2.1 time: 0.069039 May 07 21:48:38.082242 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 522/1013] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:38 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:38.087701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ca52608b-1a90-4610-aff6-e4e44a604b80 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.089140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca52608b-1a90-4610-aff6-e4e44a604b80 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:38.097062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca52608b-1a90-4610-aff6-e4e44a604b80 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.097534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca52608b-1a90-4610-aff6-e4e44a604b80 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.098635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca52608b-1a90-4610-aff6-e4e44a604b80 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.099643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca52608b-1a90-4610-aff6-e4e44a604b80 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.153765 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ca52608b-1a90-4610-aff6-e4e44a604b80 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070037 May 07 21:48:38.155531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 523/1014] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:48:38 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:48:38.160205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.160844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:38.167774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.168238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.169185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.170186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.427155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:38.438393 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53d533ab-1a45-4830-ab14-467cb9759a00 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1466 microversion: 2.1 time: 0.278962 May 07 21:48:38.439337 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 524/1015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:38 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1466 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:38.451897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19e9ab30-a9a8-4ba6-a5e3-4e35902af102 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.453028 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:48:38.453028 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:48:38.481388 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-19e9ab30-a9a8-4ba6-a5e3-4e35902af102 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/798756080" status: 202 len: 0 microversion: 2.1 time: 0.039227 May 07 21:48:38.485159 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 525/1016] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:48:38 2022] DELETE /compute/v2.1/flavors/798756080 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:38.491059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-44520178-4fe0-4492-b6ed-b3eb6137a2d4 req-afccb663-762b-4b5a-a1ab-c966b3373927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c766eaa8-8e8e-4135-9b5d-dfdaad014172", "tag": "1543b45e-f40e-472d-975d-d79ddefecdd6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:38.504113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-44520178-4fe0-4492-b6ed-b3eb6137a2d4 req-afccb663-762b-4b5a-a1ab-c966b3373927 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.504743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-44520178-4fe0-4492-b6ed-b3eb6137a2d4 req-afccb663-762b-4b5a-a1ab-c966b3373927 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.520309 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-44520178-4fe0-4492-b6ed-b3eb6137a2d4 req-afccb663-762b-4b5a-a1ab-c966b3373927 service nova] Creating event network-changed:1543b45e-f40e-472d-975d-d79ddefecdd6 for instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 on nch1-master-1 May 07 21:48:38.525479 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-44520178-4fe0-4492-b6ed-b3eb6137a2d4 req-afccb663-762b-4b5a-a1ab-c966b3373927 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038618 May 07 21:48:38.526299 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 526/1017] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:38.532292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b2c89d1f-01df-4bea-bbaf-bbc6593b91a2 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cbb9a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.582186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b2c89d1f-01df-4bea-bbaf-bbc6593b91a2 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c" status: 200 len: 784 microversion: 2.1 time: 0.053954 May 07 21:48:38.583358 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 527/1018] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:38 2022] GET /compute/v2.1/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c => generated 784 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:38.588114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.589118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:38.596137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.596600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.597453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.597825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.850364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:38.860234 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d027431c-aead-490d-90a9-bca17389e0e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1469 microversion: 2.1 time: 0.275417 May 07 21:48:38.871558 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 528/1019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:38 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:38.877583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a7f0ed1-5d99-4a55-8fd0-2f26ec8e4859 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.904425 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a7f0ed1-5d99-4a55-8fd0-2f26ec8e4859 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.030647 May 07 21:48:38.915206 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 529/1020] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:48:38 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:38.922042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-518bc4d8-9f1a-464d-b0eb-2d8e0f78426a tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:38.932316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-518bc4d8-9f1a-464d-b0eb-2d8e0f78426a tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015926 May 07 21:48:38.932974 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 530/1021] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:48:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:38.940419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fb649766-9261-4a1a-8201-4c1d77e8eb8b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:38.941110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fb649766-9261-4a1a-8201-4c1d77e8eb8b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:38.947589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb649766-9261-4a1a-8201-4c1d77e8eb8b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.948147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb649766-9261-4a1a-8201-4c1d77e8eb8b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:38.949115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb649766-9261-4a1a-8201-4c1d77e8eb8b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:38.949608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb649766-9261-4a1a-8201-4c1d77e8eb8b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:39.024173 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fb649766-9261-4a1a-8201-4c1d77e8eb8b tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391/action" status: 204 len: 0 microversion: 2.1 time: 0.089716 May 07 21:48:39.028824 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 531/1022] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:48:38 2022] POST /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:39.032024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3aa86f3c-666f-4b6c-982a-759141bc15ce tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:39.033625 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:48:39.033625 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:48:39.054043 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3aa86f3c-666f-4b6c-982a-759141bc15ce tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/150453885" status: 202 len: 0 microversion: 2.1 time: 0.027385 May 07 21:48:39.054961 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 532/1023] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:48:39 2022] DELETE /compute/v2.1/flavors/150453885 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:39.059706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-408d9dd0-7e18-4620-8a24-0fed71cc807c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cbee1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:39.702237 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-408d9dd0-7e18-4620-8a24-0fed71cc807c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "DELETE /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 204 len: 0 microversion: 2.1 time: 0.646024 May 07 21:48:39.706023 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 533/1024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:39 2022] DELETE /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:48:39.708361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:39.709100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:39.717457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:39.717914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:39.718696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:39.719214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:39.909017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:39.917125 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7ca6b995-7a02-4018-8f7f-b56b49a0d4ab tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1307 microversion: 2.1 time: 0.212857 May 07 21:48:39.917726 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 534/1025] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:39 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:39.924354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:39.925016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:39.931626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:39.932221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:39.933861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:39.934652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:39.963479 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-50f2b3fd-62a4-4248-b8f4-293db8ba1d34 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.712396 May 07 21:48:39.965671 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 492/1026] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:48:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:39.976762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a3952cb-1424-4252-af7e-653a00e01e24 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:40.002159 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a3952cb-1424-4252-af7e-653a00e01e24 tempest-ServersWithSpecificFlavorTestJSON-1751734 tempest-ServersWithSpecificFlavorTestJSON-1751734-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034836 May 07 21:48:40.003090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 493/1027] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:48:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:40.015730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac1b09ba-3ce6-40c9-bccf-943b7f99a5a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:40.017072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ac1b09ba-3ce6-40c9-bccf-943b7f99a5a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:40.027357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1b09ba-3ce6-40c9-bccf-943b7f99a5a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.027822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1b09ba-3ce6-40c9-bccf-943b7f99a5a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.028802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1b09ba-3ce6-40c9-bccf-943b7f99a5a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.029835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1b09ba-3ce6-40c9-bccf-943b7f99a5a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.073345 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ac1b09ba-3ce6-40c9-bccf-943b7f99a5a2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.068681 May 07 21:48:40.074326 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 494/1028] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:48:40 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:40.081086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-157eb330-d356-4cf2-bf51-8d8a3cdd05bb tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cda9160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:40.085996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:40.097041 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f0ec147f-97ae-45a6-99ae-ae1129c70e14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1469 microversion: 2.1 time: 0.176227 May 07 21:48:40.098161 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 535/1029] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:39 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:40.103029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f66d6fd-d50b-404b-b583-c13d8b30cb67 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:40.103856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0f66d6fd-d50b-404b-b583-c13d8b30cb67 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:40.109351 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-157eb330-d356-4cf2-bf51-8d8a3cdd05bb tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] HTTP exception thrown: Image not found. May 07 21:48:40.110089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-157eb330-d356-4cf2-bf51-8d8a3cdd05bb tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:40.111234 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-157eb330-d356-4cf2-bf51-8d8a3cdd05bb tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 404 len: 62 microversion: 2.1 time: 0.035611 May 07 21:48:40.113338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f66d6fd-d50b-404b-b583-c13d8b30cb67 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.113956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f66d6fd-d50b-404b-b583-c13d8b30cb67 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.118137 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 495/1030] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:40 2022] GET /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:48:40.119459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f66d6fd-d50b-404b-b583-c13d8b30cb67 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.121113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f66d6fd-d50b-404b-b583-c13d8b30cb67 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.124236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e31249c5-053c-43a0-842f-30f45f5b9f52 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Action: 'create', calling method: .version_select at 0x7fc41cd2b550>, body: {"pool": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:40.353512 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f66d6fd-d50b-404b-b583-c13d8b30cb67 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1689 microversion: 2.1 time: 0.254019 May 07 21:48:40.354120 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 536/1031] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:40 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1689 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:40.368889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:40.369478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:40.382701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.383178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.389602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.390220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.429904 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] HTTP exception thrown: Instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 could not be found. May 07 21:48:40.436781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Returning 404 to user: Instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:40.437950 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d61a95b-7003-4a25-9329-52c35c02c9d7 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 404 len: 111 microversion: 2.1 time: 0.082913 May 07 21:48:40.438749 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 537/1032] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:48:40 2022] DELETE /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:40.448533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b941c4de-e2b4-468c-9554-97d6059626c0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-874943877"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:40.450315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b941c4de-e2b4-468c-9554-97d6059626c0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:40.458905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b941c4de-e2b4-468c-9554-97d6059626c0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.459581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b941c4de-e2b4-468c-9554-97d6059626c0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.460923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b941c4de-e2b4-468c-9554-97d6059626c0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.461588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b941c4de-e2b4-468c-9554-97d6059626c0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.859135 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b941c4de-e2b4-468c-9554-97d6059626c0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "POST /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd/action" status: 202 len: 0 microversion: 2.1 time: 0.418278 May 07 21:48:40.860454 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 538/1033] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:48:40 2022] POST /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 21:48:40.865743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:40.867210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:40.875974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.876799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.878147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:40.880051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:40.914589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lazy-loading 'flavor' on Instance uuid 028d626c-306b-45cc-81b8-b73eca1c01c3 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:48:40.928416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Going to try to live migrate instance to nch1-master-1 {{(pid=136681) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:48:42.416236 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f9147f0-951f-4461-8597-f57b4ffc4f6e tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/action" status: 202 len: 0 microversion: 2.1 time: 1.554436 May 07 21:48:42.418226 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 539/1034] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:48:40 2022] POST /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/action => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:42.425860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-416de2ee-0882-4c9d-aa5e-0e9384ee679a req-31df501e-1d75-4da6-a5a1-fb1154c2e595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ec46f9-84e6-413a-be19-c46548cb31fd", "name": "network-vif-unplugged", "status": "completed", "tag": "04c678a5-64ac-461c-a365-ad4f4e5dd86c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:42.441637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-416de2ee-0882-4c9d-aa5e-0e9384ee679a req-31df501e-1d75-4da6-a5a1-fb1154c2e595 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:42.442379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-416de2ee-0882-4c9d-aa5e-0e9384ee679a req-31df501e-1d75-4da6-a5a1-fb1154c2e595 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:42.456563 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-416de2ee-0882-4c9d-aa5e-0e9384ee679a req-31df501e-1d75-4da6-a5a1-fb1154c2e595 service nova] Creating event network-vif-unplugged:04c678a5-64ac-461c-a365-ad4f4e5dd86c for instance d0ec46f9-84e6-413a-be19-c46548cb31fd on nch1-master-1 May 07 21:48:42.461457 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-416de2ee-0882-4c9d-aa5e-0e9384ee679a req-31df501e-1d75-4da6-a5a1-fb1154c2e595 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041804 May 07 21:48:42.462306 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 540/1035] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:42.467732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:42.468687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:42.476427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:42.477290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:42.478397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:42.479301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:42.495543 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] HTTP exception thrown: Instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 could not be found. May 07 21:48:42.496429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Returning 404 to user: Instance 9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:42.498077 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-da11d392-8dc3-4f2b-bde4-ee29558ce569 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0" status: 404 len: 111 microversion: 2.1 time: 0.033842 May 07 21:48:42.499130 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 541/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:42 2022] GET /compute/v2.1/servers/9628e17c-d8c7-4dd3-a4fd-8b3ec90ab5b0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:42.572520 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e31249c5-053c-43a0-842f-30f45f5b9f52 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.454482 May 07 21:48:42.573677 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 496/1037] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:48:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:42.583099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48b4004f-d3e7-49c0-928e-c0d8c8393d92 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cd9d700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:42.655518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48b4004f-d3e7-49c0-928e-c0d8c8393d92 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1424 microversion: 2.1 time: 0.080630 May 07 21:48:42.656104 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 497/1038] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:42 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:42.668319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:42.669097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:42.671428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1375329084", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:42.680402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:42.680861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:42.681654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:42.682627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:42.730689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:48:42.941760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:42.965416 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c3d0dd8-8665-4fa4-ac0a-e46b5de6df26 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1307 microversion: 2.1 time: 0.301275 May 07 21:48:42.967869 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 498/1039] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:42 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:42.973424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:42.973980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:42.981159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:42.982073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:42.983538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:42.983896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.026415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:48:43.026993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:48:43.027582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:48:43.028110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:48:43.032746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:48:43.055916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.056453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.057695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.058475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.079184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Getting quotas for project b32f89ced1064b42a865fa6c8f48a92b. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:48:43.083377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Getting quotas for user e1d56d3935a4454e867bfe3bbf95da2f and project b32f89ced1064b42a865fa6c8f48a92b. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:48:43.098822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:48:43.102252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:48:43.168687 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a414338-2a80-45c7-a9d5-4d77ab89533e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668164 May 07 21:48:43.169960 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 542/1040] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:48:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:48:43.179321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.181191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:43.192534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.193383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.194257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.202663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.261869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:43.281257 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a5016c88-7d5a-4b2a-80a1-a5223c3625b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1461 microversion: 2.1 time: 0.306363 May 07 21:48:43.282212 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 499/1041] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:42 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1461 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:43.308019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.309675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:43.331908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.332557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.333491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.334017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.352522 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] HTTP exception thrown: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. May 07 21:48:43.357513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Returning 404 to user: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:43.360598 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cbf491f5-eb93-4473-96fd-6d3b1509c385 tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 404 len: 111 microversion: 2.1 time: 0.068341 May 07 21:48:43.361480 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 500/1042] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:48:43 2022] DELETE /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:43.380028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-408b60c8-e57b-4aee-b357-14344f7e0d2e tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Calling method '.version_select at 0x7fc41cd91820>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.445828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:43.459054 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f50a0735-f73d-46f0-8511-d867487dffaa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1548 microversion: 2.1 time: 0.287144 May 07 21:48:43.473544 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 543/1043] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1548 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:43.473544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31d6abc6-6f91-48ab-80fc-4683d3c37a5e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.473544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-31d6abc6-6f91-48ab-80fc-4683d3c37a5e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:43.564737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31d6abc6-6f91-48ab-80fc-4683d3c37a5e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:43.575468 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31d6abc6-6f91-48ab-80fc-4683d3c37a5e tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1216 microversion: 2.1 time: 0.109735 May 07 21:48:43.581014 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 544/1044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:43.587563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.588472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:43.597707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.598435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.599492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.600161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.636519 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-408b60c8-e57b-4aee-b357-14344f7e0d2e tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/08ba378b-d677-4804-bd15-d180c9bc19c1" status: 200 len: 141 microversion: 2.1 time: 0.272065 May 07 21:48:43.638093 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 501/1045] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/os-floating-ips/08ba378b-d677-4804-bd15-d180c9bc19c1 => generated 141 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:43.645359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.645979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] [instance: ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:43.658579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.659743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.660798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.662211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.679820 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] HTTP exception thrown: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. May 07 21:48:43.680861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] Returning 404 to user: Instance ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:48:43.682079 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-611feb3e-b1db-4bba-8ce1-0b63b537aeab tempest-ServersWithSpecificFlavorTestJSON-440340344 tempest-ServersWithSpecificFlavorTestJSON-440340344-project] 10.222.0.32 "GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51" status: 404 len: 111 microversion: 2.1 time: 0.041431 May 07 21:48:43.682948 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 502/1046] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/servers/ec0e0ca3-c2ed-4b3c-8716-5aa441b40a51 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:48:43.691564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2e9382d-d154-4a3b-9d44-e0a8efdd6233 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Calling method '.version_select at 0x7fc41cd55040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.786691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:43.803861 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-70ff9f5e-346a-4d8b-94c6-8232e4d2ed31 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1461 microversion: 2.1 time: 0.220376 May 07 21:48:43.805343 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 545/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1461 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:43.818197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea6e8ad6-4cb1-4322-887e-3ea63b9fd2ae tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41caeae50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.886109 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea6e8ad6-4cb1-4322-887e-3ea63b9fd2ae tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1424 microversion: 2.1 time: 0.078511 May 07 21:48:43.890937 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 546/1048] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:43.896597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f2f2d90-6614-4caa-83c0-c8b4760616c1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '.version_select at 0x7fc41caeac10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.900026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f2f2d90-6614-4caa-83c0-c8b4760616c1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:43.900380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f2f2d90-6614-4caa-83c0-c8b4760616c1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:43.912911 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f2f2d90-6614-4caa-83c0-c8b4760616c1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 3106 microversion: 2.1 time: 0.020156 May 07 21:48:43.913836 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 547/1049] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/os-migrations => generated 3106 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:43.937078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dde51649-63d8-4d1b-b70c-19c37128ca9a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:43.966832 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dde51649-63d8-4d1b-b70c-19c37128ca9a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039873 May 07 21:48:43.968913 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 548/1050] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:48:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:43.989620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f1ea0468-274a-470d-935b-4e6108f35a2d tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1867141305", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:43.992084 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:48:43.992084 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:48:44.020222 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f1ea0468-274a-470d-935b-4e6108f35a2d tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.044793 May 07 21:48:44.021498 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 549/1051] 10.222.0.32 () {60 vars in 1145 bytes} [Sat May 7 21:48:43 2022] POST /compute/v2.1/flavors => generated 499 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:44.030893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:44.031975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:44.041300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:44.042117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:44.043361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:44.044118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:44.236657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:44.245972 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d427f912-c290-42c8-ba90-2a5a23d5cb34 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1307 microversion: 2.1 time: 0.222203 May 07 21:48:44.246925 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 550/1052] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:44 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:44.260368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-860dfd13-2981-418d-b2d5-3ea991807d1e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:44.269322 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-860dfd13-2981-418d-b2d5-3ea991807d1e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020905 May 07 21:48:44.270209 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 551/1053] 10.222.0.32 () {58 vars in 1181 bytes} [Sat May 7 21:48:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:48:44.447418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-53155395", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "839a70a4-0580-4374-bc76-4a6a2187b117"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:44.520339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:48:44.989678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:48:44.990368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:48:44.991071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:48:44.991646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:48:44.992223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:48:45.008584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:45.009048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:45.009965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:45.010420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:45.058154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:48:45.067728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for user 3eb85bfb49aa4a519099c6f43ac77099 and project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:48:45.093558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:48:45.096043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:48:45.188086 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f9e93729-34b5-4f9b-9fae-9048ffc803e4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745169 May 07 21:48:45.189138 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 552/1054] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:48:45.207558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:45.208470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:45.220761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:45.221247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:45.222058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:45.222596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:45.534954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:45.546179 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a019a953-fcac-4e96-996e-d50b78aa27f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1548 microversion: 2.1 time: 0.351748 May 07 21:48:45.555834 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 553/1055] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:45 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1548 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:45.561803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:45.562796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:45.575537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:45.577735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:45.578748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:45.582568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:45.783580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:45.800086 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-25a7d3a7-4d3d-4c95-a0be-780b17c05510 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1274 microversion: 2.1 time: 0.241300 May 07 21:48:45.802558 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 554/1056] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:45 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:45.827425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d08fbfc0-51bc-4a00-989d-429916659e4b req-29788f4e-22ec-4a58-95ed-307e63811e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc3f76-02bb-44cb-82ab-79a357f42391", "name": "network-vif-plugged", "status": "completed", "tag": "44436595-8caf-48e5-967e-1749f507e89e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:45.852947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d08fbfc0-51bc-4a00-989d-429916659e4b req-29788f4e-22ec-4a58-95ed-307e63811e19 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:45.854529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d08fbfc0-51bc-4a00-989d-429916659e4b req-29788f4e-22ec-4a58-95ed-307e63811e19 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:45.890518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d08fbfc0-51bc-4a00-989d-429916659e4b req-29788f4e-22ec-4a58-95ed-307e63811e19 service nova] Creating event network-vif-plugged:44436595-8caf-48e5-967e-1749f507e89e for instance 02cc3f76-02bb-44cb-82ab-79a357f42391 on nch2-master-1 May 07 21:48:45.903005 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d08fbfc0-51bc-4a00-989d-429916659e4b req-29788f4e-22ec-4a58-95ed-307e63811e19 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097297 May 07 21:48:45.905425 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 555/1057] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:45.926656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b243dc2d-3062-4c23-b2a0-b430312fb504 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cd48ca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:46.357738 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2e9382d-d154-4a3b-9d44-e0a8efdd6233 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/08ba378b-d677-4804-bd15-d180c9bc19c1" status: 202 len: 0 microversion: 2.1 time: 2.673499 May 07 21:48:46.358322 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 503/1058] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:48:43 2022] DELETE /compute/v2.1/os-floating-ips/08ba378b-d677-4804-bd15-d180c9bc19c1 => generated 0 bytes in 2675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:46.363560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:46.364454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:46.382037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:46.382877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:46.383880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:46.385485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:46.580808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:46.588529 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d766887-b76c-483e-90fe-038d908a8083 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1273 microversion: 2.1 time: 0.228897 May 07 21:48:46.589117 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 504/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:46 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1273 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:46.598586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:46.598586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:46.612316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:46.612782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:46.613592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:46.614046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:47.220688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:47.228659 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-404f5598-371f-441f-94b9-84940369e917 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1307 microversion: 2.1 time: 0.637308 May 07 21:48:47.237705 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 505/1060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:46 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1307 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:47.237705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb545237-608f-4e4a-a3cb-c83939c499cc tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Calling method '.version_select at 0x7fc41cd081f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:47.789009 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb545237-608f-4e4a-a3cb-c83939c499cc tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.558729 May 07 21:48:47.790434 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 506/1061] 10.222.0.32 () {58 vars in 1163 bytes} [Sat May 7 21:48:47 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:48:47.800720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:47.802966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:47.817832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:47.818957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:47.820276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:47.822286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:48.410660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:48.439690 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-165ef8cf-f7b4-4a25-9abe-0c02f1e2e644 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1548 microversion: 2.1 time: 0.648122 May 07 21:48:48.444865 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 507/1062] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:47 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1548 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:48.455673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:48.455673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:48.462253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:48.462631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:48.468724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:48.469200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:48.890073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:48.898172 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-533ca37c-468f-47a3-9ec3-f5973fb0e738 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1274 microversion: 2.1 time: 0.451346 May 07 21:48:48.899614 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 508/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:48 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1274 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:48.904781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:48.905707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:48.912908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:48.913702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:48.914729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:48.916881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:49.046679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:49.060679 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6f87dad6-9163-489e-bdce-2fafcdbb705d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1335 microversion: 2.1 time: 0.158385 May 07 21:48:49.061691 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 509/1064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:48 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1335 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:49.066361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-491a2d30-c64c-486c-9e7e-16f4c5be9010 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Calling method '.version_select at 0x7fc41cd2b8b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:49.893839 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-491a2d30-c64c-486c-9e7e-16f4c5be9010 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.830869 May 07 21:48:49.894551 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 510/1065] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 21:48:49 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:49.909872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-25af7bf9-756f-41f8-828c-3d34465dbd5f req-71c43e0b-3255-4abb-ab02-d3cc3048458b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c766eaa8-8e8e-4135-9b5d-dfdaad014172", "name": "network-vif-plugged", "status": "completed", "tag": "1543b45e-f40e-472d-975d-d79ddefecdd6"}, {"server_uuid": "d0ec46f9-84e6-413a-be19-c46548cb31fd", "name": "network-vif-plugged", "status": "completed", "tag": "04c678a5-64ac-461c-a365-ad4f4e5dd86c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:49.930471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-25af7bf9-756f-41f8-828c-3d34465dbd5f req-71c43e0b-3255-4abb-ab02-d3cc3048458b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:49.930958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-25af7bf9-756f-41f8-828c-3d34465dbd5f req-71c43e0b-3255-4abb-ab02-d3cc3048458b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:49.950976 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-25af7bf9-756f-41f8-828c-3d34465dbd5f req-71c43e0b-3255-4abb-ab02-d3cc3048458b service nova] Creating event network-vif-plugged:1543b45e-f40e-472d-975d-d79ddefecdd6 for instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 on nch1-master-1 May 07 21:48:49.951865 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-25af7bf9-756f-41f8-828c-3d34465dbd5f req-71c43e0b-3255-4abb-ab02-d3cc3048458b service nova] Creating event network-vif-plugged:04c678a5-64ac-461c-a365-ad4f4e5dd86c for instance d0ec46f9-84e6-413a-be19-c46548cb31fd on nch1-master-1 May 07 21:48:49.960851 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-25af7bf9-756f-41f8-828c-3d34465dbd5f req-71c43e0b-3255-4abb-ab02-d3cc3048458b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055953 May 07 21:48:49.965875 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 511/1066] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:49.973026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:49.974034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:50.003755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:50.006201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:50.008521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:50.011950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:50.598313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:50.609146 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-320bce6c-765f-415e-b67c-6c5ed2d9e9b6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1307 microversion: 2.1 time: 0.640549 May 07 21:48:50.610027 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 512/1067] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:49 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1307 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:50.617793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-88be081b-0032-49a8-9654-92c787c1910c req-247f449a-deff-4d95-9b8d-066394a5888c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028d626c-306b-45cc-81b8-b73eca1c01c3", "name": "network-vif-unplugged", "status": "completed", "tag": "87c894e0-03dd-4dab-a47b-82dec6ea1485"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:50.626840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-88be081b-0032-49a8-9654-92c787c1910c req-247f449a-deff-4d95-9b8d-066394a5888c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:50.627657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-88be081b-0032-49a8-9654-92c787c1910c req-247f449a-deff-4d95-9b8d-066394a5888c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:50.647951 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-88be081b-0032-49a8-9654-92c787c1910c req-247f449a-deff-4d95-9b8d-066394a5888c service nova] Creating event network-vif-unplugged:87c894e0-03dd-4dab-a47b-82dec6ea1485 for instance 028d626c-306b-45cc-81b8-b73eca1c01c3 on nch2-master-1 May 07 21:48:50.654146 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-88be081b-0032-49a8-9654-92c787c1910c req-247f449a-deff-4d95-9b8d-066394a5888c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042593 May 07 21:48:50.654979 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 513/1068] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:50.661356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:50.662443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:50.677578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:50.678151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:50.679528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:50.680103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:51.069251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:51.087196 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9a8baf1e-518b-4840-9dc9-cc9129fe248e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1548 microversion: 2.1 time: 0.428750 May 07 21:48:51.100220 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 514/1069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:50 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1548 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:51.115577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00d71d3a-a69f-43ca-b7b2-3fdc788afb65 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Calling method '.version_select at 0x7fc41cd2b700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:54.552591 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00d71d3a-a69f-43ca-b7b2-3fdc788afb65 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/9d488c51-32b2-4959-9440-3e1f85b4d2e2" status: 202 len: 0 microversion: 2.1 time: 3.447527 May 07 21:48:54.555603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 515/1070] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:48:51 2022] DELETE /compute/v2.1/os-floating-ips/9d488c51-32b2-4959-9440-3e1f85b4d2e2 => generated 0 bytes in 3455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:54.569353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:54.570598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:54.583339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:54.584370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:54.585415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:54.586080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:55.078141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:55.087025 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-daf06ceb-27b0-426b-922d-673071ef075b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1316 microversion: 2.1 time: 0.529608 May 07 21:48:55.087624 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 516/1071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:54 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:55.115015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:55.115849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:55.134369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:55.134870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:55.135674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:55.143134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:55.589797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:55.609431 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dec7342e-8745-40ec-8d4b-907e61a45f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1377 microversion: 2.1 time: 0.520698 May 07 21:48:55.610032 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 517/1072] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:55 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1377 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:55.635016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:55.639375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:55.656800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:55.657528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:55.671912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:55.674882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:56.158223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:56.206313 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d728a30-a37d-4967-bb9d-2fc7a7fac141 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1487 microversion: 2.1 time: 0.585474 May 07 21:48:56.220227 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 518/1073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:55 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1487 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:56.225650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:56.226279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:56.249745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:56.250210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:56.251943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:56.252408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:56.605106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:56.614272 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04a50a6b-0da3-404e-b242-153a72e9e2f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1548 microversion: 2.1 time: 0.392460 May 07 21:48:56.618897 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 519/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:56 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1548 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:56.623736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d9d1e624-6915-4283-ad5d-0bafedd460a3 req-52d5e0cb-7d3a-4ae4-9b0f-e5f85f82227c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028d626c-306b-45cc-81b8-b73eca1c01c3", "tag": "87c894e0-03dd-4dab-a47b-82dec6ea1485"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:56.632358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d9d1e624-6915-4283-ad5d-0bafedd460a3 req-52d5e0cb-7d3a-4ae4-9b0f-e5f85f82227c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:56.633146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d9d1e624-6915-4283-ad5d-0bafedd460a3 req-52d5e0cb-7d3a-4ae4-9b0f-e5f85f82227c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:56.647489 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d9d1e624-6915-4283-ad5d-0bafedd460a3 req-52d5e0cb-7d3a-4ae4-9b0f-e5f85f82227c service nova] Creating event network-changed:87c894e0-03dd-4dab-a47b-82dec6ea1485 for instance 028d626c-306b-45cc-81b8-b73eca1c01c3 on nch2-master-1 May 07 21:48:56.657168 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d9d1e624-6915-4283-ad5d-0bafedd460a3 req-52d5e0cb-7d3a-4ae4-9b0f-e5f85f82227c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036193 May 07 21:48:56.659808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 520/1075] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:56.665061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4300119-2858-45d3-994c-27bd8725b204 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Calling method '.version_select at 0x7fc41ce16940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:58.469391 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b243dc2d-3062-4c23-b2a0-b430312fb504 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1424 microversion: 2.1 time: 12.558911 May 07 21:48:58.471312 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 556/1076] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:45 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1424 bytes in 12565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:58.486224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:58.488580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:58.505900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:58.508653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:58.512200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:58.514012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:58.818597 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4300119-2858-45d3-994c-27bd8725b204 tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/9a28d2e7-f347-4337-a640-ce64d1995f10" status: 202 len: 0 microversion: 2.1 time: 2.157329 May 07 21:48:58.820244 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 521/1077] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:48:56 2022] DELETE /compute/v2.1/os-floating-ips/9a28d2e7-f347-4337-a640-ce64d1995f10 => generated 0 bytes in 2160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:58.828240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:58.828919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:58.847858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:58.849687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:58.851452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:58.852854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:58.881959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lazy-loading 'flavor' on Instance uuid c766eaa8-8e8e-4135-9b5d-dfdaad014172 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:48:59.003247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:59.046090 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d528f18d-2ee7-42e7-9ed1-68a9cf05952c tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1316 microversion: 2.1 time: 0.573221 May 07 21:48:59.047113 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 557/1078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:58 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:59.052238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:59.052946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:59.061566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:59.062119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:59.063018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:59.063679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:59.130386 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5a0f0f21-ada5-4f85-8db8-e496b233cbda tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172/action" status: 202 len: 0 microversion: 2.1 time: 0.308363 May 07 21:48:59.131785 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 522/1079] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:48:58 2022] POST /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:48:59.140024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:59.140856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:59.161739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:59.162465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:59.163541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:59.166260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:59.225161 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 21:48:59.225400 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 21:48:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 (ip 10.222.0.32) !!! May 07 21:48:59.474063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:59.485588 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f4b44f3-5b5b-48b6-8bb1-6d1415ed5150 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1548 microversion: 2.1 time: 0.352392 May 07 21:48:59.512772 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 523/1080] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:59 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1548 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:59.517785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6fca5767-3406-40fd-812c-d690c5ca6d46 req-587e44c3-2908-4202-a32a-6a8e924f0ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ad21b1-1341-4913-a562-49dfe8fa77f7", "tag": "95aee55b-7026-428b-aa23-c411905b5c61"}, {"name": "network-changed", "server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:48:59.552552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6fca5767-3406-40fd-812c-d690c5ca6d46 req-587e44c3-2908-4202-a32a-6a8e924f0ee3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:59.555473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:48:59.556180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6fca5767-3406-40fd-812c-d690c5ca6d46 req-587e44c3-2908-4202-a32a-6a8e924f0ee3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:59.576460 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e39f7ef-c699-4afb-a88a-6be8df954980 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1377 microversion: 2.1 time: 0.527769 May 07 21:48:59.580201 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 558/1081] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:59 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1377 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:48:59.598820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e396a13-f8ce-48a4-a1f8-b8f054c5b34a tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] Calling method '.version_select at 0x7fc41cc085e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:59.614442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6fca5767-3406-40fd-812c-d690c5ca6d46 req-587e44c3-2908-4202-a32a-6a8e924f0ee3 service nova] Creating event network-changed:95aee55b-7026-428b-aa23-c411905b5c61 for instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 on nch2-master-1 May 07 21:48:59.615007 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6fca5767-3406-40fd-812c-d690c5ca6d46 req-587e44c3-2908-4202-a32a-6a8e924f0ee3 service nova] Creating event network-changed:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch1-master-1 May 07 21:48:59.641745 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6fca5767-3406-40fd-812c-d690c5ca6d46 req-587e44c3-2908-4202-a32a-6a8e924f0ee3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.127587 May 07 21:48:59.645718 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 524/1082] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:48:59.662506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:48:59.663282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:48:59.677555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:59.678015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:48:59.678864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:48:59.679315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:00.196761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:00.208749 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15444994-a2d8-41f6-aaf7-1292e3e8edb5 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1495 microversion: 2.1 time: 0.559720 May 07 21:49:00.211084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 525/1083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:48:59 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1495 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:00.222613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2928fa11-c064-4686-8ce4-52c4951f30d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41ccf71f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:00.291369 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2928fa11-c064-4686-8ce4-52c4951f30d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1424 microversion: 2.1 time: 0.076940 May 07 21:49:00.311575 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 526/1084] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:00 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:00.324538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:00.327920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:00.344371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:00.345129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:00.346111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:00.346739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:00.827442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:00.844239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ded3f96-dc2b-41ff-9efb-3e884877555a tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1316 microversion: 2.1 time: 0.530630 May 07 21:49:00.848050 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 527/1085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:00 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:00.865488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:00.876301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:00.883654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:00.889107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:00.890460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:00.891170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:01.477314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:01.493770 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07e8a811-0bea-487c-adf5-d6c323a7b3af tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1548 microversion: 2.1 time: 0.644261 May 07 21:49:01.496636 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 528/1086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:00 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1548 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:01.513257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:01.514350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:01.525996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:01.527888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:01.533912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:01.534640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:01.970710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:01.995048 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da3ebdad-2f8a-4148-b893-f2041c5e6225 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1377 microversion: 2.1 time: 0.490928 May 07 21:49:01.999004 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 529/1087] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:01 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1377 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:02.008117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:02.011795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:02.030604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:02.031660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:02.034122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:02.035778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:02.298899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:02.334607 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-643f1bd1-16c7-4d66-816f-05bd51818fd1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 200 len: 1478 microversion: 2.1 time: 0.334198 May 07 21:49:02.337457 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 530/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:01 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 1478 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:02.354426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41f0b363-de15-4a41-bf34-11a1df557ce4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cce5160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:02.427099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e396a13-f8ce-48a4-a1f8-b8f054c5b34a tempest-FloatingIPDetailsTestJSON-3408287 tempest-FloatingIPDetailsTestJSON-3408287-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/2c45c2e6-64b3-4562-bc37-05a260d17928" status: 202 len: 0 microversion: 2.1 time: 2.843609 May 07 21:49:02.428854 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 559/1089] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:48:59 2022] DELETE /compute/v2.1/os-floating-ips/2c45c2e6-64b3-4562-bc37-05a260d17928 => generated 0 bytes in 2847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:02.450520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0194cc02-e396-477e-a238-2731e55fb9d2 req-94a81d9d-1abb-419b-95b8-83324a2dcb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ad21b1-1341-4913-a562-49dfe8fa77f7", "name": "network-vif-plugged", "status": "completed", "tag": "95aee55b-7026-428b-aa23-c411905b5c61"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:02.475338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0194cc02-e396-477e-a238-2731e55fb9d2 req-94a81d9d-1abb-419b-95b8-83324a2dcb1d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:02.477600 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41f0b363-de15-4a41-bf34-11a1df557ce4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1424 microversion: 2.1 time: 0.136132 May 07 21:49:02.478683 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 531/1090] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:02 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:02.486322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0194cc02-e396-477e-a238-2731e55fb9d2 req-94a81d9d-1abb-419b-95b8-83324a2dcb1d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:02.491638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:02.492168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:02.504555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:02.505563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:02.507394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:02.507394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:02.520317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0194cc02-e396-477e-a238-2731e55fb9d2 req-94a81d9d-1abb-419b-95b8-83324a2dcb1d service nova] Creating event network-vif-plugged:95aee55b-7026-428b-aa23-c411905b5c61 for instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 on nch2-master-1 May 07 21:49:02.535801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0194cc02-e396-477e-a238-2731e55fb9d2 req-94a81d9d-1abb-419b-95b8-83324a2dcb1d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101596 May 07 21:49:02.539322 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 560/1091] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:02.575592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f78f668d-ada3-4f54-937a-81d370dfbc88 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1359261013"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:02.578509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f78f668d-ada3-4f54-937a-81d370dfbc88 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:02.608848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f78f668d-ada3-4f54-937a-81d370dfbc88 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:02.609626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f78f668d-ada3-4f54-937a-81d370dfbc88 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:02.611699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f78f668d-ada3-4f54-937a-81d370dfbc88 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:02.612742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f78f668d-ada3-4f54-937a-81d370dfbc88 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:03.094549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:03.108920 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-61ddf7a4-27ce-4b3c-8ff8-a3d4b554496b tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1316 microversion: 2.1 time: 0.625495 May 07 21:49:03.111058 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 532/1092] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:02 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:03.119316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:03.129998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:03.131368 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f78f668d-ada3-4f54-937a-81d370dfbc88 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172/action" status: 202 len: 0 microversion: 2.1 time: 0.588569 May 07 21:49:03.143383 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 561/1093] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:49:02 2022] POST /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 21:49:03.157736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:03.158617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:03.160256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:03.160580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:03.162340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:03.183617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:03.225279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:03.230844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:03.235229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:03.238106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:03.529716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:03.539938 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f1eba30e-4fd1-46ce-92cb-2f50722949c6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1377 microversion: 2.1 time: 0.394420 May 07 21:49:03.550873 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 562/1094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:03 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1377 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:03.556296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3e18fa3-75f1-42db-b383-fade8deb8bb3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41caad1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:03.627488 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3e18fa3-75f1-42db-b383-fade8deb8bb3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.075203 May 07 21:49:03.634083 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 563/1095] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:03 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:03.643080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-25147593-f3be-49b4-a935-776e70d8eff4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cbee5e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:03.787125 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-25147593-f3be-49b4-a935-776e70d8eff4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1424 microversion: 2.1 time: 0.151875 May 07 21:49:03.788558 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 564/1096] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:03 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1424 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:03.820548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:03.833988 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-39aa1c9b-756b-4282-9dea-8b0971772fa3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1538 microversion: 2.1 time: 0.719408 May 07 21:49:03.834721 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 533/1097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:03 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1538 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:03.854243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-457cf139-392e-42c4-b396-8782ccce10b6 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '.version_select at 0x7fc41cbb6dc0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:03.864289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-457cf139-392e-42c4-b396-8782ccce10b6 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:03.872810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-457cf139-392e-42c4-b396-8782ccce10b6 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:03.904885 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-457cf139-392e-42c4-b396-8782ccce10b6 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 3106 microversion: 2.1 time: 0.053912 May 07 21:49:03.906825 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 565/1098] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:49:03 2022] GET /compute/v2.1/os-migrations => generated 3106 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:03.919375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4a200f4-5cd9-4ae9-862a-140f79602a86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:03.919990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a4a200f4-5cd9-4ae9-862a-140f79602a86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:03.929423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4a200f4-5cd9-4ae9-862a-140f79602a86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:03.929876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4a200f4-5cd9-4ae9-862a-140f79602a86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:03.930655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4a200f4-5cd9-4ae9-862a-140f79602a86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:03.931120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4a200f4-5cd9-4ae9-862a-140f79602a86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.138700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:04.138700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:04.149537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.155887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.157317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.157800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.338340 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4a200f4-5cd9-4ae9-862a-140f79602a86 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1689 microversion: 2.1 time: 0.419440 May 07 21:49:04.340703 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 534/1099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:03 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1689 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:04.360278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3ffb0af-e0f6-490a-a155-063729cb78d0 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:04.363668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b3ffb0af-e0f6-490a-a155-063729cb78d0 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:04.376489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ffb0af-e0f6-490a-a155-063729cb78d0 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.376963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ffb0af-e0f6-490a-a155-063729cb78d0 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.377768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ffb0af-e0f6-490a-a155-063729cb78d0 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.380503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3ffb0af-e0f6-490a-a155-063729cb78d0 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.407350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:04.421707 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c1febac3-cea3-49b2-b192-bdf9adbeed68 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1465 microversion: 2.1 time: 0.296343 May 07 21:49:04.423454 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 566/1100] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:04 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1465 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:04.441294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:04.442057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:04.449639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.450798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.451631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.452208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.492689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:49:04.635953 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dcd97308-a612-4503-9ca4-904d61bf9391 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 204 len: 0 microversion: 2.1 time: 0.199591 May 07 21:49:04.637965 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 567/1101] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:04 2022] DELETE /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:04.644002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:04.644721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:04.656921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.657320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.658129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.658727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.673962 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3ffb0af-e0f6-490a-a155-063729cb78d0 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1689 microversion: 2.1 time: 0.321626 May 07 21:49:04.679478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 535/1102] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:04 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1689 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:04.687756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fea7698c-6bd6-44c8-8ba8-898c9c087328 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cd08790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:04.798235 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fea7698c-6bd6-44c8-8ba8-898c9c087328 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.117403 May 07 21:49:04.799273 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 536/1103] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:04 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:04.804528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:04.807775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:04.814836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.815583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.816557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:04.817312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:04.951953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:04.962860 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8eb896f1-6812-46c5-be81-f9ea8ad8acd1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1377 microversion: 2.1 time: 0.323382 May 07 21:49:04.963435 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 568/1104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:04 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1377 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:04.980194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0805543b-8751-4bf5-a690-0200928521e3 req-ec8772ec-df33-4655-9e4b-808dcda69f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "name": "network-vif-plugged", "status": "completed", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:05.004406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0805543b-8751-4bf5-a690-0200928521e3 req-ec8772ec-df33-4655-9e4b-808dcda69f89 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:05.005587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0805543b-8751-4bf5-a690-0200928521e3 req-ec8772ec-df33-4655-9e4b-808dcda69f89 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:05.035930 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0805543b-8751-4bf5-a690-0200928521e3 req-ec8772ec-df33-4655-9e4b-808dcda69f89 service nova] Creating event network-vif-plugged:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch1-master-1 May 07 21:49:05.051464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0805543b-8751-4bf5-a690-0200928521e3 req-ec8772ec-df33-4655-9e4b-808dcda69f89 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077174 May 07 21:49:05.055532 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 569/1105] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:05.071371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:05.074474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:05.110684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:05.111095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:05.112070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:05.112417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:05.322465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lazy-loading 'services' on Instance uuid 028d626c-306b-45cc-81b8-b73eca1c01c3 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:49:05.492445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c484223-c3a3-479d-a0fd-d412e2df5c85 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "DELETE /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments/d6dda630-1042-46d5-94d9-9909cca2be3c" status: 202 len: 0 microversion: 2.1 time: 0.435347 May 07 21:49:05.493532 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 570/1106] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 21:49:05 2022] DELETE /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments/d6dda630-1042-46d5-94d9-9909cca2be3c => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:05.514868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9826bc78-93e3-4fae-a46e-bd531a7ce615 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cc084c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:05.596088 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9826bc78-93e3-4fae-a46e-bd531a7ce615 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1424 microversion: 2.1 time: 0.101261 May 07 21:49:05.598476 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 571/1107] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:05 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:05.617749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3418e633-54d0-40e9-b894-d4228adfba13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:05.619248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3418e633-54d0-40e9-b894-d4228adfba13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:05.641138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3418e633-54d0-40e9-b894-d4228adfba13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:05.641747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3418e633-54d0-40e9-b894-d4228adfba13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:05.642374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3418e633-54d0-40e9-b894-d4228adfba13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:05.643047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3418e633-54d0-40e9-b894-d4228adfba13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:05.704665 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3418e633-54d0-40e9-b894-d4228adfba13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101620 May 07 21:49:05.708832 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 572/1108] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:49:05 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:05.758925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:05.766456 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b2b74c0-a660-4f9d-818c-7c9cb1797146 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1471 microversion: 2.1 time: 0.965800 May 07 21:49:05.769375 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 537/1109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:04 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1471 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:05.812010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c30a8eea-eb18-4f53-9308-a891f662b08a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb465e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:05.865023 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c30a8eea-eb18-4f53-9308-a891f662b08a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.057353 May 07 21:49:05.865858 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 573/1110] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:05 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:05.979895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:05.980693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:05.987881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:05.988620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:05.989873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:05.990598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:06.290637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:06.327089 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bdef8ca8-190f-446b-90f3-ba6a78cc6351 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1377 microversion: 2.1 time: 0.350849 May 07 21:49:06.327700 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 538/1111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:05 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1377 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:06.611340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-061121f3-3062-4ef7-accb-d7d2d7fec13c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cbb6af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:06.716612 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-061121f3-3062-4ef7-accb-d7d2d7fec13c tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1433 microversion: 2.1 time: 0.110734 May 07 21:49:06.717479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2df4951f-9789-470f-81dc-151a850cc364 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:06.718138 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 574/1112] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:06 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1433 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:06.719285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2df4951f-9789-470f-81dc-151a850cc364 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:06.729885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06ba0234-18b7-4135-9624-676523e570a3 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cb46790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:06.733100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4951f-9789-470f-81dc-151a850cc364 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:06.733865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4951f-9789-470f-81dc-151a850cc364 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:06.734911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4951f-9789-470f-81dc-151a850cc364 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:06.735600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4951f-9789-470f-81dc-151a850cc364 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:06.812636 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06ba0234-18b7-4135-9624-676523e570a3 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 200 len: 1433 microversion: 2.1 time: 0.086589 May 07 21:49:06.820258 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 575/1113] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:06 2022] GET /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 1433 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:06.827049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:06.827697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:06.838661 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2df4951f-9789-470f-81dc-151a850cc364 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126061 May 07 21:49:06.841795 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 539/1114] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:49:06 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:49:06.849902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:06.850315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:06.851152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:06.854631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:06.855335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:06.855569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:06.880222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:06.883822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:06.886454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:06.887060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:07.151826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:07.163735 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9d452923-807e-41c3-913a-887556ef19d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1479 microversion: 2.1 time: 0.320068 May 07 21:49:07.164728 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 540/1115] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:06 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1479 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:07.182900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b56ae3a-dd98-4892-912e-7ae4d054cf53 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41ccd3670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:07.254757 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b56ae3a-dd98-4892-912e-7ae4d054cf53 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.088738 May 07 21:49:07.260689 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 541/1116] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:07 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:07.344971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:07.346309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:07.356997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:07.357427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:07.358212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:07.358658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:07.611052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:07.619703 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3114345-d74d-4cf1-9dfb-7bd182061e6a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1377 microversion: 2.1 time: 0.279328 May 07 21:49:07.621391 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 542/1117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:07 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1377 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:07.715442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1d56d3935a4454e867bfe3bbf95da2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32f89ced1064b42a865fa6c8f48a92b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:07.733552 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ae27c203-e17b-42ab-965b-c18c59e8ad5f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 200 len: 1429 microversion: 2.1 time: 0.918432 May 07 21:49:07.734174 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 576/1118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:06 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 1429 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:07.760699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9753d9ea-fb54-4c2f-9cd3-a1f904769ebf req-c032000c-62e0-4df9-a718-92c58b7a3e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ad21b1-1341-4913-a562-49dfe8fa77f7", "name": "network-vif-deleted", "tag": "95aee55b-7026-428b-aa23-c411905b5c61"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:07.792201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9753d9ea-fb54-4c2f-9cd3-a1f904769ebf req-c032000c-62e0-4df9-a718-92c58b7a3e88 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:07.792658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9753d9ea-fb54-4c2f-9cd3-a1f904769ebf req-c032000c-62e0-4df9-a718-92c58b7a3e88 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:07.811161 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9753d9ea-fb54-4c2f-9cd3-a1f904769ebf req-c032000c-62e0-4df9-a718-92c58b7a3e88 service nova] Creating event network-vif-deleted:95aee55b-7026-428b-aa23-c411905b5c61 for instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 on nch2-master-1 May 07 21:49:07.819896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9753d9ea-fb54-4c2f-9cd3-a1f904769ebf req-c032000c-62e0-4df9-a718-92c58b7a3e88 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083843 May 07 21:49:07.821305 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 577/1119] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:07.861772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-09f5e496-e1d4-4b10-8a16-240e959c7345 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:07.865018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-09f5e496-e1d4-4b10-8a16-240e959c7345 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:07.871631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22283384-4bb9-455c-865e-722936453678 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1204684529", "id": 886273048, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:07.876344 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:07.876344 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:07.884404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f5e496-e1d4-4b10-8a16-240e959c7345 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:07.885632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f5e496-e1d4-4b10-8a16-240e959c7345 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:07.887593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f5e496-e1d4-4b10-8a16-240e959c7345 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:07.889452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f5e496-e1d4-4b10-8a16-240e959c7345 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:07.910071 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-22283384-4bb9-455c-865e-722936453678 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.287688 May 07 21:49:07.910700 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 543/1120] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:07 2022] POST /compute/v2.1/flavors => generated 427 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:07.925256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0b2d377f-eb94-41dc-b713-02bdd9601ddf tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:07.926071 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:07.926071 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:07.948715 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0b2d377f-eb94-41dc-b713-02bdd9601ddf tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/886273048" status: 202 len: 0 microversion: 2.1 time: 0.031111 May 07 21:49:07.954933 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 544/1121] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:07 2022] DELETE /compute/v2.1/flavors/886273048 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:07.968037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-803479a8-1da9-4bec-b460-2f68df85657c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:07.979242 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-09f5e496-e1d4-4b10-8a16-240e959c7345 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127603 May 07 21:49:07.980377 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 578/1122] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:49:07 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:49:08.027265 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-803479a8-1da9-4bec-b460-2f68df85657c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.070955 May 07 21:49:08.028348 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 545/1123] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:07 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:08.045755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bfb43ab9-1871-4fbc-b180-90899dfd7385 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-547131773", "id": 454897364, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:08.047837 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:08.047837 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:08.073711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bfb43ab9-1871-4fbc-b180-90899dfd7385 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.034056 May 07 21:49:08.082231 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 579/1124] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:08 2022] POST /compute/v2.1/flavors => generated 413 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:08.086648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6dcf058-5adf-4a10-b87d-240b856b881d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.119090 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6dcf058-5adf-4a10-b87d-240b856b881d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5883 microversion: 2.1 time: 0.036992 May 07 21:49:08.119735 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 546/1125] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:08 2022] GET /compute/v2.1/flavors/detail => generated 5883 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:08.138274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-93721d75-b966-405d-a632-bfda0e0d155c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.144219 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:08.144219 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:08.171890 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-93721d75-b966-405d-a632-bfda0e0d155c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/454897364" status: 202 len: 0 microversion: 2.1 time: 0.037138 May 07 21:49:08.178042 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 580/1126] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:08 2022] DELETE /compute/v2.1/flavors/454897364 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:08.183892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.185069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:08.185708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8f0200f4-d3c7-4194-aad0-6185db15003b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.230207 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8f0200f4-d3c7-4194-aad0-6185db15003b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.050617 May 07 21:49:08.234822 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 581/1127] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:08 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:08.242403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:08.243061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:08.244002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:08.250088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f076a2a-d84d-497d-864c-9f89c0fdc776 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-588834245", "id": 1914056729, "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:08.250906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:08.305525 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f076a2a-d84d-497d-864c-9f89c0fdc776 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.059484 May 07 21:49:08.306266 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 582/1128] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:08 2022] POST /compute/v2.1/flavors => generated 428 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:49:08.337377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-666f0264-0a22-477b-b298-1e54497b243d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41caaeee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.462040 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-666f0264-0a22-477b-b298-1e54497b243d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.150991 May 07 21:49:08.463285 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 583/1129] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:08 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:08.475174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0a3f955b-5123-40a5-b410-021dfc477e3b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.523291 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0a3f955b-5123-40a5-b410-021dfc477e3b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1914056729" status: 202 len: 0 microversion: 2.1 time: 0.058539 May 07 21:49:08.524735 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 584/1130] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:49:08 2022] DELETE /compute/v2.1/flavors/1914056729 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:08.565591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f42d8e0-8f6a-459e-a27a-32a8d3267936 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.637313 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f42d8e0-8f6a-459e-a27a-32a8d3267936 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.108192 May 07 21:49:08.637913 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 585/1131] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:08 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:08.664239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:08.665098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:08.674569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:08.676714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:08.677734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:08.678332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:08.713214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:08.722299 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5f10f5d-6b98-475d-adf2-28e3b937c5d9 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1466 microversion: 2.1 time: 0.542848 May 07 21:49:08.724478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 547/1132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:08 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1466 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:08.735563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d581e8eb-fb8c-409a-989b-f5443751596b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1501861156", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:08.740988 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:08.740988 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:08.801228 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d581e8eb-fb8c-409a-989b-f5443751596b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.072414 May 07 21:49:08.801851 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 548/1133] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:08 2022] POST /compute/v2.1/flavors => generated 507 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:08.813492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-80b714f1-a447-4759-989c-00fcaf208e23 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41ccf7d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:09.266712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:09.286731 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d2a4036-bf82-435e-9b03-217d2f46bf91 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1527 microversion: 2.1 time: 0.626110 May 07 21:49:09.290032 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 586/1134] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:08 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1527 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:09.307654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:09.325439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:09.352190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:09.352657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:09.359950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:09.360419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:09.411380 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] HTTP exception thrown: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. May 07 21:49:09.412090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Returning 404 to user: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:09.412965 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8057c1f1-8405-4016-9aa8-ecaec66d75b5 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 404 len: 111 microversion: 2.1 time: 0.118920 May 07 21:49:09.417241 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 587/1135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:09 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:09.454206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-95fa9369-6a67-40e7-88aa-f8dc6af76f44 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:09.455051 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:09.455051 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:09.520525 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-95fa9369-6a67-40e7-88aa-f8dc6af76f44 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/75bee9f6-34c1-4c16-bd44-cd8d31637b8b" status: 202 len: 0 microversion: 2.1 time: 0.088610 May 07 21:49:09.526733 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 588/1136] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:09 2022] DELETE /compute/v2.1/flavors/75bee9f6-34c1-4c16-bd44-cd8d31637b8b => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:09.543978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0424784a-21b0-40a1-ab6b-99b662a6d580 req-7b9ecf2d-d881-4b54-8d2d-24e07b9def5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c766eaa8-8e8e-4135-9b5d-dfdaad014172", "name": "network-vif-plugged", "status": "completed", "tag": "1543b45e-f40e-472d-975d-d79ddefecdd6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:09.568839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0424784a-21b0-40a1-ab6b-99b662a6d580 req-7b9ecf2d-d881-4b54-8d2d-24e07b9def5f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:09.571211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0424784a-21b0-40a1-ab6b-99b662a6d580 req-7b9ecf2d-d881-4b54-8d2d-24e07b9def5f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:09.602704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0424784a-21b0-40a1-ab6b-99b662a6d580 req-7b9ecf2d-d881-4b54-8d2d-24e07b9def5f service nova] Creating event network-vif-plugged:1543b45e-f40e-472d-975d-d79ddefecdd6 for instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 on nch1-master-1 May 07 21:49:09.618205 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0424784a-21b0-40a1-ab6b-99b662a6d580 req-7b9ecf2d-d881-4b54-8d2d-24e07b9def5f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087296 May 07 21:49:09.620116 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 589/1137] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:09.634516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:09.636505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:09.646589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:09.647313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:09.648375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:09.648974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:09.868091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:09.884721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3162c584-19c4-46ed-afac-607739837f34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1527 microversion: 2.1 time: 0.258652 May 07 21:49:09.884721 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 590/1138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:09 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1527 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:09.900081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1023158056", "metadata": {"image_type": "test"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:09.901790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:09.916005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:09.917440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:09.918976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:09.919696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:09.955970 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] HTTP exception thrown: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. May 07 21:49:09.959980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Returning 404 to user: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:09.963653 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-318c9943-5612-4efd-b924-7105a2ff307f tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "POST /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7/action" status: 404 len: 111 microversion: 2.1 time: 0.076915 May 07 21:49:09.964481 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 591/1139] 10.222.0.32 () {60 vars in 1278 bytes} [Sat May 7 21:49:09 2022] POST /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:09.976458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8287f2ce-301c-4d93-bd72-33e346dce0fb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb46d30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.001853 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-80b714f1-a447-4759-989c-00fcaf208e23 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "DELETE /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a" status: 204 len: 0 microversion: 2.1 time: 1.192789 May 07 21:49:10.003809 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 549/1140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:08 2022] DELETE /compute/v2.1/images/c8352c0d-78dc-4ca6-be71-461e882d5f9a => generated 0 bytes in 1195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:10.010231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a3026d7-ca1c-4c16-a7cc-81237cc5cb7b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.063412 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a3026d7-ca1c-4c16-a7cc-81237cc5cb7b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.057231 May 07 21:49:10.065866 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 550/1141] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:10 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:10.078718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-908e2dca-57b5-4146-899f-0b79170a30f2 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.079515 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:10.079515 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:10.097360 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8287f2ce-301c-4d93-bd72-33e346dce0fb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.130529 May 07 21:49:10.098212 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 592/1142] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:09 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:10.113277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87b0273a-1c42-4b6c-a936-79f873ca81fd tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1757951852", "metadata": {"image_type": "test"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:10.116624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87b0273a-1c42-4b6c-a936-79f873ca81fd tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Failed to fetch instance by id tempest-invalid-1519137458 {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2926}} May 07 21:49:10.119394 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-87b0273a-1c42-4b6c-a936-79f873ca81fd tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] HTTP exception thrown: Instance tempest-invalid-1519137458 could not be found. May 07 21:49:10.119696 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-908e2dca-57b5-4146-899f-0b79170a30f2 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/839a70a4-0580-4374-bc76-4a6a2187b117" status: 202 len: 0 microversion: 2.1 time: 0.051844 May 07 21:49:10.121359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87b0273a-1c42-4b6c-a936-79f873ca81fd tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Returning 404 to user: Instance tempest-invalid-1519137458 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:10.122998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87b0273a-1c42-4b6c-a936-79f873ca81fd tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "POST /compute/v2.1/servers/tempest-invalid-1519137458/action" status: 404 len: 101 microversion: 2.1 time: 0.023665 May 07 21:49:10.124432 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 551/1143] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:10 2022] DELETE /compute/v2.1/flavors/839a70a4-0580-4374-bc76-4a6a2187b117 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:10.125962 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 593/1144] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:49:10 2022] POST /compute/v2.1/servers/tempest-invalid-1519137458/action => generated 101 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:10.134083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03ad8b07-3506-4f7f-a2e4-82e554050ef4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '.version_select at 0x7fc41cd91820>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.136124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e60740a7-cf46-4066-b4ff-426052dd8dbb tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1097165140", "id": "a48dbe7e-ee3f-4e66-91bd-cd86b801a685", "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:10.138338 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:10.138338 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:10.157655 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e60740a7-cf46-4066-b4ff-426052dd8dbb tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.030445 May 07 21:49:10.164473 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 594/1145] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:10 2022] POST /compute/v2.1/flavors => generated 507 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:10.171173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97b8b9d6-56c8-4a69-b1b0-395913a29a73 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.191858 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97b8b9d6-56c8-4a69-b1b0-395913a29a73 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.025953 May 07 21:49:10.193400 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 595/1146] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:10 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:10.199590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a97e3af-ec96-4c7c-bd51-be4e99860763 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1595793542"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:10.200873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3a97e3af-ec96-4c7c-bd51-be4e99860763 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2926}} May 07 21:49:10.201581 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3a97e3af-ec96-4c7c-bd51-be4e99860763 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 07 21:49:10.202316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a97e3af-ec96-4c7c-bd51-be4e99860763 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:10.204640 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a97e3af-ec96-4c7c-bd51-be4e99860763 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009944 May 07 21:49:10.206364 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 596/1147] 10.222.0.32 () {60 vars in 1274 bytes} [Sat May 7 21:49:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:10.225759 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-03ad8b07-3506-4f7f-a2e4-82e554050ef4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] HTTP exception thrown: Image not found. May 07 21:49:10.226098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53fe0431-297e-462e-b8c5-28560bf299c0 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.226978 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:10.226978 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:10.228461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03ad8b07-3506-4f7f-a2e4-82e554050ef4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:10.231616 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03ad8b07-3506-4f7f-a2e4-82e554050ef4 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "DELETE /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36" status: 404 len: 62 microversion: 2.1 time: 0.104734 May 07 21:49:10.232336 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 552/1148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:10 2022] DELETE /compute/v2.1/images/99ad9550-688a-40a0-adb3-dd282e818a36 => generated 62 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:10.238095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:10.239350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:10.249218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.249880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.250933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.251528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.269494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53fe0431-297e-462e-b8c5-28560bf299c0 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/a48dbe7e-ee3f-4e66-91bd-cd86b801a685" status: 202 len: 0 microversion: 2.1 time: 0.061299 May 07 21:49:10.270222 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 597/1149] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:10 2022] DELETE /compute/v2.1/flavors/a48dbe7e-ee3f-4e66-91bd-cd86b801a685 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:10.278522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f83c67d-874a-4776-a0bd-90582ea593c9 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-202158137"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:10.280586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3f83c67d-874a-4776-a0bd-90582ea593c9 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2926}} May 07 21:49:10.283306 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3f83c67d-874a-4776-a0bd-90582ea593c9 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 07 21:49:10.283903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f83c67d-874a-4776-a0bd-90582ea593c9 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:10.284760 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f83c67d-874a-4776-a0bd-90582ea593c9 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010484 May 07 21:49:10.293965 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 598/1150] 10.222.0.32 () {60 vars in 1280 bytes} [Sat May 7 21:49:10 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:10.301415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.303832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:10.322096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.322610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.323540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.323986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.380250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:49:10.420261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:10.432312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Old instance type tempest-test_resize_flavor_-1867141305, new instance type m1.heat {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 21:49:10.455754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:49:10.458113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:49:10.458823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:49:10.459422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:49:10.460770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:49:10.547600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2156af7b-2012-4e77-9992-3c00a342a035 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 204 len: 0 microversion: 2.1 time: 0.256061 May 07 21:49:10.548837 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 599/1151] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:10 2022] DELETE /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:10.555420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a1ac9200-9809-4d9e-8549-1a35deb8746d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.618188 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a1ac9200-9809-4d9e-8549-1a35deb8746d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067726 May 07 21:49:10.630993 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 600/1152] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:10.638957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.639710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:10.647392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.647868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.649515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.649969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.666625 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] HTTP exception thrown: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. May 07 21:49:10.667179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Returning 404 to user: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:10.668097 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-de0e75ba-6fa9-455a-81b9-681ca6d5a982 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 404 len: 111 microversion: 2.1 time: 0.047697 May 07 21:49:10.669755 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 601/1153] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:10 2022] DELETE /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:10.675456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.676055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:10.687584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.689513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.692079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.693716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.761167 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b1adeec9-8a59-46b7-9029-a34e2b2f4362 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96/action" status: 202 len: 0 microversion: 2.1 time: 0.525668 May 07 21:49:10.774637 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 553/1154] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:49:10 2022] POST /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:10.789810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b2c05ba3-05a2-4c85-9dac-faefe69b4baa tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-784055551", "id": 1074299232, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:10.791864 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:10.791864 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:10.828967 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b2c05ba3-05a2-4c85-9dac-faefe69b4baa tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.052540 May 07 21:49:10.834133 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 554/1155] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:10 2022] POST /compute/v2.1/flavors => generated 413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:10.841136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.841906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] [instance: c6ad21b1-1341-4913-a562-49dfe8fa77f7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:10.853117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.854218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.856258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.856989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.880591 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] HTTP exception thrown: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. May 07 21:49:10.884568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] Returning 404 to user: Instance c6ad21b1-1341-4913-a562-49dfe8fa77f7 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:10.885803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5081101c-1ebc-499b-ac6f-5e608e35ec91 tempest-ImagesNegativeTestJSON-144261636 tempest-ImagesNegativeTestJSON-144261636-project] 10.222.0.32 "GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7" status: 404 len: 111 microversion: 2.1 time: 0.050266 May 07 21:49:10.893444 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 555/1156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:10 2022] GET /compute/v2.1/servers/c6ad21b1-1341-4913-a562-49dfe8fa77f7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:10.900769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:10.901667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:10.927115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.927915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:10.928980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:10.929630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:11.288752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:11.299846 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93e32f84-8271-4764-af69-542d24f63a53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1536 microversion: 2.1 time: 0.404907 May 07 21:49:11.326017 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 556/1157] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:10 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1536 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:11.333478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52951fb2-1abc-4d6f-9554-0345c5d5cb7c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:11.367052 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52951fb2-1abc-4d6f-9554-0345c5d5cb7c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/1074299232" status: 200 len: 413 microversion: 2.1 time: 0.038721 May 07 21:49:11.376059 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 557/1158] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:11 2022] GET /compute/v2.1/flavors/1074299232 => generated 413 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:11.376273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:11.389410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb5acb19-3278-41f2-9b51-3931336d1456 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc3c0d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:11.406810 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d820ede-a52d-479d-9381-26ebcd71a9c8 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1472 microversion: 2.1 time: 0.726948 May 07 21:49:11.406810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 602/1159] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:10 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1472 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:11.521248 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb5acb19-3278-41f2-9b51-3931336d1456 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.146276 May 07 21:49:11.529451 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 558/1160] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:11 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:11.670561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-77def782-cf7d-42b3-bdf1-ba59f70d1c87 req-240bef51-095c-415e-8b1a-bb02e9caf2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ec46f9-84e6-413a-be19-c46548cb31fd", "name": "network-vif-unplugged", "status": "completed", "tag": "04c678a5-64ac-461c-a365-ad4f4e5dd86c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:11.686039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-77def782-cf7d-42b3-bdf1-ba59f70d1c87 req-240bef51-095c-415e-8b1a-bb02e9caf2e0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:11.693607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-77def782-cf7d-42b3-bdf1-ba59f70d1c87 req-240bef51-095c-415e-8b1a-bb02e9caf2e0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:11.743562 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-77def782-cf7d-42b3-bdf1-ba59f70d1c87 req-240bef51-095c-415e-8b1a-bb02e9caf2e0 service nova] Creating event network-vif-unplugged:04c678a5-64ac-461c-a365-ad4f4e5dd86c for instance d0ec46f9-84e6-413a-be19-c46548cb31fd on nch1-master-1 May 07 21:49:11.761837 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-77def782-cf7d-42b3-bdf1-ba59f70d1c87 req-240bef51-095c-415e-8b1a-bb02e9caf2e0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095547 May 07 21:49:11.763163 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 559/1161] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:11.984489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-914ecf14-9be1-4b2a-9103-d78e50688acf tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.035042 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-914ecf14-9be1-4b2a-9103-d78e50688acf tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.635237 May 07 21:49:12.039552 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 603/1162] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:11 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:12.055764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e0715de5-dde2-4ba4-b178-ca6af0caef3c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.056599 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:12.056599 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:12.109065 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e0715de5-dde2-4ba4-b178-ca6af0caef3c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1074299232" status: 202 len: 0 microversion: 2.1 time: 0.058619 May 07 21:49:12.111243 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 560/1163] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:49:12 2022] DELETE /compute/v2.1/flavors/1074299232 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:12.119701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ee90822-6465-4d44-b7a3-f14e2c512440 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.179497 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ee90822-6465-4d44-b7a3-f14e2c512440 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063205 May 07 21:49:12.180923 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 604/1164] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:12.225459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3ea4e6cb-3d5a-4b85-9626-7f2a759712a8 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1664827568", "id": 622397681, "os-flavor-access:is_public": "False"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:12.231795 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:12.231795 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:12.269842 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3ea4e6cb-3d5a-4b85-9626-7f2a759712a8 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.076481 May 07 21:49:12.279380 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 561/1165] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:12 2022] POST /compute/v2.1/flavors => generated 427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:12.291346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50bb8078-68ac-4c4b-9e4d-65a4a8c5cec3 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "622397681"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:12.327257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.328855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:12.334916 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-50bb8078-68ac-4c4b-9e4d-65a4a8c5cec3 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] HTTP exception thrown: Flavor 622397681 could not be found. May 07 21:49:12.335529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50bb8078-68ac-4c4b-9e4d-65a4a8c5cec3 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] Returning 400 to user: Flavor 622397681 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:12.342177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50bb8078-68ac-4c4b-9e4d-65a4a8c5cec3 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.055283 May 07 21:49:12.344118 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 605/1166] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:12 2022] POST /compute/v2.1/servers => generated 80 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:49:12.348423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:12.352275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:12.352427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81068488-86ab-4b85-901c-909745e6c1c0 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.358156 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:12.358156 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:12.359003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:12.362485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:12.396251 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81068488-86ab-4b85-901c-909745e6c1c0 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/622397681" status: 202 len: 0 microversion: 2.1 time: 0.048072 May 07 21:49:12.397250 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 606/1167] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:12 2022] DELETE /compute/v2.1/flavors/622397681 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:12.412940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a7c3751-d0f8-4cec-bd5d-b49ba7d08492 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.475195 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a7c3751-d0f8-4cec-bd5d-b49ba7d08492 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073711 May 07 21:49:12.481492 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 607/1168] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:12.505004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.505558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:12.527958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:12.531254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:12.532248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:12.534149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:12.760406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:12.772202 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3acb1ced-162d-4608-91f3-8e30485575a0 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1472 microversion: 2.1 time: 0.287529 May 07 21:49:12.772833 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 608/1169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:12 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:12.796024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23925fde-6a56-49e2-8332-e15ff602e667 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-421034990", "id": 321373379, "os-flavor-access:is_public": "False"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:12.803460 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:12.803460 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:12.831843 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23925fde-6a56-49e2-8332-e15ff602e667 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.040187 May 07 21:49:12.835272 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 609/1170] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:12 2022] POST /compute/v2.1/flavors => generated 411 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:12.852576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fe9738c4-9c50-44ed-9d70-f6eadace6047 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb04940>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:12.954469 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fe9738c4-9c50-44ed-9d70-f6eadace6047 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.117831 May 07 21:49:12.955231 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 610/1171] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:12 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:12.969049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4cf091d0-1c25-4756-a9ab-c73205a0261b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-173218669", "id": 368468420, "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:13.025151 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4cf091d0-1c25-4756-a9ab-c73205a0261b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.067918 May 07 21:49:13.025791 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 611/1172] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:12 2022] POST /compute/v2.1/flavors => generated 410 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:13.042516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-43dd99ee-7b3d-4f63-a07a-29b40758db8d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.092342 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-43dd99ee-7b3d-4f63-a07a-29b40758db8d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.054069 May 07 21:49:13.092907 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 612/1173] 10.222.0.32 () {58 vars in 1168 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:13.147567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8bb9918-da31-4c00-ac87-f739315047e5 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.191199 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8bb9918-da31-4c00-ac87-f739315047e5 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.038589 May 07 21:49:13.191882 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 613/1174] 10.222.0.32 () {58 vars in 1176 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:13.203552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5b4dea7-d8a3-45fa-ac4b-040f960c4d4e tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.243144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5b4dea7-d8a3-45fa-ac4b-040f960c4d4e tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.043768 May 07 21:49:13.243721 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 614/1175] 10.222.0.32 () {58 vars in 1170 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:13.269452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0666d3de-8ffd-45e8-a553-aaf4cbaab7e0 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.313963 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0666d3de-8ffd-45e8-a553-aaf4cbaab7e0 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.055158 May 07 21:49:13.314654 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 615/1176] 10.222.0.32 () {58 vars in 1168 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:13.336004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:13.340531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-55fd3e5b-ccfd-44f2-a699-cf8e2753bb01 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.350519 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1858c7e-97ff-43c3-878b-8d5f1c265941 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1536 microversion: 2.1 time: 1.029281 May 07 21:49:13.351984 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 562/1177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:12 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1536 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:13.377527 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-55fd3e5b-ccfd-44f2-a699-cf8e2753bb01 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.040872 May 07 21:49:13.380075 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 616/1178] 10.222.0.32 () {58 vars in 1168 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:13.396286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55d9f5dc-4b58-428d-b28b-ba065eb7a4a8 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.446323 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55d9f5dc-4b58-428d-b28b-ba065eb7a4a8 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.054763 May 07 21:49:13.452575 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 563/1179] 10.222.0.32 () {58 vars in 1174 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:13.465378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-77b28de6-5438-4027-be33-e6917b473bf8 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.528300 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-77b28de6-5438-4027-be33-e6917b473bf8 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.064607 May 07 21:49:13.534842 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 617/1180] 10.222.0.32 () {58 vars in 1172 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:13.544341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de2c8da3-b278-495b-925f-e4853015551d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.614263 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de2c8da3-b278-495b-925f-e4853015551d tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.074912 May 07 21:49:13.621883 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 564/1181] 10.222.0.32 () {58 vars in 1168 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:13.641894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9cc78cde-1d60-4f04-9535-1cbffba2f126 req-95cfa743-e8df-47ac-8f22-a50c0b6c9895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ec46f9-84e6-413a-be19-c46548cb31fd", "name": "network-vif-deleted", "tag": "04c678a5-64ac-461c-a365-ad4f4e5dd86c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:13.658363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-904f28b7-d388-4e3b-917c-37e4dcb8f8e3 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.663861 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:13.663861 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:13.674903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cc78cde-1d60-4f04-9535-1cbffba2f126 req-95cfa743-e8df-47ac-8f22-a50c0b6c9895 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:13.675513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cc78cde-1d60-4f04-9535-1cbffba2f126 req-95cfa743-e8df-47ac-8f22-a50c0b6c9895 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:13.700780 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9cc78cde-1d60-4f04-9535-1cbffba2f126 req-95cfa743-e8df-47ac-8f22-a50c0b6c9895 service nova] Creating event network-vif-deleted:04c678a5-64ac-461c-a365-ad4f4e5dd86c for instance d0ec46f9-84e6-413a-be19-c46548cb31fd on nch1-master-1 May 07 21:49:13.703974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-904f28b7-d388-4e3b-917c-37e4dcb8f8e3 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/368468420" status: 202 len: 0 microversion: 2.1 time: 0.072698 May 07 21:49:13.709991 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 565/1182] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:13 2022] DELETE /compute/v2.1/flavors/368468420 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:13.711841 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9cc78cde-1d60-4f04-9535-1cbffba2f126 req-95cfa743-e8df-47ac-8f22-a50c0b6c9895 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084839 May 07 21:49:13.714841 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 618/1183] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:13.720339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a82f9556-cffa-4fc1-a272-89ac34ac0a7b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.753953 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a82f9556-cffa-4fc1-a272-89ac34ac0a7b tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041368 May 07 21:49:13.766548 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 566/1184] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:13.772653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c1acfa6f-fcdc-4233-90f4-116f5cc21927 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.778125 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:13.778125 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:13.792251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.793737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:13.801860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:13.802606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:13.803802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:13.804400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:13.813334 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c1acfa6f-fcdc-4233-90f4-116f5cc21927 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/321373379" status: 202 len: 0 microversion: 2.1 time: 0.047410 May 07 21:49:13.814268 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 619/1185] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:13 2022] DELETE /compute/v2.1/flavors/321373379 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:49:13.827462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1249df2f-0796-4e3c-b22e-13aa8efa2ba4 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.883720 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1249df2f-0796-4e3c-b22e-13aa8efa2ba4 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065356 May 07 21:49:13.884573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 620/1186] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:13.904951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-67a0718c-a56e-4b45-ba6b-e3d4b7f80f66 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-888832788", "id": 2013305005, "os-flavor-access:is_public": "False"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:13.906375 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:13.906375 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:13.932973 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-67a0718c-a56e-4b45-ba6b-e3d4b7f80f66 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033461 May 07 21:49:13.933917 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 621/1187] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:13 2022] POST /compute/v2.1/flavors => generated 414 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:13.947878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af32f4f4abc2444fb869076ed80b3a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b4f20214214616967d9d414375248a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:13.949600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e628fa6-deb0-443d-ac83-6e13aabcd056 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:13.966580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09db3a75-ea63-4906-a88b-4f9affcd8b05 tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 200 len: 1302 microversion: 2.1 time: 0.173408 May 07 21:49:13.980301 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 567/1188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 1302 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:13.991228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6260d73b-314e-4ac0-8dad-305252926292 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cc505e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.012506 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e628fa6-deb0-443d-ac83-6e13aabcd056 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067354 May 07 21:49:14.014333 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 622/1189] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:14.028603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-230420c1-bada-4c19-baff-738c0d75df57 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.131034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-230420c1-bada-4c19-baff-738c0d75df57 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.106445 May 07 21:49:14.132615 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6260d73b-314e-4ac0-8dad-305252926292 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.150542 May 07 21:49:14.133207 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 568/1190] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:13 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:14.146998 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 623/1191] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:14.155145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fbb66350-24cd-40a1-8662-1521db8aea5a tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.156445 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:14.156445 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:14.204315 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fbb66350-24cd-40a1-8662-1521db8aea5a tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2013305005" status: 202 len: 0 microversion: 2.1 time: 0.054084 May 07 21:49:14.213626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-20dfe4cb-725e-4272-94f7-f0078610916c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.214013 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 569/1192] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:49:14 2022] DELETE /compute/v2.1/flavors/2013305005 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:14.250284 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-20dfe4cb-725e-4272-94f7-f0078610916c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040317 May 07 21:49:14.251643 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 624/1193] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:14.269015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-98ed8562-bd70-4def-bfe3-b6685967d6b1 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1026396262", "id": 2051099300, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:14.271310 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:14.271310 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:14.299253 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-98ed8562-bd70-4def-bfe3-b6685967d6b1 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.035013 May 07 21:49:14.307016 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 570/1194] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:14 2022] POST /compute/v2.1/flavors => generated 414 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:14.310675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b2232f9b-5ea8-4820-a1e8-5dfb36c1b419 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.355741 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b2232f9b-5ea8-4820-a1e8-5dfb36c1b419 tempest-FlavorsAdminTestJSON-1665144004 tempest-FlavorsAdminTestJSON-1665144004-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.049145 May 07 21:49:14.376514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.377843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:14.384518 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 625/1195] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:14 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:14.392784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:14.395465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:14.397502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:14.398075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:14.400578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-731db68b-848f-47f8-842f-5e43d9b8d60c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.449319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-731db68b-848f-47f8-842f-5e43d9b8d60c tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2051099300" status: 202 len: 0 microversion: 2.1 time: 0.061463 May 07 21:49:14.455154 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 626/1196] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:49:14 2022] DELETE /compute/v2.1/flavors/2051099300 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:14.470818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46c665ff-937f-4fdc-bd3f-28421fb95719 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.513500 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-46c665ff-937f-4fdc-bd3f-28421fb95719 tempest-FlavorsAdminTestJSON-842687593 tempest-FlavorsAdminTestJSON-842687593-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055224 May 07 21:49:14.526204 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 627/1197] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:14.775618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:14.791388 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-84ad1202-9605-4dca-b6df-6ad6e2491dc7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1536 microversion: 2.1 time: 0.420371 May 07 21:49:14.802214 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 571/1198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:14 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1536 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:14.989982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:14.990740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] [instance: d0ec46f9-84e6-413a-be19-c46548cb31fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:15.001417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:15.002156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:15.023626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:15.025682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:15.071838 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] HTTP exception thrown: Instance d0ec46f9-84e6-413a-be19-c46548cb31fd could not be found. May 07 21:49:15.073908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] Returning 404 to user: Instance d0ec46f9-84e6-413a-be19-c46548cb31fd could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:15.076751 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f5dbbfe-b49d-49ff-9863-a12bd260523f tempest-ImagesOneServerTestJSON-63988004 tempest-ImagesOneServerTestJSON-63988004-project] 10.222.0.32 "GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd" status: 404 len: 111 microversion: 2.1 time: 0.094139 May 07 21:49:15.082787 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 628/1199] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:14 2022] GET /compute/v2.1/servers/d0ec46f9-84e6-413a-be19-c46548cb31fd => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:15.148255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89c7abd6-8461-4712-a1d1-0bdea80020e3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cd08280>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:15.243813 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-89c7abd6-8461-4712-a1d1-0bdea80020e3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.100792 May 07 21:49:15.250061 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 572/1200] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:15 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:15.810453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:15.811661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:15.823656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:15.826910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:15.827959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:15.829963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:16.532718 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc9107d1-a91c-4668-b769-c87fb9c47211 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] 10.222.0.32 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.380814 May 07 21:49:16.534245 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 573/1201] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:49:16 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 07 21:49:16.556034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e8d672e-418c-4617-b39a-5ed46b408077 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb7fdc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:16.688085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:16.711970 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2e9135a6-8034-4c0c-8b9e-fb9ddc2808d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.891528 May 07 21:49:16.718428 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 629/1202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:15 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:16.736210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dfddd248-84bc-44a3-a284-0c4199efcae8 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Calling method '.version_select at 0x7fc41cadb1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:16.766518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e8d672e-418c-4617-b39a-5ed46b408077 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.226758 May 07 21:49:16.773199 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 574/1203] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:16 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:16.789559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-dfddd248-84bc-44a3-a284-0c4199efcae8 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] HTTP exception thrown: Image not found. May 07 21:49:16.790263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dfddd248-84bc-44a3-a284-0c4199efcae8 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:16.791158 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dfddd248-84bc-44a3-a284-0c4199efcae8 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] 10.222.0.32 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.070782 May 07 21:49:16.792059 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 630/1204] 10.222.0.32 () {58 vars in 1133 bytes} [Sat May 7 21:49:16 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:16.801700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-089410d4-6c98-4c71-b8ff-e78e834a7349 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Calling method '.version_select at 0x7fc41cb86430>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:16.833148 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-089410d4-6c98-4c71-b8ff-e78e834a7349 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] HTTP exception thrown: Image not found. May 07 21:49:16.834077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-089410d4-6c98-4c71-b8ff-e78e834a7349 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:16.835387 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-089410d4-6c98-4c71-b8ff-e78e834a7349 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] 10.222.0.32 "DELETE /compute/v2.1/images/3aee3cdc-ab93-4ffc-a5e5-f6a04d95e92j" status: 404 len: 62 microversion: 2.1 time: 0.037651 May 07 21:49:16.836921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 575/1205] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:16 2022] DELETE /compute/v2.1/images/3aee3cdc-ab93-4ffc-a5e5-f6a04d95e92j => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:16.846244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7e135c1f-8153-4a6d-b109-b7f8ebe7f7b4 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Calling method '.version_select at 0x7fc41cadbb80>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:16.879515 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7e135c1f-8153-4a6d-b109-b7f8ebe7f7b4 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] HTTP exception thrown: Image not found. May 07 21:49:16.880676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7e135c1f-8153-4a6d-b109-b7f8ebe7f7b4 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:16.881923 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7e135c1f-8153-4a6d-b109-b7f8ebe7f7b4 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] 10.222.0.32 "DELETE /compute/v2.1/images/4026b98f-6082-4528-98c0-32a16c198e9a1" status: 404 len: 62 microversion: 2.1 time: 0.039902 May 07 21:49:16.883042 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 631/1206] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:16 2022] DELETE /compute/v2.1/images/4026b98f-6082-4528-98c0-32a16c198e9a1 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:16.893428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e31f8915-7fbb-4f95-b441-85d1c693e882 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Calling method '.version_select at 0x7fc41cd55d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:16.958920 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-e31f8915-7fbb-4f95-b441-85d1c693e882 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] HTTP exception thrown: Image not found. May 07 21:49:16.959805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e31f8915-7fbb-4f95-b441-85d1c693e882 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:16.977818 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e31f8915-7fbb-4f95-b441-85d1c693e882 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] 10.222.0.32 "DELETE /compute/v2.1/images/tempest-invalid-1018879900" status: 404 len: 62 microversion: 2.1 time: 0.073166 May 07 21:49:16.979697 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 576/1207] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 21:49:16 2022] DELETE /compute/v2.1/images/tempest-invalid-1018879900 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:16.992959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2b19b34-115f-489d-aa80-035ebce0c454 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Calling method '.version_select at 0x7fc41cc18790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:17.037486 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e2b19b34-115f-489d-aa80-035ebce0c454 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] HTTP exception thrown: Image not found. May 07 21:49:17.038214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2b19b34-115f-489d-aa80-035ebce0c454 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:17.040093 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e2b19b34-115f-489d-aa80-035ebce0c454 tempest-ImagesDeleteNegativeTestJSON-147838705 tempest-ImagesDeleteNegativeTestJSON-147838705-project] 10.222.0.32 "DELETE /compute/v2.1/images/35fe8434-03d7-4135-b625-401a664a224f" status: 404 len: 62 microversion: 2.1 time: 0.054661 May 07 21:49:17.040899 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 632/1208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:16 2022] DELETE /compute/v2.1/images/35fe8434-03d7-4135-b625-401a664a224f => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:17.739227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:17.740539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:17.760925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:17.766454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:17.767726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:17.770837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:17.784390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30b21c02-7939-46b1-9f3e-7b3b14ae78c9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb460d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:17.899919 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-30b21c02-7939-46b1-9f3e-7b3b14ae78c9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.123632 May 07 21:49:17.902270 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 633/1209] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:17 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:18.250850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:18.266389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-99f5db12-e631-48c2-837e-252ea2451988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.529524 May 07 21:49:18.268092 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 577/1210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:17 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:18.656722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4ba8c011-8d40-402b-9a7a-1822210122d4 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Calling method '.version_select at 0x7fc41cadb670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:18.724275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-4ba8c011-8d40-402b-9a7a-1822210122d4 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdae0875-a49b-4b5f-bc5b-79c98744cba1 does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:49:18.724890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-4ba8c011-8d40-402b-9a7a-1822210122d4 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Neutron security group cdae0875-a49b-4b5f-bc5b-79c98744cba1 not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:49:18.725418 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4ba8c011-8d40-402b-9a7a-1822210122d4 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] HTTP exception thrown: Security group cdae0875-a49b-4b5f-bc5b-79c98744cba1 does not exist May 07 21:49:18.725418 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-dabfb45f-02df-420d-bbb4-bcdd19a959b9'] May 07 21:49:18.726016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4ba8c011-8d40-402b-9a7a-1822210122d4 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Returning 404 to user: Security group cdae0875-a49b-4b5f-bc5b-79c98744cba1 does not exist May 07 21:49:18.726016 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-dabfb45f-02df-420d-bbb4-bcdd19a959b9'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:18.726889 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4ba8c011-8d40-402b-9a7a-1822210122d4 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/cdae0875-a49b-4b5f-bc5b-79c98744cba1" status: 404 len: 194 microversion: 2.1 time: 0.419281 May 07 21:49:18.733027 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 634/1211] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:18 2022] DELETE /compute/v2.1/os-security-groups/cdae0875-a49b-4b5f-bc5b-79c98744cba1 => generated 194 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:18.738287 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bb9b6cd8-19a2-4a34-badf-61f9ee515b8c tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003867 May 07 21:49:18.738724 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 578/1212] 10.222.0.32 () {58 vars in 1163 bytes} [Sat May 7 21:49:18 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 07 21:49:18.747977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c586ec77-ac71-46cf-b817-ec0ea7c46616 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Calling method '.version_select at 0x7fc41cadbd30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:18.915029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b67f718e-b7f2-4db2-b3b3-f11a48f57ab7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb94280>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:19.043192 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b67f718e-b7f2-4db2-b3b3-f11a48f57ab7 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.132901 May 07 21:49:19.044047 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 579/1213] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:18 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:19.287458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:19.288532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:19.292668 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c586ec77-ac71-46cf-b817-ec0ea7c46616 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.548424 May 07 21:49:19.293302 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 635/1214] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:18 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:19.306224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:19.307695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d315e92-3fb6-46d6-93a4-f9b7ad8cc82f tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Calling method '.version_select at 0x7fc41cadb0d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:19.318848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:19.326263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:19.327151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:19.670154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-3d315e92-3fb6-46d6-93a4-f9b7ad8cc82f tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:49:19.671242 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3d315e92-3fb6-46d6-93a4-f9b7ad8cc82f tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] HTTP exception thrown: Insufficient rights for removing default security group. May 07 21:49:19.671242 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-c350b2ca-3128-4770-bb32-3990370bfca4'] May 07 21:49:19.672143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d315e92-3fb6-46d6-93a4-f9b7ad8cc82f tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Returning 400 to user: Insufficient rights for removing default security group. May 07 21:49:19.672143 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-c350b2ca-3128-4770-bb32-3990370bfca4'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:19.673343 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3d315e92-3fb6-46d6-93a4-f9b7ad8cc82f tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/5c04eace-83a1-482d-bb10-3db4b814e81f" status: 400 len: 182 microversion: 2.1 time: 0.372375 May 07 21:49:19.674188 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 636/1215] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:19 2022] DELETE /compute/v2.1/os-security-groups/5c04eace-83a1-482d-bb10-3db4b814e81f => generated 182 bytes in 374 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:49:19.691265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-374c1b2e-ac19-480a-b306-c2e1dcfb3d6a tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Calling method '.version_select at 0x7fc41cabc280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:19.738308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-374c1b2e-ac19-480a-b306-c2e1dcfb3d6a tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 293df26a-83a6-4dcc-af1d-b9cb806330b1 does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:49:19.746437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-374c1b2e-ac19-480a-b306-c2e1dcfb3d6a tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Neutron security group 293df26a-83a6-4dcc-af1d-b9cb806330b1 not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:49:19.747943 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-374c1b2e-ac19-480a-b306-c2e1dcfb3d6a tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] HTTP exception thrown: Security group 293df26a-83a6-4dcc-af1d-b9cb806330b1 does not exist May 07 21:49:19.747943 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-543d1643-c045-4936-b2dd-d6e00eb761ed'] May 07 21:49:19.752069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-374c1b2e-ac19-480a-b306-c2e1dcfb3d6a tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Returning 404 to user: Security group 293df26a-83a6-4dcc-af1d-b9cb806330b1 does not exist May 07 21:49:19.752069 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-543d1643-c045-4936-b2dd-d6e00eb761ed'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:19.755202 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-374c1b2e-ac19-480a-b306-c2e1dcfb3d6a tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/293df26a-83a6-4dcc-af1d-b9cb806330b1" status: 404 len: 194 microversion: 2.1 time: 0.072437 May 07 21:49:19.758429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:19.760476 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 637/1216] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:49:19 2022] GET /compute/v2.1/os-security-groups/293df26a-83a6-4dcc-af1d-b9cb806330b1 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:19.773812 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b80dd9be-c175-4d0f-a61e-5a64487594f6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.490684 May 07 21:49:19.795578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b17e052c-0c1b-4e3a-b25c-be41f482a378 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Action: 'update', calling method: .version_select at 0x7fc41cadb9d0>, body: {"security_group": {"name": "tempest-sg-471416325", "description": "tempest-description-1128341639"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:19.801411 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 580/1217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:19 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:19.857615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-b17e052c-0c1b-4e3a-b25c-be41f482a378 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c15d592c-7338-4c76-809b-8f26432a79da does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:49:19.858685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-b17e052c-0c1b-4e3a-b25c-be41f482a378 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Neutron security group c15d592c-7338-4c76-809b-8f26432a79da not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:49:19.859428 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b17e052c-0c1b-4e3a-b25c-be41f482a378 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] HTTP exception thrown: Security group c15d592c-7338-4c76-809b-8f26432a79da does not exist May 07 21:49:19.859428 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-a2f75ae7-ca71-4e58-bc52-99abd7a52f2c'] May 07 21:49:19.860506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b17e052c-0c1b-4e3a-b25c-be41f482a378 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] Returning 404 to user: Security group c15d592c-7338-4c76-809b-8f26432a79da does not exist May 07 21:49:19.860506 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-a2f75ae7-ca71-4e58-bc52-99abd7a52f2c'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:19.861948 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b17e052c-0c1b-4e3a-b25c-be41f482a378 tempest-SecurityGroupsNegativeTestJSON-1798131104 tempest-SecurityGroupsNegativeTestJSON-1798131104-project] 10.222.0.32 "PUT /compute/v2.1/os-security-groups/c15d592c-7338-4c76-809b-8f26432a79da" status: 404 len: 194 microversion: 2.1 time: 0.070888 May 07 21:49:19.862721 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 638/1218] 10.222.0.32 () {60 vars in 1289 bytes} [Sat May 7 21:49:19 2022] PUT /compute/v2.1/os-security-groups/c15d592c-7338-4c76-809b-8f26432a79da => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:20.063184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21dfe839-2d5e-45ed-9055-46af70e61404 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb944c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:20.203590 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21dfe839-2d5e-45ed-9055-46af70e61404 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.149846 May 07 21:49:20.210154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 581/1219] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:20 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:20.794694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:20.795960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:20.808179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-933c2525-93c5-498d-856b-304568fb89a1 tempest-ListImageFiltersNegativeTestJSON-554547786 tempest-ListImageFiltersNegativeTestJSON-554547786-project] Calling method '.version_select at 0x7fc41cabc9d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:20.821021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:20.821021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:20.822577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:20.824950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:20.861519 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-933c2525-93c5-498d-856b-304568fb89a1 tempest-ListImageFiltersNegativeTestJSON-554547786 tempest-ListImageFiltersNegativeTestJSON-554547786-project] HTTP exception thrown: Image not found. May 07 21:49:20.862331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-933c2525-93c5-498d-856b-304568fb89a1 tempest-ListImageFiltersNegativeTestJSON-554547786 tempest-ListImageFiltersNegativeTestJSON-554547786-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:20.863215 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-933c2525-93c5-498d-856b-304568fb89a1 tempest-ListImageFiltersNegativeTestJSON-554547786 tempest-ListImageFiltersNegativeTestJSON-554547786-project] 10.222.0.32 "GET /compute/v2.1/images/c28ccbda-bbb7-4b18-bca6-6b8cbbcf49f9" status: 404 len: 62 microversion: 2.1 time: 0.734231 May 07 21:49:20.863978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 639/1220] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:20 2022] GET /compute/v2.1/images/c28ccbda-bbb7-4b18-bca6-6b8cbbcf49f9 => generated 62 bytes in 736 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:21.203015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:21.227476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c604756-c707-404f-810c-0345b26c8929 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cacc280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:21.238891 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e1ae710-6b63-405c-90f1-025031c4a222 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.426100 May 07 21:49:21.256548 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 582/1221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:20 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:21.345408 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c604756-c707-404f-810c-0345b26c8929 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.125400 May 07 21:49:21.352077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 640/1222] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:21 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:22.259520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:22.260149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:22.272320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:22.272922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:22.277627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:22.280319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:22.360740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f131543a-8ab3-4148-b49c-f9c77c41e629 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41caccc10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:22.462381 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f131543a-8ab3-4148-b49c-f9c77c41e629 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.107200 May 07 21:49:22.464305 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 641/1223] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:22 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:22.541532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:22.556180 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-987a2d85-f1d7-4cd5-abbb-00317527a412 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.300135 May 07 21:49:22.557520 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 583/1224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:22 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:23.089845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3cfbb362-ec6e-41d7-838f-940b34034c96 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Calling method '.version_select at 0x7fc41cadd4c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:23.107715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cfbb362-ec6e-41d7-838f-940b34034c96 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:23.108236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cfbb362-ec6e-41d7-838f-940b34034c96 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:23.109448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cfbb362-ec6e-41d7-838f-940b34034c96 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:23.109958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cfbb362-ec6e-41d7-838f-940b34034c96 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:23.145128 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3cfbb362-ec6e-41d7-838f-940b34034c96 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] 10.222.0.32 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.641684 May 07 21:49:23.147967 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 642/1225] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:49:23.390145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4bde80bf-9496-40e3-bdc1-6ca0d7ea8639 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1669681457", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:23.475015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-4bde80bf-9496-40e3-bdc1-6ca0d7ea8639 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:49:23.476445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f2dba02-7dd9-471d-9a4c-dcb17ac83d51 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cadd940>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:23.578016 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f2dba02-7dd9-471d-9a4c-dcb17ac83d51 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.105256 May 07 21:49:23.584492 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 643/1226] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:23 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:23.600387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:23.601046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:23.636811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:23.637275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:23.638130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:23.638605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:23.921611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4bde80bf-9496-40e3-bdc1-6ca0d7ea8639 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Getting quotas for project 273e6b1d35a44caaafcda83f27d0a744. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:23.926556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4bde80bf-9496-40e3-bdc1-6ca0d7ea8639 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Getting quotas for user e3d508ca036e4ac5aae50cc67eb63bbf and project 273e6b1d35a44caaafcda83f27d0a744. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:23.934275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:23.950641 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-4bde80bf-9496-40e3-bdc1-6ca0d7ea8639 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 07 21:49:23.951486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4bde80bf-9496-40e3-bdc1-6ca0d7ea8639 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:23.955866 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4bde80bf-9496-40e3-bdc1-6ca0d7ea8639 tempest-AbsoluteLimitsNegativeTestJSON-1648799684 tempest-AbsoluteLimitsNegativeTestJSON-1648799684-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.571187 May 07 21:49:23.956168 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79c60570-4ead-455c-87a6-7b4b99f8dc3e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.370396 May 07 21:49:23.956785 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 644/1227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:23 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:23.959695 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 584/1228] 10.222.0.32 () {60 vars in 1147 bytes} [Sat May 7 21:49:23 2022] POST /compute/v2.1/servers => generated 87 bytes in 576 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:24.592258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1790c4eb-9177-4dc7-9878-da3bc02c5cf8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb949d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:24.698004 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1790c4eb-9177-4dc7-9878-da3bc02c5cf8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.110525 May 07 21:49:24.701495 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 585/1229] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:24 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:24.885847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0991e844-efb7-48f5-9dad-0bda8820375c tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1983951957", "id": 402019157, "os-flavor-access:is_public": "False"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:24.888175 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:24.888175 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:24.917324 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0991e844-efb7-48f5-9dad-0bda8820375c tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.500843 May 07 21:49:24.924622 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 645/1230] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:24 2022] POST /compute/v2.1/flavors => generated 436 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:24.931355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1e94251-6bd1-45a5-b7b6-bf93cc3bfd2e tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9e8e0d71ab744caca68c43441b435233"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:24.933078 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:24.933078 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:24.977890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:24.979015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:24.994735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:24.996467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:24.997433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:24.998072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:25.352402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:25.367967 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa890d5c-4307-45d1-b62a-dd09d8259242 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.394211 May 07 21:49:25.372778 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 646/1231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:24 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:25.495167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f781765-358a-4c4c-9d22-d68bb776b595 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41caddaf0>, body: {"keypair": {"name": "tempest-keypair-1898919812"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:25.518193 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1e94251-6bd1-45a5-b7b6-bf93cc3bfd2e tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/402019157/action" status: 200 len: 96 microversion: 2.1 time: 0.591017 May 07 21:49:25.521502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2f781765-358a-4c4c-9d22-d68bb776b595 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:25.526145 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 586/1232] 10.222.0.32 () {60 vars in 1196 bytes} [Sat May 7 21:49:24 2022] POST /compute/v2.1/flavors/402019157/action => generated 96 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:49:25.528842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2f781765-358a-4c4c-9d22-d68bb776b595 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:25.533154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1336370878", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "38d1a38e-1f99-466b-bf7f-940113b4b6ed"}], "block_device_mapping_v2": [{"uuid": "3864f924-91b4-4015-ab37-8bdbf8ad652d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:25.642591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] validate_networks() for [('38d1a38e-1f99-466b-bf7f-940113b4b6ed', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:49:25.929839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2f781765-358a-4c4c-9d22-d68bb776b595 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:25.937908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2f781765-358a-4c4c-9d22-d68bb776b595 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:25.967357 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f781765-358a-4c4c-9d22-d68bb776b595 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.593098 May 07 21:49:25.968334 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 647/1233] 10.222.0.32 () {62 vars in 1197 bytes} [Sat May 7 21:49:25 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 595 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:25.973221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3a4b267-59ba-4c96-8df9-027f02f897de tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9e8e0d71ab744caca68c43441b435233"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:25.974831 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:25.974831 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:26.354498 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-d3a4b267-59ba-4c96-8df9-027f02f897de tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 9e8e0d71ab744caca68c43441b435233 combination. May 07 21:49:26.355228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3a4b267-59ba-4c96-8df9-027f02f897de tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 9e8e0d71ab744caca68c43441b435233 combination. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:26.362925 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3a4b267-59ba-4c96-8df9-027f02f897de tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/402019157/action" status: 409 len: 152 microversion: 2.1 time: 0.393186 May 07 21:49:26.364368 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 648/1234] 10.222.0.32 () {60 vars in 1196 bytes} [Sat May 7 21:49:25 2022] POST /compute/v2.1/flavors/402019157/action => generated 152 bytes in 395 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:26.374634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-023441eb-9559-4f01-8c14-c11eeb2b82b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cade3a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:26.455548 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-023441eb-9559-4f01-8c14-c11eeb2b82b4 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.089858 May 07 21:49:26.464752 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 649/1235] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:26 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:26.494339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e6398ee8-454c-4311-b73d-ab8d6247786e tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb46790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:26.533229 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e6398ee8-454c-4311-b73d-ab8d6247786e tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-1898919812" status: 200 len: 706 microversion: 2.2 time: 0.063965 May 07 21:49:26.534289 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 650/1236] 10.222.0.32 () {60 vars in 1257 bytes} [Sat May 7 21:49:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1898919812 => generated 706 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:26.544997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd8cadd4-7dbd-4d43-9c2e-4564d162d7ba tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9e8e0d71ab744caca68c43441b435233"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:26.548173 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:26.548173 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:26.688894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:49:26.689575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:49:26.690285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:49:26.692637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:49:26.693364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:49:26.722688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:26.725657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:26.730158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:26.731015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:26.773732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:26.783480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Getting quotas for user 99e9b91d4fb949f18cc61bf2bbd63ab6 and project 4db49857a44d4f399959ac625886505a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:26.965783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:49:26.968334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3864f924-91b4-4015-ab37-8bdbf8ad652d',volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:49:27.188737 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd8cadd4-7dbd-4d43-9c2e-4564d162d7ba tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/402019157/action" status: 200 len: 21 microversion: 2.1 time: 0.646993 May 07 21:49:27.190955 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 651/1237] 10.222.0.32 () {60 vars in 1196 bytes} [Sat May 7 21:49:26 2022] POST /compute/v2.1/flavors/402019157/action => generated 21 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:49:27.201141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:27.208570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:27.227044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:27.228702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:27.229882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:27.231265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:27.280138 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a71eddce-80d9-47b9-a3a4-829c27add257 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.750442 May 07 21:49:27.284366 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 587/1238] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:49:27.304540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a211086f-30ae-4654-8155-9a355cb0d8c1 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb91e50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:27.376021 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a211086f-30ae-4654-8155-9a355cb0d8c1 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898919812" status: 204 len: 0 microversion: 2.2 time: 0.090256 May 07 21:49:27.377930 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 588/1239] 10.222.0.32 () {60 vars in 1260 bytes} [Sat May 7 21:49:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898919812 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:27.384142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-11b2e25a-263b-4099-83a5-d0eb3845eb7e tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:27.386366 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:27.386366 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:27.445612 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-11b2e25a-263b-4099-83a5-d0eb3845eb7e tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/402019157" status: 202 len: 0 microversion: 2.1 time: 0.066318 May 07 21:49:27.446968 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 589/1240] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:27 2022] DELETE /compute/v2.1/flavors/402019157 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:27.453182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-828f9b20-0aab-4128-b6cf-72504315c09e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:27.454236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-828f9b20-0aab-4128-b6cf-72504315c09e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:27.592155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-828f9b20-0aab-4128-b6cf-72504315c09e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:27.616965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-828f9b20-0aab-4128-b6cf-72504315c09e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:27.621916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-828f9b20-0aab-4128-b6cf-72504315c09e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:27.626765 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-828f9b20-0aab-4128-b6cf-72504315c09e tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1104 microversion: 2.25 time: 0.178400 May 07 21:49:27.627879 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 590/1241] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:27 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1104 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:27.637415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e6c94c1d-562b-4c32-9737-d4096146f889 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41cb470d0>, body: {"keypair": {"name": "tempest-keypair-246835343"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:27.669619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e6c94c1d-562b-4c32-9737-d4096146f889 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:27.681949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e6c94c1d-562b-4c32-9737-d4096146f889 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:28.044878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:28.059773 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53a8f3f7-cee0-400b-b101-d2a7cab9f393 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.865405 May 07 21:49:28.074784 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 652/1242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:27 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:28.092569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1516006413", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "28405dfe-908d-4039-91f6-1d02165b34cd"}], "block_device_mapping_v2": [{"uuid": "bc15f6da-d437-4012-98cf-feca629acbf3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:28.120738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e6c94c1d-562b-4c32-9737-d4096146f889 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:28.144611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e6c94c1d-562b-4c32-9737-d4096146f889 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:28.206110 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e6c94c1d-562b-4c32-9737-d4096146f889 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.2 time: 0.576943 May 07 21:49:28.206747 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 591/1243] 10.222.0.32 () {62 vars in 1197 bytes} [Sat May 7 21:49:27 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 578 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:28.229126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-08d9fd34-b7ca-4915-a9d7-f7d503a8184d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:28.245272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] validate_networks() for [('28405dfe-908d-4039-91f6-1d02165b34cd', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:49:28.300619 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-08d9fd34-b7ca-4915-a9d7-f7d503a8184d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086895 May 07 21:49:28.301261 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 592/1244] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:28.306792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1776e9cc-7fcc-4577-b5dc-1508cfc44534 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb7fdc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:28.410556 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1776e9cc-7fcc-4577-b5dc-1508cfc44534 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1438 microversion: 2.1 time: 0.108166 May 07 21:49:28.411593 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 593/1245] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:28 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:28.421824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aea4a5d0-8cb3-43b4-be40-8de0a5f3172e tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb47550>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:28.514167 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aea4a5d0-8cb3-43b4-be40-8de0a5f3172e tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-246835343" status: 204 len: 0 microversion: 2.2 time: 0.090351 May 07 21:49:28.518015 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 594/1246] 10.222.0.32 () {60 vars in 1257 bytes} [Sat May 7 21:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-246835343 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:28.542310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-97d92685-6615-474a-a29b-5106a42c9d45 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1288847527", "id": 489553139, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:28.552631 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:28.552631 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:28.638278 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-97d92685-6615-474a-a29b-5106a42c9d45 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.117033 May 07 21:49:28.659067 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 595/1247] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:28 2022] POST /compute/v2.1/flavors => generated 435 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:28.680705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f41feca5-3026-4e87-a13b-63ff86151c09 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41cb3a160>, body: {"keypair": {"name": "tempest-keypair-1197926344", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:28.763475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f41feca5-3026-4e87-a13b-63ff86151c09 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:28.798328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f41feca5-3026-4e87-a13b-63ff86151c09 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:28.879867 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f41feca5-3026-4e87-a13b-63ff86151c09 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.214707 May 07 21:49:28.885048 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 596/1248] 10.222.0.32 () {62 vars in 1198 bytes} [Sat May 7 21:49:28 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 221 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 07 21:49:28.890692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:28.891409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:28.904618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:28.904618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:28.904618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:28.904618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:29.052619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:29.087160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:29.093931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:29.098316 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2baf56c-dc2c-4185-8f48-bb0cbb3879a8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1233 microversion: 2.25 time: 0.214586 May 07 21:49:29.099508 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 597/1249] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:28 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1233 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:29.119891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8280b0bf-0264-436c-9c15-b3e81fb43fa6 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:29.123337 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:29.123337 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:29.134629 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8280b0bf-0264-436c-9c15-b3e81fb43fa6 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] HTTP exception thrown: Access list not available for public flavors. May 07 21:49:29.139700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8280b0bf-0264-436c-9c15-b3e81fb43fa6 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:29.140804 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8280b0bf-0264-436c-9c15-b3e81fb43fa6 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/489553139/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.039507 May 07 21:49:29.147116 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 598/1250] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 21:49:29 2022] GET /compute/v2.1/flavors/489553139/os-flavor-access => generated 91 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:29.158995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-588c8c61-c4de-4122-964a-cb5ab5866438 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb94e50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:29.207368 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-588c8c61-c4de-4122-964a-cb5ab5866438 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197926344" status: 204 len: 0 microversion: 2.2 time: 0.056289 May 07 21:49:29.208274 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 599/1251] 10.222.0.32 () {60 vars in 1260 bytes} [Sat May 7 21:49:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197926344 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:29.225538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:29.226186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:29.239892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:29.240358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:29.241666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:29.242129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:29.538661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:29.558216 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-80afe892-e4d4-40f2-a58e-b1d748028d63 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.348677 May 07 21:49:29.559462 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 600/1252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:29 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:29.578004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9054f4f0-0cab-4699-aeab-9aa34b26900c tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:29.578876 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:29.578876 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:29.603001 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9054f4f0-0cab-4699-aeab-9aa34b26900c tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/489553139" status: 202 len: 0 microversion: 2.1 time: 0.031302 May 07 21:49:29.604524 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 601/1253] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:49:29 2022] DELETE /compute/v2.1/flavors/489553139 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:29.611727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c782a3d2-5b00-46a2-bbfd-8951557f6c90 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41cb86940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-275346445"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:29.628073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c782a3d2-5b00-46a2-bbfd-8951557f6c90 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:29.632931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c782a3d2-5b00-46a2-bbfd-8951557f6c90 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:30.026213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:49:30.027904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:49:30.029039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:49:30.029620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:49:30.030199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:49:30.043588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:30.046645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:30.050440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:30.051713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:30.077955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:30.082351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Getting quotas for user 7dd9c30816a7410f94b10294234c1dc2 and project 1bcaffad5d3447b98f0216d3481045e5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:30.149285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c782a3d2-5b00-46a2-bbfd-8951557f6c90 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:30.159497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:49:30.161683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc15f6da-d437-4012-98cf-feca629acbf3',volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:49:30.170183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c782a3d2-5b00-46a2-bbfd-8951557f6c90 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:30.216335 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c782a3d2-5b00-46a2-bbfd-8951557f6c90 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.610484 May 07 21:49:30.221143 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 602/1254] 10.222.0.32 () {62 vars in 1197 bytes} [Sat May 7 21:49:29 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 615 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:30.227408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e336412-7ca8-42a0-a3af-a5ced2c48da3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb3ac10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:30.285492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5e336412-7ca8-42a0-a3af-a5ced2c48da3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1447 microversion: 2.1 time: 0.063162 May 07 21:49:30.293674 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 603/1255] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:30 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1447 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:30.298176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a2cf55d-eacd-4df9-b800-b1d4addc1e0c tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:30.350210 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a2cf55d-eacd-4df9-b800-b1d4addc1e0c tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055501 May 07 21:49:30.351217 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 604/1256] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:30.390101 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-139c68b9-cec4-4a7d-8cc8-c7a0dd4f34f1 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.311187 May 07 21:49:30.391629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 653/1257] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:49:30.397607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:30.398498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:30.407009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:30.407764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:30.408734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:30.409348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:30.557386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:30.576511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:30.581483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:30.583544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ada5a0ce-7c50-402d-b9e0-199bc08feab4 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cb94c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-608935030", "description": "tempest-description-1231676832"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:30.586104 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-16b44be7-d876-4424-b570-a54cdf36acf4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1251 microversion: 2.25 time: 0.191068 May 07 21:49:30.587680 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 654/1258] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:30 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1251 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:30.623520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-24a67527-be53-4424-a29c-e931ab5a2859 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41cabc550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-689136392"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:30.667603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-24a67527-be53-4424-a29c-e931ab5a2859 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:30.686361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-24a67527-be53-4424-a29c-e931ab5a2859 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:30.959053 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ada5a0ce-7c50-402d-b9e0-199bc08feab4 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.606032 May 07 21:49:30.960435 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 605/1259] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:49:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:30.967207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc209cd8-fb60-4711-9f47-7d7de16e6f09 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb3a940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:31.062106 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc209cd8-fb60-4711-9f47-7d7de16e6f09 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 200 len: 1447 microversion: 2.1 time: 0.099783 May 07 21:49:31.062958 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 606/1260] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:30 2022] GET /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 1447 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:31.075417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5360719c-e2eb-4f4f-95e7-b9829f3bff2a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-540381070", "id": 1007095509, "os-flavor-access:is_public": "False"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:31.077459 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:31.077459 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:31.114963 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5360719c-e2eb-4f4f-95e7-b9829f3bff2a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.050096 May 07 21:49:31.115586 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 607/1261] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:31 2022] POST /compute/v2.1/flavors => generated 438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:31.127734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1170452-6ada-4c07-825a-e02fa0d0e508 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:31.128395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1170452-6ada-4c07-825a-e02fa0d0e508 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:31.201123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-24a67527-be53-4424-a29c-e931ab5a2859 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:31.208711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-24a67527-be53-4424-a29c-e931ab5a2859 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:31.233159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f1170452-6ada-4c07-825a-e02fa0d0e508 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:31.245533 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-24a67527-be53-4424-a29c-e931ab5a2859 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.655950 May 07 21:49:31.246724 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 655/1262] 10.222.0.32 () {62 vars in 1197 bytes} [Sat May 7 21:49:30 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 658 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:31.253101 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1170452-6ada-4c07-825a-e02fa0d0e508 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1053 microversion: 2.1 time: 0.132957 May 07 21:49:31.253622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:31.254459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:31.263001 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 608/1263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:31 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1053 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:31.269359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:31.270043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:31.271085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:31.271363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-edeab2b5-5b7b-44df-b4eb-03b464dada71 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cb94a60>, body: {"security_group_rule": {"parent_group_id": "24dfbb90-f01b-4579-8eef-15a39d5a8575", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:31.271850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:31.501849 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-edeab2b5-5b7b-44df-b4eb-03b464dada71 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.237654 May 07 21:49:31.502849 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 609/1264] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:49:31 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:31.507013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8dc01b73-6c57-4a59-b96f-ed0c61b0f381 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cce5d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:31.752025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:31.763243 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-accd8532-5253-4fb1-a9e6-a6a35de3f423 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.515240 May 07 21:49:31.766375 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 656/1265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:31 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:31.962172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a45b080f-2392-4240-97c1-93e23c1596db tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9e8e0d71ab744caca68c43441b435233"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:31.967619 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:31.967619 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:31.968864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a45b080f-2392-4240-97c1-93e23c1596db tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '989bb6e140994164aa31fd17d2023f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e0d71ab744caca68c43441b435233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:31.969738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a45b080f-2392-4240-97c1-93e23c1596db tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:31.970749 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a45b080f-2392-4240-97c1-93e23c1596db tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] 10.222.0.32 "POST /compute/v2.1/flavors/1007095509/action" status: 403 len: 130 microversion: 2.1 time: 0.202436 May 07 21:49:31.979325 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 657/1266] 10.222.0.32 () {60 vars in 1199 bytes} [Sat May 7 21:49:31 2022] POST /compute/v2.1/flavors/1007095509/action => generated 130 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:31.984780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d4da410-130d-4151-8326-fb6e319dc0a7 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41ca880d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-588236699"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:32.037333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9d4da410-130d-4151-8326-fb6e319dc0a7 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:32.055427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9d4da410-130d-4151-8326-fb6e319dc0a7 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:32.310612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9d4da410-130d-4151-8326-fb6e319dc0a7 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:32.319125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9d4da410-130d-4151-8326-fb6e319dc0a7 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:32.380410 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d4da410-130d-4151-8326-fb6e319dc0a7 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.399586 May 07 21:49:32.385515 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 658/1267] 10.222.0.32 () {62 vars in 1197 bytes} [Sat May 7 21:49:31 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 401 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:32.391067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a13d9af9-bb66-4869-b3b7-ea672141829c tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cd96e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1347508193", "description": "tempest-description-619026935"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:32.501905 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8dc01b73-6c57-4a59-b96f-ed0c61b0f381 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 204 len: 0 microversion: 2.1 time: 0.998250 May 07 21:49:32.502603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 610/1268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:31 2022] DELETE /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 0 bytes in 1000 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:32.508184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:32.509202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:32.519374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:32.519873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:32.520778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:32.521224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:32.938046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:32.948866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:32.950405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:32.951987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cdf4a0af-01f4-41dc-ba76-7cb779f82159 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1281 microversion: 2.25 time: 0.448187 May 07 21:49:32.952748 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 611/1269] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:32 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1281 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:32.962758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-216d5632-a564-490d-be97-5434a2989674 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:32.964291 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:32.964291 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:32.999508 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-216d5632-a564-490d-be97-5434a2989674 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1007095509" status: 202 len: 0 microversion: 2.1 time: 0.045481 May 07 21:49:33.002528 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 612/1270] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:49:32 2022] DELETE /compute/v2.1/flavors/1007095509 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:33.015192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:33.016221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:33.029257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:33.032089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:33.032997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:33.033604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:33.165492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:33.180217 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7f1ce943-a485-462e-81fc-7a48d71084c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1169 microversion: 2.1 time: 0.176301 May 07 21:49:33.181981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 613/1271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:33 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1169 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:33.208813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b8124e5d-3af7-453c-90a5-d09e666f7aa3 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb7f1f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:33.214589 ncdv-master-1 devstack@n-api.service[136682]: WARNING oslo_db.sqlalchemy.utils [None req-b8124e5d-3af7-453c-90a5-d09e666f7aa3 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Unique keys not in sort_keys. The sorting order may be unstable. May 07 21:49:33.234067 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b8124e5d-3af7-453c-90a5-d09e666f7aa3 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 1721 microversion: 2.2 time: 0.041502 May 07 21:49:33.234932 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 614/1272] 10.222.0.32 () {60 vars in 1176 bytes} [Sat May 7 21:49:33 2022] GET /compute/v2.1/os-keypairs => generated 1721 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:33.244419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:33.245258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:33.255714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:33.256525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:33.257605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:33.258309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:33.290468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:49:33.398254 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a13d9af9-bb66-4869-b3b7-ea672141829c tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.014840 May 07 21:49:33.404742 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 659/1273] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:49:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:33.404742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:33.405091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:33.434714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:33.435203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:33.436173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:33.439071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:33.453212 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-29dd2dc3-b528-4127-bcb2-7c026e2eaab8 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 204 len: 0 microversion: 2.1 time: 0.216584 May 07 21:49:33.453898 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 615/1274] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:33 2022] DELETE /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:33.481884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3c106865-00ef-4e54-9749-500f11addf03 req-d1e3a53d-2fb3-4819-b170-9de4af043856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c766eaa8-8e8e-4135-9b5d-dfdaad014172", "name": "network-vif-unplugged", "status": "completed", "tag": "1543b45e-f40e-472d-975d-d79ddefecdd6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:33.493601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3c106865-00ef-4e54-9749-500f11addf03 req-d1e3a53d-2fb3-4819-b170-9de4af043856 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:33.494097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3c106865-00ef-4e54-9749-500f11addf03 req-d1e3a53d-2fb3-4819-b170-9de4af043856 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:33.509800 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3c106865-00ef-4e54-9749-500f11addf03 req-d1e3a53d-2fb3-4819-b170-9de4af043856 service nova] Creating event network-vif-unplugged:1543b45e-f40e-472d-975d-d79ddefecdd6 for instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 on nch1-master-1 May 07 21:49:33.520645 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3c106865-00ef-4e54-9749-500f11addf03 req-d1e3a53d-2fb3-4819-b170-9de4af043856 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061630 May 07 21:49:33.521781 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 616/1275] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:33.536585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f59cbcba-8d6a-4058-b878-9af6efc4014a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:33.583476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f59cbcba-8d6a-4058-b878-9af6efc4014a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058763 May 07 21:49:33.598737 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 617/1276] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:33.612614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-32377ac7-9875-4b30-89e2-8d9443f14ede tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cd08280>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:33.654401 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-32377ac7-9875-4b30-89e2-8d9443f14ede tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-588236699" status: 204 len: 0 microversion: 2.2 time: 0.053614 May 07 21:49:33.656236 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 618/1277] 10.222.0.32 () {60 vars in 1317 bytes} [Sat May 7 21:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-588236699 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:33.670052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e3897d5-780b-4dec-8d09-40c62d1cd1f9 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cc505e0>, body: {"security_group_rule": {"parent_group_id": "298d6f93-1b46-4e36-bc08-b4d1fe72fba5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:33.885701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:33.899103 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96fcd764-533f-46f4-aa44-3ad60e66c9ff tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.495315 May 07 21:49:33.901377 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 660/1278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:33 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:33.919506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-04a051c9-5dba-49e3-a7f3-e442062759df tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2101077921", "id": 1459545479, "os-flavor-access:is_public": "False"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:33.921551 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:33.921551 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:33.953018 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-04a051c9-5dba-49e3-a7f3-e442062759df tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.049757 May 07 21:49:33.954549 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 661/1279] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:33.973205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-886284731", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "d3775254-6c3d-4b27-a2f1-ae073d9f981d"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:34.041011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] validate_networks() for [('d3775254-6c3d-4b27-a2f1-ae073d9f981d', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:49:34.234377 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8e3897d5-780b-4dec-8d09-40c62d1cd1f9 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.568138 May 07 21:49:34.235206 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 619/1280] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:49:33 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:34.253148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3f5145b-f622-477d-8f57-ee6e47299175 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb3af70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:34.297865 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a3f5145b-f622-477d-8f57-ee6e47299175 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-689136392" status: 204 len: 0 microversion: 2.2 time: 0.061489 May 07 21:49:34.312889 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 620/1281] 10.222.0.32 () {60 vars in 1317 bytes} [Sat May 7 21:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-689136392 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:34.320506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea874d11-6b15-4828-9713-1624c2df1f50 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9e8e0d71ab744caca68c43441b435233"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:34.322623 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:34.322623 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:34.514318 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea874d11-6b15-4828-9713-1624c2df1f50 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1459545479/action" status: 200 len: 97 microversion: 2.1 time: 0.199578 May 07 21:49:34.516327 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 621/1282] 10.222.0.32 () {60 vars in 1199 bytes} [Sat May 7 21:49:34 2022] POST /compute/v2.1/flavors/1459545479/action => generated 97 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:49:34.523811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:34.524946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:34.532170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:34.533720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:34.534713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:34.535384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:34.798147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:34.811577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:34.815718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:34.823487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a11d3bdb-4edf-46e5-a8eb-52a3b57fb98f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1281 microversion: 2.25 time: 0.299301 May 07 21:49:34.824218 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 622/1283] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:34 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:34.831594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:34.833812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:34.857522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:34.858254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:34.859082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:34.859527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:35.278731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:35.289482 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ebb36f45-d449-41f5-9e26-cfd29ff482c7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.463959 May 07 21:49:35.290335 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 623/1284] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:34 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:35.295857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2909e554-cd10-4001-85fa-fb343167675d tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cb3a550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-665603394", "description": "tempest-description-1621786591"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:35.672989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:49:35.675392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:49:35.676165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:49:35.676815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:49:35.678071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:49:35.694717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:35.696187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:35.697299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:35.698175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:35.747778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:35.754678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Getting quotas for user c562e7dec6d34cd0a7fc7cea14fa5e74 and project bd92ab7de4f3456e82ccaa60aa378562. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:35.774834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:49:35.778879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:49:35.790824 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2909e554-cd10-4001-85fa-fb343167675d tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.498921 May 07 21:49:35.793392 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 624/1285] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:49:35 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:35.801474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-39bfc036-34ad-4406-b742-8fc138cad5ce tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb7fd30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:35.833755 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-39bfc036-34ad-4406-b742-8fc138cad5ce tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-275346445" status: 204 len: 0 microversion: 2.2 time: 0.038791 May 07 21:49:35.835886 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 625/1286] 10.222.0.32 () {60 vars in 1317 bytes} [Sat May 7 21:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-275346445 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:35.845853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff51251a-a686-4771-af85-6fb316e5ab3a tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9e8e0d71ab744caca68c43441b435233"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:35.847376 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:35.847376 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:35.848536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff51251a-a686-4771-af85-6fb316e5ab3a tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '989bb6e140994164aa31fd17d2023f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8e0d71ab744caca68c43441b435233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:35.849369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff51251a-a686-4771-af85-6fb316e5ab3a tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:35.850406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff51251a-a686-4771-af85-6fb316e5ab3a tempest-FlavorsAccessNegativeTestJSON-2008976500 tempest-FlavorsAccessNegativeTestJSON-2008976500-project] 10.222.0.32 "POST /compute/v2.1/flavors/1459545479/action" status: 403 len: 133 microversion: 2.1 time: 0.013404 May 07 21:49:35.853563 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 626/1287] 10.222.0.32 () {60 vars in 1199 bytes} [Sat May 7 21:49:35 2022] POST /compute/v2.1/flavors/1459545479/action => generated 133 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:35.859826 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6fa7aa57-3813-442c-a3e3-8a0e0cc02256 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.903002 May 07 21:49:35.863047 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 662/1288] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:49:35.869174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e67493b7-8a18-49e3-831a-aa2f04ba2e77 req-c68799de-f154-4bbe-97b0-b92864a9b1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef", "tag": "8b09d66b-7638-451c-902c-9a93667bb5b6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:35.880771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:35.881888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:35.890637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e67493b7-8a18-49e3-831a-aa2f04ba2e77 req-c68799de-f154-4bbe-97b0-b92864a9b1ff service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:35.892609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e67493b7-8a18-49e3-831a-aa2f04ba2e77 req-c68799de-f154-4bbe-97b0-b92864a9b1ff service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:35.913440 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e67493b7-8a18-49e3-831a-aa2f04ba2e77 req-c68799de-f154-4bbe-97b0-b92864a9b1ff service nova] Creating event network-changed:8b09d66b-7638-451c-902c-9a93667bb5b6 for instance 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef on nch2-master-1 May 07 21:49:35.924481 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e67493b7-8a18-49e3-831a-aa2f04ba2e77 req-c68799de-f154-4bbe-97b0-b92864a9b1ff service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058934 May 07 21:49:35.925876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 663/1289] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:35.931522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b5021ef-787e-4d78-90e3-8b22d999673f tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41caae940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1140681754", "description": "tempest-description-1560435883"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:35.939893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:35.940358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:35.941174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:35.941621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.213446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:36.236024 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1b828c7-55d2-4fd7-9707-0bbb678001b4 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.367648 May 07 21:49:36.236692 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 627/1290] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:35 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:36.248017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4000dda4-7b5d-448c-8941-611b5bf39b48 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41cb94c10>, body: {"keypair": {"name": "tempest-keypair-1196447815"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:36.291854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4000dda4-7b5d-448c-8941-611b5bf39b48 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:36.299676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4000dda4-7b5d-448c-8941-611b5bf39b48 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:36.404420 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b5021ef-787e-4d78-90e3-8b22d999673f tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.477499 May 07 21:49:36.407286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 664/1291] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:49:35 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:36.412018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:36.412744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:36.426433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:36.426939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.427886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:36.428327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.621151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4000dda4-7b5d-448c-8941-611b5bf39b48 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:36.625482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4000dda4-7b5d-448c-8941-611b5bf39b48 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:36.645630 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4000dda4-7b5d-448c-8941-611b5bf39b48 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.407113 May 07 21:49:36.646698 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 628/1292] 10.222.0.32 () {62 vars in 1197 bytes} [Sat May 7 21:49:36 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 409 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:36.657692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d94ce0fc-788d-4b49-b289-81b80547e22d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9e8e0d71ab744caca68c43441b435233"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:36.659026 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:36.659026 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:36.746383 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d94ce0fc-788d-4b49-b289-81b80547e22d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1459545479/action" status: 200 len: 21 microversion: 2.1 time: 0.098256 May 07 21:49:36.751102 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 629/1293] 10.222.0.32 () {60 vars in 1199 bytes} [Sat May 7 21:49:36 2022] POST /compute/v2.1/flavors/1459545479/action => generated 21 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:49:36.751964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:36.752588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:36.758664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:36.759166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.760016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:36.760470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.791492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:36.815219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:36.817283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:36.819516 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a61e0dde-8db7-475c-b032-53895e2f6b6d tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1281 microversion: 2.25 time: 0.411234 May 07 21:49:36.830946 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 665/1294] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:36 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1281 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:36.836244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:36.837369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3fa20279-4ac0-46e8-8658-b3b30ce7c5b4 req-df298448-a663-4621-9d5b-335dda9ad500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c766eaa8-8e8e-4135-9b5d-dfdaad014172", "name": "network-vif-deleted", "tag": "1543b45e-f40e-472d-975d-d79ddefecdd6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:36.844904 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9731f32b-af24-42f9-b280-d1b11c41d4fa tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1211 microversion: 2.1 time: 0.096503 May 07 21:49:36.845582 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 630/1295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:36 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:36.852418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3fa20279-4ac0-46e8-8658-b3b30ce7c5b4 req-df298448-a663-4621-9d5b-335dda9ad500 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:36.855781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3fa20279-4ac0-46e8-8658-b3b30ce7c5b4 req-df298448-a663-4621-9d5b-335dda9ad500 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.867249 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3fa20279-4ac0-46e8-8658-b3b30ce7c5b4 req-df298448-a663-4621-9d5b-335dda9ad500 service nova] Creating event network-vif-deleted:1543b45e-f40e-472d-975d-d79ddefecdd6 for instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 on nch1-master-1 May 07 21:49:36.872242 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3fa20279-4ac0-46e8-8658-b3b30ce7c5b4 req-df298448-a663-4621-9d5b-335dda9ad500 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039682 May 07 21:49:36.873150 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 666/1296] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:36.879661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:36.880578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:36.888636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:36.889087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.889896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:36.890337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:36.921062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9bebe406-8ed6-4fe2-a01f-c5e9fb42e745 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Action: 'create', calling method: .version_select at 0x7fc41cc50f70>, body: {"keypair": {"name": "tempest-keypair-1026050338"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:36.935587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9bebe406-8ed6-4fe2-a01f-c5e9fb42e745 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Getting quotas for project 281216301a5449cdb4c66e9f35e6e582. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:36.939370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9bebe406-8ed6-4fe2-a01f-c5e9fb42e745 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Getting quotas for user 1e3abb274c044cc4b88d57193b5c62d2 and project 281216301a5449cdb4c66e9f35e6e582. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:37.243269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9bebe406-8ed6-4fe2-a01f-c5e9fb42e745 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Getting quotas for project 281216301a5449cdb4c66e9f35e6e582. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:37.248727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9bebe406-8ed6-4fe2-a01f-c5e9fb42e745 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Getting quotas for user 1e3abb274c044cc4b88d57193b5c62d2 and project 281216301a5449cdb4c66e9f35e6e582. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:37.256618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:37.266678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9bebe406-8ed6-4fe2-a01f-c5e9fb42e745 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.419667 May 07 21:49:37.269798 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 631/1297] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:49:36 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:37.275576 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84e184aa-c626-47d2-971f-920c6b8927d2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.400224 May 07 21:49:37.276415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0da0d9f3-a01d-4ef8-af87-ea122a073eea tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cb7fee0>, body: {"security_group_rule": {"parent_group_id": "b1dd49f9-0b01-4680-8de7-d77b07b7a863", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4b3c93ff-1e4b-451c-802d-7dd2ca808608"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:37.277944 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 667/1298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:36 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:37.299761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d9e72b2b-eaed-4a70-9175-f7b26500c1f4 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cc199d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:37.314474 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d9e72b2b-eaed-4a70-9175-f7b26500c1f4 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-1196447815" status: 200 len: 707 microversion: 2.2 time: 0.034109 May 07 21:49:37.327019 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 668/1299] 10.222.0.32 () {60 vars in 1257 bytes} [Sat May 7 21:49:37 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1196447815 => generated 707 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:37.333887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7ab80e2e-1449-4633-874c-3137fe4a3ee0 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:37.335279 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:37.335279 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:37.376808 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7ab80e2e-1449-4633-874c-3137fe4a3ee0 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1459545479" status: 202 len: 0 microversion: 2.1 time: 0.048084 May 07 21:49:37.377400 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 669/1300] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:49:37 2022] DELETE /compute/v2.1/flavors/1459545479 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:37.385405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:37.387071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:37.393967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:37.394744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:37.395769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:37.396430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:37.683882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:37.693152 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-edad3113-1a9e-4fb6-9837-486089462f7d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1541 microversion: 2.1 time: 0.311481 May 07 21:49:37.694674 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 670/1301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:37 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1541 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:37.707823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b4608eb7-4a21-4d82-8080-a7f49e7edbec tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41caf0ca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:37.711151 ncdv-master-1 devstack@n-api.service[136681]: WARNING oslo_db.sqlalchemy.utils [None req-b4608eb7-4a21-4d82-8080-a7f49e7edbec tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Unique keys not in sort_keys. The sorting order may be unstable. May 07 21:49:37.722398 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b4608eb7-4a21-4d82-8080-a7f49e7edbec tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.026293 May 07 21:49:37.723411 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 671/1302] 10.222.0.32 () {60 vars in 1176 bytes} [Sat May 7 21:49:37 2022] GET /compute/v2.1/os-keypairs => generated 564 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:37.736570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6acfe50e-b9e1-4abd-8257-718509853bad tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:37.773278 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6acfe50e-b9e1-4abd-8257-718509853bad tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048221 May 07 21:49:37.776553 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 672/1303] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:37.786715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bbf9461c-2aab-4803-b4ca-6481ced0f030 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cc19700>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:37.823079 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bbf9461c-2aab-4803-b4ca-6481ced0f030 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196447815" status: 204 len: 0 microversion: 2.2 time: 0.042804 May 07 21:49:37.830327 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 673/1304] 10.222.0.32 () {60 vars in 1260 bytes} [Sat May 7 21:49:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196447815 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:37.850063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-974a907a-44ea-4e4e-9a3d-e2a8553327ad tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-743164193", "id": 1376999867, "os-flavor-access:is_public": "False"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:37.860858 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:37.860858 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:37.891684 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-974a907a-44ea-4e4e-9a3d-e2a8553327ad tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.049431 May 07 21:49:37.901804 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 674/1305] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:37 2022] POST /compute/v2.1/flavors => generated 438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:37.913137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Action: 'create', calling method: .version_select at 0x7fc41cadbee0>, body: {"keypair": {"name": "tempest-keypair-221548859", "type": "x509"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:37.965833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:37.973177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:38.008048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.processutils [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpnpfu3u9m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnpfu3u9m/temp.key -subj /CN=737f5a73ba024d2989cce569bc1177d3 -extensions v3_req_client {{(pid=136681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:38.043929 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0da0d9f3-a01d-4ef8-af87-ea122a073eea tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.773995 May 07 21:49:38.044603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 632/1306] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:49:37 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:38.055383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:38.057080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:38.079898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:38.080358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:38.084371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:38.085052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:38.457736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:38.480887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:38.486219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.processutils [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpnpfu3u9m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpnpfu3u9m/temp.key -subj /CN=737f5a73ba024d2989cce569bc1177d3 -extensions v3_req_client" returned: 0 in 0.477s {{(pid=136681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:38.488136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.processutils [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpnpfu3u9m/temp.key -password pass: {{(pid=136681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 07 21:49:38.489101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:38.493842 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-17ed1a07-1cef-4a3e-926e-c36ae0ec0f50 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1281 microversion: 2.25 time: 0.445087 May 07 21:49:38.495001 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 633/1307] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:38 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1281 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:38.506681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:38.509470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:38.526377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:38.530957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:38.532478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:38.534158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:38.553410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.processutils [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpnpfu3u9m/temp.key -password pass:" returned: 0 in 0.065s {{(pid=136681) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 07 21:49:38.653085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:38.662233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Getting quotas for user 737f5a73ba024d2989cce569bc1177d3 and project 5cff54bc356c492ba7c917ff045462cc. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:38.664207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:38.671927 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ca2b7523-74a8-4ec4-8bd4-ce936fbb966f tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1265 microversion: 2.1 time: 0.174777 May 07 21:49:38.688850 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 634/1308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:38 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:38.696088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb5a4966-47b5-4e98-b6f8-0f96352643ff tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "de583b1aaef54fd483197444d6f601a6"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:38.700626 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:38.700626 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:38.713633 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bcad5e93-27e0-4e0f-a1b4-4ec5bb6c8324 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.805884 May 07 21:49:38.722263 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 675/1309] 10.222.0.32 () {62 vars in 1197 bytes} [Sat May 7 21:49:37 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 816 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:38.738882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ea8db21-a12f-42f0-b83e-d9344cd04619 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41caf0b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-590758216", "description": "tempest-description-759088779"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:38.804434 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-cb5a4966-47b5-4e98-b6f8-0f96352643ff tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] HTTP exception thrown: Flavor access not found for 40 / de583b1aaef54fd483197444d6f601a6 combination. May 07 21:49:38.805047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb5a4966-47b5-4e98-b6f8-0f96352643ff tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Returning 404 to user: Flavor access not found for 40 / de583b1aaef54fd483197444d6f601a6 combination. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:38.806391 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb5a4966-47b5-4e98-b6f8-0f96352643ff tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1376999867/action" status: 404 len: 124 microversion: 2.1 time: 0.116205 May 07 21:49:38.807043 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 635/1310] 10.222.0.32 () {60 vars in 1199 bytes} [Sat May 7 21:49:38 2022] POST /compute/v2.1/flavors/1376999867/action => generated 124 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:38.816166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a1597233-a6aa-4314-8b85-4658a1bfe9fe req-05b8ac7d-8f73-44d8-aed6-314a87fb36a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea4853a-41f9-43d9-b213-c627f5c9eb4e", "tag": "efb357b8-d8e7-40c3-b60d-4600d4ef216f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:38.826545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a1597233-a6aa-4314-8b85-4658a1bfe9fe req-05b8ac7d-8f73-44d8-aed6-314a87fb36a4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:38.827703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a1597233-a6aa-4314-8b85-4658a1bfe9fe req-05b8ac7d-8f73-44d8-aed6-314a87fb36a4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:38.842236 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a1597233-a6aa-4314-8b85-4658a1bfe9fe req-05b8ac7d-8f73-44d8-aed6-314a87fb36a4 service nova] Creating event network-changed:efb357b8-d8e7-40c3-b60d-4600d4ef216f for instance 5ea4853a-41f9-43d9-b213-c627f5c9eb4e on nch2-master-1 May 07 21:49:38.847573 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a1597233-a6aa-4314-8b85-4658a1bfe9fe req-05b8ac7d-8f73-44d8-aed6-314a87fb36a4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034859 May 07 21:49:38.848378 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 636/1311] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:38.853678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:38.854373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:38.870361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:38.871904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:38.872898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:38.873409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:39.107804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:39.116965 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a5b0f91-77b3-4a41-89f5-3d3d5877a400 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.267577 May 07 21:49:39.118447 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 637/1312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:38 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:39.125763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:39.139772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:39.146407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:39.147046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:39.148087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:39.148623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:39.352651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:39.367325 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d45d681-4889-42ed-9708-6388597b31ea tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1540 microversion: 2.1 time: 0.247300 May 07 21:49:39.368170 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 638/1313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:39 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1540 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:39.388905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-87b187df-57df-46a7-a470-c0485e6b6993 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb943a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:39.401836 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-87b187df-57df-46a7-a470-c0485e6b6993 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-221548859" status: 200 len: 1533 microversion: 2.2 time: 0.022223 May 07 21:49:39.410849 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 639/1314] 10.222.0.32 () {60 vars in 1254 bytes} [Sat May 7 21:49:39 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-221548859 => generated 1533 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:39.420379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8fe347cb-f52d-4eac-8445-a546e2feab4e tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:39.421650 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:39.421650 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:39.448074 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8fe347cb-f52d-4eac-8445-a546e2feab4e tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1376999867" status: 202 len: 0 microversion: 2.1 time: 0.035523 May 07 21:49:39.453000 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 640/1315] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:49:39 2022] DELETE /compute/v2.1/flavors/1376999867 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:39.459228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-793cf43d-ef55-40c1-be84-a2b5a2646ea0 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb474c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:39.462316 ncdv-master-1 devstack@n-api.service[136682]: WARNING oslo_db.sqlalchemy.utils [None req-793cf43d-ef55-40c1-be84-a2b5a2646ea0 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Unique keys not in sort_keys. The sorting order may be unstable. May 07 21:49:39.476152 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-793cf43d-ef55-40c1-be84-a2b5a2646ea0 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.021518 May 07 21:49:39.483201 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 641/1316] 10.222.0.32 () {60 vars in 1176 bytes} [Sat May 7 21:49:39 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:39.489180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9b4e26a7-52ab-4d4f-9fd2-c4973b57783f tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:39.514030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9b4e26a7-52ab-4d4f-9fd2-c4973b57783f tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028658 May 07 21:49:39.526512 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 642/1317] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:39.532123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce58a2b5-fa2b-41f9-afe4-08052f9e68d1 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] Calling method '.version_select at 0x7fc41cb479d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:39.575327 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce58a2b5-fa2b-41f9-afe4-08052f9e68d1 tempest-KeyPairsV22TestJSON-622321900 tempest-KeyPairsV22TestJSON-622321900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-221548859" status: 204 len: 0 microversion: 2.2 time: 0.047253 May 07 21:49:39.575928 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 643/1318] 10.222.0.32 () {60 vars in 1257 bytes} [Sat May 7 21:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-221548859 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:39.614940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:39.615670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:39.639478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:39.639941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:39.640750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:39.641193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:40.073356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:40.093556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:40.103123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:40.105041 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-445f2003-874c-4ca7-b5d0-1a76ea3fbbc4 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1281 microversion: 2.25 time: 0.510089 May 07 21:49:40.106348 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 644/1319] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:39 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1281 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:40.120117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:40.122042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:40.133200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:40.133897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:40.134907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:40.135889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:40.293250 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ea8db21-a12f-42f0-b83e-d9344cd04619 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.573342 May 07 21:49:40.293891 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 676/1320] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:49:38 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:40.298970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:40.300136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:40.309227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:40.309869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:40.310973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:40.311572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:40.806896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:40.834264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bff206f6-0dea-47a8-8ba4-6b7a3aaf268f tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.532714 May 07 21:49:40.838112 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 677/1321] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:40 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:40.852539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1c42a3ea-ff81-4968-bac0-ae16d676d3a4 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cc19280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-615521899", "description": "tempest-description-2022881111"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:40.979874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:40.999189 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4033819a-53a2-4f81-ae12-b9cd9a862b01 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1307 microversion: 2.1 time: 0.891349 May 07 21:49:41.000472 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 645/1322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:40 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1307 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:41.012210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:41.013145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:41.031939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:41.037261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:41.038197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:41.038663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:41.406152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:41.428183 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a63ee833-c995-42b0-95e6-b3f3588f9a14 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1540 microversion: 2.1 time: 0.422454 May 07 21:49:41.440516 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 646/1323] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:41 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1540 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:41.449842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-13f81bce-582a-4144-91b7-9c500fee71b9 req-fd274f58-7457-4300-a43f-06b09dde2aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "name": "network-vif-unplugged", "status": "completed", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:41.460955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-13f81bce-582a-4144-91b7-9c500fee71b9 req-fd274f58-7457-4300-a43f-06b09dde2aab service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:41.461438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-13f81bce-582a-4144-91b7-9c500fee71b9 req-fd274f58-7457-4300-a43f-06b09dde2aab service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:41.478406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-13f81bce-582a-4144-91b7-9c500fee71b9 req-fd274f58-7457-4300-a43f-06b09dde2aab service nova] Creating event network-vif-unplugged:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch2-master-1 May 07 21:49:41.487762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-13f81bce-582a-4144-91b7-9c500fee71b9 req-fd274f58-7457-4300-a43f-06b09dde2aab service nova] Instance bf92f729-2124-482e-b270-05ad87327f96 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:49:41.507803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-13f81bce-582a-4144-91b7-9c500fee71b9 req-fd274f58-7457-4300-a43f-06b09dde2aab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068888 May 07 21:49:41.510352 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 647/1324] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:41.519581 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1c42a3ea-ff81-4968-bac0-ae16d676d3a4 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.678943 May 07 21:49:41.526982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:41.527356 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 678/1325] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:49:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:41.527451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:41.530036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:41.530505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:41.531369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:41.531493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5107e99-32e1-4a28-83c5-ff264150aeaa tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cadb1f0>, body: {"security_group_rule": {"parent_group_id": "edaa12f3-10f7-4223-b7c5-db7d7270f0c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "35501d64-75fb-4e65-9627-416f804f2a43"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:41.531875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:41.968340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:41.981934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:41.983936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:41.985087 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6c12f80-36e5-412c-bf4d-3c87594797e2 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1281 microversion: 2.25 time: 0.471929 May 07 21:49:41.985848 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 648/1326] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:41 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:41.996394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dd582291-4231-4a41-94bc-8228d604426b req-26783c50-50f5-4028-a1fc-cfd121e3a691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25758f5c-a017-4e91-9486-d8ef2e6da85d", "tag": "cb812400-5de5-4055-b8c5-f05049026aa6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:42.015569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dd582291-4231-4a41-94bc-8228d604426b req-26783c50-50f5-4028-a1fc-cfd121e3a691 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.016019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dd582291-4231-4a41-94bc-8228d604426b req-26783c50-50f5-4028-a1fc-cfd121e3a691 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.028005 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dd582291-4231-4a41-94bc-8228d604426b req-26783c50-50f5-4028-a1fc-cfd121e3a691 service nova] Creating event network-changed:cb812400-5de5-4055-b8c5-f05049026aa6 for instance 25758f5c-a017-4e91-9486-d8ef2e6da85d on nch1-master-1 May 07 21:49:42.039675 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dd582291-4231-4a41-94bc-8228d604426b req-26783c50-50f5-4028-a1fc-cfd121e3a691 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047046 May 07 21:49:42.040084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 649/1327] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:42.049871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ec5e3ae1-0114-4e4d-aa47-c8c1d4f5a33a req-171ef086-e197-49e5-9e4b-f7eeb728457c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef", "name": "network-vif-plugged", "status": "completed", "tag": "8b09d66b-7638-451c-902c-9a93667bb5b6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:42.066762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ec5e3ae1-0114-4e4d-aa47-c8c1d4f5a33a req-171ef086-e197-49e5-9e4b-f7eeb728457c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.067269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ec5e3ae1-0114-4e4d-aa47-c8c1d4f5a33a req-171ef086-e197-49e5-9e4b-f7eeb728457c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.091066 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ec5e3ae1-0114-4e4d-aa47-c8c1d4f5a33a req-171ef086-e197-49e5-9e4b-f7eeb728457c service nova] Creating event network-vif-plugged:8b09d66b-7638-451c-902c-9a93667bb5b6 for instance 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef on nch2-master-1 May 07 21:49:42.097793 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ec5e3ae1-0114-4e4d-aa47-c8c1d4f5a33a req-171ef086-e197-49e5-9e4b-f7eeb728457c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056268 May 07 21:49:42.098867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 650/1328] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:42.106339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:42.107010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:42.115279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.115735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.117432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.117938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.436394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:42.445476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd4027e8-cf2d-4e51-a9e5-c53dc2733fd7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.345226 May 07 21:49:42.447999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 651/1329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:42 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:42.460964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:42.461673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:42.481073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.481974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.483013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.483867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.535230 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5107e99-32e1-4a28-83c5-ff264150aeaa tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.004616 May 07 21:49:42.542698 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 679/1330] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:49:41 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:42.546399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:42.547982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:42.561104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.561576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.562373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:42.562913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:42.722855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:42.730987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-83e09c3a-3fc0-4efe-a40f-4086538e5e39 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1307 microversion: 2.1 time: 0.279422 May 07 21:49:42.741747 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 652/1331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:42 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:42.748307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "cdb18e56-26d2-4f79-bcda-791d483028bc"}], "security_groups": [{"name": "tempest-securitygroup--1503297075"}], "key_name": "tempest-keypair-1026050338", "user_data": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:42.845706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:42.857753 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c132758-aad0-4c67-ab8d-331e2b145486 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1540 microversion: 2.1 time: 0.316481 May 07 21:49:42.858478 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 680/1332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:42 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1540 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:42.864210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d60e0d99-5a2e-4e77-9b62-fa2c8bb7a1fe tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41cadbaf0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:42.928706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] validate_networks() for [('cdb18e56-26d2-4f79-bcda-791d483028bc', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:49:43.251002 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d60e0d99-5a2e-4e77-9b62-fa2c8bb7a1fe tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/35501d64-75fb-4e65-9627-416f804f2a43" status: 202 len: 0 microversion: 2.1 time: 0.391246 May 07 21:49:43.251925 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 681/1333] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:42 2022] DELETE /compute/v2.1/os-security-groups/35501d64-75fb-4e65-9627-416f804f2a43 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:43.260464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:43.261248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:43.278298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.278760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.279588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.280043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.549589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:49:43.550100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:49:43.551881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:49:43.552306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:49:43.553897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:49:43.562152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:43.571648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:43.573238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:43.574416 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c421057-c149-4424-806b-9c34fb401a40 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1281 microversion: 2.25 time: 0.318001 May 07 21:49:43.589716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 682/1334] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:43 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1281 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:43.592490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.592952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.604275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.605852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.610895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3384a29b-2881-4499-b0ea-bcc24578e703 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41ca6bca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:43.656327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Getting quotas for project 281216301a5449cdb4c66e9f35e6e582. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:43.666794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Getting quotas for user 1e3abb274c044cc4b88d57193b5c62d2 and project 281216301a5449cdb4c66e9f35e6e582. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:43.694381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:49:43.697056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:49:43.754423 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c14e8a7-6406-4702-bc45-245304949f54 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.010731 May 07 21:49:43.760008 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 653/1335] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:49:42 2022] POST /compute/v2.1/servers => generated 409 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:49:43.760426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:43.761701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:43.769057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.769656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.770549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.771126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.787075 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3384a29b-2881-4499-b0ea-bcc24578e703 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/edaa12f3-10f7-4223-b7c5-db7d7270f0c7" status: 200 len: 246 microversion: 2.1 time: 0.192795 May 07 21:49:43.787944 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 683/1336] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:49:43 2022] GET /compute/v2.1/os-security-groups/edaa12f3-10f7-4223-b7c5-db7d7270f0c7 => generated 246 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:43.793027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-30a3bddb-6e71-42f9-924f-c9b75b9e6ee6 req-26c6e6d7-d412-4f45-992a-b5e5b760ff02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:43.802702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-30a3bddb-6e71-42f9-924f-c9b75b9e6ee6 req-26c6e6d7-d412-4f45-992a-b5e5b760ff02 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.803469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-30a3bddb-6e71-42f9-924f-c9b75b9e6ee6 req-26c6e6d7-d412-4f45-992a-b5e5b760ff02 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.820224 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-30a3bddb-6e71-42f9-924f-c9b75b9e6ee6 req-26c6e6d7-d412-4f45-992a-b5e5b760ff02 service nova] Creating event network-changed:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch2-master-1 May 07 21:49:43.829013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-30a3bddb-6e71-42f9-924f-c9b75b9e6ee6 req-26c6e6d7-d412-4f45-992a-b5e5b760ff02 service nova] Instance bf92f729-2124-482e-b270-05ad87327f96 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:49:43.842186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-30a3bddb-6e71-42f9-924f-c9b75b9e6ee6 req-26c6e6d7-d412-4f45-992a-b5e5b760ff02 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052312 May 07 21:49:43.843661 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 684/1337] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:43.851010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:43.852706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:43.861114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.861876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:43.863893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:43.864863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:44.103811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:44.115334 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-73fb6f0e-cf69-4c12-8c19-180cacc6d7a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.358501 May 07 21:49:44.115922 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 654/1338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:43 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:44.135149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-387dc78f-b7d1-4b82-9184-9621269ef29f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:44.135972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-387dc78f-b7d1-4b82-9184-9621269ef29f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:44.193368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:44.207961 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5088f884-6db7-4f10-8679-8353b260b79d tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1307 microversion: 2.1 time: 0.361914 May 07 21:49:44.211276 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 685/1339] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:43 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:44.228003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a537115-4881-49a2-b71b-119a2fb4512f tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cade700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2124432273", "description": "tempest-description-974815884"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:44.231699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-387dc78f-b7d1-4b82-9184-9621269ef29f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:44.241810 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-387dc78f-b7d1-4b82-9184-9621269ef29f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1226 microversion: 2.1 time: 0.113692 May 07 21:49:44.243629 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 655/1340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:44 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:44.249453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:44.250607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:44.288457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:44.289542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:44.290972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:44.296972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:44.636359 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a537115-4881-49a2-b71b-119a2fb4512f tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.423678 May 07 21:49:44.637501 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 686/1341] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:49:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:44.644561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5bc59d58-f958-47ee-ad96-593d92179ce5 req-d7926c26-8348-46f7-aab7-28c739e46459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea4853a-41f9-43d9-b213-c627f5c9eb4e", "name": "network-vif-plugged", "status": "completed", "tag": "efb357b8-d8e7-40c3-b60d-4600d4ef216f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:44.653094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:44.654529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5bc59d58-f958-47ee-ad96-593d92179ce5 req-d7926c26-8348-46f7-aab7-28c739e46459 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:44.655201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5bc59d58-f958-47ee-ad96-593d92179ce5 req-d7926c26-8348-46f7-aab7-28c739e46459 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:44.662619 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e05bc3e0-b727-47f9-bb4d-ca2eabce2c54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1472 microversion: 2.1 time: 0.417479 May 07 21:49:44.663254 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 656/1342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:44 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:44.682465 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5bc59d58-f958-47ee-ad96-593d92179ce5 req-d7926c26-8348-46f7-aab7-28c739e46459 service nova] Creating event network-vif-plugged:efb357b8-d8e7-40c3-b60d-4600d4ef216f for instance 5ea4853a-41f9-43d9-b213-c627f5c9eb4e on nch2-master-1 May 07 21:49:44.694614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:44.695844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:44.708654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:44.713825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:44.714688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:44.715168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:44.718099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5bc59d58-f958-47ee-ad96-593d92179ce5 req-d7926c26-8348-46f7-aab7-28c739e46459 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074786 May 07 21:49:44.719484 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 687/1343] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:44.726289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39af5c8d-0703-415e-a731-733dd39ff124 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41ca99820>, body: {"security_group_rule": {"parent_group_id": "fbaa15b5-9b20-47fa-98e6-74bd6e80f252", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:45.031329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:45.040561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:45.046433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:45.047776 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a8efa5b-358a-41b4-8878-68f5718004a9 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1477 microversion: 2.25 time: 0.370671 May 07 21:49:45.059842 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 657/1344] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:44 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1477 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:45.069772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:45.071631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:45.084903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:45.085832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:45.087364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:45.088250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:45.428193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:49:45.454849 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0635cf91-b343-4859-963e-d21e4ddea17f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1970 microversion: 2.25 time: 0.389792 May 07 21:49:45.455850 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 658/1345] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:45 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1970 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:45.462459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:45.463324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:45.472432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:45.473703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:45.477226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:45.478158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:45.652383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:45.662338 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f8a6fd5f-b03e-414e-925b-924161c7d535 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.205065 May 07 21:49:45.665062 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 659/1346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:45 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:45.672994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:45.673853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:45.682531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:45.683126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:45.683929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:45.684562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.051393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:46.060314 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e84ca635-f37e-49cc-9a9d-09b63ad38344 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1307 microversion: 2.1 time: 0.393151 May 07 21:49:46.066264 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 660/1347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:45 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1307 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:46.094542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:46.095530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:46.112162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.113214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.115093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.115916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.203033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-39af5c8d-0703-415e-a731-733dd39ff124 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.481990 May 07 21:49:46.204697 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 688/1348] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:49:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:46.221292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:46.222609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:46.238970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.239501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.243475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.244152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.319357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:46.329844 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7f8206f-faee-4052-a373-327e17319b66 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1296 microversion: 2.1 time: 0.245937 May 07 21:49:46.334972 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 661/1349] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:46 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1296 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:46.345265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:46.345946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:46.357672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.358140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.358982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.359569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.508873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:46.516360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:49:46.521060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab294d96-3be5-4fe9-bb3e-fd78a77261a1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1469 microversion: 2.1 time: 0.186936 May 07 21:49:46.521955 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 662/1350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:46 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:46.526509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c1ad56df-caeb-4d8b-a6fc-66f731bf027d tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Action: 'create', calling method: .version_select at 0x7fc41cb94940>, body: {"security_group_rule": {"parent_group_id": "fbaa15b5-9b20-47fa-98e6-74bd6e80f252", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:46.542803 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce1001b3-4ab6-4434-8964-c8aae2d67ddd tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1970 microversion: 2.25 time: 0.336478 May 07 21:49:46.556382 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 689/1351] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:46 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1970 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:46.576150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:46.576719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:46.602825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.603957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.611618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.612348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.679412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.680554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.681407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:46.683520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:46.723627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:46.729362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for user 3eb85bfb49aa4a519099c6f43ac77099 and project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:46.973559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48c3677e-5507-40d5-b542-762df8eea593 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96/action" status: 202 len: 0 microversion: 2.1 time: 0.412596 May 07 21:49:46.978857 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 690/1352] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:49:46 2022] POST /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:46.989621 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c1ad56df-caeb-4d8b-a6fc-66f731bf027d tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.465606 May 07 21:49:46.990939 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 663/1353] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:49:46 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:47.011178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:47.012057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:47.025299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.026229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.027266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.028513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d8c50ee-15fd-4c4c-ad06-498dc8c54452 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:47.029709 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:47.029709 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:47.031041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.031182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d8c50ee-15fd-4c4c-ad06-498dc8c54452 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.034659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d8c50ee-15fd-4c4c-ad06-498dc8c54452 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.035680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d8c50ee-15fd-4c4c-ad06-498dc8c54452 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.036141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d8c50ee-15fd-4c4c-ad06-498dc8c54452 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.135660 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d8c50ee-15fd-4c4c-ad06-498dc8c54452 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.154556 May 07 21:49:47.136337 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 691/1354] 10.222.0.32 () {60 vars in 1216 bytes} [Sat May 7 21:49:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:49:47.310290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Calling method '.version_select at 0x7fc41ca84160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:47.312008 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:47.312008 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:47.314246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.314858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.345120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:47.352494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.353467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.357828 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-516f6305-c458-48b7-b837-9606a857d8f5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1199 microversion: 2.1 time: 0.364800 May 07 21:49:47.358634 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 664/1355] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:46 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1199 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:47.364094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:47.364903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:47.373031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.373882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.374897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.376132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.384305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.384937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.402044 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2308fb48-055b-405a-8225-f0fb17d99dc3 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.257406 May 07 21:49:47.409223 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 692/1356] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:47.415071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e55e7b70-4b21-47b4-94d6-143d9fafd849 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41ca880d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:47.605903 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e55e7b70-4b21-47b4-94d6-143d9fafd849 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/fbaa15b5-9b20-47fa-98e6-74bd6e80f252" status: 200 len: 664 microversion: 2.1 time: 0.194716 May 07 21:49:47.606827 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 693/1357] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:49:47 2022] GET /compute/v2.1/os-security-groups/fbaa15b5-9b20-47fa-98e6-74bd6e80f252 => generated 664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:47.612809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-dc73365e-0b8d-4cb4-9cea-c2f6f5b3ec34 req-af57818b-4864-43ab-92ef-e3560abf0b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25758f5c-a017-4e91-9486-d8ef2e6da85d", "name": "network-vif-plugged", "status": "completed", "tag": "cb812400-5de5-4055-b8c5-f05049026aa6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:47.625029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dc73365e-0b8d-4cb4-9cea-c2f6f5b3ec34 req-af57818b-4864-43ab-92ef-e3560abf0b90 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.625838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dc73365e-0b8d-4cb4-9cea-c2f6f5b3ec34 req-af57818b-4864-43ab-92ef-e3560abf0b90 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.645364 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-dc73365e-0b8d-4cb4-9cea-c2f6f5b3ec34 req-af57818b-4864-43ab-92ef-e3560abf0b90 service nova] Creating event network-vif-plugged:cb812400-5de5-4055-b8c5-f05049026aa6 for instance 25758f5c-a017-4e91-9486-d8ef2e6da85d on nch1-master-1 May 07 21:49:47.651392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:47.670353 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-dc73365e-0b8d-4cb4-9cea-c2f6f5b3ec34 req-af57818b-4864-43ab-92ef-e3560abf0b90 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047075 May 07 21:49:47.671473 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 694/1358] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:47.683432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:47.683573 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f669ae2-37e4-46db-abcf-8f551329f787 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1468 microversion: 2.1 time: 0.323287 May 07 21:49:47.684148 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 665/1359] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:47 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:47.684284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:47.703913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:47.704318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.704785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.705663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.706254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.707052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:47.723528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.724181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.725717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:47.726313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:47.766444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'flavor' on Instance uuid 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:49:47.792403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Going to try to live migrate instance to nch1-master-1 {{(pid=136682) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:49:48.275068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:48.285894 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f7138c21-436a-4ed8-b7df-0179e97636e2 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1307 microversion: 2.1 time: 0.612894 May 07 21:49:48.286622 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 695/1360] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:47 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1307 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:48.299014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:48.305593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:48.325213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:48.328958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:48.332272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:48.332852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:48.864043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:48.883691 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e4bd251-a27a-4790-9916-f749c7500b80 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1352 microversion: 2.1 time: 0.595711 May 07 21:49:48.884328 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 696/1361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:48 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1352 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:48.894543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Calling method '.version_select at 0x7fc41cadee50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:48.897720 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:48.897720 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:48.898903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:48.899364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:48.926623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:48.928233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:49.008479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:49.008944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:49.017690 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d900b56-8bd0-4bd1-9ae9-2aeb0e2dd55b tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 512 microversion: 2.1 time: 0.132169 May 07 21:49:49.018753 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 697/1362] 10.222.0.32 () {58 vars in 1211 bytes} [Sat May 7 21:49:48 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 512 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:49.023811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-500decce-5c57-49c8-804a-4e7cada499b1 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41cadb790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:49.803769 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-500decce-5c57-49c8-804a-4e7cada499b1 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-group-rules/d20ee587-770c-4740-aaec-d903321d71fc" status: 202 len: 0 microversion: 2.1 time: 0.782950 May 07 21:49:49.809260 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 698/1363] 10.222.0.32 () {58 vars in 1286 bytes} [Sat May 7 21:49:49 2022] DELETE /compute/v2.1/os-security-group-rules/d20ee587-770c-4740-aaec-d903321d71fc => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:49.823524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:49.824602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:49.830960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:49.831704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:49.832696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:49.833415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.074101 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-846d25e0-1db9-4aa1-8a0f-46a803bf6cbc tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef/action" status: 202 len: 0 microversion: 2.25 time: 2.385997 May 07 21:49:50.075413 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 666/1364] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:49:47 2022] POST /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef/action => generated 0 bytes in 2388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:50.082582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:50.083489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:50.091701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.092417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.093384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.094026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.275248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:50.284078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5a025fe5-6316-47cc-8e78-4b9c695de67e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1383 microversion: 2.1 time: 0.478168 May 07 21:49:50.284665 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 699/1365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:49 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1383 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:50.293119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c12159e9-fe89-44cc-b3b0-d393d5903041 req-b3f91a70-7806-4fd8-9c07-bdd478b7c203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb2faa2-ee9e-47d3-a891-24cec328a4c2", "tag": "95a695cd-81c6-4f14-adb9-b284c5d977e3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:50.303382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c12159e9-fe89-44cc-b3b0-d393d5903041 req-b3f91a70-7806-4fd8-9c07-bdd478b7c203 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.303837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c12159e9-fe89-44cc-b3b0-d393d5903041 req-b3f91a70-7806-4fd8-9c07-bdd478b7c203 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.316398 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c12159e9-fe89-44cc-b3b0-d393d5903041 req-b3f91a70-7806-4fd8-9c07-bdd478b7c203 service nova] Creating event network-changed:95a695cd-81c6-4f14-adb9-b284c5d977e3 for instance bbb2faa2-ee9e-47d3-a891-24cec328a4c2 on nch2-master-1 May 07 21:49:50.322442 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c12159e9-fe89-44cc-b3b0-d393d5903041 req-b3f91a70-7806-4fd8-9c07-bdd478b7c203 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036381 May 07 21:49:50.323300 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 700/1366] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:50.328742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Calling method '.version_select at 0x7fc41ca6b3a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:50.329489 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:50.329489 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:50.330681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.331893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.348565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.349562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.363188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.363650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.371546 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06fedca7-9176-448d-b786-6e9c115114a9 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047167 May 07 21:49:50.372695 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 701/1367] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:49:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:50.386960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:50.389005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:50.399590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.400045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.401103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.402454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.667759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:50.692610 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6fcf2ba-bd56-4d22-b3fd-a29ddacda2f9 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1487 microversion: 2.1 time: 0.313473 May 07 21:49:50.695152 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 702/1368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:50 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1487 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:50.713051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d19b664f-819e-445d-8249-9464feaab129 req-693a7e59-a0e1-41de-b840-e03528a60883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "name": "network-vif-plugged", "status": "completed", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:50.725918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d19b664f-819e-445d-8249-9464feaab129 req-693a7e59-a0e1-41de-b840-e03528a60883 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.727226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d19b664f-819e-445d-8249-9464feaab129 req-693a7e59-a0e1-41de-b840-e03528a60883 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.743083 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d19b664f-819e-445d-8249-9464feaab129 req-693a7e59-a0e1-41de-b840-e03528a60883 service nova] Creating event network-vif-plugged:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch2-master-1 May 07 21:49:50.755630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-d19b664f-819e-445d-8249-9464feaab129 req-693a7e59-a0e1-41de-b840-e03528a60883 service nova] Instance bf92f729-2124-482e-b270-05ad87327f96 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:49:50.777303 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d19b664f-819e-445d-8249-9464feaab129 req-693a7e59-a0e1-41de-b840-e03528a60883 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078624 May 07 21:49:50.779097 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 703/1369] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:50.790062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-492fc289-9e09-4674-8019-84a291e1a082 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41cade9d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:50.824222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:50.835927 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6d72a40c-9f63-4d9e-9fa7-45ad046355ba tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1468 microversion: 2.1 time: 0.756798 May 07 21:49:50.846630 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 667/1370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:50 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1468 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:50.856504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:50.857145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:50.874529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.875201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:50.875998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:50.876447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.081319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-492fc289-9e09-4674-8019-84a291e1a082 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/fbaa15b5-9b20-47fa-98e6-74bd6e80f252" status: 202 len: 0 microversion: 2.1 time: 0.299820 May 07 21:49:51.082805 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 704/1371] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:50 2022] DELETE /compute/v2.1/os-security-groups/fbaa15b5-9b20-47fa-98e6-74bd6e80f252 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:51.091552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:51.099611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:51.129084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.129703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.130528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.131012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.331075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:51.340481 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15d78aa4-1a0c-46b0-ae4a-814525d47e19 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1352 microversion: 2.1 time: 0.492613 May 07 21:49:51.341091 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 668/1372] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:50 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1352 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:51.342567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:51.354688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b76e66fc-3a2f-4383-91e2-80d23ad31421 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:51.356545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:51.357163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b76e66fc-3a2f-4383-91e2-80d23ad31421 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:51.358277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:51.361525 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c954cf4-0822-411e-b1dd-101839dd469a tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.272959 May 07 21:49:51.363463 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 705/1373] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:51 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:51.376250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76e66fc-3a2f-4383-91e2-80d23ad31421 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.376715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76e66fc-3a2f-4383-91e2-80d23ad31421 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.377661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76e66fc-3a2f-4383-91e2-80d23ad31421 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.377957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76e66fc-3a2f-4383-91e2-80d23ad31421 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.379043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd0e179f-dd1e-4e81-a03a-babbef874e88 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Calling method '.version_select at 0x7fc41ca97310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:51.380137 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:51.380137 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:51.389467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd0e179f-dd1e-4e81-a03a-babbef874e88 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.392725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd0e179f-dd1e-4e81-a03a-babbef874e88 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.420168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd0e179f-dd1e-4e81-a03a-babbef874e88 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.420628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd0e179f-dd1e-4e81-a03a-babbef874e88 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.426869 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd0e179f-dd1e-4e81-a03a-babbef874e88 tempest-HypervisorAdminUnderV252Test-2102388072 tempest-HypervisorAdminUnderV252Test-2102388072-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.051414 May 07 21:49:51.427846 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 706/1374] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 21:49:51 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:51.433500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7aa46c82-67d3-4d54-af84-4d6540310c25 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-142420453"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:51.435447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7aa46c82-67d3-4d54-af84-4d6540310c25 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:51.449407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa46c82-67d3-4d54-af84-4d6540310c25 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.449875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa46c82-67d3-4d54-af84-4d6540310c25 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.450677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa46c82-67d3-4d54-af84-4d6540310c25 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.451164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa46c82-67d3-4d54-af84-4d6540310c25 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.792536 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7aa46c82-67d3-4d54-af84-4d6540310c25 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "POST /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d/action" status: 202 len: 0 microversion: 2.1 time: 0.363246 May 07 21:49:51.793184 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 707/1375] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:49:51 2022] POST /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 21:49:51.798831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e1398b17-92a3-4437-b560-380872f5b88a tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41ca88160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:51.808222 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b76e66fc-3a2f-4383-91e2-80d23ad31421 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1534 microversion: 2.1 time: 0.461629 May 07 21:49:51.809229 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 669/1376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:51 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1534 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:51.831597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-26e60add-c585-4b49-9712-7f92d35ff33b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cabbca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:51.839930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-e1398b17-92a3-4437-b560-380872f5b88a tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 35501d64-75fb-4e65-9627-416f804f2a43 does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:49:51.840727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-e1398b17-92a3-4437-b560-380872f5b88a tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Neutron security group 35501d64-75fb-4e65-9627-416f804f2a43 not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:49:51.841288 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e1398b17-92a3-4437-b560-380872f5b88a tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] HTTP exception thrown: Security group 35501d64-75fb-4e65-9627-416f804f2a43 does not exist May 07 21:49:51.841288 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-2af56c81-4690-424c-9a76-bd7848a1749a'] May 07 21:49:51.841917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e1398b17-92a3-4437-b560-380872f5b88a tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Returning 404 to user: Security group 35501d64-75fb-4e65-9627-416f804f2a43 does not exist May 07 21:49:51.841917 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-2af56c81-4690-424c-9a76-bd7848a1749a'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:51.842892 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e1398b17-92a3-4437-b560-380872f5b88a tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/35501d64-75fb-4e65-9627-416f804f2a43" status: 404 len: 194 microversion: 2.1 time: 0.048333 May 07 21:49:51.844865 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 708/1377] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:51 2022] DELETE /compute/v2.1/os-security-groups/35501d64-75fb-4e65-9627-416f804f2a43 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:49:51.855337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e33fb23c-9275-465b-9e39-9a81b4b19c87 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:51.857325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e33fb23c-9275-465b-9e39-9a81b4b19c87 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:51.864153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e33fb23c-9275-465b-9e39-9a81b4b19c87 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.864965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e33fb23c-9275-465b-9e39-9a81b4b19c87 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.866083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e33fb23c-9275-465b-9e39-9a81b4b19c87 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.866723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e33fb23c-9275-465b-9e39-9a81b4b19c87 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.900736 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-26e60add-c585-4b49-9712-7f92d35ff33b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f" status: 200 len: 1411 microversion: 2.1 time: 0.088495 May 07 21:49:51.901642 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 670/1378] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:51 2022] GET /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:51.906844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:51.907678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:51.915131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.915842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:51.916791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:51.917417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:52.080038 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e33fb23c-9275-465b-9e39-9a81b4b19c87 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1534 microversion: 2.1 time: 0.230663 May 07 21:49:52.094083 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 709/1379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:51 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1534 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:52.100223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21f3a953-4e48-4308-972a-c6e163ab0075 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41cb46280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:52.487127 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-21f3a953-4e48-4308-972a-c6e163ab0075 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/edaa12f3-10f7-4223-b7c5-db7d7270f0c7" status: 202 len: 0 microversion: 2.1 time: 0.391802 May 07 21:49:52.487688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 710/1380] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:52 2022] DELETE /compute/v2.1/os-security-groups/edaa12f3-10f7-4223-b7c5-db7d7270f0c7 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:52.493066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4daf5534-c94e-4af4-959e-50f5cea13b81 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41ca97940>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:52.544942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:52.556807 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dfc3c7ea-efef-4dd7-a002-90513ee87ba7 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1534 microversion: 2.1 time: 0.653747 May 07 21:49:52.572499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 671/1381] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:51 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1534 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:52.577055 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4daf5534-c94e-4af4-959e-50f5cea13b81 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f" status: 200 len: 1411 microversion: 2.1 time: 0.087970 May 07 21:49:52.577812 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 711/1382] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:52 2022] GET /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:52.584450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:52.589513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:52.592049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-487deaa2-f275-4dfc-a0eb-c5962614a810 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:52.597404 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:52.597404 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:52.599633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:52.600101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:52.600901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:52.601356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:52.602567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-487deaa2-f275-4dfc-a0eb-c5962614a810 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:52.604292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-487deaa2-f275-4dfc-a0eb-c5962614a810 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:52.605552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-487deaa2-f275-4dfc-a0eb-c5962614a810 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:52.606169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-487deaa2-f275-4dfc-a0eb-c5962614a810 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:52.647640 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-487deaa2-f275-4dfc-a0eb-c5962614a810 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073149 May 07 21:49:52.654989 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 672/1383] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:49:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:52.662184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:52.663332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:52.670090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:52.670988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:52.672024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:52.672693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:52.896644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:52.908102 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8eb707f0-d76d-4e2d-b703-d7e4ab7449f6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1352 microversion: 2.1 time: 0.329209 May 07 21:49:52.920617 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 712/1384] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:52 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1352 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:52.926242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d8eddc2-1c95-4c8a-84dc-32ef9b22bc43 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41ca88670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:53.396364 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d8eddc2-1c95-4c8a-84dc-32ef9b22bc43 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/4b3c93ff-1e4b-451c-802d-7dd2ca808608" status: 202 len: 0 microversion: 2.1 time: 0.474202 May 07 21:49:53.398421 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 713/1385] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:52 2022] DELETE /compute/v2.1/os-security-groups/4b3c93ff-1e4b-451c-802d-7dd2ca808608 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:53.421169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02b57ede-9df7-4505-8149-5ee56d8d905a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41ca97e50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:53.606850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:53.628897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:53.630369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:53.637529 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d5f4dcb2-a0af-47c9-8f47-90082278b36f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.980783 May 07 21:49:53.638139 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 673/1386] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:52 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:53.645273 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-02b57ede-9df7-4505-8149-5ee56d8d905a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f" status: 204 len: 0 microversion: 2.1 time: 0.245469 May 07 21:49:53.647069 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 714/1387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:53 2022] DELETE /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:53.655617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d81f55be-de1c-495b-8f59-c69e06d8c442 req-bdb59e50-4dc8-4e7f-ac73-c27892667f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "name": "network-vif-unplugged", "status": "completed", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:53.667680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:53.669743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:53.679949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:53.680680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:53.681896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:53.682859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:53.688973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d81f55be-de1c-495b-8f59-c69e06d8c442 req-bdb59e50-4dc8-4e7f-ac73-c27892667f66 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:53.693247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d81f55be-de1c-495b-8f59-c69e06d8c442 req-bdb59e50-4dc8-4e7f-ac73-c27892667f66 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:53.720682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lazy-loading 'flavor' on Instance uuid 5ea4853a-41f9-43d9-b213-c627f5c9eb4e {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:49:53.722382 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d81f55be-de1c-495b-8f59-c69e06d8c442 req-bdb59e50-4dc8-4e7f-ac73-c27892667f66 service nova] Creating event network-vif-unplugged:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch1-master-1 May 07 21:49:53.735243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Going to try to live migrate instance to nch1-master-1 {{(pid=136682) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:49:53.736868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-d81f55be-de1c-495b-8f59-c69e06d8c442 req-bdb59e50-4dc8-4e7f-ac73-c27892667f66 service nova] Instance bf92f729-2124-482e-b270-05ad87327f96 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:49:53.765688 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d81f55be-de1c-495b-8f59-c69e06d8c442 req-bdb59e50-4dc8-4e7f-ac73-c27892667f66 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117152 May 07 21:49:53.767830 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 715/1388] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:53.775603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-90996a6b-9266-48c8-aaa5-3a26c8879db1 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41caae430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:54.114461 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-90996a6b-9266-48c8-aaa5-3a26c8879db1 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/b1dd49f9-0b01-4680-8de7-d77b07b7a863" status: 202 len: 0 microversion: 2.1 time: 0.345140 May 07 21:49:54.115598 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 716/1389] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:53 2022] DELETE /compute/v2.1/os-security-groups/b1dd49f9-0b01-4680-8de7-d77b07b7a863 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:54.121232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:54.122049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:54.132877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:54.133349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:54.134151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:54.134714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:54.389414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:54.397548 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5bb2387-8ac5-401b-9803-2b42ee9fa32f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1534 microversion: 2.1 time: 0.280781 May 07 21:49:54.407092 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 717/1390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:54 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1534 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:54.412330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40bc7ebe-3e7b-4de8-87e3-9f39a3804a50 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41caaee50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:54.457681 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-40bc7ebe-3e7b-4de8-87e3-9f39a3804a50 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Image not found. May 07 21:49:54.458536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40bc7ebe-3e7b-4de8-87e3-9f39a3804a50 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:54.459903 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-40bc7ebe-3e7b-4de8-87e3-9f39a3804a50 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f" status: 404 len: 62 microversion: 2.1 time: 0.051498 May 07 21:49:54.467053 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 718/1391] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:54 2022] GET /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:54.473243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:54.473888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:54.483481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:54.484015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:54.485180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:54.485815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:54.747908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:54.759984 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1ef7b615-5f63-4417-98cb-03d6517b549c tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1352 microversion: 2.1 time: 0.291788 May 07 21:49:54.761371 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 719/1392] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:54 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1352 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:54.767522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-574a0092-1538-4d14-8422-1e8b45d113a4 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41ca881f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:55.142686 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-574a0092-1538-4d14-8422-1e8b45d113a4 tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/298d6f93-1b46-4e36-bc08-b4d1fe72fba5" status: 202 len: 0 microversion: 2.1 time: 0.378836 May 07 21:49:55.144135 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 720/1393] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:54 2022] DELETE /compute/v2.1/os-security-groups/298d6f93-1b46-4e36-bc08-b4d1fe72fba5 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:55.153456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:55.154384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:55.175712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:55.177575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:55.179228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:55.179866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:55.363843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:55.375224 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1eaef07-d49d-4a25-852d-d4598467cc16 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1500 microversion: 2.1 time: 0.228326 May 07 21:49:55.375988 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 721/1394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:55 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:55.392426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:55.393377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:55.401402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:55.403448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:55.404896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:55.406273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:55.614885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:55.634381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:55.638439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:55.640226 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db49c77e-0e53-4662-9e53-e5caa6e0fb39 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.262446 May 07 21:49:55.641456 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 722/1395] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:55 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:55.657065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97333f1f-c19a-4b7a-93da-76c9b76cd6dd tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] Calling method '.version_select at 0x7fc41caaec10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:55.975662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97333f1f-c19a-4b7a-93da-76c9b76cd6dd tempest-SecurityGroupRulesTestJSON-744216268 tempest-SecurityGroupRulesTestJSON-744216268-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/24dfbb90-f01b-4579-8eef-15a39d5a8575" status: 202 len: 0 microversion: 2.1 time: 0.332863 May 07 21:49:55.976460 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 723/1396] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:49:55 2022] DELETE /compute/v2.1/os-security-groups/24dfbb90-f01b-4579-8eef-15a39d5a8575 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:55.984644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:55.986182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:55.994820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:55.996262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:55.999176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:56.000172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:56.195691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:56.209959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1299ca10-9b8b-44c3-bf22-9bc2bddc36b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1534 microversion: 2.1 time: 0.232412 May 07 21:49:56.210688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 724/1397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:55 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1534 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:56.216744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:56.217626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:56.224866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:56.225349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:56.226151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:56.226605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:56.402037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:56.412147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6906cb8e-4687-44d2-a079-135cb99a3458 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1352 microversion: 2.1 time: 0.200295 May 07 21:49:56.422904 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 725/1398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:56 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1352 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:56.428122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-847bd4b9-aa38-4d1a-8e4e-9d78e1196b71 req-de9470bd-c81e-4418-8619-90de45a42dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:56.436597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-847bd4b9-aa38-4d1a-8e4e-9d78e1196b71 req-de9470bd-c81e-4418-8619-90de45a42dc7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:56.437376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-847bd4b9-aa38-4d1a-8e4e-9d78e1196b71 req-de9470bd-c81e-4418-8619-90de45a42dc7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:56.450951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-847bd4b9-aa38-4d1a-8e4e-9d78e1196b71 req-de9470bd-c81e-4418-8619-90de45a42dc7 service nova] Creating event network-changed:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch1-master-1 May 07 21:49:56.456600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-847bd4b9-aa38-4d1a-8e4e-9d78e1196b71 req-de9470bd-c81e-4418-8619-90de45a42dc7 service nova] Instance bf92f729-2124-482e-b270-05ad87327f96 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:49:56.469066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-847bd4b9-aa38-4d1a-8e4e-9d78e1196b71 req-de9470bd-c81e-4418-8619-90de45a42dc7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044498 May 07 21:49:56.470003 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 726/1399] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:56.580183 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-98d062fd-674c-49ce-aa03-dd86c5cdf8a1 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e/action" status: 202 len: 0 microversion: 2.1 time: 2.917463 May 07 21:49:56.581140 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 674/1400] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:49:53 2022] POST /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e/action => generated 0 bytes in 2942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:49:56.586098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:56.586725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:56.609422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:56.609882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:56.610906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:56.611584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:56.717893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ccb822ea-1045-4f85-8427-e9c108f73fee tempest-InstanceUsageAuditLogTestJSON-83939055 tempest-InstanceUsageAuditLogTestJSON-83939055-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:56.719249 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:56.719249 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:49:56.751420 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ccb822ea-1045-4f85-8427-e9c108f73fee tempest-InstanceUsageAuditLogTestJSON-83939055 tempest-InstanceUsageAuditLogTestJSON-83939055-project-admin] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-07 21:49:55" status: 200 len: 318 microversion: 2.1 time: 0.278942 May 07 21:49:56.753159 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 727/1401] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:49:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-07%2021%3A49%3A55 => generated 318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:56.842695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0d238137-fdd6-4e83-acd7-fb8692997eb2 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Action: 'create', calling method: .version_select at 0x7fc41caae5e0>, body: {"keypair": {"name": "tempest-keypair-503183074"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:56.865496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0d238137-fdd6-4e83-acd7-fb8692997eb2 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for project 487fc10ff315438ca2de090c396e3cfb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:56.874736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0d238137-fdd6-4e83-acd7-fb8692997eb2 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for user 63270cc27d704b5095bc8d1133544eeb and project 487fc10ff315438ca2de090c396e3cfb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:56.983877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:56.994153 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67972382-7378-459c-a3d0-fe1f8ed18e2a tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1487 microversion: 2.1 time: 0.411928 May 07 21:49:57.006760 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 675/1402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:56 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1487 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:57.021166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:57.022078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:57.030181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.031131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.032354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.033405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.117310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0d238137-fdd6-4e83-acd7-fb8692997eb2 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for project 487fc10ff315438ca2de090c396e3cfb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:49:57.124610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0d238137-fdd6-4e83-acd7-fb8692997eb2 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for user 63270cc27d704b5095bc8d1133544eeb and project 487fc10ff315438ca2de090c396e3cfb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:49:57.142733 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0d238137-fdd6-4e83-acd7-fb8692997eb2 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.385507 May 07 21:49:57.148218 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 728/1403] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:49:56 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:57.151398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:57.152298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:57.164259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.164259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.165963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.166656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.493066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:57.504965 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2815837-051f-4116-87d6-61c065d23c06 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.494570 May 07 21:49:57.505580 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 676/1404] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:57 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:57.518450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d6f9e7d-e0a5-440a-b1ad-f17a28d84d22 tempest-InstanceUsageAuditLogTestJSON-83939055 tempest-InstanceUsageAuditLogTestJSON-83939055-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:57.519490 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:49:57.519490 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:49:57.550300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:57.559115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:57.566125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:57.568783 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6c02e514-f8d0-46d6-955c-1d35d6dfcee5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.424076 May 07 21:49:57.577975 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d6f9e7d-e0a5-440a-b1ad-f17a28d84d22 tempest-InstanceUsageAuditLogTestJSON-83939055 tempest-InstanceUsageAuditLogTestJSON-83939055-project-admin] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.068686 May 07 21:49:57.580910 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 729/1405] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:57 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:57.581837 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 677/1406] 10.222.0.32 () {58 vars in 1184 bytes} [Sat May 7 21:49:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:57.592525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:57.598216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:57.602329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:57.606620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.607377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.608481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.609147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.613014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:57.629811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.630011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.638927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.650288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:49:57.652452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.823243 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2f5a30b-a332-4569-8da1-8cdf710564d1 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 204 len: 0 microversion: 2.1 time: 0.240834 May 07 21:49:57.824503 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 730/1407] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:57 2022] DELETE /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:57.842802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:57.844747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:57.865990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.866870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:57.875097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:57.876595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.113725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:58.140068 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9b44f1d8-a419-43bf-9bfd-ae958d38e976 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1534 microversion: 2.1 time: 0.549012 May 07 21:49:58.164260 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 678/1408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:57 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1534 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:58.174385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a87670c-6837-4e13-a270-283c138cdb60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cb21280>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:58.203295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:58.226329 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8a87670c-6837-4e13-a270-283c138cdb60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Image not found. May 07 21:49:58.227802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a87670c-6837-4e13-a270-283c138cdb60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:49:58.230501 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eff6dbc2-b098-406a-bd52-34a26e0cad95 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1352 microversion: 2.1 time: 0.403427 May 07 21:49:58.236860 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 731/1409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:57 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1352 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:58.249529 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a87670c-6837-4e13-a270-283c138cdb60 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f" status: 404 len: 62 microversion: 2.1 time: 0.081663 May 07 21:49:58.250460 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 679/1410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:58 2022] DELETE /compute/v2.1/images/49c4b948-f12b-44e5-b29e-1f09f62d7d5f => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:49:58.261810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:58.265039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:58.284036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:58.285022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.288552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:58.289441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.350739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:49:58.426994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-fb74bb88-5f23-460e-a7a1-cd2827e1f207 req-7245b15b-be92-4009-b3ea-8ea19b8c08bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb2faa2-ee9e-47d3-a891-24cec328a4c2", "name": "network-vif-plugged", "status": "completed", "tag": "95a695cd-81c6-4f14-adb9-b284c5d977e3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:58.458207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fb74bb88-5f23-460e-a7a1-cd2827e1f207 req-7245b15b-be92-4009-b3ea-8ea19b8c08bf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:58.459885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fb74bb88-5f23-460e-a7a1-cd2827e1f207 req-7245b15b-be92-4009-b3ea-8ea19b8c08bf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.497929 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.compute.api [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Instance is already in deleting state, ignoring this request May 07 21:49:58.501265 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff7b612a-7c75-450a-8e01-473e07402c80 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 204 len: 0 microversion: 2.1 time: 0.244876 May 07 21:49:58.503144 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 732/1411] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:49:58 2022] DELETE /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:49:58.520403 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-fb74bb88-5f23-460e-a7a1-cd2827e1f207 req-7245b15b-be92-4009-b3ea-8ea19b8c08bf service nova] Creating event network-vif-plugged:95a695cd-81c6-4f14-adb9-b284c5d977e3 for instance bbb2faa2-ee9e-47d3-a891-24cec328a4c2 on nch2-master-1 May 07 21:49:58.523499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:58.525116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:58.535141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-fb74bb88-5f23-460e-a7a1-cd2827e1f207 req-7245b15b-be92-4009-b3ea-8ea19b8c08bf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116637 May 07 21:49:58.536510 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 680/1412] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:58.539246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:58.540551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.542712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:58.554502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.579552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:58.581788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:58.613220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:58.614336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.616016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:58.617293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:58.961514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:58.973681 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a999578f-a0f7-498d-babb-970b9326b28c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1493 microversion: 2.1 time: 0.463315 May 07 21:49:58.986931 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 733/1413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:58 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1493 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:58.995718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9ae67f21-6bc1-4109-83d1-f3fd0b7617f1 req-f07f599b-0f49-44e8-acbe-6c13d33426a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef", "name": "network-vif-unplugged", "status": "completed", "tag": "8b09d66b-7638-451c-902c-9a93667bb5b6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:49:59.019436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:59.030022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9ae67f21-6bc1-4109-83d1-f3fd0b7617f1 req-f07f599b-0f49-44e8-acbe-6c13d33426a6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:59.031807 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f007d07b-548b-4f0c-b5cd-a4be01c921fa tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.490640 May 07 21:49:59.032348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9ae67f21-6bc1-4109-83d1-f3fd0b7617f1 req-f07f599b-0f49-44e8-acbe-6c13d33426a6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:59.032880 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 681/1414] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:58 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:59.040664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:59.041572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:59.058080 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9ae67f21-6bc1-4109-83d1-f3fd0b7617f1 req-f07f599b-0f49-44e8-acbe-6c13d33426a6 service nova] Creating event network-vif-unplugged:8b09d66b-7638-451c-902c-9a93667bb5b6 for instance 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef on nch2-master-1 May 07 21:49:59.059863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:59.062258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:59.063813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:59.066316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:59.072681 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9ae67f21-6bc1-4109-83d1-f3fd0b7617f1 req-f07f599b-0f49-44e8-acbe-6c13d33426a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084012 May 07 21:49:59.074004 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 734/1415] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:49:59.169892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:59.171002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:59.189491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:59.189989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:59.190734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:59.191207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:59.524164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:59.534711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:59.536699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:59.538115 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-25f79a23-09e6-4865-ae23-25c79bbdf375 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.501791 May 07 21:49:59.539513 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 682/1416] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:49:59 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:49:59.561193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:59.564821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:49:59.582536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:59.583650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:59.585075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:49:59.585727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:49:59.785151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:59.796034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f638f72-0d07-4521-8d97-73cc3699d6cb tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1534 microversion: 2.1 time: 0.630224 May 07 21:49:59.808764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:49:59.810106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 735/1417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:59 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1534 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:49:59.821436 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-779c54db-8c5c-41ce-9e97-0b41b0dd195f tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1352 microversion: 2.1 time: 0.279605 May 07 21:49:59.824495 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 683/1418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:59 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1352 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:49:59.994613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:49:59.996418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:00.013349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:00.015300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:00.017080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:00.020313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:00.049881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:00.050563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:00.063639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:00.064113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:00.067525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:00.068285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:00.411579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:00.423970 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b61b1b35-6e05-4ba1-9bcf-9421537acfa5 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.377828 May 07 21:50:00.425418 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 684/1419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:00 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:00.489396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:00.500232 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87f588c6-33c9-44be-9abc-79dce3c4e5c6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1493 microversion: 2.1 time: 0.511579 May 07 21:50:00.501596 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 736/1420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:49:59 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1493 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:00.557165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:00.558479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:00.567856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:00.568888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:00.576243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:00.576945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:00.707387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2034803250", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3cd5ba47-406b-4cd5-8f0e-08872326b372"}], "security_groups": [{"name": "tempest-securitygroup--204450055"}], "key_name": "tempest-keypair-503183074", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:00.905858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] validate_networks() for [('3cd5ba47-406b-4cd5-8f0e-08872326b372', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:01.453006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:01.469636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:01.472041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:01.473665 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5b3ec53-05ac-4a5b-8ad7-9a83ecc9ccae tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.921031 May 07 21:50:01.474947 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 685/1421] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:00 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:01.484257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:01.488710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:01.519492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.519775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for project 487fc10ff315438ca2de090c396e3cfb. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:01.522098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.524214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.525702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.527447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for user 63270cc27d704b5095bc8d1133544eeb and project 487fc10ff315438ca2de090c396e3cfb. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:01.542121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:01.542553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:01.545025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:01.545441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:01.545930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:01.557113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.559114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.560509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.565225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.587704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for project 487fc10ff315438ca2de090c396e3cfb. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:01.592376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Getting quotas for user 63270cc27d704b5095bc8d1133544eeb and project 487fc10ff315438ca2de090c396e3cfb. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:01.605518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:01.609324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:01.666390 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-19e76275-f972-40ef-96ce-9c2854376623 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.968080 May 07 21:50:01.668500 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 737/1422] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:50:01.675290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:01.676194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:01.686708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.691150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.692178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.692979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.883208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:01.892522 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3cd7f14-d4ef-4d0c-a93b-e151031e22b6 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1543 microversion: 2.1 time: 0.222717 May 07 21:50:01.893316 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 738/1423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:01 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1543 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:01.898296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5edf11c4-5f3b-4f52-b5b8-23c345d49a02 req-52dc0609-a208-46e2-8154-cc8196599d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef", "tag": "8b09d66b-7638-451c-902c-9a93667bb5b6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:01.906990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5edf11c4-5f3b-4f52-b5b8-23c345d49a02 req-52dc0609-a208-46e2-8154-cc8196599d56 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.908529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5edf11c4-5f3b-4f52-b5b8-23c345d49a02 req-52dc0609-a208-46e2-8154-cc8196599d56 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.922393 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5edf11c4-5f3b-4f52-b5b8-23c345d49a02 req-52dc0609-a208-46e2-8154-cc8196599d56 service nova] Creating event network-changed:8b09d66b-7638-451c-902c-9a93667bb5b6 for instance 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef on nch2-master-1 May 07 21:50:01.936542 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5edf11c4-5f3b-4f52-b5b8-23c345d49a02 req-52dc0609-a208-46e2-8154-cc8196599d56 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040344 May 07 21:50:01.938234 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 739/1424] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:01.946965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:01.948013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:01.971195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.973331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:01.974165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:01.974620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.051329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:02.061720 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-182c923d-f784-473e-9788-dddfa9181e9d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1527 microversion: 2.1 time: 0.585468 May 07 21:50:02.076716 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 686/1425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:01 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1527 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:02.089672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:02.091131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:02.099322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.100132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.101597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.102274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.177834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:02.187892 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7b0f357-f07e-4e5c-b395-1fdae9748861 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.246457 May 07 21:50:02.202696 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 740/1426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:01 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:02.213208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-45d40ef0-48ed-44d9-abaf-78e3c7148999 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:02.215319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-45d40ef0-48ed-44d9-abaf-78e3c7148999 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:02.278702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-45d40ef0-48ed-44d9-abaf-78e3c7148999 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:02.286925 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-45d40ef0-48ed-44d9-abaf-78e3c7148999 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1269 microversion: 2.1 time: 0.082566 May 07 21:50:02.287516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 741/1427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:02 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:02.293858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8b39e366-4165-4174-8de1-f80a578ac6c0 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:02.294588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b39e366-4165-4174-8de1-f80a578ac6c0 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:02.302025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b39e366-4165-4174-8de1-f80a578ac6c0 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.302724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b39e366-4165-4174-8de1-f80a578ac6c0 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.303702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b39e366-4165-4174-8de1-f80a578ac6c0 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.304366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b39e366-4165-4174-8de1-f80a578ac6c0 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.395869 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8b39e366-4165-4174-8de1-f80a578ac6c0 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106459 May 07 21:50:02.396649 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 742/1428] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:50:02 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:02.405438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:02.406694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:02.419067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.419538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.420347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.420802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.633129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c562e7dec6d34cd0a7fc7cea14fa5e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd92ab7de4f3456e82ccaa60aa378562', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:02.641901 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d8f1b742-a868-4439-8309-32e188993702 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 200 len: 1493 microversion: 2.1 time: 0.563606 May 07 21:50:02.644371 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 687/1429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:02 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 1493 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:02.652591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:02.657166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:02.672722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.673188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.673984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:02.674435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:02.779045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:02.790030 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-559f9192-13c4-480f-bc0a-9f0a4ba41250 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1527 microversion: 2.1 time: 0.391697 May 07 21:50:02.790633 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 743/1430] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:02 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1527 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:02.812616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-848dccd2-6c38-4f01-8b58-21680095eae1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:02.813473 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:02.813473 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:02.830377 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-848dccd2-6c38-4f01-8b58-21680095eae1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] HTTP exception thrown: Flavor 839a70a4-0580-4374-bc76-4a6a2187b117 could not be found. May 07 21:50:02.831068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-848dccd2-6c38-4f01-8b58-21680095eae1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Returning 404 to user: Flavor 839a70a4-0580-4374-bc76-4a6a2187b117 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:02.836286 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-848dccd2-6c38-4f01-8b58-21680095eae1 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/839a70a4-0580-4374-bc76-4a6a2187b117" status: 404 len: 109 microversion: 2.1 time: 0.028969 May 07 21:50:02.836286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 744/1431] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:02 2022] DELETE /compute/v2.1/flavors/839a70a4-0580-4374-bc76-4a6a2187b117 => generated 109 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:03.020974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2ce68a0e-1629-4bb0-84aa-932846ad0486 req-05463767-360e-4390-94e1-97ba4bf88466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "name": "network-vif-plugged", "status": "completed", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:03.042821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2ce68a0e-1629-4bb0-84aa-932846ad0486 req-05463767-360e-4390-94e1-97ba4bf88466 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:03.043856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2ce68a0e-1629-4bb0-84aa-932846ad0486 req-05463767-360e-4390-94e1-97ba4bf88466 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:03.082879 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2ce68a0e-1629-4bb0-84aa-932846ad0486 req-05463767-360e-4390-94e1-97ba4bf88466 service nova] Creating event network-vif-plugged:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch1-master-1 May 07 21:50:03.098462 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2ce68a0e-1629-4bb0-84aa-932846ad0486 req-05463767-360e-4390-94e1-97ba4bf88466 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080107 May 07 21:50:03.101186 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 745/1432] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:03.113989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-671665678", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:03.223766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:03.240050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:03.258023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:03.260517 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-34beaaf8-bbb7-456b-9782-8cc1c6abceb0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.614195 May 07 21:50:03.270222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:03.277675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 688/1433] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:02 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:03.300918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:03.304222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:03.320025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:03.321341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:03.322459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:03.323957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.112072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:04.125650 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9086543-b186-416c-acbf-0dbf94e714ff tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.842642 May 07 21:50:04.127567 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 689/1434] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:03 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:04.139835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:04.142098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:04.157833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.158886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.161830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.165071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.300945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:04.319178 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a06f01dd-f3bb-4169-a923-9efd2a2b7bda tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1327 microversion: 2.1 time: 0.187939 May 07 21:50:04.321963 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 690/1435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:04 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1327 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:04.329583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:04.331199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 25758f5c-a017-4e91-9486-d8ef2e6da85d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:04.339370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.340193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.342083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.342754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.394307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Instance 25758f5c-a017-4e91-9486-d8ef2e6da85d could not be found. May 07 21:50:04.395368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Instance 25758f5c-a017-4e91-9486-d8ef2e6da85d could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:04.396465 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82a4cd22-4dc4-478c-8257-b140664073fe tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d" status: 404 len: 111 microversion: 2.1 time: 0.073208 May 07 21:50:04.398187 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 691/1436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:04 2022] GET /compute/v2.1/servers/25758f5c-a017-4e91-9486-d8ef2e6da85d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:04.404776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-42dca7cd-6b29-48cc-a0ea-17ecf4541cd2 req-c56bdb5b-4a36-4a15-b815-b839d244ac5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25758f5c-a017-4e91-9486-d8ef2e6da85d", "name": "network-vif-deleted", "tag": "cb812400-5de5-4055-b8c5-f05049026aa6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:04.420384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-42dca7cd-6b29-48cc-a0ea-17ecf4541cd2 req-c56bdb5b-4a36-4a15-b815-b839d244ac5e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.421369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-42dca7cd-6b29-48cc-a0ea-17ecf4541cd2 req-c56bdb5b-4a36-4a15-b815-b839d244ac5e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.449239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-42dca7cd-6b29-48cc-a0ea-17ecf4541cd2 req-c56bdb5b-4a36-4a15-b815-b839d244ac5e service nova] Creating event network-vif-deleted:cb812400-5de5-4055-b8c5-f05049026aa6 for instance 25758f5c-a017-4e91-9486-d8ef2e6da85d on nch1-master-1 May 07 21:50:04.463223 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-42dca7cd-6b29-48cc-a0ea-17ecf4541cd2 req-c56bdb5b-4a36-4a15-b815-b839d244ac5e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063023 May 07 21:50:04.465806 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 692/1437] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:04.560527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:04.561092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:04.561423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:04.561846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:04.562268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:04.574752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.575256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.576071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.576697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.606744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:04.621552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Getting quotas for user 3eb85bfb49aa4a519099c6f43ac77099 and project 7789855db11445de842c4df75bd05e10. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:04.641289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:04.643442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55986079-5b91-4894-9b5f-9eb799609531 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:04.644295 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:04.644295 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:50:04.644960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:04.646715 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-55986079-5b91-4894-9b5f-9eb799609531 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 07 21:50:04.647341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55986079-5b91-4894-9b5f-9eb799609531 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:04.648227 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55986079-5b91-4894-9b5f-9eb799609531 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409 tempest-InstanceUsageAuditLogNegativeTestJSON-1410099409-project-admin] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.179999 May 07 21:50:04.649422 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 693/1438] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:50:04.654799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:04.659895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:04.682127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.686950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.688351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:04.689712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:04.722519 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d986face-3b97-4266-ac05-07d5e2755895 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619371 May 07 21:50:04.740943 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 746/1439] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:50:04.771051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76bd92f0-ff73-4a48-ae7f-ac9621cb0c4e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41caae0d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:04.821009 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-76bd92f0-ff73-4a48-ae7f-ac9621cb0c4e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Image not found. May 07 21:50:04.821639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76bd92f0-ff73-4a48-ae7f-ac9621cb0c4e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Image not found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:04.823078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-76bd92f0-ff73-4a48-ae7f-ac9621cb0c4e tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2" status: 404 len: 62 microversion: 2.1 time: 0.078641 May 07 21:50:04.823649 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 747/1440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:04 2022] DELETE /compute/v2.1/images/1ad4851c-e7ce-463d-a34c-6426478bb0f2 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:50:05.013413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f428873b-9d38-423c-af94-8c4de5d33b52 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.015131 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:05.015131 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:05.017090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f428873b-9d38-423c-af94-8c4de5d33b52 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '998318cac1694d988e8740803f6229a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cde6b55f49a40cba5aaf99ac1b8723d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:05.018117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f428873b-9d38-423c-af94-8c4de5d33b52 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.019641 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f428873b-9d38-423c-af94-8c4de5d33b52 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.194878 May 07 21:50:05.020451 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 748/1441] 10.222.0.32 () {58 vars in 1184 bytes} [Sat May 7 21:50:04 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:05.031685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8c024470-fe06-48a2-adb5-4ad527abed25 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.032338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8c024470-fe06-48a2-adb5-4ad527abed25 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.219999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c024470-fe06-48a2-adb5-4ad527abed25 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:05.231472 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8c024470-fe06-48a2-adb5-4ad527abed25 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1212 microversion: 2.1 time: 0.209493 May 07 21:50:05.232085 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 749/1442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:05 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1212 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:05.238341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.238890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.260583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.261439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.266584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.268888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.310336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 could not be found. May 07 21:50:05.312373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.316714 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-beced37c-cda6-4db8-9f21-8e35af91ff8b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 404 len: 111 microversion: 2.1 time: 0.081152 May 07 21:50:05.318853 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 750/1443] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:05 2022] DELETE /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:05.330291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db724024-6681-4aee-8bc1-3e5dfe4aa748 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.332269 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:05.332269 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:05.335257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db724024-6681-4aee-8bc1-3e5dfe4aa748 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '998318cac1694d988e8740803f6229a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cde6b55f49a40cba5aaf99ac1b8723d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:05.336783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db724024-6681-4aee-8bc1-3e5dfe4aa748 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.339221 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db724024-6681-4aee-8bc1-3e5dfe4aa748 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601 tempest-InstanceUsageAuditLogNegativeTestJSON-389819601-project] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-07 21:50:05" status: 403 len: 128 microversion: 2.1 time: 0.016373 May 07 21:50:05.342490 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 751/1444] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:50:05 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-07%2021%3A50%3A05 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:05.382547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.384184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.398994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.399715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.402590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.403299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.438076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:05.458458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:05.466882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:05.471923 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f291614e-52a0-402e-bc63-25b7090084b1 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.820382 May 07 21:50:05.475731 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 694/1445] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:04 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:05.494249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.495992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: c766eaa8-8e8e-4135-9b5d-dfdaad014172] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.505401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.506023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.507408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.508290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.544608 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 could not be found. May 07 21:50:05.545717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Instance c766eaa8-8e8e-4135-9b5d-dfdaad014172 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.547135 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-988cac4f-be5c-4894-96ce-d194416e0cbc tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172" status: 404 len: 111 microversion: 2.1 time: 0.069803 May 07 21:50:05.548503 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 695/1446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:05 2022] GET /compute/v2.1/servers/c766eaa8-8e8e-4135-9b5d-dfdaad014172 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:05.581707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.582516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.593324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.594064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.595907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.596506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.723065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:05.733171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57e3e6d1-8b14-415e-b8ee-78e037b4601c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1327 microversion: 2.1 time: 0.163368 May 07 21:50:05.734255 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 696/1447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:05 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:05.748460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3415767a-31b9-404e-96db-7430f146f965 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cadf160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.789151 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-3415767a-31b9-404e-96db-7430f146f965 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Image not found. May 07 21:50:05.789765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3415767a-31b9-404e-96db-7430f146f965 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.790823 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3415767a-31b9-404e-96db-7430f146f965 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff" status: 404 len: 62 microversion: 2.1 time: 0.055420 May 07 21:50:05.791542 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 697/1448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:05 2022] DELETE /compute/v2.1/images/ab23f346-372e-452e-95f2-306e7f67c2ff => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:50:05.802162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.802683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.813413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.813890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.814982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.815446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.834651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Instance 12a792c3-0086-43d1-8995-7d56146f84b2 could not be found. May 07 21:50:05.835289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Instance 12a792c3-0086-43d1-8995-7d56146f84b2 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.836488 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15b0e9dc-de3a-4bdc-b431-f236a1ec617b tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 404 len: 111 microversion: 2.1 time: 0.040216 May 07 21:50:05.837731 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 698/1449] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:05 2022] DELETE /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:50:05.857399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.858385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 12a792c3-0086-43d1-8995-7d56146f84b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.876219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.877995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.879228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:05.879863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:05.899043 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Instance 12a792c3-0086-43d1-8995-7d56146f84b2 could not be found. May 07 21:50:05.900856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Instance 12a792c3-0086-43d1-8995-7d56146f84b2 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.902754 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-22a15888-62d8-4f11-93c4-6d2c2856a3cb tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2" status: 404 len: 111 microversion: 2.1 time: 0.060384 May 07 21:50:05.907616 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 699/1450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:05 2022] GET /compute/v2.1/servers/12a792c3-0086-43d1-8995-7d56146f84b2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:05.914079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0be2fa43-8900-4fe2-a6c1-143929ecb2d6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '.version_select at 0x7fc41cadf940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.957557 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0be2fa43-8900-4fe2-a6c1-143929ecb2d6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Image not found. May 07 21:50:05.958166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0be2fa43-8900-4fe2-a6c1-143929ecb2d6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:05.959188 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0be2fa43-8900-4fe2-a6c1-143929ecb2d6 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc" status: 404 len: 62 microversion: 2.1 time: 0.050113 May 07 21:50:05.960725 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 700/1451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:05 2022] DELETE /compute/v2.1/images/7cda6bb6-7c72-49d1-9e4d-bf9c49631bfc => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:50:05.982011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:05.982815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:05.997312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.003635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.004986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.005630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.028885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Instance 63bd05ee-f966-4884-89dc-17c61c1942fe could not be found. May 07 21:50:06.031473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Instance 63bd05ee-f966-4884-89dc-17c61c1942fe could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:06.032757 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8efe1782-19d7-47e7-a5a0-fb30095ff4c3 tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "DELETE /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 404 len: 111 microversion: 2.1 time: 0.062491 May 07 21:50:06.033458 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 701/1452] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:05 2022] DELETE /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:06.041832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:06.042695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] [instance: 63bd05ee-f966-4884-89dc-17c61c1942fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:06.056636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.057106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.059282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.059925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.078801 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] HTTP exception thrown: Instance 63bd05ee-f966-4884-89dc-17c61c1942fe could not be found. May 07 21:50:06.079489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] Returning 404 to user: Instance 63bd05ee-f966-4884-89dc-17c61c1942fe could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:06.080342 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b29268e3-7026-4660-b64e-396a33de2c2c tempest-ImagesTestJSON-998677380 tempest-ImagesTestJSON-998677380-project] 10.222.0.32 "GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe" status: 404 len: 111 microversion: 2.1 time: 0.042488 May 07 21:50:06.081102 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 702/1453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:06 2022] GET /compute/v2.1/servers/63bd05ee-f966-4884-89dc-17c61c1942fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:06.116010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:06.134620 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5f90ef87-199a-494c-b798-4de63ac1d9e3 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.790544 May 07 21:50:06.136378 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 752/1454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:05 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:06.211342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-79abb354-324f-4ebf-b19f-971eaada605a req-cb873384-5f8e-4a94-b77f-1ac5a602dad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb2faa2-ee9e-47d3-a891-24cec328a4c2", "tag": "95a695cd-81c6-4f14-adb9-b284c5d977e3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:06.224924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-79abb354-324f-4ebf-b19f-971eaada605a req-cb873384-5f8e-4a94-b77f-1ac5a602dad7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.225385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-79abb354-324f-4ebf-b19f-971eaada605a req-cb873384-5f8e-4a94-b77f-1ac5a602dad7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.249162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:06.249805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:06.267456 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-79abb354-324f-4ebf-b19f-971eaada605a req-cb873384-5f8e-4a94-b77f-1ac5a602dad7 service nova] Creating event network-changed:95a695cd-81c6-4f14-adb9-b284c5d977e3 for instance bbb2faa2-ee9e-47d3-a891-24cec328a4c2 on nch2-master-1 May 07 21:50:06.268132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.268611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.269440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.269894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.289625 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-79abb354-324f-4ebf-b19f-971eaada605a req-cb873384-5f8e-4a94-b77f-1ac5a602dad7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075829 May 07 21:50:06.291000 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 703/1455] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:50:06.440083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:06.453034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-98e22197-3791-459d-843a-b34a2883af54 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1264 microversion: 2.1 time: 0.208893 May 07 21:50:06.463893 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 753/1456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:06 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:06.498433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:06.500271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:06.536652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.537402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.538580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.539464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.760297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:06.764730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:06.779193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.779665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:06.780804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:06.781516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:07.215149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:07.224549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-45962426-e436-441e-9502-417f8a008c72 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1394 microversion: 2.1 time: 0.477321 May 07 21:50:07.225418 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 754/1457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:06 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1394 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:07.239623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:07.240581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:07.247340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:07.248402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:07.249445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:07.250119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:07.554417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:07.563580 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54963316-f48c-4ab1-8d91-d1108e867c0a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.327968 May 07 21:50:07.564978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 755/1458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:07 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:07.570422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:07.573531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:07.582287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:07.583466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:07.585606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:07.586749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:07.692766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:07.707883 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7037a382-c7f9-410f-bea7-4b02164645fa tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1270 microversion: 2.1 time: 0.141354 May 07 21:50:07.712160 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 756/1459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:07 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:07.829176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:07.863300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:07.864871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:07.866074 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a43b563d-1555-41aa-840d-1a9ca605e4fe tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 1.374673 May 07 21:50:07.872799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 704/1460] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:06 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:50:08.243727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:08.244389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:08.258931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:08.260042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:08.262644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:08.263493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:08.430436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-62f4eda5-59a4-43d9-b323-1294819f55de req-e023945c-a34b-4780-95ac-d691aabbbcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af003a02-3515-4f58-9883-d6033c1b72f4", "tag": "6ce344e7-dcb0-471f-b006-52cef1e33f6f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:08.456025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-62f4eda5-59a4-43d9-b323-1294819f55de req-e023945c-a34b-4780-95ac-d691aabbbcd7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:08.456846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-62f4eda5-59a4-43d9-b323-1294819f55de req-e023945c-a34b-4780-95ac-d691aabbbcd7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:08.506905 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-62f4eda5-59a4-43d9-b323-1294819f55de req-e023945c-a34b-4780-95ac-d691aabbbcd7 service nova] Creating event network-changed:6ce344e7-dcb0-471f-b006-52cef1e33f6f for instance af003a02-3515-4f58-9883-d6033c1b72f4 on nch1-master-1 May 07 21:50:08.531718 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-62f4eda5-59a4-43d9-b323-1294819f55de req-e023945c-a34b-4780-95ac-d691aabbbcd7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109277 May 07 21:50:08.532539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 705/1461] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:08.589197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:08.589984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:08.602873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:08.603536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:08.604572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:08.605422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:08.804408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:08.825856 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa2043a6-8f4b-4a48-9dbe-a0fcde14bd66 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1394 microversion: 2.1 time: 0.586461 May 07 21:50:08.827908 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 757/1462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:08 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1394 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:08.843071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:08.843985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:08.860516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:08.861499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:08.862599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:08.863935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:09.055109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:09.069697 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9d40eab-032e-472a-9e57-622c4f70792e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1270 microversion: 2.1 time: 0.240041 May 07 21:50:09.082857 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 758/1463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:08 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:09.082857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:09.082857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:09.086276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:09.087290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:09.087895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:09.088485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:09.532216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:09.541255 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-232f8183-49bb-42c2-af5a-855984344f3a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.962116 May 07 21:50:09.542810 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 706/1464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:08 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:09.796649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:09.804974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:09.806517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:09.833021 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a7c507e-a337-4699-95b5-d4ef477c4349 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.757178 May 07 21:50:09.840150 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 759/1465] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:09 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:09.864127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:09.865779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:09.881817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:09.883080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:09.885140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:09.886789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:10.092985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:10.093611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:10.111843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:10.112336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:10.113136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:10.113606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:10.270354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:10.292971 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a98ddad-9f78-419a-8834-9352ab3e77f9 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1270 microversion: 2.1 time: 0.204991 May 07 21:50:10.294299 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 760/1466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:10 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:10.310614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:10.321146 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb30d0a8-1137-4daf-8c54-8393b871097d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1394 microversion: 2.1 time: 0.466822 May 07 21:50:10.323698 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 707/1467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:09 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1394 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:10.559788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:10.560452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:10.577066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:10.578549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:10.582095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:10.582639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:10.878237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:10.879144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:10.894334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:10.896235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:10.900326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:10.900793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:10.985908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:10.997961 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27c2c1cb-fb9e-4bbe-8491-48fd71f223e6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.442991 May 07 21:50:11.001759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 761/1468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:10 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:11.151673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:11.168374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:11.174353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:11.179772 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-793760b2-e676-4e47-ac29-dcd0c56db03b tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1487 microversion: 2.25 time: 0.310551 May 07 21:50:11.183091 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 708/1469] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:10 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1487 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:50:11.316392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:11.317198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:11.340383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:11.340644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:11.341955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:11.343322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:11.353661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:11.359998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:11.361478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:11.365524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:11.373720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:11.374316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:11.764368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:11.775816 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d314e250-6c11-4b4c-8859-2bffcd57c774 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.466967 May 07 21:50:11.779493 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 762/1470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:11 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:11.953434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:11.968050 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a7f2d0c-b9f0-4077-afb3-7a4b96419bae tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1394 microversion: 2.1 time: 0.632236 May 07 21:50:11.971127 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 709/1471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:11 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1394 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:12.020272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:12.021690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:12.035203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.037169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.039335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.039994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.201172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:12.202337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:12.213503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.213962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.221453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.222139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.438207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:12.446650 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15eaa10a-752f-49d8-ad63-2adb114869a4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.431040 May 07 21:50:12.453219 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 763/1472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:12 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:12.741980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:12.771765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:12.773566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:12.781322 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5be679fc-fd5a-476a-8422-446bb1ca15e7 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1477 microversion: 2.25 time: 0.581209 May 07 21:50:12.782733 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 710/1473] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:12 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1477 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:12.797584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:12.798295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:12.814385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1bb4bece-c2c1-4c1f-afb0-df4aaf2f5a8f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '.version_select at 0x7fc41cab9c10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:12.819247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.820255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.824197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bb4bece-c2c1-4c1f-afb0-df4aaf2f5a8f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.824928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.825512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.827496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bb4bece-c2c1-4c1f-afb0-df4aaf2f5a8f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.888467 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1bb4bece-c2c1-4c1f-afb0-df4aaf2f5a8f tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 5134 microversion: 2.25 time: 0.086915 May 07 21:50:12.893081 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 711/1474] 10.222.0.32 () {60 vars in 1183 bytes} [Sat May 7 21:50:12 2022] GET /compute/v2.1/os-migrations => generated 5134 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:12.908197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:12.915552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:12.939493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.946451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:12.960322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:12.965496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:13.553461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] Lazy-loading 'services' on Instance uuid 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:13.601075 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-17ab90d6-0176-481d-a17c-e9ee8d4dba39 tempest-LiveAutoBlockMigrationV225Test-638033416 tempest-LiveAutoBlockMigrationV225Test-638033416-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1970 microversion: 2.25 time: 0.697600 May 07 21:50:13.601686 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 712/1475] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:12 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1970 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:13.613341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:13.615014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:13.629749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:13.631817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:13.633055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:13.634056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:13.714273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:13.729974 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-af6f5829-267b-4525-927c-59e0426fac49 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.934127 May 07 21:50:13.730972 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 764/1476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:12 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:14.239857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:14.248599 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2f48653-eb95-445d-bef7-2b9e2c439726 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1394 microversion: 2.1 time: 0.643582 May 07 21:50:14.251739 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 713/1477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:13 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1394 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:14.271030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:14.271972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:14.295288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.296053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.297026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.300928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.364776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-83100db1-5cf4-445e-aee2-e7ca6ff98078 tempest-ListImagesTestJSON-1238036253 tempest-ListImagesTestJSON-1238036253-project] Calling method '.version_select at 0x7fc41cc57c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:14.438420 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-83100db1-5cf4-445e-aee2-e7ca6ff98078 tempest-ListImagesTestJSON-1238036253 tempest-ListImagesTestJSON-1238036253-project] 10.222.0.32 "GET /compute/v2.1/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c" status: 200 len: 784 microversion: 2.1 time: 0.700765 May 07 21:50:14.439057 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 765/1478] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:13 2022] GET /compute/v2.1/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c => generated 784 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:14.451281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:14.451791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:14.460155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.460803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.461622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.462276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.511646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:14.654085 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ff7f2bd-02e6-4752-b65f-bbce8c8e5185 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 204 len: 0 microversion: 2.25 time: 0.212602 May 07 21:50:14.654706 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 766/1479] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:50:14 2022] DELETE /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:50:14.670147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6c436248-9133-43f5-8165-f64f69d8b633 req-19853668-e52f-4fbf-ac01-f5569b019baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:14.684942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6c436248-9133-43f5-8165-f64f69d8b633 req-19853668-e52f-4fbf-ac01-f5569b019baa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.685664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6c436248-9133-43f5-8165-f64f69d8b633 req-19853668-e52f-4fbf-ac01-f5569b019baa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.702539 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6c436248-9133-43f5-8165-f64f69d8b633 req-19853668-e52f-4fbf-ac01-f5569b019baa service nova] Creating event network-changed:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch1-master-1 May 07 21:50:14.711295 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6c436248-9133-43f5-8165-f64f69d8b633 req-19853668-e52f-4fbf-ac01-f5569b019baa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051239 May 07 21:50:14.713041 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 767/1480] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:14.743880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:14.760539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eba2697f-1753-4698-9703-1d7255faf83a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.506884 May 07 21:50:14.771296 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 714/1481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:14 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:14.782494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67b07cfa-f1e1-4650-93a4-c5a887150a97 tempest-ListImagesTestJSON-1238036253 tempest-ListImagesTestJSON-1238036253-project] Calling method '.version_select at 0x7fc422727ca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:14.799082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cc57e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:14.800533 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:14.800533 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:14.801727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.802190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.817411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.817934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.828602 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] HTTP exception thrown: Service 32be2d82-e96c-4126-87a6-7369b8a1b3e4 could not be found. May 07 21:50:14.829486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Returning 404 to user: Service 32be2d82-e96c-4126-87a6-7369b8a1b3e4 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:14.830603 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cbf621f4-ea26-45b7-a47f-0a4e56d3a412 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-services/32be2d82-e96c-4126-87a6-7369b8a1b3e4" status: 404 len: 110 microversion: 2.53 time: 0.115862 May 07 21:50:14.837685 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 768/1482] 10.222.0.32 () {62 vars in 1308 bytes} [Sat May 7 21:50:14 2022] PUT /compute/v2.1/os-services/32be2d82-e96c-4126-87a6-7369b8a1b3e4 => generated 110 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:14.844765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:14.845748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:14.859018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.859608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.860872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.861489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.944685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67b07cfa-f1e1-4650-93a4-c5a887150a97 tempest-ListImagesTestJSON-1238036253 tempest-ListImagesTestJSON-1238036253-project] 10.222.0.32 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.172263 May 07 21:50:14.945557 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 715/1483] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:14 2022] GET /compute/v2.1/images => generated 445 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:14.951990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:14.952635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:14.960240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.960968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:14.961984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:14.962595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.153798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:15.169392 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47a66118-7549-4ca9-b04a-3261b7f50ce6 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.222088 May 07 21:50:15.171461 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 716/1484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:14 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:15.180603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Action: 'update', calling method: .version_select at 0x7fc422727dc0>, body: {"status": "disabled"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:15.182386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:15.182803 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.182803 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:50:15.184604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.185588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.192784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:15.194623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.195113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.212588 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] HTTP exception thrown: Service 32be2d82-e96c-4126-87a6-7369b8a1b3e4 could not be found. May 07 21:50:15.212794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:15.213220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Returning 404 to user: Service 32be2d82-e96c-4126-87a6-7369b8a1b3e4 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:15.214838 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ac8bb4dd-4af4-4f2f-94e5-0f016a555262 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-services/32be2d82-e96c-4126-87a6-7369b8a1b3e4" status: 404 len: 110 microversion: 2.53 time: 0.041811 May 07 21:50:15.216105 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a737609-b4ee-46b0-9966-f0c732888730 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1483 microversion: 2.25 time: 0.376355 May 07 21:50:15.216985 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 769/1485] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:14 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1483 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:15.221964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 717/1486] 10.222.0.32 () {62 vars in 1308 bytes} [Sat May 7 21:50:15 2022] PUT /compute/v2.1/os-services/32be2d82-e96c-4126-87a6-7369b8a1b3e4 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:15.222542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed2eff7d-f7fa-4e0a-9f1d-90e24a9c4012 tempest-ListImagesTestJSON-1238036253 tempest-ListImagesTestJSON-1238036253-project] Calling method '.version_select at 0x7fc41caae1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.227609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cc3c430>, body: {"status": "enabled"} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:15.230393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.234573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.246636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.249154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.263897 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] HTTP exception thrown: Service 32be2d82-e96c-4126-87a6-7369b8a1b3e4 could not be found. May 07 21:50:15.264920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Returning 404 to user: Service 32be2d82-e96c-4126-87a6-7369b8a1b3e4 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:15.275470 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea3a7de1-5bb3-4f29-ac77-96d879474d92 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-services/32be2d82-e96c-4126-87a6-7369b8a1b3e4" status: 404 len: 110 microversion: 2.53 time: 0.042922 May 07 21:50:15.277180 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 718/1487] 10.222.0.32 () {62 vars in 1308 bytes} [Sat May 7 21:50:15 2022] PUT /compute/v2.1/os-services/32be2d82-e96c-4126-87a6-7369b8a1b3e4 => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:15.284697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.285568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:15.294302 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed2eff7d-f7fa-4e0a-9f1d-90e24a9c4012 tempest-ListImagesTestJSON-1238036253 tempest-ListImagesTestJSON-1238036253-project] 10.222.0.32 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.075962 May 07 21:50:15.295783 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 770/1488] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:15.296942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.297486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.298361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.299047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.301916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e3a5178-0743-433e-ac74-ea2e71e22ff2 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.303528 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.303528 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:15.305832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3a5178-0743-433e-ac74-ea2e71e22ff2 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.306842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3a5178-0743-433e-ac74-ea2e71e22ff2 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.308052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3a5178-0743-433e-ac74-ea2e71e22ff2 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.308648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3a5178-0743-433e-ac74-ea2e71e22ff2 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.341825 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e3a5178-0743-433e-ac74-ea2e71e22ff2 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.044713 May 07 21:50:15.342625 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 771/1489] 10.222.0.32 () {60 vars in 1177 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:15.347659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0fbc5aa7-db92-4bcd-a6e6-26c05a794af0 req-596f21bf-dfc7-4572-857f-230b3216a946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af003a02-3515-4f58-9883-d6033c1b72f4", "name": "network-vif-plugged", "status": "completed", "tag": "6ce344e7-dcb0-471f-b006-52cef1e33f6f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:15.359664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0fbc5aa7-db92-4bcd-a6e6-26c05a794af0 req-596f21bf-dfc7-4572-857f-230b3216a946 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.360134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0fbc5aa7-db92-4bcd-a6e6-26c05a794af0 req-596f21bf-dfc7-4572-857f-230b3216a946 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.380408 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0fbc5aa7-db92-4bcd-a6e6-26c05a794af0 req-596f21bf-dfc7-4572-857f-230b3216a946 service nova] Creating event network-vif-plugged:6ce344e7-dcb0-471f-b006-52cef1e33f6f for instance af003a02-3515-4f58-9883-d6033c1b72f4 on nch1-master-1 May 07 21:50:15.388563 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0fbc5aa7-db92-4bcd-a6e6-26c05a794af0 req-596f21bf-dfc7-4572-857f-230b3216a946 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043284 May 07 21:50:15.390606 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 772/1490] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:15.398238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84059f2f-bda9-4db9-9a0c-66fcb8a61ad7 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.399607 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.399607 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:15.401989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84059f2f-bda9-4db9-9a0c-66fcb8a61ad7 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.402539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84059f2f-bda9-4db9-9a0c-66fcb8a61ad7 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.403434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84059f2f-bda9-4db9-9a0c-66fcb8a61ad7 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.403892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84059f2f-bda9-4db9-9a0c-66fcb8a61ad7 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.445881 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84059f2f-bda9-4db9-9a0c-66fcb8a61ad7 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.053021 May 07 21:50:15.446953 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 773/1491] 10.222.0.32 () {60 vars in 1210 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:15.461117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79414dc5-f473-46c5-9cc8-96efb7fa8130 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.464786 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.464786 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:15.470110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79414dc5-f473-46c5-9cc8-96efb7fa8130 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.470765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79414dc5-f473-46c5-9cc8-96efb7fa8130 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.472373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79414dc5-f473-46c5-9cc8-96efb7fa8130 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.478757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79414dc5-f473-46c5-9cc8-96efb7fa8130 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.516809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79414dc5-f473-46c5-9cc8-96efb7fa8130 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.060948 May 07 21:50:15.517997 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 774/1492] 10.222.0.32 () {60 vars in 1177 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:50:15.531058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f49b3345-ec96-4872-9718-74a8a6a84477 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.532942 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.532942 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:15.534818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f49b3345-ec96-4872-9718-74a8a6a84477 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.535530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f49b3345-ec96-4872-9718-74a8a6a84477 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.537022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f49b3345-ec96-4872-9718-74a8a6a84477 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.537902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f49b3345-ec96-4872-9718-74a8a6a84477 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.545263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:15.554129 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c9e1f185-ca66-4d4d-931f-49e27a770b14 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1394 microversion: 2.1 time: 0.275676 May 07 21:50:15.565715 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 719/1493] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1394 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:15.582253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f49b3345-ec96-4872-9718-74a8a6a84477 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.057131 May 07 21:50:15.583269 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 775/1494] 10.222.0.32 () {60 vars in 1236 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:15.595601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f14bebc3-5c6c-4ae3-84c5-7bd72c964c2e tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.596946 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.596946 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:50:15.598306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14bebc3-5c6c-4ae3-84c5-7bd72c964c2e tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.599061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14bebc3-5c6c-4ae3-84c5-7bd72c964c2e tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.599927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14bebc3-5c6c-4ae3-84c5-7bd72c964c2e tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.600418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14bebc3-5c6c-4ae3-84c5-7bd72c964c2e tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.631785 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f14bebc3-5c6c-4ae3-84c5-7bd72c964c2e tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.041198 May 07 21:50:15.632464 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 720/1495] 10.222.0.32 () {60 vars in 1177 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:15.645602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3fb99d66-31be-4566-8c82-d5af97a9a904 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.647831 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.647831 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:50:15.650001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fb99d66-31be-4566-8c82-d5af97a9a904 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.650534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fb99d66-31be-4566-8c82-d5af97a9a904 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.651608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fb99d66-31be-4566-8c82-d5af97a9a904 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.652124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fb99d66-31be-4566-8c82-d5af97a9a904 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.683179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3fb99d66-31be-4566-8c82-d5af97a9a904 tempest-ServicesAdminNegativeV253TestJSON-435283153 tempest-ServicesAdminNegativeV253TestJSON-435283153-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040935 May 07 21:50:15.684102 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 721/1496] 10.222.0.32 () {60 vars in 1238 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:15.863744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4a0441b4-c33e-44fd-880b-3befec79b09a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Action: 'create', calling method: .version_select at 0x7fc41cc03a60>, body: {"keypair": {"name": "tempest-keypair-1665312064"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:15.896972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a0441b4-c33e-44fd-880b-3befec79b09a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for project 2a463927927b488ebe8a6e118484e8df. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:15.903470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a0441b4-c33e-44fd-880b-3befec79b09a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for user cd60e0534aac4bc697aafe66723e1ab8 and project 2a463927927b488ebe8a6e118484e8df. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:15.927924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6cd9bd1f-dcb2-409c-bde5-16d39daf0c92 tempest-ServicesAdminNegativeV253TestJSON-1889633116 tempest-ServicesAdminNegativeV253TestJSON-1889633116-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.930809 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:15.930809 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:50:15.933870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6cd9bd1f-dcb2-409c-bde5-16d39daf0c92 tempest-ServicesAdminNegativeV253TestJSON-1889633116 tempest-ServicesAdminNegativeV253TestJSON-1889633116-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0c1ced81c6de4445a6815875dd58dc92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70e6d26bd4e47d2a3e560421ddadc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:15.935150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6cd9bd1f-dcb2-409c-bde5-16d39daf0c92 tempest-ServicesAdminNegativeV253TestJSON-1889633116 tempest-ServicesAdminNegativeV253TestJSON-1889633116-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:15.936749 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6cd9bd1f-dcb2-409c-bde5-16d39daf0c92 tempest-ServicesAdminNegativeV253TestJSON-1889633116 tempest-ServicesAdminNegativeV253TestJSON-1889633116-project] 10.222.0.32 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.244820 May 07 21:50:15.938447 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 722/1497] 10.222.0.32 () {60 vars in 1177 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 247 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:15.946928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:15.947722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:15.956399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.957080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:15.958211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:15.958871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:16.331424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:16.344342 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48a37983-86ee-4983-8b7b-7f32fccb3aa4 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.400340 May 07 21:50:16.345036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 723/1498] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:15 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:16.366531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:16.367187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:16.387393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:16.393729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:16.394747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:16.396676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:16.769282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a0441b4-c33e-44fd-880b-3befec79b09a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for project 2a463927927b488ebe8a6e118484e8df. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:16.775189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a0441b4-c33e-44fd-880b-3befec79b09a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for user cd60e0534aac4bc697aafe66723e1ab8 and project 2a463927927b488ebe8a6e118484e8df. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:16.838133 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4a0441b4-c33e-44fd-880b-3befec79b09a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.227847 May 07 21:50:16.844518 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 776/1499] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:50:15 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:16.856569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:16.860966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:16.887614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:16.892051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:16.893922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:16.895440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:16.938319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:16.946918 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5974289c-0716-4146-a4db-a153bc0b0a55 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.599947 May 07 21:50:16.966112 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 724/1500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:16 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:16.972000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:16.972866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:16.984521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:16.989427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:16.990482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:16.992068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:17.222382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:17.237016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:17.239404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:17.241998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c6b61c9-0fe8-4281-ab3b-7222366d01ba tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1483 microversion: 2.25 time: 0.395149 May 07 21:50:17.243570 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 777/1501] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:16 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1483 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:17.364507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:17.365399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:17.385032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:17.387704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:17.390755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:17.394815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:17.554296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:17.567546 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e2d4ff30-2d3e-47a2-bdaf-a0eefbfc8bff tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1394 microversion: 2.1 time: 0.598317 May 07 21:50:17.587157 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 725/1502] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:16 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1394 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:17.974080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:17.975504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:17.991461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:17.993465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:17.996419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:17.997879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:18.266265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:18.278796 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2c6e36d-12a1-4a50-9ec6-ee8241211cda tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.920840 May 07 21:50:18.279716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 778/1503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:17 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:18.285393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:18.286513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:18.295473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:18.296351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:18.297186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:18.297650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:18.387287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:18.398377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:18.400813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:18.403156 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f262d8ce-abb9-41da-b39a-fd54a93721ce tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1441 microversion: 2.25 time: 0.122137 May 07 21:50:18.405986 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 779/1504] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:18 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1441 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:18.429480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:18.441661 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-10d9c449-036e-4833-96f6-06596b721ab3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.472267 May 07 21:50:18.444479 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 726/1505] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:17 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:18.473683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1cc51b7d-4627-40a2-92ef-ed59895d4c13 req-449113e2-e5b5-47d0-affc-f02cd8a53899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef", "name": "network-vif-deleted", "tag": "8b09d66b-7638-451c-902c-9a93667bb5b6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:18.503794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1cc51b7d-4627-40a2-92ef-ed59895d4c13 req-449113e2-e5b5-47d0-affc-f02cd8a53899 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:18.504395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1cc51b7d-4627-40a2-92ef-ed59895d4c13 req-449113e2-e5b5-47d0-affc-f02cd8a53899 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:18.527751 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1cc51b7d-4627-40a2-92ef-ed59895d4c13 req-449113e2-e5b5-47d0-affc-f02cd8a53899 service nova] Creating event network-vif-deleted:8b09d66b-7638-451c-902c-9a93667bb5b6 for instance 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef on nch1-master-1 May 07 21:50:18.534125 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1cc51b7d-4627-40a2-92ef-ed59895d4c13 req-449113e2-e5b5-47d0-affc-f02cd8a53899 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067884 May 07 21:50:18.535407 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 780/1506] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:18.585689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:18.587047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:18.615648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:18.618977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:18.623859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:18.624457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:18.961331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:18.971605 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b83562eb-eb34-4602-a2ad-55530e1af853 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1574 microversion: 2.1 time: 0.390237 May 07 21:50:18.985606 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 727/1507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:18 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1574 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:18.998371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a3e5022-51c6-4e1e-9bad-340fb659b452 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:19.001411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a3e5022-51c6-4e1e-9bad-340fb659b452 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:19.018885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a3e5022-51c6-4e1e-9bad-340fb659b452 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:19.021058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a3e5022-51c6-4e1e-9bad-340fb659b452 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:19.022302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a3e5022-51c6-4e1e-9bad-340fb659b452 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:19.026889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a3e5022-51c6-4e1e-9bad-340fb659b452 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:19.164022 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a3e5022-51c6-4e1e-9bad-340fb659b452 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177130 May 07 21:50:19.164848 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 728/1508] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:50:18 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:19.224582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d77102d9-c81e-4b08-80f3-850f0bd5e5b7 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc41cbb6550>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:19.229905 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-d77102d9-c81e-4b08-80f3-850f0bd5e5b7 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 07 21:50:19.231877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d77102d9-c81e-4b08-80f3-850f0bd5e5b7 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:19.234721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d77102d9-c81e-4b08-80f3-850f0bd5e5b7 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.553647 May 07 21:50:19.235847 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 781/1509] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:50:18 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 555 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:19.246219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41bd6355-d10d-4df3-b318-158a7463f275 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc41cb3a8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2035327336", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:19.279335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-41bd6355-d10d-4df3-b318-158a7463f275 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:19.285332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-41bd6355-d10d-4df3-b318-158a7463f275 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for user 8fb80ca48f9a4db7bb427145e7cf20ea and project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:19.298730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:19.299525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:19.315546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:19.316047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:19.320967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:19.321434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:19.345047 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-41bd6355-d10d-4df3-b318-158a7463f275 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 07 21:50:19.346113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41bd6355-d10d-4df3-b318-158a7463f275 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:19.347106 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41bd6355-d10d-4df3-b318-158a7463f275 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.105270 May 07 21:50:19.348214 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 729/1510] 10.222.0.32 () {60 vars in 1159 bytes} [Sat May 7 21:50:19 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:50:19.359929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e173f64-d956-40af-9c44-cbaa982b96df tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc422733b80>, body: {"keypair": {"name": "tempest-keypair-1250738679"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:19.408810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e173f64-d956-40af-9c44-cbaa982b96df tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:19.419154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e173f64-d956-40af-9c44-cbaa982b96df tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for user 8fb80ca48f9a4db7bb427145e7cf20ea and project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:19.836881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:19.851588 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bbeff209-b84e-4d76-8f81-408475b6de23 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.558373 May 07 21:50:19.852933 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 782/1511] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:19 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:19.868169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:19.871043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:19.891697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:19.893390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:19.897524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:19.898233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:20.002437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e173f64-d956-40af-9c44-cbaa982b96df tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:20.008754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e173f64-d956-40af-9c44-cbaa982b96df tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for user 8fb80ca48f9a4db7bb427145e7cf20ea and project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:20.020127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:20.020846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:20.027594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lazy-loading 'fault' on Instance uuid 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:20.031711 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e173f64-d956-40af-9c44-cbaa982b96df tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.677897 May 07 21:50:20.033150 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 730/1512] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:50:19 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:20.038417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:20.039305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:20.049482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:20.049948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:20.050742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:20.051405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:20.133938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:20.160449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:20.163037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:20.165213 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d54520c4-fde9-4ea2-ac26-05da2e1bef09 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 200 len: 1194 microversion: 2.25 time: 0.308750 May 07 21:50:20.166189 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 783/1513] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:19 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 1194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:20.173726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91b7acef-e93e-435c-9da9-15b60438ae4a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc41cc57940>, body: {"keypair": {"name": "tempest-keypair-1250738679"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:20.192143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-91b7acef-e93e-435c-9da9-15b60438ae4a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:20.198122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-91b7acef-e93e-435c-9da9-15b60438ae4a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for user 8fb80ca48f9a4db7bb427145e7cf20ea and project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:20.405253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-91b7acef-e93e-435c-9da9-15b60438ae4a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] HTTP exception thrown: Key pair 'tempest-keypair-1250738679' already exists. May 07 21:50:20.405908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91b7acef-e93e-435c-9da9-15b60438ae4a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 409 to user: Key pair 'tempest-keypair-1250738679' already exists. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:20.406846 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91b7acef-e93e-435c-9da9-15b60438ae4a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.238762 May 07 21:50:20.407556 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 784/1514] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:50:20 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 240 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 21:50:20.430660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7ff45832-3484-4bb5-8bf1-4ca9b4ecfd2a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Calling method '.version_select at 0x7fc41caea430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:20.468921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7ff45832-3484-4bb5-8bf1-4ca9b4ecfd2a tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250738679" status: 202 len: 0 microversion: 2.1 time: 0.056941 May 07 21:50:20.469883 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 785/1515] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:50:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1250738679 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:50:20.481244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-227a08e9-9490-4bab-a803-c9098d4564d0 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc41cb04040>, body: {"keypair": {"name": ""}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:20.483869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-227a08e9-9490-4bab-a803-c9098d4564d0 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:20.485033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-227a08e9-9490-4bab-a803-c9098d4564d0 tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009916 May 07 21:50:20.486135 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 786/1516] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:50:20 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:20.495991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1e65869-2906-4b7f-bc92-a34fed7f67fc tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc41cade790>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1802602194", "public_key": " "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:20.516612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b1e65869-2906-4b7f-bc92-a34fed7f67fc tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:20.521973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b1e65869-2906-4b7f-bc92-a34fed7f67fc tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for user 8fb80ca48f9a4db7bb427145e7cf20ea and project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:20.544299 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b1e65869-2906-4b7f-bc92-a34fed7f67fc tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 07 21:50:20.546082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1e65869-2906-4b7f-bc92-a34fed7f67fc tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:20.548070 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1e65869-2906-4b7f-bc92-a34fed7f67fc tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.057048 May 07 21:50:20.550192 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 787/1517] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:50:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 07 21:50:20.565783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f2db1166-5a5d-4c1b-9b47-015e7fd2609c tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc41cc9dee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:20.567816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f2db1166-5a5d-4c1b-9b47-015e7fd2609c tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:20.569124 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f2db1166-5a5d-4c1b-9b47-015e7fd2609c tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012079 May 07 21:50:20.571213 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 788/1518] 10.222.0.32 () {60 vars in 1158 bytes} [Sat May 7 21:50:20 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:20.582969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a36f15cc-05af-4ab6-bc5e-7818d53a6cfe tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Action: 'create', calling method: .version_select at 0x7fc41cb04940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-664662365", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:20.603242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:20.605632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a36f15cc-05af-4ab6-bc5e-7818d53a6cfe tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:20.612121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a36f15cc-05af-4ab6-bc5e-7818d53a6cfe tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Getting quotas for user 8fb80ca48f9a4db7bb427145e7cf20ea and project 6a76c4307b504f23b442ba15422665e8. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:20.613770 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5330fc39-b0fe-492c-812c-dd84de455164 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.579262 May 07 21:50:20.614364 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 731/1519] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:20 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:20.646857 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-a36f15cc-05af-4ab6-bc5e-7818d53a6cfe tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 07 21:50:20.648062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a36f15cc-05af-4ab6-bc5e-7818d53a6cfe tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:20.649808 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a36f15cc-05af-4ab6-bc5e-7818d53a6cfe tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073333 May 07 21:50:20.653591 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 789/1520] 10.222.0.32 () {60 vars in 1158 bytes} [Sat May 7 21:50:20 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:50:20.663657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a565097-e2a1-46d5-809f-681c1ac4ca8e tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Calling method '.version_select at 0x7fc42271e790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:20.695533 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0a565097-e2a1-46d5-809f-681c1ac4ca8e tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1118909887 not found for user 8fb80ca48f9a4db7bb427145e7cf20ea May 07 21:50:20.696167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a565097-e2a1-46d5-809f-681c1ac4ca8e tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1118909887 not found for user 8fb80ca48f9a4db7bb427145e7cf20ea {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:20.702344 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a565097-e2a1-46d5-809f-681c1ac4ca8e tempest-KeyPairsNegativeTestJSON-971286200 tempest-KeyPairsNegativeTestJSON-971286200-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1118909887" status: 404 len: 145 microversion: 2.1 time: 0.042620 May 07 21:50:20.704043 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 732/1521] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:50:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1118909887 => generated 145 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:20.875493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:20.875814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:20.884577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:20.885045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:20.886651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:20.887161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:21.188899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:21.190456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:21.215842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:21.217480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:21.218421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:21.219283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:21.247600 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] HTTP exception thrown: Instance 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef could not be found. May 07 21:50:21.249128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Returning 404 to user: Instance 3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:21.250274 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-05ede9e4-183f-45ae-af90-06a042928f32 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef" status: 404 len: 111 microversion: 2.25 time: 0.068621 May 07 21:50:21.253572 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 733/1522] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:21 2022] GET /compute/v2.1/servers/3c5e8d5a-79cf-4bea-96aa-2a6e95ec8aef => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 07 21:50:21.375281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ddf844b4-b876-44fd-a915-dc85f6dbacb0 req-33f06860-c211-4ccb-b36f-bf137ce14fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea4853a-41f9-43d9-b213-c627f5c9eb4e", "name": "network-vif-unplugged", "status": "completed", "tag": "efb357b8-d8e7-40c3-b60d-4600d4ef216f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:21.423913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ddf844b4-b876-44fd-a915-dc85f6dbacb0 req-33f06860-c211-4ccb-b36f-bf137ce14fd7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:21.424781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ddf844b4-b876-44fd-a915-dc85f6dbacb0 req-33f06860-c211-4ccb-b36f-bf137ce14fd7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:21.457923 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ddf844b4-b876-44fd-a915-dc85f6dbacb0 req-33f06860-c211-4ccb-b36f-bf137ce14fd7 service nova] Creating event network-vif-unplugged:efb357b8-d8e7-40c3-b60d-4600d4ef216f for instance 5ea4853a-41f9-43d9-b213-c627f5c9eb4e on nch2-master-1 May 07 21:50:21.465004 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ddf844b4-b876-44fd-a915-dc85f6dbacb0 req-33f06860-c211-4ccb-b36f-bf137ce14fd7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116365 May 07 21:50:21.468518 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 734/1523] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:21.637392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:21.639924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:21.645584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:21.654012 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce679f44-06e0-4a20-a574-b4fc6136f033 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.788934 May 07 21:50:21.668602 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 790/1524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:20 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:21.675038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:21.681968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:21.684879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:21.685579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:21.879776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-836c9823-c0cf-4172-87ea-4fe1af2a072b req-0c8d5d70-8dca-41f0-bdce-15bc233034fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "name": "network-vif-plugged", "status": "completed", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:21.905897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-836c9823-c0cf-4172-87ea-4fe1af2a072b req-0c8d5d70-8dca-41f0-bdce-15bc233034fc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:21.908765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-836c9823-c0cf-4172-87ea-4fe1af2a072b req-0c8d5d70-8dca-41f0-bdce-15bc233034fc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:21.928936 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-836c9823-c0cf-4172-87ea-4fe1af2a072b req-0c8d5d70-8dca-41f0-bdce-15bc233034fc service nova] Creating event network-vif-plugged:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch1-master-1 May 07 21:50:21.950559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-836c9823-c0cf-4172-87ea-4fe1af2a072b req-0c8d5d70-8dca-41f0-bdce-15bc233034fc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082687 May 07 21:50:21.952259 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 791/1525] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:21.983497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:21.984866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:21.996232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:21.997179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:22.000984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:22.002031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:22.223896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:22.233684 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8f20751d-ac2b-4dab-902e-1d11b895f435 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.606481 May 07 21:50:22.247791 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 735/1526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:21 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:22.263000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7ad79318-62bc-4193-985f-27404ed91758 req-81976ce8-3258-43c7-b66a-76cd630df559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af003a02-3515-4f58-9883-d6033c1b72f4", "tag": "6ce344e7-dcb0-471f-b006-52cef1e33f6f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:22.279174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7ad79318-62bc-4193-985f-27404ed91758 req-81976ce8-3258-43c7-b66a-76cd630df559 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:22.280170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7ad79318-62bc-4193-985f-27404ed91758 req-81976ce8-3258-43c7-b66a-76cd630df559 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:22.293156 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7ad79318-62bc-4193-985f-27404ed91758 req-81976ce8-3258-43c7-b66a-76cd630df559 service nova] Creating event network-changed:6ce344e7-dcb0-471f-b006-52cef1e33f6f for instance af003a02-3515-4f58-9883-d6033c1b72f4 on nch1-master-1 May 07 21:50:22.299493 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7ad79318-62bc-4193-985f-27404ed91758 req-81976ce8-3258-43c7-b66a-76cd630df559 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049356 May 07 21:50:22.301258 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 736/1527] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:22.354607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1783088572", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a410d8ef-ee3d-4030-b2bf-4c0b7f9d7aaa"}], "security_groups": [{"name": "tempest-securitygroup--236613123"}], "key_name": "tempest-keypair-1665312064", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:22.387303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:22.400791 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a1c9729-4cb6-43c2-9e21-6fbe3bf8729c tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1574 microversion: 2.1 time: 0.446731 May 07 21:50:22.401529 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 792/1528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:21 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1574 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:22.671077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:22.672440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:22.682669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:22.687432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:22.688561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:22.689213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:22.794526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] validate_networks() for [('a410d8ef-ee3d-4030-b2bf-4c0b7f9d7aaa', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:23.158543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:23.176084 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6abb71b7-7f98-4320-bdfa-8c8793a76cc6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.506843 May 07 21:50:23.178382 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 793/1529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:22 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:23.252243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:23.252881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:23.261990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:23.262455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:23.263285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:23.275516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:23.607334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:23.622269 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3240b03c-fb0f-44a5-85f6-711392e70b0e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1312 microversion: 2.1 time: 0.374151 May 07 21:50:23.628356 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 794/1530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:23 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1312 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:23.643475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4904237f-93bc-4d93-9365-57debc985c8c req-6be443c4-371c-4774-82e9-ff1d2c528b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea4853a-41f9-43d9-b213-c627f5c9eb4e", "tag": "efb357b8-d8e7-40c3-b60d-4600d4ef216f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:23.662678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4904237f-93bc-4d93-9365-57debc985c8c req-6be443c4-371c-4774-82e9-ff1d2c528b1d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:23.663128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4904237f-93bc-4d93-9365-57debc985c8c req-6be443c4-371c-4774-82e9-ff1d2c528b1d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:23.688527 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4904237f-93bc-4d93-9365-57debc985c8c req-6be443c4-371c-4774-82e9-ff1d2c528b1d service nova] Creating event network-changed:efb357b8-d8e7-40c3-b60d-4600d4ef216f for instance 5ea4853a-41f9-43d9-b213-c627f5c9eb4e on nch2-master-1 May 07 21:50:23.698828 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4904237f-93bc-4d93-9365-57debc985c8c req-6be443c4-371c-4774-82e9-ff1d2c528b1d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068889 May 07 21:50:23.703002 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 795/1531] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:23.796202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:23.797112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:23.811790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:23.812601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:23.815641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:23.818853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:23.852316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for project 2a463927927b488ebe8a6e118484e8df. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:23.859927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for user cd60e0534aac4bc697aafe66723e1ab8 and project 2a463927927b488ebe8a6e118484e8df. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:23.893918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:23.908380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:23.909585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:23.910461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:23.913126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:23.914285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:23.941848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:23.944895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:23.946168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:23.948264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:23.976450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for project 2a463927927b488ebe8a6e118484e8df. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:23.983647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Getting quotas for user cd60e0534aac4bc697aafe66723e1ab8 and project 2a463927927b488ebe8a6e118484e8df. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:24.003642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:24.008757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:24.121610 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc06fe8e-3304-4ab8-8ef7-510259103af2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.772586 May 07 21:50:24.122853 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13b23b83-aa71-4940-b724-48e9d3223289 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 204 len: 0 microversion: 2.25 time: 0.334358 May 07 21:50:24.126751 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 796/1533] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:50:23 2022] DELETE /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 07 21:50:24.126975 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 737/1533] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:22 2022] POST /compute/v2.1/servers => generated 408 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:50:24.140998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a00a7ca5-91fa-402d-86b1-cd3591ee4ca2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:24.142103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a00a7ca5-91fa-402d-86b1-cd3591ee4ca2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:24.144605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:24.145173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:24.171450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:24.172913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:24.174054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:24.175955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:24.275505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a00a7ca5-91fa-402d-86b1-cd3591ee4ca2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:24.285887 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a00a7ca5-91fa-402d-86b1-cd3591ee4ca2 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1278 microversion: 2.1 time: 0.155233 May 07 21:50:24.288818 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 797/1534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:24 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:24.301340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:24.302498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:24.311951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:24.312535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:24.314381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:24.314880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:24.579305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:24.596541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c9bd357-06f1-4beb-8375-7cd5391d9f51 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.305342 May 07 21:50:24.598224 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 798/1535] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:24 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:24.640098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:24.640546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:24.641343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:24.653126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:24.654705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:24.656093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:24.658835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:24.659892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:24.660259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:24.662227 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f29f5bdb-0c12-4d1e-8d45-677bad3d26a3 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1564 microversion: 2.25 time: 0.532534 May 07 21:50:24.667988 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 738/1536] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:24 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1564 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:24.969126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-537646645", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "b2fcd05a-fa57-478e-9f0c-05c502306fa7"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:25.028430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] validate_networks() for [('b2fcd05a-fa57-478e-9f0c-05c502306fa7', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:25.138869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:25.150539 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa9db92a-584d-4ec3-9b80-e76f8227713f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1462 microversion: 2.1 time: 0.515051 May 07 21:50:25.163231 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 799/1537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:24 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1462 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:25.169080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66b00ddf-4e1f-4920-aebb-5b257d3d4b5a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:25.170017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-66b00ddf-4e1f-4920-aebb-5b257d3d4b5a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:25.176958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66b00ddf-4e1f-4920-aebb-5b257d3d4b5a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.178147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66b00ddf-4e1f-4920-aebb-5b257d3d4b5a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.178652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66b00ddf-4e1f-4920-aebb-5b257d3d4b5a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.179177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66b00ddf-4e1f-4920-aebb-5b257d3d4b5a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.444453 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66b00ddf-4e1f-4920-aebb-5b257d3d4b5a tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1613 microversion: 2.1 time: 0.279691 May 07 21:50:25.458340 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 800/1538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:25 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1613 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:25.466961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:25.468081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:25.476239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.476979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.478337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.478998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.551153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:25.551602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:25.552061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:25.552563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:25.563280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:25.579006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:25.581565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.583249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.584291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.584747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.592379 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4c8076e-2610-40e2-ae8d-dc90c560d866 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1330 microversion: 2.1 time: 0.132327 May 07 21:50:25.593355 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 801/1539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:25 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:25.599428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:25.600594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:25.608718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.609521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.611127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.612211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.650375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for project 00dedc5654754e7fbb60abf79a14666e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:25.660724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for user 29d121c7d37142d6a935ae607c0e062b and project 00dedc5654754e7fbb60abf79a14666e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:25.674330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a6edc155dc2646fbb81df7bb279aeee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566d958787dd43a0be6c8221f003c8f4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:25.675196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] flavor_id is None. Assuming migration. {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4142}} May 07 21:50:25.675963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 21:50:25.702722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:25.705054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:25.825682 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f95db0ec-d368-414a-ab1f-a0cac26e9377 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011659 May 07 21:50:25.832505 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 739/1540] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:50:25.840878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:25.842851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:25.850465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.851149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.852588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.853304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.857715 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-39bfcd5b-57cf-4fd3-9aa8-914e86082c71 tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3/action" status: 202 len: 0 microversion: 2.1 time: 0.262902 May 07 21:50:25.859395 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 802/1541] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:50:25 2022] POST /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:50:25.866602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:25.870227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:25.881066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.881815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.883653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:25.884323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:25.986241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:26.000620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:26.006123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:26.010369 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84161842-6657-42ee-b9be-cb718b4fac05 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 200 len: 1522 microversion: 2.25 time: 0.149011 May 07 21:50:26.011274 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 803/1542] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:25 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:26.025244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8976f967-710d-4fd2-9238-47659577a005 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:26.030283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8976f967-710d-4fd2-9238-47659577a005 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:26.118723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8976f967-710d-4fd2-9238-47659577a005 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:26.125799 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8976f967-710d-4fd2-9238-47659577a005 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1224 microversion: 2.1 time: 0.111268 May 07 21:50:26.126380 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 804/1543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:26 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:26.140124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9c89edbd-f355-4567-a321-aa2780389d47 req-b8b1795c-5e63-4c95-aaad-2231c55d7d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f62982-0b82-42d1-9d49-2b8d8f6ec04f", "name": "network-vif-deleted", "tag": "446d2d04-f43a-4396-ae3d-6321f1ea6225"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:26.157224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9c89edbd-f355-4567-a321-aa2780389d47 req-b8b1795c-5e63-4c95-aaad-2231c55d7d4c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:26.158496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9c89edbd-f355-4567-a321-aa2780389d47 req-b8b1795c-5e63-4c95-aaad-2231c55d7d4c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:26.206526 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9c89edbd-f355-4567-a321-aa2780389d47 req-b8b1795c-5e63-4c95-aaad-2231c55d7d4c service nova] Creating event network-vif-deleted:446d2d04-f43a-4396-ae3d-6321f1ea6225 for instance f6f62982-0b82-42d1-9d49-2b8d8f6ec04f on nch2-master-1 May 07 21:50:26.216962 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9c89edbd-f355-4567-a321-aa2780389d47 req-b8b1795c-5e63-4c95-aaad-2231c55d7d4c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086041 May 07 21:50:26.217815 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 805/1544] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:26.228545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:26.229540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:26.236510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:26.238278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:26.238983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:26.240064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:26.240717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:26.265044 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d88d39f8-f6dc-4a03-ae05-ac90f00b58ae tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.430954 May 07 21:50:26.265958 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 740/1545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:25 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:26.522929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0ceae96a-a706-4c1c-8679-95fe8793df3c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41cb47790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-904707903", "description": "tempest-description-366625570"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:26.540207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:26.557564 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-57588098-b82d-4712-9f66-ab600654e730 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1471 microversion: 2.1 time: 0.332735 May 07 21:50:26.582369 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 806/1546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:26 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:26.610542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:26.611571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:26.624030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:26.624503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:26.625307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:26.625754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:26.773313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:26.786636 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51ecb54d-c4ab-4103-97a7-c2bc141286c1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1336 microversion: 2.1 time: 0.179936 May 07 21:50:26.789825 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 807/1547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:26 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1336 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:27.021153 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0ceae96a-a706-4c1c-8679-95fe8793df3c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.666789 May 07 21:50:27.023911 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 741/1548] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:27.031708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:27.032470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: f6f62982-0b82-42d1-9d49-2b8d8f6ec04f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:27.037293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf401959-6682-4fb8-a703-791a186eb79c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41cb3ac10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2564329", "description": "tempest-description-631037265"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:27.045766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.046365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.047246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.047693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.079421 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] HTTP exception thrown: Instance f6f62982-0b82-42d1-9d49-2b8d8f6ec04f could not be found. May 07 21:50:27.080077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Returning 404 to user: Instance f6f62982-0b82-42d1-9d49-2b8d8f6ec04f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:27.084422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-571fcf67-6224-4016-86a2-e59ea19fe980 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f" status: 404 len: 111 microversion: 2.25 time: 0.060028 May 07 21:50:27.085164 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 808/1549] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:27 2022] GET /compute/v2.1/servers/f6f62982-0b82-42d1-9d49-2b8d8f6ec04f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 07 21:50:27.106541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:27.108261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:27.130957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.131419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.132426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.132875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.173456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:27.319914 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a115072-5284-4901-ba14-65efba66a5f5 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 204 len: 0 microversion: 2.25 time: 0.228770 May 07 21:50:27.322201 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 809/1550] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:50:27 2022] DELETE /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:50:27.339207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:27.340274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:27.356885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.357757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.359901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.360592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.413240 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bf401959-6682-4fb8-a703-791a186eb79c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 0.380780 May 07 21:50:27.414944 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 742/1551] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:27 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:27.446199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:27.450752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:27.828693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:27.847683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.848514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.848954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.849404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.857790 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-78e62b96-eb84-427a-aa56-f76d4f569e26 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1276 microversion: 2.1 time: 0.532486 May 07 21:50:27.858401 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 810/1552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:27 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1276 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:27.870792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:27.871404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:27.887816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.888275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:27.889094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:27.889515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:28.141139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:28.157000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:28.158754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:28.160156 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c13c4731-6553-417b-a345-f42ca90a6db8 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1547 microversion: 2.25 time: 0.300748 May 07 21:50:28.160861 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 811/1553] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:27 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1547 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:28.166438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2023086178", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "5d9854c1-90bd-4898-b59a-14d465203832"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:28.237916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] validate_networks() for [('5d9854c1-90bd-4898-b59a-14d465203832', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:28.681430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:28.693148 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-65d3b783-8f3d-420d-b980-6a39e24281a8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 1.273902 May 07 21:50:28.693960 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 743/1554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:27 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:28.710396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:28.711328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:28.720659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:28.721151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:28.722216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:28.722839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.229459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:29.244845 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c150e73a-8dcf-4847-9392-c1c3b98c4368 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1471 microversion: 2.1 time: 0.537378 May 07 21:50:29.256921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 744/1555] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:28 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1471 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:29.266932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:29.267491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:29.267850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:29.268326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:29.268695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:29.283956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:29.286251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.286734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.287592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.288049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.293926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:29.309139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.309978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.311031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.311823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.345280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Getting quotas for project f61b3dd3880d475b939a8543d9bbf481. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:29.387134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Getting quotas for user c5c73f7347e64178b56a8331649c576e and project f61b3dd3880d475b939a8543d9bbf481. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:29.412093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:29.418307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:29.484197 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29acea4e-dc09-4315-a4f8-9c11e895dd25 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321637 May 07 21:50:29.489585 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 812/1556] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:50:29.492852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:29.493538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:29.501670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.502341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.503322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.503773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.788636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:29.801439 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-76540153-69dc-48c5-b672-5cfda2f76fa4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1282 microversion: 2.1 time: 0.314791 May 07 21:50:29.803794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 813/1557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:29 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1282 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:29.817666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:29.819969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:29.833117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.835225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.837599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:29.839196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:29.951954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:29.967840 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-36b8dd8e-cb3d-4feb-8a96-86bea77421ea tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1403 microversion: 2.1 time: 0.695581 May 07 21:50:29.969856 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 745/1558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:29 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1403 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:29.979625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-58d29e84-83ce-4825-8bbe-8eb6b5629a79 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:29.982960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-58d29e84-83ce-4825-8bbe-8eb6b5629a79 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:30.023185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:30.051095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:30.053146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:30.054544 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea8817b7-0cc1-45c3-b235-7e347985dcc0 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 200 len: 1505 microversion: 2.25 time: 0.246568 May 07 21:50:30.055609 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 814/1559] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:29 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:30.075877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:30.076789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:30.084904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:30.085644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:30.086813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:30.087417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:30.176509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-58d29e84-83ce-4825-8bbe-8eb6b5629a79 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:30.221087 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-58d29e84-83ce-4825-8bbe-8eb6b5629a79 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1216 microversion: 2.1 time: 0.219509 May 07 21:50:30.224101 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 746/1560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:29 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1216 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:30.240813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6665ef32-64ee-4376-9bfd-468d84883320 req-c763fbdc-4872-419e-8545-5ce6bc900a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa51d13-aa03-48ef-9aea-32ae407e5d9d", "name": "network-vif-deleted", "tag": "aac6c92e-cff2-4454-9401-e05c725747f7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:30.268850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6665ef32-64ee-4376-9bfd-468d84883320 req-c763fbdc-4872-419e-8545-5ce6bc900a17 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:30.269422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6665ef32-64ee-4376-9bfd-468d84883320 req-c763fbdc-4872-419e-8545-5ce6bc900a17 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:30.302950 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6665ef32-64ee-4376-9bfd-468d84883320 req-c763fbdc-4872-419e-8545-5ce6bc900a17 service nova] Creating event network-vif-deleted:aac6c92e-cff2-4454-9401-e05c725747f7 for instance bfa51d13-aa03-48ef-9aea-32ae407e5d9d on nch1-master-1 May 07 21:50:30.318963 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6665ef32-64ee-4376-9bfd-468d84883320 req-c763fbdc-4872-419e-8545-5ce6bc900a17 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091753 May 07 21:50:30.321792 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 747/1561] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:30.335363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:30.336207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:30.344145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:30.344698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:30.357963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:30.358847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:30.682561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:30.694492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a2cd4a7-d6ef-4a95-abc7-959acc3ebabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1471 microversion: 2.1 time: 0.370984 May 07 21:50:30.695787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:30.710045 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 748/1562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:30 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1471 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:30.710309 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-95b3837d-c645-46f9-b355-78ef8799db43 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.638572 May 07 21:50:30.711019 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 815/1563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:30 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:30.822237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:30.823033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:30.836558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:30.837027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:30.837834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:30.838832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:30.985251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:30.986807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:31.004466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.005647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.006819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.008750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.159169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:31.167189 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ddc288e-c547-4d91-922a-63d2ed195dc9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.349660 May 07 21:50:31.168268 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 749/1564] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:30 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:31.173097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:31.173896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: bfa51d13-aa03-48ef-9aea-32ae407e5d9d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:31.182552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.183052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.184194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.184631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.204460 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] HTTP exception thrown: Instance bfa51d13-aa03-48ef-9aea-32ae407e5d9d could not be found. May 07 21:50:31.204781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Returning 404 to user: Instance bfa51d13-aa03-48ef-9aea-32ae407e5d9d could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:31.205852 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85d1b093-5d5a-4708-b4a6-041c82b35f93 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d" status: 404 len: 111 microversion: 2.25 time: 0.036454 May 07 21:50:31.206407 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 750/1565] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:31 2022] GET /compute/v2.1/servers/bfa51d13-aa03-48ef-9aea-32ae407e5d9d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:31.215120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:31.215877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:31.222753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.223234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.224099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.224546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.253194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:31.313184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:31.330088 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8847f02e-31c1-4b9c-b55f-2276d2f238fb tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1403 microversion: 2.1 time: 0.348746 May 07 21:50:31.344919 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 816/1566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:30 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1403 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:31.357215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:31.358146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:31.364486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f14ca93-c1c3-4efc-a739-1460f2c0531f tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 204 len: 0 microversion: 2.25 time: 0.153540 May 07 21:50:31.365691 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 751/1567] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:50:31 2022] DELETE /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 07 21:50:31.366714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.367393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.368570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.369883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.375174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:31.376331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:31.386846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.387644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.390236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.391113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.496830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:31.506376 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-444c3b13-f4c9-4cb9-a9fe-010ada25a141 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1268 microversion: 2.1 time: 0.159801 May 07 21:50:31.510033 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 817/1568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:31 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:31.585152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:31.594252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:31.595881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:31.597264 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e69217df-d559-4d7d-98b8-314c2b534ef6 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1563 microversion: 2.25 time: 0.227701 May 07 21:50:31.597982 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 752/1569] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:31 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1563 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:50:31.717242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:31.717874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:31.725228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.725907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.728051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:31.729708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:31.735408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.736084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.741169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.741632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.743381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:31.743781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:31.934188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:31.943910 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ecccea8b-e81c-4f80-9dee-baf10ee5f82e tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1393 microversion: 2.1 time: 0.219719 May 07 21:50:31.944708 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 753/1570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:31 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:32.184765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:32.185763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:32.191992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.192592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.193896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.194399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.362192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:32.372654 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1ea18ad-c696-418e-aefd-7e3622d50bc2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.191744 May 07 21:50:32.373216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 754/1571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:32 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:32.378028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2f6e590d-c608-40fb-8380-c1a090ba3068 req-0c724c06-1246-44cb-aaab-854c4113db1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d774b77-243e-4663-a376-3bbd59bd54e5", "tag": "667cf044-3f39-4bfe-97b5-7ac327708e49"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:32.388209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2f6e590d-c608-40fb-8380-c1a090ba3068 req-0c724c06-1246-44cb-aaab-854c4113db1b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.389704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2f6e590d-c608-40fb-8380-c1a090ba3068 req-0c724c06-1246-44cb-aaab-854c4113db1b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.403417 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2f6e590d-c608-40fb-8380-c1a090ba3068 req-0c724c06-1246-44cb-aaab-854c4113db1b service nova] Creating event network-changed:667cf044-3f39-4bfe-97b5-7ac327708e49 for instance 5d774b77-243e-4663-a376-3bbd59bd54e5 on nch2-master-1 May 07 21:50:32.409867 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2f6e590d-c608-40fb-8380-c1a090ba3068 req-0c724c06-1246-44cb-aaab-854c4113db1b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035128 May 07 21:50:32.410630 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 755/1572] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:32.416639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:32.417527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:32.424744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.425174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.425980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.426822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.433618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:32.443130 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7d7c850e-291a-45d7-ad36-f6b271b2adb3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.730145 May 07 21:50:32.455060 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 818/1573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:31 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:32.547663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:32.553542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:32.565940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.566624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.567765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.569414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.653922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:32.664049 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c30be4df-1ee6-47f4-8c7e-0c0fffabfe76 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1403 microversion: 2.1 time: 0.251942 May 07 21:50:32.664488 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 756/1574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:32 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1403 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:32.681397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:32.682978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:32.691481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.691952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.692757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.693883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.800617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:32.811777 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aefb67f3-7c4b-445f-a946-5565222c1073 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1274 microversion: 2.1 time: 0.271658 May 07 21:50:32.814133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 819/1575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:32 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:32.919243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:32.928598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:32.930433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:32.931827 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8b09a799-b6fa-4634-8390-46f776813d82 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1563 microversion: 2.25 time: 0.266325 May 07 21:50:32.932494 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 757/1576] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:32 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1563 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:32.962881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:32.967033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:32.974037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.974983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:32.976033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:32.976703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.008987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e7d30834-a937-4d45-b05c-d7c7d40f4cf3 req-1668b871-0b58-4001-af7b-0fe4f3a0c99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd9b73d-94f5-48f0-9bd4-f06f09d7b556", "tag": "24115db9-2f6d-4fcc-8408-e98da05a26e6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:33.019926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e7d30834-a937-4d45-b05c-d7c7d40f4cf3 req-1668b871-0b58-4001-af7b-0fe4f3a0c99b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.020774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e7d30834-a937-4d45-b05c-d7c7d40f4cf3 req-1668b871-0b58-4001-af7b-0fe4f3a0c99b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.059399 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e7d30834-a937-4d45-b05c-d7c7d40f4cf3 req-1668b871-0b58-4001-af7b-0fe4f3a0c99b service nova] Creating event network-changed:24115db9-2f6d-4fcc-8408-e98da05a26e6 for instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 on nch2-master-1 May 07 21:50:33.070321 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e7d30834-a937-4d45-b05c-d7c7d40f4cf3 req-1668b871-0b58-4001-af7b-0fe4f3a0c99b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065797 May 07 21:50:33.075045 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 758/1577] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:50:33.392261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:33.394459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:33.402673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.404046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.405061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.405689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.547833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:33.558205 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f4031e5-c430-484c-9350-6704ff316dcb tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1383 microversion: 2.1 time: 0.600334 May 07 21:50:33.558846 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 820/1578] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:32 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1383 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:33.564453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:33.565160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:33.578873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:33.582239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.583000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.584047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.584441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.590217 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-42db2a51-d924-41c2-9520-381875e81fe7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.203218 May 07 21:50:33.590660 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 759/1579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:33 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:33.596343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9657d9b3-c051-43b8-b415-a74ac437fcef tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '.version_select at 0x7fc41cadf940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:33.599033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9657d9b3-c051-43b8-b415-a74ac437fcef tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.599668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9657d9b3-c051-43b8-b415-a74ac437fcef tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.613659 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9657d9b3-c051-43b8-b415-a74ac437fcef tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 3509 microversion: 2.1 time: 0.021617 May 07 21:50:33.614522 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 760/1580] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 21:50:33 2022] GET /compute/v2.1/os-migrations => generated 3509 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:33.631106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-650fceec-d730-453e-93bf-554be95f8e53 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:33.631773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-650fceec-d730-453e-93bf-554be95f8e53 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:33.643757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-650fceec-d730-453e-93bf-554be95f8e53 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.644223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-650fceec-d730-453e-93bf-554be95f8e53 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.645068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-650fceec-d730-453e-93bf-554be95f8e53 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.645525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-650fceec-d730-453e-93bf-554be95f8e53 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.801563 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-650fceec-d730-453e-93bf-554be95f8e53 tempest-LiveMigrationTest-1060990445 tempest-LiveMigrationTest-1060990445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1534 microversion: 2.1 time: 0.177100 May 07 21:50:33.802160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 761/1581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:33 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1534 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:33.809937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:33.809937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:33.829424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.829921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:33.832164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:33.832164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.016662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.028817 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4e6a18bb-153f-4421-94e0-1211c41e7a74 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1403 microversion: 2.1 time: 0.225449 May 07 21:50:34.029899 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 762/1582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:33 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1403 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:34.044755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:34.045050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:34.052615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.053083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.053887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.054336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.100569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:34.127222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.143513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fba7867b-f64a-4361-bdb9-4e0d4a2a7918 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.582979 May 07 21:50:34.154247 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 821/1583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:33 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:34.174002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:34.177300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:34.184789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.186337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.187311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.198370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.243457 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86986444-aa11-466c-bdfb-b42fa8d535c8 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 204 len: 0 microversion: 2.1 time: 0.203050 May 07 21:50:34.248785 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 763/1584] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:34 2022] DELETE /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:50:34.257375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:34.259070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:34.268649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.269184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.270356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.270829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.306012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.307364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.307827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lazy-loading 'fault' on Instance uuid 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:34.361043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.394199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.403030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99e9b91d4fb949f18cc61bf2bbd63ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db49857a44d4f399959ac625886505a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.405709 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af9f1efc-b6d1-4fe8-8954-7b44fe3f0591 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 200 len: 1351 microversion: 2.25 time: 0.155522 May 07 21:50:34.407843 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 764/1585] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:34 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:34.423761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:34.424470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:34.432286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.432785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.433898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.434226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.515003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.524281 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a6f6bc96-0bfb-49cf-862c-af32ff0174b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.359658 May 07 21:50:34.525123 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 822/1586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:34 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:34.586330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.593839 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-709d217c-3048-4ba9-9a1f-f0c8f46dcd13 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1389 microversion: 2.1 time: 0.182134 May 07 21:50:34.594415 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 765/1587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:34 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1389 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:34.606733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:34.607437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:34.613251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.613705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.614479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:34.614970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:34.743945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:34.751250 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-218bc070-0cab-46ff-9f7d-20caef32ad1b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.148427 May 07 21:50:34.751820 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 823/1588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:34 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:35.045526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:35.046656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:35.052769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.053238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.054025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.054545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.115577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-28ca87d3-94da-406f-94a1-5c7d0b8fed58 req-ac76f1be-eb9a-4011-be8f-0bf5e229aa5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52713c0c-6d75-42a3-96ac-5a93b17ef0b1", "name": "network-vif-deleted", "tag": "8fc97b61-6eb0-420e-adf9-104bdbfbc835"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:35.127823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-28ca87d3-94da-406f-94a1-5c7d0b8fed58 req-ac76f1be-eb9a-4011-be8f-0bf5e229aa5b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.128989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-28ca87d3-94da-406f-94a1-5c7d0b8fed58 req-ac76f1be-eb9a-4011-be8f-0bf5e229aa5b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.154361 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-28ca87d3-94da-406f-94a1-5c7d0b8fed58 req-ac76f1be-eb9a-4011-be8f-0bf5e229aa5b service nova] Creating event network-vif-deleted:8fc97b61-6eb0-420e-adf9-104bdbfbc835 for instance 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 on nch1-master-1 May 07 21:50:35.162896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-28ca87d3-94da-406f-94a1-5c7d0b8fed58 req-ac76f1be-eb9a-4011-be8f-0bf5e229aa5b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052904 May 07 21:50:35.166603 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 824/1589] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:35.173684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:35.174656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:35.181489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.182648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.183575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.184154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.200576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:35.207724 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c14aa70-061b-4972-b300-f12932ff59f1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1403 microversion: 2.1 time: 0.165567 May 07 21:50:35.215248 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 766/1590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:35 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1403 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:35.426880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:35.427535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] [instance: 52713c0c-6d75-42a3-96ac-5a93b17ef0b1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:35.434465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.434973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.435770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.436224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.450616 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] HTTP exception thrown: Instance 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 could not be found. May 07 21:50:35.451390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] Returning 404 to user: Instance 52713c0c-6d75-42a3-96ac-5a93b17ef0b1 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:35.452240 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5dd2124c-ab7a-4e60-b3f5-8f08273b0045 tempest-LiveAutoBlockMigrationV225Test-1194124795 tempest-LiveAutoBlockMigrationV225Test-1194124795-project] 10.222.0.32 "GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1" status: 404 len: 111 microversion: 2.25 time: 0.029615 May 07 21:50:35.452782 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 767/1591] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:35 2022] GET /compute/v2.1/servers/52713c0c-6d75-42a3-96ac-5a93b17ef0b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 07 21:50:35.541541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:35.543153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:35.549231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.549760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.550618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.551197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.564206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:35.580548 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48f28f31-9259-4f7e-9805-d2e4712ea988 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.411874 May 07 21:50:35.581763 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 825/1592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:35 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:35.610815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:35.611796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:35.618456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.618456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.620053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.620526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.762430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:35.772825 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b2f8f8d5-0975-4049-9ffc-973578e61502 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.235132 May 07 21:50:35.775600 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 768/1593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:35 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:35.778300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:35.779115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:35.786244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.786951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:35.788019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:35.788341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.046969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:36.061614 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9bb16edd-b601-4471-a5d5-3c8297976677 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.286779 May 07 21:50:36.072566 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 769/1594] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:35 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:36.078868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-52df2e4c-be96-4771-a083-f1ad337b34b3 req-bfb45318-f58d-4bdc-939b-d1c1774f4500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d774b77-243e-4663-a376-3bbd59bd54e5", "name": "network-vif-plugged", "status": "completed", "tag": "667cf044-3f39-4bfe-97b5-7ac327708e49"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:36.088540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-52df2e4c-be96-4771-a083-f1ad337b34b3 req-bfb45318-f58d-4bdc-939b-d1c1774f4500 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:36.088996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-52df2e4c-be96-4771-a083-f1ad337b34b3 req-bfb45318-f58d-4bdc-939b-d1c1774f4500 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.101557 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-52df2e4c-be96-4771-a083-f1ad337b34b3 req-bfb45318-f58d-4bdc-939b-d1c1774f4500 service nova] Creating event network-vif-plugged:667cf044-3f39-4bfe-97b5-7ac327708e49 for instance 5d774b77-243e-4663-a376-3bbd59bd54e5 on nch2-master-1 May 07 21:50:36.108349 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-52df2e4c-be96-4771-a083-f1ad337b34b3 req-bfb45318-f58d-4bdc-939b-d1c1774f4500 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033381 May 07 21:50:36.109309 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 770/1595] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:36.230179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:36.235652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:36.248457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:36.250592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.251931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:36.254835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.376568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:36.387136 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d273730-5a0d-433c-a941-0f70592e218a tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1389 microversion: 2.1 time: 0.780155 May 07 21:50:36.388678 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 826/1596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:35 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1389 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:36.507114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:36.516381 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1df2c276-b3b6-4ea2-8e04-870388ee8442 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1403 microversion: 2.1 time: 0.292177 May 07 21:50:36.517038 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 771/1597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:36 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1403 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:36.597396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:36.598033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:36.604689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:36.605154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.605942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:36.606393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.790836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:36.792466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:36.798686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:36.799199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.800005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:36.800463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:36.940771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:36.949613 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09887626-de27-45fe-9b91-274285cce144 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.163483 May 07 21:50:36.950508 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 772/1598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:36 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:37.080727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:37.081563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:37.096889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.097713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.098786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.099463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.175706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:37.187090 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29426039-e145-483c-82b0-7d0553c0b127 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.592992 May 07 21:50:37.188453 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 827/1599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:36 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:37.220107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-26dc0c5d-31f3-40db-ab3e-1930c9377b48 req-72c3f388-290c-4d9d-adb1-3c22da50d7fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a90838-d258-4958-946b-46c5f06a0e4c", "tag": "f4e84972-b5b8-4161-be41-2a7625450b34"}, {"server_uuid": "5ea4853a-41f9-43d9-b213-c627f5c9eb4e", "name": "network-vif-deleted", "tag": "efb357b8-d8e7-40c3-b60d-4600d4ef216f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:37.230267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-26dc0c5d-31f3-40db-ab3e-1930c9377b48 req-72c3f388-290c-4d9d-adb1-3c22da50d7fb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.231212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-26dc0c5d-31f3-40db-ab3e-1930c9377b48 req-72c3f388-290c-4d9d-adb1-3c22da50d7fb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.246029 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-26dc0c5d-31f3-40db-ab3e-1930c9377b48 req-72c3f388-290c-4d9d-adb1-3c22da50d7fb service nova] Creating event network-changed:f4e84972-b5b8-4161-be41-2a7625450b34 for instance 94a90838-d258-4958-946b-46c5f06a0e4c on nch1-master-1 May 07 21:50:37.246557 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-26dc0c5d-31f3-40db-ab3e-1930c9377b48 req-72c3f388-290c-4d9d-adb1-3c22da50d7fb service nova] Creating event network-vif-deleted:efb357b8-d8e7-40c3-b60d-4600d4ef216f for instance 5ea4853a-41f9-43d9-b213-c627f5c9eb4e on nch1-master-1 May 07 21:50:37.253307 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-26dc0c5d-31f3-40db-ab3e-1930c9377b48 req-72c3f388-290c-4d9d-adb1-3c22da50d7fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040455 May 07 21:50:37.254536 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 828/1600] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:37.272171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:37.280450 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1ca7716a-6230-48ea-92d4-5edd01f422a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.204719 May 07 21:50:37.281036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 773/1601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:37 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:37.406023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:37.406975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:37.414462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.414963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.415859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.416676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.458601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.459402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.460053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lazy-loading 'fault' on Instance uuid 5ea4853a-41f9-43d9-b213-c627f5c9eb4e {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:37.534824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:37.537302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:37.547325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.547855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.548765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.549462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.574975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:37.611969 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6bfc2a03-2c26-4f9e-b23c-37ea2990b6a7 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 200 len: 1143 microversion: 2.1 time: 0.210161 May 07 21:50:37.614914 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 829/1602] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:37 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 1143 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:37.732627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:37.740748 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-625f6ec5-9c79-4d42-978d-a305508796ed tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1403 microversion: 2.1 time: 0.211012 May 07 21:50:37.741445 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 774/1603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:37 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1403 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:37.971164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:37.972028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:37.982628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.983359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:37.984320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:37.985872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.141781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:38.149480 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-37207cfc-163d-4e9d-b5ca-2e2aa317b244 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.187621 May 07 21:50:38.150150 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 830/1604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:37 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:38.205973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:38.206676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:38.216621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.217238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.218321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.222590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.297207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:38.298291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:38.310202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.312998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.313919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.316038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.436198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:38.446590 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e78c5d53-5f2a-475b-8e87-073245b1b883 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.245192 May 07 21:50:38.448449 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 775/1605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:38 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:38.592707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:38.601037 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-36388365-4765-4f5d-9bac-1fa4395ff3f2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.308150 May 07 21:50:38.601624 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 831/1606] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:38 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:38.630029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:38.630747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 5ea4853a-41f9-43d9-b213-c627f5c9eb4e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:38.637421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.637883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.638671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.639145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.653283 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] HTTP exception thrown: Instance 5ea4853a-41f9-43d9-b213-c627f5c9eb4e could not be found. May 07 21:50:38.653890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Returning 404 to user: Instance 5ea4853a-41f9-43d9-b213-c627f5c9eb4e could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:38.654791 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-171a5e27-eca6-479b-a32b-18f71b9d7e32 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e" status: 404 len: 111 microversion: 2.1 time: 0.028857 May 07 21:50:38.655356 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 776/1607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:38 2022] GET /compute/v2.1/servers/5ea4853a-41f9-43d9-b213-c627f5c9eb4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:38.759097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:38.760072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:38.773318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.773879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:38.774952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:38.777295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.048972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:39.058704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a26b1dc3-9d92-4951-b5a7-7dc4780188be tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1589 microversion: 2.1 time: 0.304850 May 07 21:50:39.059816 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 832/1608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:38 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1589 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:39.076260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6b5f1ea8-d2c5-4991-996c-c61a79fc5770 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:39.076814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6b5f1ea8-d2c5-4991-996c-c61a79fc5770 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:39.083694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b5f1ea8-d2c5-4991-996c-c61a79fc5770 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.084071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b5f1ea8-d2c5-4991-996c-c61a79fc5770 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.084843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b5f1ea8-d2c5-4991-996c-c61a79fc5770 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.085819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b5f1ea8-d2c5-4991-996c-c61a79fc5770 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.170835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:39.171636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:39.174263 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6b5f1ea8-d2c5-4991-996c-c61a79fc5770 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101101 May 07 21:50:39.175083 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 777/1609] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:50:39 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:39.183608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.184319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.185400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.186708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.466974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:39.469884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:39.476348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:39.477542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.478552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.479866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.480910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.487601 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84a4b653-91d4-4957-99ad-b38f6448a2c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.321933 May 07 21:50:39.488529 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 833/1610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:39 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:39.618070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:39.620945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:39.628726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.628726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.628726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.628726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.791460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:39.800446 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63e652cb-5d65-422f-acff-c45c9293ca0b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.186542 May 07 21:50:39.802847 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 834/1611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:39 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:39.829340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:39.829857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:39.837410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.838200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.839250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.839886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:39.870197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:39.977921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88895cdc-690d-4ac6-81b8-acfb7a693d44 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "DELETE /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 204 len: 0 microversion: 2.1 time: 0.153672 May 07 21:50:39.981059 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 835/1612] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:39 2022] DELETE /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:50:39.989427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:39.990568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:39.998642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:39.999345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.000385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.001048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.077963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:40.085886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-65c5167f-97a2-4cec-8e1e-103c5b406f79 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.625274 May 07 21:50:40.088821 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 778/1613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:39 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:40.099307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e1baaab3-a6f3-49ff-acf5-df714e7723c8 req-0ede830c-e1a8-4e36-89cd-ef680ca762a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9b73d-94f5-48f0-9bd4-f06f09d7b556", "name": "network-vif-plugged", "status": "completed", "tag": "24115db9-2f6d-4fcc-8408-e98da05a26e6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:40.125226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e1baaab3-a6f3-49ff-acf5-df714e7723c8 req-0ede830c-e1a8-4e36-89cd-ef680ca762a0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.125600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e1baaab3-a6f3-49ff-acf5-df714e7723c8 req-0ede830c-e1a8-4e36-89cd-ef680ca762a0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.143366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e1baaab3-a6f3-49ff-acf5-df714e7723c8 req-0ede830c-e1a8-4e36-89cd-ef680ca762a0 service nova] Creating event network-vif-plugged:24115db9-2f6d-4fcc-8408-e98da05a26e6 for instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 on nch2-master-1 May 07 21:50:40.149978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e1baaab3-a6f3-49ff-acf5-df714e7723c8 req-0ede830c-e1a8-4e36-89cd-ef680ca762a0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059945 May 07 21:50:40.150634 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 779/1614] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:40.171264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:40.180494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bf4d2cb6-a73a-49f8-babc-3feffb79bf7d tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1498 microversion: 2.1 time: 0.195365 May 07 21:50:40.181419 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 836/1615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:39 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1498 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:40.181630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:40.182710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:40.190399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.190988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.191867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.192401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.232764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:40.357743 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-33f8485e-3d70-4092-beb8-2bb55f9ec927 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 204 len: 0 microversion: 2.1 time: 0.180585 May 07 21:50:40.361480 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 780/1616] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:40 2022] DELETE /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 21:50:40.367949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:40.369593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:40.380040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.381967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.393009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.393481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.505595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:40.506423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:40.519193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.519935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.520869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.521422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.573398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:40.581153 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b37cf93b-255c-4997-9890-9fbf90185804 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1667 microversion: 2.1 time: 0.218358 May 07 21:50:40.587221 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 837/1617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:40 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1667 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:40.715335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1791920165", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:40.756250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:40.768452 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6004ec6-dfb5-4225-8f94-ead2e793b9fb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.267062 May 07 21:50:40.778361 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 781/1618] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:40 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:40.782542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:40.817766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:40.818756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:40.825792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.826251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.827071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.827510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.972081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:40.980425 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a0157961-404a-4b55-809b-75dadf8579a2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.166547 May 07 21:50:40.981242 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 782/1619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:40 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:40.988983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:40.990700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:40.996923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.997591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:40.998652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:40.999221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.124225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:41.125003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:41.125711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:41.126380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:41.127068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:41.138755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.139800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.140891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.141438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.153263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:41.160022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Getting quotas for project 3ed0bf2e98fe4e67abb30f040a638365. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:41.163382 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92073681-af81-40b9-8eb5-5e594b997bc1 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1589 microversion: 2.1 time: 0.180758 May 07 21:50:41.164562 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 783/1620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:40 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1589 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:41.165131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Getting quotas for user 2e6fd0a2daba417b9e39213a5e4c1f4e and project 3ed0bf2e98fe4e67abb30f040a638365. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:41.179751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:41.183136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:41.185700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e4d71c56-f6af-4e74-aab1-e48235eaefe1 req-688a9e19-5d97-481c-a45f-fd1f1ac30343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d774b77-243e-4663-a376-3bbd59bd54e5", "tag": "667cf044-3f39-4bfe-97b5-7ac327708e49"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:41.198431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e4d71c56-f6af-4e74-aab1-e48235eaefe1 req-688a9e19-5d97-481c-a45f-fd1f1ac30343 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.199513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e4d71c56-f6af-4e74-aab1-e48235eaefe1 req-688a9e19-5d97-481c-a45f-fd1f1ac30343 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.218947 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e4d71c56-f6af-4e74-aab1-e48235eaefe1 req-688a9e19-5d97-481c-a45f-fd1f1ac30343 service nova] Creating event network-changed:667cf044-3f39-4bfe-97b5-7ac327708e49 for instance 5d774b77-243e-4663-a376-3bbd59bd54e5 on nch2-master-1 May 07 21:50:41.227171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e4d71c56-f6af-4e74-aab1-e48235eaefe1 req-688a9e19-5d97-481c-a45f-fd1f1ac30343 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060576 May 07 21:50:41.229461 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 784/1621] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:41.236778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:41.237766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:41.245520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.246281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.247333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.247984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.281985 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e78c408-4c02-4668-bdad-68285eb2b95d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693282 May 07 21:50:41.283228 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 838/1622] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:50:41.289659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:41.290519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:41.317187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.319641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.320755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.321415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.410348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:41.419444 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2b30ef7-fa00-4a03-a12a-b71204b49832 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 200 len: 1456 microversion: 2.1 time: 0.134954 May 07 21:50:41.421086 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 839/1623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:41 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 1456 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:41.426058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-091b77ca-bad3-455d-91e1-17331e88b43e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:41.426816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-091b77ca-bad3-455d-91e1-17331e88b43e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:41.522060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-091b77ca-bad3-455d-91e1-17331e88b43e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:41.529227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-091b77ca-bad3-455d-91e1-17331e88b43e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1219 microversion: 2.1 time: 0.106915 May 07 21:50:41.529979 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 840/1624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:41 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:41.538596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3b9e8173-2aae-44be-8c11-d30f2994f3e0 req-472c8b56-da1d-42d3-a12d-ff9181567680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028d626c-306b-45cc-81b8-b73eca1c01c3", "name": "network-vif-deleted", "tag": "87c894e0-03dd-4dab-a47b-82dec6ea1485"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:41.551524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b9e8173-2aae-44be-8c11-d30f2994f3e0 req-472c8b56-da1d-42d3-a12d-ff9181567680 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.552006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b9e8173-2aae-44be-8c11-d30f2994f3e0 req-472c8b56-da1d-42d3-a12d-ff9181567680 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.557380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:41.567129 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0547bde9-7d41-4efb-9428-07aff55b9028 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.335464 May 07 21:50:41.568988 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 785/1625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:41 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:41.580570 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3b9e8173-2aae-44be-8c11-d30f2994f3e0 req-472c8b56-da1d-42d3-a12d-ff9181567680 service nova] Creating event network-vif-deleted:87c894e0-03dd-4dab-a47b-82dec6ea1485 for instance 028d626c-306b-45cc-81b8-b73eca1c01c3 on nch1-master-1 May 07 21:50:41.586034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3b9e8173-2aae-44be-8c11-d30f2994f3e0 req-472c8b56-da1d-42d3-a12d-ff9181567680 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055016 May 07 21:50:41.593327 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 841/1626] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:41.597734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:41.598368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:41.607735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.608545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.609847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.610536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.779463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:41.791968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:41.793946 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9d6c0b37-e803-4da3-9afb-16ee1d8a0e0b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1667 microversion: 2.1 time: 0.199559 May 07 21:50:41.794640 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 786/1627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:41 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1667 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:41.795337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:41.802123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.802896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.803779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:41.804468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:41.998091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:41.998671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:41.999593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:42.011368 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-105d5ec6-d8d5-4657-af9c-4c01d7a4f8ae tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.229460 May 07 21:50:42.012797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.013257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 842/1628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:41 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:42.013446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.015137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.015597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.224703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:42.257699 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-708f00c7-72a7-45b9-8a08-6eb985416423 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1324 microversion: 2.1 time: 0.263628 May 07 21:50:42.268614 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 787/1629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:41 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:42.438031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:42.439328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 028d626c-306b-45cc-81b8-b73eca1c01c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:42.446806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.447896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.448730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.449192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.465035 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] HTTP exception thrown: Instance 028d626c-306b-45cc-81b8-b73eca1c01c3 could not be found. May 07 21:50:42.465550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Returning 404 to user: Instance 028d626c-306b-45cc-81b8-b73eca1c01c3 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:42.466418 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54f10416-d58e-40ef-b7eb-e0daac19b697 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3" status: 404 len: 111 microversion: 2.1 time: 0.032765 May 07 21:50:42.467023 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 843/1630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:42 2022] GET /compute/v2.1/servers/028d626c-306b-45cc-81b8-b73eca1c01c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:42.479038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:42.479673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:42.489885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.490357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.491203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.491658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.520377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:42.545792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:42.546586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:42.558297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.559102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.563588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.565155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.628732 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-06aeff44-863a-47b7-a406-ab6e7f2aa622 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 204 len: 0 microversion: 2.1 time: 0.157136 May 07 21:50:42.632620 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 788/1631] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:42 2022] DELETE /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:50:42.639143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:42.640012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:42.648445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.648668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.649537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.650064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.780200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:42.798721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e612cc49-b965-400f-8e3d-fcfea73c6397 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1271 microversion: 2.1 time: 0.256832 May 07 21:50:42.801955 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 844/1632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:42 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:42.815457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:42.816088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:42.824270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.824738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.825501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.826123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.916378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:42.926072 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be3e53dd-0c77-43b7-9208-a6b1fc8ed84e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.291991 May 07 21:50:42.927118 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 789/1633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:42 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:42.932793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:42.933582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:42.939995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.940671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:42.941843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:42.942577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.168129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3abb274c044cc4b88d57193b5c62d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '281216301a5449cdb4c66e9f35e6e582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:43.186495 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0ba5d61c-4a02-4e88-b031-566e8a0e7863 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 200 len: 1667 microversion: 2.1 time: 0.257581 May 07 21:50:43.187588 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 790/1634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:42 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 1667 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:43.192703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:43.201076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:43.208378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.208846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.215328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.216130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.248639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:43.262987 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2a4caab7-8c98-4f6a-add2-10f1e9e3098c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1485 microversion: 2.1 time: 0.459797 May 07 21:50:43.274350 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 845/1635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:42 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1485 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:43.283503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:43.284506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:43.292499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.293143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.294168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.294643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.569218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:43.583277 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63aab855-7dbf-4d78-818c-e4b63bbaa866 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.394017 May 07 21:50:43.595077 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 791/1636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:43 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:43.612353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b81f3d2c-34e7-4f0f-b919-bf7962c65f8d req-98fc8b7e-1476-4e80-8232-8b0ff1bea36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a90838-d258-4958-946b-46c5f06a0e4c", "name": "network-vif-plugged", "status": "completed", "tag": "f4e84972-b5b8-4161-be41-2a7625450b34"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:43.622096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b81f3d2c-34e7-4f0f-b919-bf7962c65f8d req-98fc8b7e-1476-4e80-8232-8b0ff1bea36e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.622712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b81f3d2c-34e7-4f0f-b919-bf7962c65f8d req-98fc8b7e-1476-4e80-8232-8b0ff1bea36e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.637291 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b81f3d2c-34e7-4f0f-b919-bf7962c65f8d req-98fc8b7e-1476-4e80-8232-8b0ff1bea36e service nova] Creating event network-vif-plugged:f4e84972-b5b8-4161-be41-2a7625450b34 for instance 94a90838-d258-4958-946b-46c5f06a0e4c on nch1-master-1 May 07 21:50:43.642507 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b81f3d2c-34e7-4f0f-b919-bf7962c65f8d req-98fc8b7e-1476-4e80-8232-8b0ff1bea36e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045986 May 07 21:50:43.643783 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 792/1637] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:43.652716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9fc318dd-5d80-43f4-8ded-605a3a8cc2ce req-e03aee83-7366-44f3-9d78-06bce52e2cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb2faa2-ee9e-47d3-a891-24cec328a4c2", "name": "network-vif-deleted", "tag": "95a695cd-81c6-4f14-adb9-b284c5d977e3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:43.663963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9fc318dd-5d80-43f4-8ded-605a3a8cc2ce req-e03aee83-7366-44f3-9d78-06bce52e2cc0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.665217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9fc318dd-5d80-43f4-8ded-605a3a8cc2ce req-e03aee83-7366-44f3-9d78-06bce52e2cc0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.680141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9fc318dd-5d80-43f4-8ded-605a3a8cc2ce req-e03aee83-7366-44f3-9d78-06bce52e2cc0 service nova] Creating event network-vif-deleted:95a695cd-81c6-4f14-adb9-b284c5d977e3 for instance bbb2faa2-ee9e-47d3-a891-24cec328a4c2 on nch2-master-1 May 07 21:50:43.688418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9fc318dd-5d80-43f4-8ded-605a3a8cc2ce req-e03aee83-7366-44f3-9d78-06bce52e2cc0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042694 May 07 21:50:43.689484 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 793/1638] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:43.819173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:43.820359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:43.827349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.828059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.829059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.829506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.896835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:43.912396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:43.912556 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-59178b93-14f3-4d0d-aa1b-18da42840074 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.636431 May 07 21:50:43.913025 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 846/1639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:43 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:43.932058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:43.933265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:43.934024 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c9ffd1e-00c5-41f2-9c3c-ac2acc5bca0e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1277 microversion: 2.1 time: 0.119538 May 07 21:50:43.934983 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 794/1640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:43 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:43.942580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.943151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.944287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.945007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.956076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:43.957610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:43.968279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.968972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:43.969917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:43.970518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.143299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:44.154239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ec5022bc-c9a1-4f49-a593-73b908ea4645 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.213066 May 07 21:50:44.155793 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 795/1641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:43 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:44.218119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:44.218800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] [instance: bbb2faa2-ee9e-47d3-a891-24cec328a4c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:44.227813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.229543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.230606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.231730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.253732 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] HTTP exception thrown: Instance bbb2faa2-ee9e-47d3-a891-24cec328a4c2 could not be found. May 07 21:50:44.254337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Returning 404 to user: Instance bbb2faa2-ee9e-47d3-a891-24cec328a4c2 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:44.255276 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a242eab4-32b5-4729-bf9f-ec2ed7eeaf50 tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2" status: 404 len: 111 microversion: 2.1 time: 0.049674 May 07 21:50:44.255837 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 796/1642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:44 2022] GET /compute/v2.1/servers/bbb2faa2-ee9e-47d3-a891-24cec328a4c2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:44.269110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-73106e8f-b29d-40db-b800-82f7c597657b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] Calling method '.version_select at 0x7fc4226c8820>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:44.272718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:44.291081 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a994a871-b423-4afa-84c5-575054541a52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.363698 May 07 21:50:44.296229 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 847/1643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:43 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:44.296697 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-73106e8f-b29d-40db-b800-82f7c597657b tempest-ServersTestFqdnHostnames-1252842742 tempest-ServersTestFqdnHostnames-1252842742-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026050338" status: 202 len: 0 microversion: 2.1 time: 0.033416 May 07 21:50:44.298935 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 797/1644] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:50:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026050338 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:50:44.311069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:44.316786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:44.323274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ce48314-2ba6-4a86-8063-076a9456218d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1819177688", "metadata": {"": ""}}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:44.327628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ce48314-2ba6-4a86-8063-076a9456218d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:44.328229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.329040 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ce48314-2ba6-4a86-8063-076a9456218d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action" status: 400 len: 170 microversion: 2.1 time: 0.016017 May 07 21:50:44.329484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.330363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.330848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.332978 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 798/1645] 10.222.0.32 () {60 vars in 1278 bytes} [Sat May 7 21:50:44 2022] POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:44.342015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:44.343005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:44.352263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.353001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.354055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.354710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.490292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:44.501525 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-90955c52-aa9a-4f6c-ba4a-fd88dfc470a0 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 200 len: 1443 microversion: 2.1 time: 0.203557 May 07 21:50:44.503387 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 848/1646] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:44 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 1443 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:44.592125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-fda9244b-007f-49c0-9baa-f38aded544b4 req-1e7425a2-8a58-41be-94e2-f9a3575562b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3533de6f-5073-4e2e-9620-5655b2cdcb7f", "name": "network-vif-deleted", "tag": "9177df96-b4f9-41db-8806-f7ea5787a4fc"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:44.602377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:44.612149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2940645d-a464-4552-a953-f9466d985f5a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.276353 May 07 21:50:44.615223 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 799/1647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:44 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:44.616837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fda9244b-007f-49c0-9baa-f38aded544b4 req-1e7425a2-8a58-41be-94e2-f9a3575562b3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.618443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fda9244b-007f-49c0-9baa-f38aded544b4 req-1e7425a2-8a58-41be-94e2-f9a3575562b3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.628112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:44.628775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:44.636266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.636604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.637460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.637913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.647463 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-fda9244b-007f-49c0-9baa-f38aded544b4 req-1e7425a2-8a58-41be-94e2-f9a3575562b3 service nova] Creating event network-vif-deleted:9177df96-b4f9-41db-8806-f7ea5787a4fc for instance 3533de6f-5073-4e2e-9620-5655b2cdcb7f on nch1-master-1 May 07 21:50:44.654399 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-fda9244b-007f-49c0-9baa-f38aded544b4 req-1e7425a2-8a58-41be-94e2-f9a3575562b3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065897 May 07 21:50:44.655986 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 849/1648] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:50:44.665831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:44.686587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:44.699282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.699881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.700783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.703276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.928635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:44.937302 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dfe316f9-2fd2-4471-94df-a05176b6574e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.278920 May 07 21:50:44.937908 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 850/1649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:44 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:44.951642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:44.952573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:44.959267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.973047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:44.974274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:44.975206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.062836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:45.071030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c342e29b-cbb7-4583-925a-46a3e571b4b8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1316 microversion: 2.1 time: 0.454695 May 07 21:50:45.074043 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 800/1650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:44 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:45.085083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5ada66a7-a2d6-4f94-869f-f13160604df9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-216271104", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:45.086377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5ada66a7-a2d6-4f94-869f-f13160604df9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:45.087256 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5ada66a7-a2d6-4f94-869f-f13160604df9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action" status: 400 len: 938 microversion: 2.1 time: 0.012451 May 07 21:50:45.096152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 801/1651] 10.222.0.32 () {60 vars in 1278 bytes} [Sat May 7 21:50:45 2022] POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:45.110039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:45.111447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:45.129930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.130510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.131563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.132009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.285678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:45.293829 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-303108d0-2ad1-42a4-913d-17d05c6e7d55 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.346010 May 07 21:50:45.294971 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 851/1652] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:44 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:45.305008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:45.305935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:45.313024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.313852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.314957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.315497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.343396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:45.352500 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-97b0258d-a8ec-4159-b344-21846fe29bc7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.253901 May 07 21:50:45.353626 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 802/1653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:45 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:45.369781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:45.386981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:45.415264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.416739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.417740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.418362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.582146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:45.591488 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-df7bf225-19da-4eb7-9411-1a2122c80be1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.295236 May 07 21:50:45.592331 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 852/1654] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:45 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:45.597325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:45.598300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 3533de6f-5073-4e2e-9620-5655b2cdcb7f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:45.607144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.607606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.608400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.608846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.625349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] HTTP exception thrown: Instance 3533de6f-5073-4e2e-9620-5655b2cdcb7f could not be found. May 07 21:50:45.625964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Returning 404 to user: Instance 3533de6f-5073-4e2e-9620-5655b2cdcb7f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:45.626836 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb5abaf1-985a-4ada-9b86-b7fcd727f8e2 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f" status: 404 len: 111 microversion: 2.1 time: 0.033342 May 07 21:50:45.627767 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 853/1655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:45 2022] GET /compute/v2.1/servers/3533de6f-5073-4e2e-9620-5655b2cdcb7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:45.636373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:45.636891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:45.643498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.643952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.644389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:45.645462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.646075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.653402 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-45662d66-2453-49cd-85cc-f1aaa74865a3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.287516 May 07 21:50:45.654811 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 803/1656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:45 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:45.672182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:45.673526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5d621e5-8b42-433d-ab56-9da5ab95421d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:45.674878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5d621e5-8b42-433d-ab56-9da5ab95421d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:45.675785 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5d621e5-8b42-433d-ab56-9da5ab95421d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action" status: 400 len: 619 microversion: 2.1 time: 0.009132 May 07 21:50:45.676708 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 804/1657] 10.222.0.32 () {60 vars in 1278 bytes} [Sat May 7 21:50:45 2022] POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:50:45.686804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:45.687568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:45.699904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.701432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.702568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.703305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.785993 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-22785f3b-6c74-45b7-b2c5-a379a0c05046 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "DELETE /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 204 len: 0 microversion: 2.1 time: 0.153761 May 07 21:50:45.789936 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 854/1658] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:45 2022] DELETE /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:50:45.797346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:45.798083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:45.804540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.805002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:45.805974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:45.806454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.013247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:46.024360 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64ec18d6-4cec-4d00-a331-2dc975797ea1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.343540 May 07 21:50:46.024999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 805/1659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:45 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:46.043506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:46.044173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:46.050238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.050694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.051500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.052134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.116770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:46.127593 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-151ff15e-03e0-4259-99cc-ab399ea8a1c6 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1501 microversion: 2.1 time: 0.334401 May 07 21:50:46.129819 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 855/1660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:45 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1501 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:46.133026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:46.135182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:46.141647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.142233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.143159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.144051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.202111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:46.210816 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f21443d1-9b61-4fd4-8bd3-14715711b085 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.172109 May 07 21:50:46.210816 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 806/1661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:46 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:46.226416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf129665-3735-4af7-9e00-3b45361f5031 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-404761084"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:46.227542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cf129665-3735-4af7-9e00-3b45361f5031 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:46.234437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf129665-3735-4af7-9e00-3b45361f5031 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.234935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf129665-3735-4af7-9e00-3b45361f5031 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.235722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf129665-3735-4af7-9e00-3b45361f5031 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.236172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf129665-3735-4af7-9e00-3b45361f5031 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.584449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:46.592429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f8a4c44d-54ea-4d3b-ba6e-c5e005ad8019 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1503 microversion: 2.1 time: 0.463043 May 07 21:50:46.593206 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 856/1662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:46 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:46.597380 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf129665-3735-4af7-9e00-3b45361f5031 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action" status: 202 len: 0 microversion: 2.1 time: 0.374608 May 07 21:50:46.598042 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 807/1663] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:50:46 2022] POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 07 21:50:46.598498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:46.599378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:46.614728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.615524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.618045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.618447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.624397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:46.625135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:46.651935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.652545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.653541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.656127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.904686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:46.911644 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4c02d58b-2dd1-4ebe-ad9b-700d28edb647 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.295915 May 07 21:50:46.921122 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 808/1664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:46 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:46.921122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-426014689"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:46.921122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:46.926091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.926568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.927474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.927968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.963934 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Cannot 'createImage' instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 while it is in task_state image_snapshot May 07 21:50:46.964559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 409 to user: Cannot 'createImage' instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 while it is in task_state image_snapshot {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:46.965466 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8b4b10ea-9181-44f6-a88c-e4775844126b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action" status: 409 len: 159 microversion: 2.1 time: 0.052222 May 07 21:50:46.966118 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 809/1665] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:50:46 2022] POST /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556/action => generated 159 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 21:50:46.972680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-904707903"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:46.972680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:46.978249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.978748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:46.979660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:46.980116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.212268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:47.222268 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-110b2103-b3b6-4306-b2f6-26acc5862f80 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.627707 May 07 21:50:47.223429 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 857/1666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:46 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:47.238414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2af33c02-f870-480f-8021-657d7167ad59 req-c3f3e947-4069-4857-a508-2252ff25af06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8f76a4-6ad3-415b-b1a9-6bd011fd0571", "tag": "05c8f9e9-22a2-4423-bdc3-f8822a75ace8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:47.254487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2af33c02-f870-480f-8021-657d7167ad59 req-c3f3e947-4069-4857-a508-2252ff25af06 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.257271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2af33c02-f870-480f-8021-657d7167ad59 req-c3f3e947-4069-4857-a508-2252ff25af06 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.274154 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2af33c02-f870-480f-8021-657d7167ad59 req-c3f3e947-4069-4857-a508-2252ff25af06 service nova] Creating event network-changed:05c8f9e9-22a2-4423-bdc3-f8822a75ace8 for instance 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 on nch2-master-1 May 07 21:50:47.281166 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2af33c02-f870-480f-8021-657d7167ad59 req-c3f3e947-4069-4857-a508-2252ff25af06 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056111 May 07 21:50:47.283965 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 858/1667] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:47.295823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9808fccc-763b-414f-a194-ae89d2eff7c4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '.version_select at 0x7fc41cd72f70>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:47.397736 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.network.security_group_api [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Adding security group 6822a52d-a9a1-47aa-af0c-ed993dc876ed to port f4e84972-b5b8-4161-be41-2a7625450b34 May 07 21:50:47.489508 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9808fccc-763b-414f-a194-ae89d2eff7c4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/images/32946ea2-2fa3-4906-8955-d46f1e0a61e0" status: 204 len: 0 microversion: 2.1 time: 0.202923 May 07 21:50:47.490095 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 859/1668] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:47 2022] DELETE /compute/v2.1/images/32946ea2-2fa3-4906-8955-d46f1e0a61e0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:50:47.496008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:47.496770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:47.503411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.503881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.504686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.505135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.541819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.542583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.543129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lazy-loading 'fault' on Instance uuid 88890ab3-196b-48f2-85db-aacd17e27ba5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:47.594920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:47.602550 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d4528b7f-f5d1-4f93-80c8-a77798fe83fc tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1301 microversion: 2.1 time: 0.111433 May 07 21:50:47.603862 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 860/1669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:47 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:47.617549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-65b84791-7ea8-4824-a79c-b5e2520c1ff3 req-6206042f-72f0-4ec0-9f79-a908e8039c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88890ab3-196b-48f2-85db-aacd17e27ba5", "name": "network-vif-deleted", "tag": "1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:47.630191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-65b84791-7ea8-4824-a79c-b5e2520c1ff3 req-6206042f-72f0-4ec0-9f79-a908e8039c94 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.630650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-65b84791-7ea8-4824-a79c-b5e2520c1ff3 req-6206042f-72f0-4ec0-9f79-a908e8039c94 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.646287 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-65b84791-7ea8-4824-a79c-b5e2520c1ff3 req-6206042f-72f0-4ec0-9f79-a908e8039c94 service nova] Creating event network-vif-deleted:1bb32ad4-f7ec-4b0a-809b-4fbe4d0f7952 for instance 88890ab3-196b-48f2-85db-aacd17e27ba5 on nch2-master-1 May 07 21:50:47.651448 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-65b84791-7ea8-4824-a79c-b5e2520c1ff3 req-6206042f-72f0-4ec0-9f79-a908e8039c94 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037850 May 07 21:50:47.652479 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 861/1670] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:47.658349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:47.659207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:47.667318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.667780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.668524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.668970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.824257 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ad051255-c85d-479a-9ca3-228f598bc8c1 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c/action" status: 202 len: 0 microversion: 2.1 time: 0.856997 May 07 21:50:47.825518 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 810/1671] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:50:46 2022] POST /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c/action => generated 0 bytes in 859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:50:47.834516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2564329"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:47.835491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:47.848670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.850388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:47.854122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:47.854648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.050719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:48.058326 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d71a329-289a-447b-a7a3-2903cd0f64f5 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1534 microversion: 2.1 time: 0.404165 May 07 21:50:48.061939 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 862/1672] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:47 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1534 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:48.073960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:48.074998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:48.087583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.091098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.093648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.096183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.108493 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.network.security_group_api [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Adding security group fc246f2c-2527-4352-9411-bbd768681e49 to port f4e84972-b5b8-4161-be41-2a7625450b34 May 07 21:50:48.340169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:48.348287 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71c3e787-7c12-422e-a49f-1e8073536047 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.284895 May 07 21:50:48.349003 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 863/1673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:48 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:48.354109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:48.355112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:48.361377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.362704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.363647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.364170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.541447 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-adea25ed-afed-4786-8133-6a12870964b6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c/action" status: 202 len: 0 microversion: 2.1 time: 0.711480 May 07 21:50:48.543131 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 811/1674] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:50:47 2022] POST /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:50:48.555245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-135b4273-6445-4364-b4d2-1876f81ab507 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:48.557181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-135b4273-6445-4364-b4d2-1876f81ab507 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:48.576461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-135b4273-6445-4364-b4d2-1876f81ab507 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.576992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-135b4273-6445-4364-b4d2-1876f81ab507 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.577965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-135b4273-6445-4364-b4d2-1876f81ab507 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.579095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-135b4273-6445-4364-b4d2-1876f81ab507 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.595947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:48.609863 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9854c69a-e8d8-400a-b0a5-f2d884602c00 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.259535 May 07 21:50:48.611212 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 864/1675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:48 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:48.631551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:48.633026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:48.642960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.645128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.646417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.647128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.708126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:48.709068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:48.709736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lazy-loading 'fault' on Instance uuid 88890ab3-196b-48f2-85db-aacd17e27ba5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:48.765445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd9c30816a7410f94b10294234c1dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bcaffad5d3447b98f0216d3481045e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:48.773660 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7e261b4-5b6c-489b-a27e-793896401b1c tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 200 len: 1301 microversion: 2.1 time: 0.152011 May 07 21:50:48.774594 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 865/1676] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:48 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 1301 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:48.853882 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-135b4273-6445-4364-b4d2-1876f81ab507 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c/os-security-groups" status: 200 len: 1153 microversion: 2.1 time: 0.305893 May 07 21:50:48.854629 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 812/1677] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 21:50:48 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c/os-security-groups => generated 1153 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:48.868773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c131ac34-edf1-48e6-9f59-03572f07bbd4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41ccec430>, body: {"security_group": {"name": " tempest-securitygroup -1230173679 ", "description": "tempest-description-300988627"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:49.077613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:49.078247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:49.088171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.089881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.091130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.092023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.296163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:49.298271 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c131ac34-edf1-48e6-9f59-03572f07bbd4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.433203 May 07 21:50:49.306067 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 866/1678] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:48 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:49.309772 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8089a9c0-544f-486a-b4d4-576ce9efbf5e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1540 microversion: 2.1 time: 0.235885 May 07 21:50:49.312554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-892331d7-e945-4450-b5fb-2e48e0347c8d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cade0d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:49.320186 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 813/1679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:49 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1540 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:49.379643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:49.380290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:49.386942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.387421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.388226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.388682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.428784 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-892331d7-e945-4450-b5fb-2e48e0347c8d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd" status: 200 len: 223 microversion: 2.1 time: 0.120587 May 07 21:50:49.430165 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 867/1680] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:50:49 2022] GET /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd => generated 223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:49.441846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-68a06ed1-d854-45b0-82a6-1851807cbbff tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41ce1e430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:49.595168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:49.606188 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-350f8391-391c-4110-b544-c8480da2a3fd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.243050 May 07 21:50:49.607420 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 814/1681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:49 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:49.628831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:49.629528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:49.636397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.636923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.637791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.638314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.738129 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-68a06ed1-d854-45b0-82a6-1851807cbbff tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd" status: 202 len: 0 microversion: 2.1 time: 0.300323 May 07 21:50:49.739439 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 868/1682] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:50:49 2022] DELETE /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:50:49.754072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-35bc6a60-b524-41ea-9b58-813ab75080ad req-14f73e43-6cfb-4e28-b61d-6c0175d355f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94a90838-d258-4958-946b-46c5f06a0e4c", "tag": "f4e84972-b5b8-4161-be41-2a7625450b34"}, {"name": "network-changed", "server_uuid": "94a90838-d258-4958-946b-46c5f06a0e4c", "tag": "f4e84972-b5b8-4161-be41-2a7625450b34"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:49.768289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-35bc6a60-b524-41ea-9b58-813ab75080ad req-14f73e43-6cfb-4e28-b61d-6c0175d355f2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.769240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-35bc6a60-b524-41ea-9b58-813ab75080ad req-14f73e43-6cfb-4e28-b61d-6c0175d355f2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.783190 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-35bc6a60-b524-41ea-9b58-813ab75080ad req-14f73e43-6cfb-4e28-b61d-6c0175d355f2 service nova] Creating event network-changed:f4e84972-b5b8-4161-be41-2a7625450b34 for instance 94a90838-d258-4958-946b-46c5f06a0e4c on nch1-master-1 May 07 21:50:49.784009 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-35bc6a60-b524-41ea-9b58-813ab75080ad req-14f73e43-6cfb-4e28-b61d-6c0175d355f2 service nova] Creating event network-changed:f4e84972-b5b8-4161-be41-2a7625450b34 for instance 94a90838-d258-4958-946b-46c5f06a0e4c on nch1-master-1 May 07 21:50:49.789959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-35bc6a60-b524-41ea-9b58-813ab75080ad req-14f73e43-6cfb-4e28-b61d-6c0175d355f2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049100 May 07 21:50:49.790664 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 869/1683] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:49.796800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9cd69c6-6ee1-484a-9569-ca8bad98a9e9 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cc03a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:49.824643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-a9cd69c6-6ee1-484a-9569-ca8bad98a9e9 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:50:49.825254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-a9cd69c6-6ee1-484a-9569-ca8bad98a9e9 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:50:49.825843 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-a9cd69c6-6ee1-484a-9569-ca8bad98a9e9 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd does not exist May 07 21:50:49.825843 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-beec978e-e83a-4a82-b3ae-1fc48f3639c2'] May 07 21:50:49.826740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9cd69c6-6ee1-484a-9569-ca8bad98a9e9 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd does not exist May 07 21:50:49.826740 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-beec978e-e83a-4a82-b3ae-1fc48f3639c2'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:49.827665 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9cd69c6-6ee1-484a-9569-ca8bad98a9e9 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd" status: 404 len: 194 microversion: 2.1 time: 0.035281 May 07 21:50:49.828234 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 870/1684] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:50:49 2022] GET /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:49.836467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:49.837227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] [instance: 88890ab3-196b-48f2-85db-aacd17e27ba5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:49.845365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.845824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.847256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:49.847700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:49.862612 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] HTTP exception thrown: Instance 88890ab3-196b-48f2-85db-aacd17e27ba5 could not be found. May 07 21:50:49.863281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] Returning 404 to user: Instance 88890ab3-196b-48f2-85db-aacd17e27ba5 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:49.864136 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-324f6939-7536-435c-963a-56bbc3125020 tempest-LiveMigrationTest-1138711820 tempest-LiveMigrationTest-1138711820-project] 10.222.0.32 "GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5" status: 404 len: 111 microversion: 2.1 time: 0.034785 May 07 21:50:49.864712 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 871/1685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:49 2022] GET /compute/v2.1/servers/88890ab3-196b-48f2-85db-aacd17e27ba5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:49.872731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-af9ed030-cae0-48bc-8cd1-c06827cd01b7 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41cc03a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-610174127", "description": "tempest-description-952170643"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:49.971947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:49.981395 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-501e1e19-c3fa-4156-a0f9-92780af801ac tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.356773 May 07 21:50:49.982356 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 815/1686] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:49 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:50.328918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:50.331113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:50.339542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:50.340250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:50.341046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:50.341580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:50.515870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:50.526447 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c71a916-c41f-4064-bec0-04f5b8b1689b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1540 microversion: 2.1 time: 0.202187 May 07 21:50:50.536801 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 816/1687] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:50 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1540 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:50.544792 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-af9ed030-cae0-48bc-8cd1-c06827cd01b7 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.674902 May 07 21:50:50.545756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 872/1688] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:49 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:50.557834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0409e1d3-10cb-4a6c-b8e8-c200acb81331 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41cd9dee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1734112971", "description": "tempest-description-524225259"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:50.624295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:50.625180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:50.637927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:50.638758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:50.640830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:50.641452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:50.874958 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0409e1d3-10cb-4a6c-b8e8-c200acb81331 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.321663 May 07 21:50:50.876130 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 817/1689] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:50.889509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ba65947d-4427-484d-85d9-0ab124353f2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc4226c84c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1504673267", "description": "tempest-description-1886637056"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:50.914548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:50.925464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f650824d-8e99-4cfb-94f7-b4922741b585 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.306472 May 07 21:50:50.927947 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 873/1690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:50 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:50.998052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:50.999037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:51.010841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:51.011300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:51.013879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:51.013879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:51.257896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:51.273931 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8b3b578c-78fe-4949-8ac3-644b1a2fe9fe tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.280191 May 07 21:50:51.274537 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 874/1691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:50 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:51.439771 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ba65947d-4427-484d-85d9-0ab124353f2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.555737 May 07 21:50:51.440468 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 818/1692] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:50:51.452186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d43dc83a-f88d-4c27-8e64-70e5f2f30db8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cd51a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:51.545444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:51.547029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:51.557906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:51.558736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:51.559993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:51.560450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:51.846565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:51.858013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d05ffdbf-e676-4e51-9439-0cbdfaf3d93f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1522 microversion: 2.1 time: 0.318197 May 07 21:50:51.870284 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 819/1693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:51 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:51.877150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:51.878603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:51.885740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:51.886201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:51.887246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:51.887700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:51.927330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:50:52.046486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41510f80-3105-4b0f-9c8e-534958fd86c0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 204 len: 0 microversion: 2.1 time: 0.174183 May 07 21:50:52.048880 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 820/1694] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:50:51 2022] DELETE /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:50:52.057158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:52.058292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:52.067091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:52.067728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:52.069184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:52.069969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:52.330495 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d43dc83a-f88d-4c27-8e64-70e5f2f30db8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups" status: 200 len: 1828 microversion: 2.1 time: 0.882078 May 07 21:50:52.331138 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 875/1695] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:50:51 2022] GET /compute/v2.1/os-security-groups => generated 1828 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:52.344473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:52.345429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:52.358890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:52.361919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:52.363282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:52.364004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:52.406170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:52.418566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-02f96213-d877-4fc9-9d9a-be4a12370a4c tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.367491 May 07 21:50:52.420624 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 821/1696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:52 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:52.426489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5fe9b548-06fb-44d7-b4bf-7770393ce1cb req-09454f5c-47aa-4830-b253-e67ee872ac34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9b73d-94f5-48f0-9bd4-f06f09d7b556", "name": "network-vif-plugged", "status": "completed", "tag": "24115db9-2f6d-4fcc-8408-e98da05a26e6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:52.454669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5fe9b548-06fb-44d7-b4bf-7770393ce1cb req-09454f5c-47aa-4830-b253-e67ee872ac34 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:52.455317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5fe9b548-06fb-44d7-b4bf-7770393ce1cb req-09454f5c-47aa-4830-b253-e67ee872ac34 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:52.475275 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5fe9b548-06fb-44d7-b4bf-7770393ce1cb req-09454f5c-47aa-4830-b253-e67ee872ac34 service nova] Creating event network-vif-plugged:24115db9-2f6d-4fcc-8408-e98da05a26e6 for instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 on nch2-master-1 May 07 21:50:52.488785 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5fe9b548-06fb-44d7-b4bf-7770393ce1cb req-09454f5c-47aa-4830-b253-e67ee872ac34 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066663 May 07 21:50:52.495812 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 822/1697] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:52.507653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:52.508738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:52.519789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:52.520443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:52.545555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:52.546060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:52.615940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:52.624695 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-717b5c0c-01f5-421a-878c-cd851e9e0049 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1528 microversion: 2.1 time: 0.292290 May 07 21:50:52.638307 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 876/1698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:52 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1528 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:52.646570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-57d737f2-c082-4351-8c1a-9a38da66206f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cdaa1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:52.777986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:52.793310 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e547ccb0-370e-4e17-9c3d-c89250959fc4 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.293008 May 07 21:50:52.795086 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 823/1699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:52 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:52.914622 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-57d737f2-c082-4351-8c1a-9a38da66206f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f" status: 202 len: 0 microversion: 2.1 time: 0.274855 May 07 21:50:52.915330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 877/1700] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:50:52 2022] DELETE /compute/v2.1/os-security-groups/d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:50:52.923403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d9cd503-f742-4a86-a3fc-3d9bb76f091e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cd2b9d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:52.950575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-0d9cd503-f742-4a86-a3fc-3d9bb76f091e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f does not exist", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:50:52.951337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.security_group_api [None req-0d9cd503-f742-4a86-a3fc-3d9bb76f091e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f not found {{(pid=136682) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:50:52.952682 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0d9cd503-f742-4a86-a3fc-3d9bb76f091e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f does not exist May 07 21:50:52.952682 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-b3518d27-6152-42b8-90ba-0fd13637face'] May 07 21:50:52.953622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d9cd503-f742-4a86-a3fc-3d9bb76f091e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f does not exist May 07 21:50:52.953622 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-b3518d27-6152-42b8-90ba-0fd13637face'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:52.956080 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d9cd503-f742-4a86-a3fc-3d9bb76f091e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f" status: 404 len: 194 microversion: 2.1 time: 0.036470 May 07 21:50:52.957035 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 824/1701] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:50:52 2022] GET /compute/v2.1/os-security-groups/d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:52.967085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6fec23b-3535-43c7-90ca-d660c6c708be tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cd48c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.222607 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6fec23b-3535-43c7-90ca-d660c6c708be tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/22f8b829-fe56-4e5e-bfc9-213bd3ef066b" status: 202 len: 0 microversion: 2.1 time: 0.261314 May 07 21:50:53.223847 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 878/1702] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:50:52 2022] DELETE /compute/v2.1/os-security-groups/22f8b829-fe56-4e5e-bfc9-213bd3ef066b => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:50:53.231475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-02738e48-73a2-41b4-909e-6f9bdd7d972e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cd249d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.257284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-02738e48-73a2-41b4-909e-6f9bdd7d972e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b does not exist", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:50:53.257887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.security_group_api [None req-02738e48-73a2-41b4-909e-6f9bdd7d972e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b not found {{(pid=136682) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:50:53.258578 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-02738e48-73a2-41b4-909e-6f9bdd7d972e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b does not exist May 07 21:50:53.258578 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-a0c5f079-fb89-4170-aa8a-a53ddbc054b6'] May 07 21:50:53.260286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-02738e48-73a2-41b4-909e-6f9bdd7d972e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b does not exist May 07 21:50:53.260286 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-a0c5f079-fb89-4170-aa8a-a53ddbc054b6'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:53.262353 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-02738e48-73a2-41b4-909e-6f9bdd7d972e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/22f8b829-fe56-4e5e-bfc9-213bd3ef066b" status: 404 len: 194 microversion: 2.1 time: 0.033578 May 07 21:50:53.264267 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 825/1703] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:50:53 2022] GET /compute/v2.1/os-security-groups/22f8b829-fe56-4e5e-bfc9-213bd3ef066b => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:53.273277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-131ee633-786b-4e09-901c-7a7ef311f79d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41ce36a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.439340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.439340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:53.446901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:53.447949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:53.448813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:53.449201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:53.500915 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-131ee633-786b-4e09-901c-7a7ef311f79d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/3d7ed19c-884e-429f-a70b-6e56a4844de9" status: 202 len: 0 microversion: 2.1 time: 0.232680 May 07 21:50:53.502501 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 879/1704] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:50:53 2022] DELETE /compute/v2.1/os-security-groups/3d7ed19c-884e-429f-a70b-6e56a4844de9 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:50:53.510816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d0ffe7a-4308-4826-8fcd-10c86676936e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cc9d700>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.575715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-9d0ffe7a-4308-4826-8fcd-10c86676936e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:50:53.576510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-9d0ffe7a-4308-4826-8fcd-10c86676936e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:50:53.577182 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-9d0ffe7a-4308-4826-8fcd-10c86676936e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 does not exist May 07 21:50:53.577182 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-3e2a6e43-c9b7-44dd-9002-1a71d59f895b'] May 07 21:50:53.581931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d0ffe7a-4308-4826-8fcd-10c86676936e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 does not exist May 07 21:50:53.581931 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-3e2a6e43-c9b7-44dd-9002-1a71d59f895b'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:53.583253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d0ffe7a-4308-4826-8fcd-10c86676936e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/3d7ed19c-884e-429f-a70b-6e56a4844de9" status: 404 len: 194 microversion: 2.1 time: 0.076998 May 07 21:50:53.584169 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 880/1705] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:50:53 2022] GET /compute/v2.1/os-security-groups/3d7ed19c-884e-429f-a70b-6e56a4844de9 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:50:53.593341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84703dd9-578a-4e1e-bbb6-8203a86fc7c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cdaaaf0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.670746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:53.679695 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d8f06b7b-5158-44ba-b272-b3e71adcc3ce tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.248229 May 07 21:50:53.680501 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 826/1706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:53 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:53.694713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.695764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:53.702191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:53.702910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:53.703899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:53.704351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:53.877979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:53.886195 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5fb62c90-78d7-4db3-8fd9-86570893b3c9 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1528 microversion: 2.1 time: 0.201590 May 07 21:50:53.886864 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 827/1707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:53 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1528 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:53.891439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:53.892260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:53.893781 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84703dd9-578a-4e1e-bbb6-8203a86fc7c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups" status: 200 len: 1153 microversion: 2.1 time: 0.304520 May 07 21:50:53.899156 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 881/1708] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 21:50:53 2022] GET /compute/v2.1/os-security-groups => generated 1153 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:53.907476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:53.908485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:53.909542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:53.909902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.061237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:54.069628 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-33189292-ad47-42e4-93f5-3283003bcb97 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.181693 May 07 21:50:54.080498 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 828/1709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:53 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:54.085564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bdace156-93c2-4f31-b96d-ffab546abdac tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41cd080d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1599307591", "description": "tempest-description-568432811"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:54.306708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-602338171", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": "none"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:54.316952 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bdace156-93c2-4f31-b96d-ffab546abdac tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.235181 May 07 21:50:54.317759 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 829/1710] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:54.333961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c2e9a31-bbb0-4b60-b8df-fc6c91374a11 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41cd55310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-190477318", "description": "tempest-description-1595696999"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:54.397896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:54.398582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:54.399271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:54.399868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:54.401090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:54.414190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.415241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.416260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.417071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.439349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Getting quotas for project c8ae6fafdc4a405a8ba51f68a9a90f65. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:54.444621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Getting quotas for user 5314d193cd404462bc0e5fe1e69cc052 and project c8ae6fafdc4a405a8ba51f68a9a90f65. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:54.464223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:54.468560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:54.541942 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4a54dc4-589d-4d0c-8949-e286cb07f262 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.646482 May 07 21:50:54.543433 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 882/1711] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:50:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:50:54.549347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2b8e06db-3630-4753-8dc1-0d5c3e7cc795 req-c097e821-1d5b-4787-97c4-cd9d651f6bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd9b73d-94f5-48f0-9bd4-f06f09d7b556", "name": "network-vif-deleted", "tag": "24115db9-2f6d-4fcc-8408-e98da05a26e6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:54.559422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2b8e06db-3630-4753-8dc1-0d5c3e7cc795 req-c097e821-1d5b-4787-97c4-cd9d651f6bdd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.560279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2b8e06db-3630-4753-8dc1-0d5c3e7cc795 req-c097e821-1d5b-4787-97c4-cd9d651f6bdd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.576089 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2b8e06db-3630-4753-8dc1-0d5c3e7cc795 req-c097e821-1d5b-4787-97c4-cd9d651f6bdd service nova] Creating event network-vif-deleted:24115db9-2f6d-4fcc-8408-e98da05a26e6 for instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 on nch2-master-1 May 07 21:50:54.581397 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2b8e06db-3630-4753-8dc1-0d5c3e7cc795 req-c097e821-1d5b-4787-97c4-cd9d651f6bdd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036328 May 07 21:50:54.582924 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 883/1712] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:54.584381 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c2e9a31-bbb0-4b60-b8df-fc6c91374a11 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.256919 May 07 21:50:54.585496 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 830/1713] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:50:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:54.590613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-b7010952-4e77-4b99-b4b1-eb8ae22625a1 req-a404093d-af88-41cf-b56f-8c3e927fa1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8f76a4-6ad3-415b-b1a9-6bd011fd0571", "name": "network-vif-plugged", "status": "completed", "tag": "05c8f9e9-22a2-4423-bdc3-f8822a75ace8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:54.595211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76e98087-cd06-488b-b590-164108364b07 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:54.596134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76e98087-cd06-488b-b590-164108364b07 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:54.600746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b7010952-4e77-4b99-b4b1-eb8ae22625a1 req-a404093d-af88-41cf-b56f-8c3e927fa1d3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.601331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b7010952-4e77-4b99-b4b1-eb8ae22625a1 req-a404093d-af88-41cf-b56f-8c3e927fa1d3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.617190 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-b7010952-4e77-4b99-b4b1-eb8ae22625a1 req-a404093d-af88-41cf-b56f-8c3e927fa1d3 service nova] Creating event network-vif-plugged:05c8f9e9-22a2-4423-bdc3-f8822a75ace8 for instance 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 on nch2-master-1 May 07 21:50:54.624415 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-b7010952-4e77-4b99-b4b1-eb8ae22625a1 req-a404093d-af88-41cf-b56f-8c3e927fa1d3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039592 May 07 21:50:54.625104 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 884/1714] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:54.689046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76e98087-cd06-488b-b590-164108364b07 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:54.699550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76e98087-cd06-488b-b590-164108364b07 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:54.701242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:54.701535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76e98087-cd06-488b-b590-164108364b07 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:54.702330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:54.702847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76e98087-cd06-488b-b590-164108364b07 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1280 microversion: 2.47 time: 0.116173 May 07 21:50:54.714530 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 831/1715] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:54 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:54.717315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.717775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.719246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.720468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.804785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2115170047", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "5d9854c1-90bd-4898-b59a-14d465203832"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:54.870834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:54.882326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] validate_networks() for [('5d9854c1-90bd-4898-b59a-14d465203832', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:54.891578 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1ceb2886-749d-4e79-9b70-d944de8cbf53 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.196618 May 07 21:50:54.902491 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 885/1716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:54 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:54.904565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:54.906062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:54.913196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.913660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.914466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.915045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.977165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:54.977532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:54.978918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lazy-loading 'fault' on Instance uuid ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:55.061107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:55.069309 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-248c2cf7-7d29-4935-86f5-059842f7406f tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 200 len: 1314 microversion: 2.1 time: 0.169899 May 07 21:50:55.069893 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 886/1717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:54 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:55.090314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:55.091232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:55.098933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.099816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.100849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.101477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.264102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:55.272691 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-64d3c38f-0fd2-4622-bb1c-78c8190c3e5d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1319 microversion: 2.1 time: 0.188107 May 07 21:50:55.273557 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 887/1718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:55 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:55.417911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:55.418548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:55.419084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:55.419696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:55.420122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:55.430356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.430965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.432414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.432867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.451087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Getting quotas for project f61b3dd3880d475b939a8543d9bbf481. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:55.455674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Getting quotas for user c5c73f7347e64178b56a8331649c576e and project f61b3dd3880d475b939a8543d9bbf481. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:55.466697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:55.469202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:55.515426 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ede04063-ab80-402d-8017-77b97ee1d7dd tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716520 May 07 21:50:55.516099 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 832/1719] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:50:55.527848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c02260c-61f7-42db-bdac-080e209a4ce6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:55.528822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c02260c-61f7-42db-bdac-080e209a4ce6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:55.584237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c02260c-61f7-42db-bdac-080e209a4ce6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:55.591557 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c02260c-61f7-42db-bdac-080e209a4ce6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1216 microversion: 2.1 time: 0.069265 May 07 21:50:55.601311 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 888/1720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:55 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:55.721731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:55.722363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:55.728932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.729463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.730337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.730685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.847929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:55.857132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:55.858683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:55.860104 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6b591909-b77e-41df-8d8f-df60db73e52f tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1284 microversion: 2.47 time: 0.143101 May 07 21:50:55.860759 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 833/1721] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:55 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:55.911747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:55.912815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:55.920716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.921246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.922196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:55.922803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:55.949228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76606b04-3e16-4286-956f-95c46ea127c7 tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] Calling method '.version_select at 0x7fc41cdb4040>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:55.950180 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:55.950180 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:55.965651 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-76606b04-3e16-4286-956f-95c46ea127c7 tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.173572 May 07 21:50:55.978945 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 889/1722] 10.222.0.32 () {58 vars in 1184 bytes} [Sat May 7 21:50:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:55.985146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54f22ed2-2224-4b73-a2d3-40c61c8b54e2 tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cd48a60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:55.987355 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:55.987355 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:50:56.093811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:56.102784 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a35e454a-ada3-40d9-839a-87cc5b2a124e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.196252 May 07 21:50:56.105048 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 834/1723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:55 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:56.110321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:56.111222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:56.118071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.118881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.119797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.120380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.135125 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 could not be found. May 07 21:50:56.135735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:56.136787 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f79bcf3e-2347-4165-9699-794553ac3f48 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 404 len: 111 microversion: 2.1 time: 0.030462 May 07 21:50:56.137349 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 835/1724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:56 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:50:56.147066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c18a6266-334e-475c-9820-bef1aa84ecd4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'create', calling method: .version_select at 0x7fc4226c8f70>, body: {"keypair": {"name": "tempest-keypair-188137537"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:56.162026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c18a6266-334e-475c-9820-bef1aa84ecd4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for project 00dedc5654754e7fbb60abf79a14666e. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:56.167107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c18a6266-334e-475c-9820-bef1aa84ecd4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for user 29d121c7d37142d6a935ae607c0e062b and project 00dedc5654754e7fbb60abf79a14666e. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:56.323127 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54f22ed2-2224-4b73-a2d3-40c61c8b54e2 tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.342648 May 07 21:50:56.323640 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 890/1725] 10.222.0.32 () {60 vars in 1205 bytes} [Sat May 7 21:50:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:56.328870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:56.329089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:56.334885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.335344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.336127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.336571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.410594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c18a6266-334e-475c-9820-bef1aa84ecd4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for project 00dedc5654754e7fbb60abf79a14666e. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:56.415436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c18a6266-334e-475c-9820-bef1aa84ecd4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for user 29d121c7d37142d6a935ae607c0e062b and project 00dedc5654754e7fbb60abf79a14666e. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:56.429974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c18a6266-334e-475c-9820-bef1aa84ecd4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.287252 May 07 21:50:56.430581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 836/1726] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:50:56 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:50:56.435060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e0880d0e-2a59-4cd6-b627-482243f3fa49 tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] Calling method '.version_select at 0x7fc41cd9db80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:56.436129 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:56.436129 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:50:56.450601 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e0880d0e-2a59-4cd6-b627-482243f3fa49 tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.018960 May 07 21:50:56.451387 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 837/1727] 10.222.0.32 () {58 vars in 1184 bytes} [Sat May 7 21:50:56 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:56.463472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-381d9874-38f2-4fb1-844e-9aceab93d1dd tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cd9d940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:56.466667 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:50:56.466667 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:50:56.504937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:56.519159 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c8e2f70-8248-473e-801d-e0a88e85475b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1468 microversion: 2.1 time: 0.194306 May 07 21:50:56.525711 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 891/1728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:56 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1468 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:56.619349 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-381d9874-38f2-4fb1-844e-9aceab93d1dd tempest-QuotaClassesAdminTestJSON-1019933729 tempest-QuotaClassesAdminTestJSON-1019933729-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.161047 May 07 21:50:56.621220 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 838/1729] 10.222.0.32 () {60 vars in 1205 bytes} [Sat May 7 21:50:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:50:56.639466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:56.641297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:56.655381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.659600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.661942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.663929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.700002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1730048798", "block_migration": true, "disk_over_commit": false}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:56.701170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:56.714917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.715386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.716188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.716749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.773611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:56.778681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lazy-loading 'flavor' on Instance uuid 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:50:56.790017 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1ae32ed0-1214-40fa-a85b-d966dc0f0cbb tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1212 microversion: 2.1 time: 0.166727 May 07 21:50:56.790831 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 839/1730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:56 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1212 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:56.795255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Going to try to live migrate instance to tempest-host-1730048798 {{(pid=136681) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 21:50:56.804773 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] HTTP exception thrown: Compute host tempest-host-1730048798 could not be found. May 07 21:50:56.805394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Returning 400 to user: Compute host tempest-host-1730048798 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:50:56.807869 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4bfa18a8-7741-41bb-aa97-e25825692722 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571/action" status: 400 len: 100 microversion: 2.1 time: 0.268958 May 07 21:50:56.809375 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 892/1731] 10.222.0.32 () {60 vars in 1278 bytes} [Sat May 7 21:50:56 2022] POST /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571/action => generated 100 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 07 21:50:56.819875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:56.821326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:56.831361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.831837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.832696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.833365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.879499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:56.880137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:56.888048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.888786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:56.889497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:56.889950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:57.011124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:57.020625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:57.024088 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-54c78539-29e0-4950-acf2-5c6c4c675872 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1468 microversion: 2.1 time: 0.209058 May 07 21:50:57.042653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:57.044605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:57.046126 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aaeab7bb-fe9d-4bae-a841-e15de47be031 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1338 microversion: 2.47 time: 0.170730 May 07 21:50:57.047020 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 893/1732] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:56 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1338 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:50:57.058208 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 840/1733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:56 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1468 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:57.124893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:57.125615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:57.139507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:57.139980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:57.140744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:57.141185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:57.193988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1407727605", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:57.256319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:57.333957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:57.343188 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-83396d5e-2303-4c76-a231-ef3a7fa0df18 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1476 microversion: 2.1 time: 0.225165 May 07 21:50:57.352909 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 841/1734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:57 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:57.583074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:50:57.583608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:50:57.584624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:50:57.585147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:50:57.585778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:50:57.596924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:57.597469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:57.598358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:57.598915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:57.619612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Getting quotas for project 3ed0bf2e98fe4e67abb30f040a638365. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:50:57.625129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Getting quotas for user 2e6fd0a2daba417b9e39213a5e4c1f4e and project 3ed0bf2e98fe4e67abb30f040a638365. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:50:57.640070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:50:57.642399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:50:57.692613 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05d9a58b-26a2-49d3-8943-81616aa40590 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503108 May 07 21:50:57.693696 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 894/1735] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:50:57.703602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b1c8256-c9fc-475e-a43a-f2777379e739 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:57.704355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b1c8256-c9fc-475e-a43a-f2777379e739 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:57.790171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b1c8256-c9fc-475e-a43a-f2777379e739 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:57.798361 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b1c8256-c9fc-475e-a43a-f2777379e739 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1219 microversion: 2.1 time: 0.098632 May 07 21:50:57.809033 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 842/1736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:57 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:57.811171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:57.811913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:57.821346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:57.822910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:57.823048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:57.823427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:57.932956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:57.959280 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e1bba0e-3dd7-4596-b267-f0e29acfbc9f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1276 microversion: 2.1 time: 0.156252 May 07 21:50:57.965688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 895/1737] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:57 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:58.070027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:58.070568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:58.096632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:58.097102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:58.097914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:58.102025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:58.247965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:58.269327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:58.276558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:58.279132 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-498b9893-82d4-43e1-bab7-9527065637df tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1338 microversion: 2.47 time: 0.217477 May 07 21:50:58.281013 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 843/1738] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:58 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1338 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:58.361282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:58.361918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:58.384228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:58.385848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:58.387354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:58.387971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:58.690658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:58.701659 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f4499047-48a6-436b-9a54-84cdbd557e2d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1475 microversion: 2.1 time: 0.344662 May 07 21:50:58.702831 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 896/1739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:58 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:58.764732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-83391869", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:58.818571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:58.819829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:58.824504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] validate_networks() for [('b2fcd05a-fa57-478e-9f0c-05c502306fa7', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:50:58.828338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:58.828889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:58.829820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:58.830274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:58.928012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:58.942421 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-216c027b-189b-4ba7-b91f-789278797117 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1271 microversion: 2.1 time: 0.128105 May 07 21:50:58.952490 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 897/1740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:58 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:58.982802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:58.983515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:58.994839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:58.995155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:59.003017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:59.003822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:59.129610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:59.140783 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b06e9b3-6360-4c5d-b779-731aac03a24c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1274 microversion: 2.1 time: 0.162851 May 07 21:50:59.154006 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 898/1741] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:50:58 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:50:59.299184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:50:59.300117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:59.313751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:59.327386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:59.328502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:59.329109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:59.421716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:59.435835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:59.442942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:50:59.447867 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b714678c-f448-4c47-beb9-3041aea94ac6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1359 microversion: 2.47 time: 0.150961 May 07 21:50:59.448643 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 899/1742] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:50:59 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:50:59.468038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2db9a79-0df6-4cec-9e74-c8d681a86418 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-794103368"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:50:59.469457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2db9a79-0df6-4cec-9e74-c8d681a86418 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:50:59.481311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2db9a79-0df6-4cec-9e74-c8d681a86418 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:59.484444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2db9a79-0df6-4cec-9e74-c8d681a86418 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:50:59.485481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2db9a79-0df6-4cec-9e74-c8d681a86418 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:50:59.490149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2db9a79-0df6-4cec-9e74-c8d681a86418 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.035085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:51:00.036243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:51:00.036898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:51:00.037476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:51:00.038122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:51:00.042451 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2db9a79-0df6-4cec-9e74-c8d681a86418 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "POST /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972/action" status: 202 len: 52 microversion: 2.47 time: 0.579698 May 07 21:51:00.044250 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 900/1743] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:50:59 2022] POST /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972/action => generated 52 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 07 21:51:00.054489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:00.056898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:00.063891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.065374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.066555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.066739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.067564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.068734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.069034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.069753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.105219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for project 00dedc5654754e7fbb60abf79a14666e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:51:00.113567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for user 29d121c7d37142d6a935ae607c0e062b and project 00dedc5654754e7fbb60abf79a14666e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:51:00.131404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:51:00.133975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:51:00.233762 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9e4bfff-1cc5-4e1f-ad29-5cbe3c5c6fdf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.473843 May 07 21:51:00.238201 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 844/1744] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:50:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:51:00.254156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:00.254156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:00.254699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Searching by: {'deleted': False, 'project_id': '487fc10ff315438ca2de090c396e3cfb'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:51:00.264494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.265233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.266212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.269339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.404343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:00.423346 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f660df4b-2875-483c-b8c7-a9ff2c91089d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1475 microversion: 2.1 time: 0.377319 May 07 21:51:00.427984 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 901/1745] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:00 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1475 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:00.449359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:00.449837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:00.457095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:51:00.468563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.469063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.469906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.470358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.613611 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ded7202a-daea-4b82-a585-b133d68b81bc tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.372580 May 07 21:51:00.615518 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 845/1746] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:51:00 2022] GET /compute/v2.1/servers => generated 334 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:00.628681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:00.631487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:00.643262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:00.647803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.648149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.652641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.653841 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5725599-3ddd-4d6b-aa20-087d45313743 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1277 microversion: 2.1 time: 0.214280 May 07 21:51:00.654397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.665944 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 902/1747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:00 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:00.677184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:00.677831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:00.703034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.703146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.704959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:00.705258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:00.705931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:00.887389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-003891b2-0058-41a8-9b04-842c59e44890 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 204 len: 0 microversion: 2.47 time: 0.268757 May 07 21:51:00.888491 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 846/1748] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:51:00 2022] DELETE /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:51:01.080530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2d5e996d-ffd6-45b9-b75f-8198356450ba req-1cd4e3d4-3378-4509-89f7-eace054c0b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "name": "network-vif-unplugged", "status": "completed", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:01.089738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2d5e996d-ffd6-45b9-b75f-8198356450ba req-1cd4e3d4-3378-4509-89f7-eace054c0b89 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.090191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2d5e996d-ffd6-45b9-b75f-8198356450ba req-1cd4e3d4-3378-4509-89f7-eace054c0b89 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.104803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2d5e996d-ffd6-45b9-b75f-8198356450ba req-1cd4e3d4-3378-4509-89f7-eace054c0b89 service nova] Creating event network-vif-unplugged:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch2-master-1 May 07 21:51:01.114291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-2d5e996d-ffd6-45b9-b75f-8198356450ba req-1cd4e3d4-3378-4509-89f7-eace054c0b89 service nova] Instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:51:01.135697 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2d5e996d-ffd6-45b9-b75f-8198356450ba req-1cd4e3d4-3378-4509-89f7-eace054c0b89 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.243891 May 07 21:51:01.137304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 847/1749] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:01.147726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:01.149456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:01.157969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.159735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.160230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.161891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.162655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.173142 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be55fa51-e4d5-4978-a900-d7b05efe4cdc tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.505820 May 07 21:51:01.173756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 903/1750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:00 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:01.200338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:01.213210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.214398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Searching by: {'deleted': False, 'project_id': '487fc10ff315438ca2de090c396e3cfb'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:51:01.222376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.222999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.224082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.224675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.261693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:51:01.264268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.274486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-afc9ffa6-a352-44ed-b23e-aabd04df84d6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1219 microversion: 2.1 time: 0.134694 May 07 21:51:01.277369 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 848/1751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:01 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:01.308784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.317640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.319050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.397924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-542a93e8-d6b0-45e5-a99a-e16cccbf8837 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Action: 'update', calling method: .version_select at 0x7fc41ce14ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:01.485718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-542a93e8-d6b0-45e5-a99a-e16cccbf8837 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.486583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-542a93e8-d6b0-45e5-a99a-e16cccbf8837 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.487844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-542a93e8-d6b0-45e5-a99a-e16cccbf8837 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.488483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-542a93e8-d6b0-45e5-a99a-e16cccbf8837 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.561886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-542a93e8-d6b0-45e5-a99a-e16cccbf8837 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727" status: 200 len: 148 microversion: 2.57 time: 0.283014 May 07 21:51:01.563199 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 849/1752] 10.222.0.32 () {62 vars in 1302 bytes} [Sat May 7 21:51:01 2022] PUT /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727 => generated 148 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:01.568870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:01.569411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:01.576427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.576888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.577834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.578289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.658739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.670415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.672413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.673915 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9046c210-a3df-4ca6-857c-16fbbf7bd0a8 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1365 microversion: 2.47 time: 0.109492 May 07 21:51:01.674606 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 850/1753] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:51:01 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:51:01.680115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:01.681046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:01.687737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.688352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.689215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.689729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.851349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:01.860331 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4770d3da-8856-43d2-849f-ff1168674738 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1475 microversion: 2.1 time: 0.183781 May 07 21:51:01.861404 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 851/1754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:01 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1475 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:01.866372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8beadb56-6cac-41f7-8203-75f4e8b5d58e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Calling method '.version_select at 0x7fc41ce144c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:01.944663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8beadb56-6cac-41f7-8203-75f4e8b5d58e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.945395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8beadb56-6cac-41f7-8203-75f4e8b5d58e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.946281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8beadb56-6cac-41f7-8203-75f4e8b5d58e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.946737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8beadb56-6cac-41f7-8203-75f4e8b5d58e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.971298 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8beadb56-6cac-41f7-8203-75f4e8b5d58e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727/detail" status: 200 len: 463 microversion: 2.57 time: 0.108037 May 07 21:51:01.971904 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 852/1755] 10.222.0.32 () {60 vars in 1303 bytes} [Sat May 7 21:51:01 2022] GET /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727/detail => generated 463 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:01.976632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:01.977257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:01.983576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.984032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:01.984822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:01.985270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.176021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:02.186009 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5a75ddc-8415-4ba4-94c1-4a5d6e57d7ef tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.213084 May 07 21:51:02.186803 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 853/1756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:01 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:02.204328 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5fa8bdbd-a917-45ad-b585-95c31243f563 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 1.029473 May 07 21:51:02.204919 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 904/1757] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:51:01 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:02.209583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.210524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:02.216039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Action: 'update', calling method: .version_select at 0x7fc41cc50c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:02.224326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.225150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.227565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.228032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.288392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.288857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.289911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.290370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.329696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.330163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.331112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.331572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.395344 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb6e5f48-438e-4d84-b738-2ec6fa860f18 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727?user_id=bb22b98884654ff597d3763608703bb5" status: 200 len: 148 microversion: 2.57 time: 0.193639 May 07 21:51:02.396017 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 854/1758] 10.222.0.32 () {62 vars in 1383 bytes} [Sat May 7 21:51:02 2022] PUT /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727?user_id=bb22b98884654ff597d3763608703bb5 => generated 148 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:02.401139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c79eaad3-f6fd-48d1-a7c2-67273288b44d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.409543 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c79eaad3-f6fd-48d1-a7c2-67273288b44d tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012460 May 07 21:51:02.410432 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 855/1759] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:51:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:02.415017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.415923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:02.421670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.422134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.422944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.423394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.487358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:02.495837 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1ee11db2-a8a3-4a75-b184-c140e5fac35d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1281 microversion: 2.1 time: 0.084353 May 07 21:51:02.496416 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 856/1760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:02 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:02.502144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d97dbecf-00d4-4a0c-ba98-c6eb724ebe8e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Calling method '.version_select at 0x7fc41cd91670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.576440 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d97dbecf-00d4-4a0c-ba98-c6eb724ebe8e tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727?user_id=bb22b98884654ff597d3763608703bb5" status: 200 len: 190 microversion: 2.57 time: 0.078871 May 07 21:51:02.576937 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 857/1761] 10.222.0.32 () {60 vars in 1363 bytes} [Sat May 7 21:51:02 2022] GET /compute/v2.1/os-quota-sets/9c325c9685e1493a82504edfff44a727?user_id=bb22b98884654ff597d3763608703bb5 => generated 190 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:02.627880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-0d75fc12-c729-4721-a793-1fe6658fd1aa req-82af41e9-4332-4045-8a4b-3ae157b2588a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bd37e9-7131-4834-a215-e56f0fb30c5d", "tag": "bf4cdac7-29da-404a-9ec1-943fa91f5ab0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:02.639134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0d75fc12-c729-4721-a793-1fe6658fd1aa req-82af41e9-4332-4045-8a4b-3ae157b2588a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.639951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0d75fc12-c729-4721-a793-1fe6658fd1aa req-82af41e9-4332-4045-8a4b-3ae157b2588a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.653155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:02.655885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-0d75fc12-c729-4721-a793-1fe6658fd1aa req-82af41e9-4332-4045-8a4b-3ae157b2588a service nova] Creating event network-changed:bf4cdac7-29da-404a-9ec1-943fa91f5ab0 for instance a4bd37e9-7131-4834-a215-e56f0fb30c5d on nch2-master-1 May 07 21:51:02.661157 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-0d75fc12-c729-4721-a793-1fe6658fd1aa req-82af41e9-4332-4045-8a4b-3ae157b2588a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038842 May 07 21:51:02.661900 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 858/1762] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:02.662738 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-68e7eb33-9907-4c54-bf20-1c7da57e51c8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.456746 May 07 21:51:02.663403 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 905/1763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:02 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:02.699135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.699894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:02.707500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.708126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.708930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.710029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.752726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.753620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:02.761586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.762137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.763058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.763600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.793263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:02.800248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:02.804628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:02.809724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:02.811192 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bf726df8-abf5-4a5e-8f26-8cbed47e50c6 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1365 microversion: 2.47 time: 0.120883 May 07 21:51:02.814817 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 859/1764] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:51:02 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:51:02.877296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.878994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:02.888151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.888433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.889644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.890102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.921662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-735143e4-ff27-4e05-9a42-4cd1f54f4204 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "DELETE /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 204 len: 0 microversion: 2.1 time: 0.174372 May 07 21:51:02.922689 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 906/1765] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:02 2022] DELETE /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:02.933409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:02.934953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:02.941911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.943459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:02.944438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:02.945049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.064716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.074664 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-658165e0-e3b8-40d7-9867-292499ff1275 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1473 microversion: 2.1 time: 0.201646 May 07 21:51:03.075447 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 860/1766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:02 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:03.174451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d09b8d99-0d59-4abf-831e-8415c6f099a7 req-d1fbe8ab-bc38-41bf-b1ec-e6bfe5b734fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:03.189336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d09b8d99-0d59-4abf-831e-8415c6f099a7 req-d1fbe8ab-bc38-41bf-b1ec-e6bfe5b734fb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.189930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d09b8d99-0d59-4abf-831e-8415c6f099a7 req-d1fbe8ab-bc38-41bf-b1ec-e6bfe5b734fb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.218573 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d09b8d99-0d59-4abf-831e-8415c6f099a7 req-d1fbe8ab-bc38-41bf-b1ec-e6bfe5b734fb service nova] Creating event network-changed:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch2-master-1 May 07 21:51:03.227320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-d09b8d99-0d59-4abf-831e-8415c6f099a7 req-d1fbe8ab-bc38-41bf-b1ec-e6bfe5b734fb service nova] Instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:51:03.238555 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d09b8d99-0d59-4abf-831e-8415c6f099a7 req-d1fbe8ab-bc38-41bf-b1ec-e6bfe5b734fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067972 May 07 21:51:03.239681 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 861/1767] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:03.245873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:03.246625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:03.256401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.256401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.257482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.258061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.294311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.308696 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-386d2e85-4fe2-4bdd-943c-e443000bb632 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1699 microversion: 2.1 time: 0.379734 May 07 21:51:03.319587 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 907/1768] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:02 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1699 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:03.456355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.466013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a6525043-7ce9-4ad0-889c-786edd151bb6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.225047 May 07 21:51:03.466591 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 862/1769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:03 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:03.514715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:03.515477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:03.522012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.522785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.523999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.524671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.688335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:03.689801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:03.699949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.700503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.701528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.702211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.791663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.801450 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-896da03d-df92-46ed-84f9-3c1f9e831b1e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.291995 May 07 21:51:03.802250 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 908/1770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:03 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:03.836755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:03.838482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:03.853124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.853740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.855218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:03.856114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:03.888519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.900847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6c7cc1c5-30db-43ea-8206-dd3541d6ca66 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.224075 May 07 21:51:03.902792 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 863/1771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:03 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:03.964121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.972634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.974439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:03.975740 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1390cbe2-0160-4763-a68e-ce0a76a5176a tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1365 microversion: 2.47 time: 0.150182 May 07 21:51:03.976325 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 909/1772] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:51:03 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:51:04.092480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:04.093115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:04.099260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.099779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.100615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.101066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.328569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:04.329148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:04.335547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.336111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.337021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.338251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.467167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:04.475051 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b942e314-f11a-445e-bead-3b365503aabf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1473 microversion: 2.1 time: 0.386993 May 07 21:51:04.475887 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 864/1773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:04 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1473 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:04.483654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:04.484364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:04.490527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.491387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.492238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.492849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.812272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:04.825439 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c46ef1ec-06d5-4dde-b4cb-a005952ba002 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1699 microversion: 2.1 time: 0.501441 May 07 21:51:04.826192 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 910/1774] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:04 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1699 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:04.840487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3bc389dd-a7e7-428d-a866-57b828cb5257 req-af5b24c9-fb00-419d-a5df-516a0232eb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827a3df8-0013-4d92-a2f1-b9c40fcf5ef1", "tag": "ff48314b-c114-4414-a45f-e2db275b1d72"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:04.853428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:04.869884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3bc389dd-a7e7-428d-a866-57b828cb5257 req-af5b24c9-fb00-419d-a5df-516a0232eb89 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.871013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-387ca9db-0114-4e9f-a7bc-05c3a876dce7 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.391210 May 07 21:51:04.871643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3bc389dd-a7e7-428d-a866-57b828cb5257 req-af5b24c9-fb00-419d-a5df-516a0232eb89 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.873921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 865/1775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:04 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:04.880890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:04.883997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:04.893145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.894025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.895233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.895878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.905919 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3bc389dd-a7e7-428d-a866-57b828cb5257 req-af5b24c9-fb00-419d-a5df-516a0232eb89 service nova] Creating event network-changed:ff48314b-c114-4414-a45f-e2db275b1d72 for instance 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 on nch1-master-1 May 07 21:51:04.910858 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3bc389dd-a7e7-428d-a866-57b828cb5257 req-af5b24c9-fb00-419d-a5df-516a0232eb89 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083186 May 07 21:51:04.911704 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 911/1776] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:04.920490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:04.921394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:04.927872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.928521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:04.929491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:04.930261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.146276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:05.153981 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-daaee7d7-ffc2-48f6-ba2c-0a9ffa642926 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.278524 May 07 21:51:05.163479 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 866/1777] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:04 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:05.168706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:05.169554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:05.176150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.176907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.178057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.178734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.285178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:05.295300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:05.297556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5314d193cd404462bc0e5fe1e69cc052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:05.299076 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-08a5eb03-3b8b-4647-912d-5a423fcea956 tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 200 len: 1365 microversion: 2.47 time: 0.134196 May 07 21:51:05.300217 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 867/1778] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:51:05 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:51:05.496425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:05.497795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:05.504252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.505638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.506716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.507406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.813319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:05.823505 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94795259-3d8c-4684-b65f-5df5fcc96a02 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1470 microversion: 2.1 time: 0.334238 May 07 21:51:05.831541 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 868/1779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:05 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:05.850619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:05.855378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:05.908835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.909761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.910797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.912117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.930294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:05.937801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c89214f-1fcc-4549-a45f-3337e93a8b78 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 1.022426 May 07 21:51:05.938388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 912/1780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:04 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:05.951607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-527376e4-9f70-4661-976e-e81864f347ae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:05.972769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-527376e4-9f70-4661-976e-e81864f347ae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:05.979957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-527376e4-9f70-4661-976e-e81864f347ae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.980686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-527376e4-9f70-4661-976e-e81864f347ae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:05.981666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-527376e4-9f70-4661-976e-e81864f347ae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:05.995267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-527376e4-9f70-4661-976e-e81864f347ae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:06.217181 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-527376e4-9f70-4661-976e-e81864f347ae tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "POST /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3/action" status: 202 len: 0 microversion: 2.1 time: 0.263784 May 07 21:51:06.221578 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 913/1781] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:51:05 2022] POST /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:06.231497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:06.233982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:06.242765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:06.244196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:06.245338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:06.246029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:06.265943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63270cc27d704b5095bc8d1133544eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487fc10ff315438ca2de090c396e3cfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:06.290032 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef4d493e-7fd7-448a-ae9b-74e830160b45 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 200 len: 1632 microversion: 2.1 time: 0.449913 May 07 21:51:06.299688 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 869/1782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:05 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 1632 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:06.313031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:06.314587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:06.329857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:06.330810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:06.331995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:06.336335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:06.616082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:06.623809 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c299498-afe1-4a3c-a617-550e937f9c91 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.322715 May 07 21:51:06.625098 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 870/1783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:06 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:06.638492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7d5da19f-55a1-4c72-9f4f-1a00886f8a7c req-88aa3488-c154-462d-a87e-7d68944fb799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af003a02-3515-4f58-9883-d6033c1b72f4", "name": "network-vif-deleted", "tag": "6ce344e7-dcb0-471f-b006-52cef1e33f6f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:06.652027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7d5da19f-55a1-4c72-9f4f-1a00886f8a7c req-88aa3488-c154-462d-a87e-7d68944fb799 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:06.652953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7d5da19f-55a1-4c72-9f4f-1a00886f8a7c req-88aa3488-c154-462d-a87e-7d68944fb799 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:06.672176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7d5da19f-55a1-4c72-9f4f-1a00886f8a7c req-88aa3488-c154-462d-a87e-7d68944fb799 service nova] Creating event network-vif-deleted:6ce344e7-dcb0-471f-b006-52cef1e33f6f for instance af003a02-3515-4f58-9883-d6033c1b72f4 on nch1-master-1 May 07 21:51:06.678360 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7d5da19f-55a1-4c72-9f4f-1a00886f8a7c req-88aa3488-c154-462d-a87e-7d68944fb799 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051819 May 07 21:51:06.680090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 871/1784] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:06.687738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:06.689225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:06.699096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:06.700185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:06.701210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:06.702761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.012557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:07.033363 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a315c763-448e-47b9-9640-3ebdeafcf537 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.810072 May 07 21:51:07.034311 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 914/1785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:06 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:07.046619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:07.047287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] [instance: 6e16d2bf-a309-499a-8966-4cbe19870972] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:07.076521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.077314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.078307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.078953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.097396 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] HTTP exception thrown: Instance 6e16d2bf-a309-499a-8966-4cbe19870972 could not be found. May 07 21:51:07.098310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] Returning 404 to user: Instance 6e16d2bf-a309-499a-8966-4cbe19870972 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:07.099370 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3d0d2922-c3e5-437d-bf31-414957380c1e tempest-ServersAaction247Test-984437898 tempest-ServersAaction247Test-984437898-project] 10.222.0.32 "GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972" status: 404 len: 111 microversion: 2.47 time: 0.064084 May 07 21:51:07.103399 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 915/1786] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:51:07 2022] GET /compute/v2.1/servers/6e16d2bf-a309-499a-8966-4cbe19870972 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:51:07.109724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:07.110589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:07.121382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.122125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.123858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.127366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.590277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:07.599983 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-79ba71ba-e8c1-4841-9ca0-c02bc3ae59be tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1469 microversion: 2.1 time: 0.917022 May 07 21:51:07.601655 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 872/1787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:06 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1469 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:07.616058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:07.623014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] [instance: af003a02-3515-4f58-9883-d6033c1b72f4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:07.639388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.644779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.646057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.646733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.678725 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] HTTP exception thrown: Instance af003a02-3515-4f58-9883-d6033c1b72f4 could not be found. May 07 21:51:07.679495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Returning 404 to user: Instance af003a02-3515-4f58-9883-d6033c1b72f4 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:07.685764 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dae19909-3275-4f58-96d1-6171b1e6fede tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4" status: 404 len: 111 microversion: 2.1 time: 0.073670 May 07 21:51:07.696087 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 873/1788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:07 2022] GET /compute/v2.1/servers/af003a02-3515-4f58-9883-d6033c1b72f4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:07.701925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-68c52fe3-4aec-4e49-9ffc-87a919dca807 req-7cfcada7-4028-46e7-9052-62d010ef9544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe177f0-906a-4fa9-aea9-ccd116bb7d25", "tag": "67f000bc-ddb0-4641-a111-92bb8cc56ac3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:07.723688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-68c52fe3-4aec-4e49-9ffc-87a919dca807 req-7cfcada7-4028-46e7-9052-62d010ef9544 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.726150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-68c52fe3-4aec-4e49-9ffc-87a919dca807 req-7cfcada7-4028-46e7-9052-62d010ef9544 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.754498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:07.758251 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-68c52fe3-4aec-4e49-9ffc-87a919dca807 req-7cfcada7-4028-46e7-9052-62d010ef9544 service nova] Creating event network-changed:67f000bc-ddb0-4641-a111-92bb8cc56ac3 for instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 on nch1-master-1 May 07 21:51:07.766091 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-900e80e3-9708-4a13-83e9-346202e08b60 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.660268 May 07 21:51:07.776330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 916/1789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:07 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:07.780535 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-68c52fe3-4aec-4e49-9ffc-87a919dca807 req-7cfcada7-4028-46e7-9052-62d010ef9544 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082117 May 07 21:51:07.781918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:07.782760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:07.785631 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 874/1790] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:07.799042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.799512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.800026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b226e26b-0738-412a-a337-54f605b57ba9 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] Calling method '.version_select at 0x7fc41ce94280>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:07.800710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:07.801347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:07.859177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b226e26b-0738-412a-a337-54f605b57ba9 tempest-ServersTestJSON-539909651 tempest-ServersTestJSON-539909651-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-503183074" status: 202 len: 0 microversion: 2.1 time: 0.071821 May 07 21:51:07.861753 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 875/1791] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 21:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-503183074 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:08.050431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:08.051067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:08.066357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:08.066357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:08.067336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:08.067898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:08.210808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:08.227566 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea8250f2-1d63-4195-9457-dd61705387ef tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.449469 May 07 21:51:08.229132 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 917/1792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:07 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:08.416100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:08.428913 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d29b7703-e179-47cc-bb53-2548ea594916 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.382124 May 07 21:51:08.440320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 876/1793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:08 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:08.618043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:08.618911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:08.628651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:08.629194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:08.630605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:08.639441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:08.785820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:08.787547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:08.797614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:08.798441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:08.800231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:08.800908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:08.958279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:08.971941 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-279fe4e7-4e80-4f17-9267-8033b2a6d20d tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1469 microversion: 2.1 time: 0.356561 May 07 21:51:08.981994 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 918/1794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:08 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:08.988099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f47a3c7e-00dd-451a-b862-54bb91524c3a req-2648caf2-d07e-42d7-872a-ee2d694b6d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "name": "network-vif-plugged", "status": "completed", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:08.999070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f47a3c7e-00dd-451a-b862-54bb91524c3a req-2648caf2-d07e-42d7-872a-ee2d694b6d74 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:08.999532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f47a3c7e-00dd-451a-b862-54bb91524c3a req-2648caf2-d07e-42d7-872a-ee2d694b6d74 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:09.021264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:09.029123 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-31441968-d4c7-4a55-9ba2-cab63255d702 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.250363 May 07 21:51:09.039891 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f47a3c7e-00dd-451a-b862-54bb91524c3a req-2648caf2-d07e-42d7-872a-ee2d694b6d74 service nova] Creating event network-vif-plugged:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch2-master-1 May 07 21:51:09.040098 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 877/1795] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:08 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:09.049697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-f47a3c7e-00dd-451a-b862-54bb91524c3a req-2648caf2-d07e-42d7-872a-ee2d694b6d74 service nova] Instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:51:09.062430 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f47a3c7e-00dd-451a-b862-54bb91524c3a req-2648caf2-d07e-42d7-872a-ee2d694b6d74 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086987 May 07 21:51:09.063498 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 919/1796] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:09.246034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:09.246753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:09.254075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:09.257423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:09.262375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:09.263336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:09.449983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:09.451662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:09.472996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:09.473528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:09.477449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:09.480137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:09.575553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:09.586242 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8618c606-532b-440b-bb80-20f987919203 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.344509 May 07 21:51:09.591320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 878/1797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:09 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:09.745000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:09.755835 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-044bb114-7080-497e-a123-5ba8d8cc90c1 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.311624 May 07 21:51:09.757174 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 920/1798] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:09 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:09.989418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:09.990033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:09.997796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:09.998258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:09.999177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:09.999509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:10.052555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:10.053183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:10.067937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:10.068656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:10.069449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:10.069920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:10.356309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:10.365392 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4da8f6ca-a677-466e-922d-2e2fb244fab1 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1469 microversion: 2.1 time: 0.379741 May 07 21:51:10.367581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 879/1799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:09 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:10.608010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:10.610275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:10.616539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:10.617385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:10.618343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:10.619497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:10.899059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:10.907549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-344683f2-f0d1-439f-b9b2-f29115b79f31 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.859039 May 07 21:51:10.917897 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 921/1800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:10 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:10.922841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:10.923472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:10.942532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:10.943013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:10.944077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:10.944524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:11.124589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:11.132900 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4bb39ef7-c192-42ca-b3b7-b03cc0871ee7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.528884 May 07 21:51:11.135423 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 880/1801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:10 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:11.384694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-63e04fa5-efa2-48aa-a3d1-d391140651c4 req-f77d5940-afca-440b-aed0-105b8f3a709c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827a3df8-0013-4d92-a2f1-b9c40fcf5ef1", "name": "network-vif-plugged", "status": "completed", "tag": "ff48314b-c114-4414-a45f-e2db275b1d72"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:11.403571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-63e04fa5-efa2-48aa-a3d1-d391140651c4 req-f77d5940-afca-440b-aed0-105b8f3a709c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:11.404016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-63e04fa5-efa2-48aa-a3d1-d391140651c4 req-f77d5940-afca-440b-aed0-105b8f3a709c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:11.425513 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-63e04fa5-efa2-48aa-a3d1-d391140651c4 req-f77d5940-afca-440b-aed0-105b8f3a709c service nova] Creating event network-vif-plugged:ff48314b-c114-4414-a45f-e2db275b1d72 for instance 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 on nch1-master-1 May 07 21:51:11.433532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-63e04fa5-efa2-48aa-a3d1-d391140651c4 req-f77d5940-afca-440b-aed0-105b8f3a709c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286663 May 07 21:51:11.434406 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 881/1802] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:11.444062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:11.454097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:11.466706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:11.467205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:11.468173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:11.468610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:11.571313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:11.586424 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-34abfc52-5222-4e82-bb58-3f0d4379b94e tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.667143 May 07 21:51:11.587141 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 922/1803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:10 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:11.924876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:11.927128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:11.934852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:11.935553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:11.936705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:11.937553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:12.129494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:12.143873 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9692ea95-b7bc-4a95-962b-16bbe7312d34 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1469 microversion: 2.1 time: 0.706782 May 07 21:51:12.145112 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 882/1804] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:11 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1469 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:12.157921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:12.158995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:12.168143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:12.168939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:12.170979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:12.172004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:12.204783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:12.229866 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd20f1b6-ade2-4ba8-ae3e-64720d010672 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.308801 May 07 21:51:12.241982 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 923/1805] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:11 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:12.580235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:12.588688 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77a341b9-7b10-49cb-9186-4ccc27bc0828 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.436306 May 07 21:51:12.601630 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 883/1806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:12 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:12.607076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:12.608156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:12.628755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:12.629227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:12.630046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:12.630496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:12.980849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:12.985225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1151779974", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "4513501c-1efd-4921-875a-affadc96a9fe"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:13.008326 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7f9de9d4-f0b9-4b14-8292-ed5551ee4066 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1319 microversion: 2.1 time: 0.407142 May 07 21:51:13.011167 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 924/1807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:12 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:13.020873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-8499cd90-ba6d-4b7b-9235-2b44517ca836 req-51ace4f3-1cfd-42c4-89da-90bbdf2fa5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "name": "network-vif-unplugged", "status": "completed", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:13.071197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8499cd90-ba6d-4b7b-9235-2b44517ca836 req-51ace4f3-1cfd-42c4-89da-90bbdf2fa5c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:13.073388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8499cd90-ba6d-4b7b-9235-2b44517ca836 req-51ace4f3-1cfd-42c4-89da-90bbdf2fa5c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:13.111596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] validate_networks() for [('4513501c-1efd-4921-875a-affadc96a9fe', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:51:13.119158 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-8499cd90-ba6d-4b7b-9235-2b44517ca836 req-51ace4f3-1cfd-42c4-89da-90bbdf2fa5c3 service nova] Creating event network-vif-unplugged:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch1-master-1 May 07 21:51:13.132892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-8499cd90-ba6d-4b7b-9235-2b44517ca836 req-51ace4f3-1cfd-42c4-89da-90bbdf2fa5c3 service nova] Instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:51:13.157253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-8499cd90-ba6d-4b7b-9235-2b44517ca836 req-51ace4f3-1cfd-42c4-89da-90bbdf2fa5c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140051 May 07 21:51:13.157939 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 925/1808] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:13.167273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:13.168258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:13.176798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:13.179353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:13.180410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:13.181263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:13.489047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:13.500206 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fe6788b-d25a-4bbf-bae5-5678dd33a5d0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1469 microversion: 2.1 time: 0.340995 May 07 21:51:13.501133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 926/1809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:13 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:13.508360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:13.509008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:13.525537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:13.526002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:13.526834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:13.527281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:14.260740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:14.270333 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f895e0e7-a8a9-46cb-a08d-5544a3746c55 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.768103 May 07 21:51:14.275873 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 927/1810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:13 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:14.280880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:14.291858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:14.297965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:14.298428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:14.299265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:14.299735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:14.379168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:51:14.379736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:51:14.380297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:51:14.380956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:51:14.381703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:51:14.392749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:14.393621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:14.394815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:14.395489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:14.417333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Getting quotas for project aa0a7786f72343d6a66da6b4e40aee4e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:51:14.424185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Getting quotas for user c0cb82fc11df4dddb6401647d91d09df and project aa0a7786f72343d6a66da6b4e40aee4e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:51:14.439305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:51:14.442511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:51:14.502050 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-000271f7-9961-48bf-9b95-042d88ef7b78 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581925 May 07 21:51:14.504063 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 884/1811] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:51:14.510751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:14.511754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:14.519285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:14.520100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:14.521395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:14.522066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:14.906817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:14.918325 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e62f130b-b65b-439a-80c2-87b063e9c768 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1468 microversion: 2.1 time: 0.412755 May 07 21:51:14.919191 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 885/1812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:14 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1468 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:14.936736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5cd9f3b-8afc-44b6-a498-50df467d942e tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:14.937759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5cd9f3b-8afc-44b6-a498-50df467d942e tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:15.047417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5cd9f3b-8afc-44b6-a498-50df467d942e tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:15.061323 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5cd9f3b-8afc-44b6-a498-50df467d942e tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1217 microversion: 2.1 time: 0.126497 May 07 21:51:15.071023 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 886/1813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:14 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:15.078856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:15.082822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:15.084097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:15.092571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.094276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.095656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.096499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.102818 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2184415a-4629-4927-9401-2fa6e473bc27 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.825498 May 07 21:51:15.103421 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 928/1814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:14 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:15.118117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-dfbf981c-8ae2-49aa-bfcc-406e852b77e0 req-0d954a10-0bf2-4416-b3cc-3e977c69c6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe177f0-906a-4fa9-aea9-ccd116bb7d25", "name": "network-vif-plugged", "status": "completed", "tag": "67f000bc-ddb0-4641-a111-92bb8cc56ac3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:15.132517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dfbf981c-8ae2-49aa-bfcc-406e852b77e0 req-0d954a10-0bf2-4416-b3cc-3e977c69c6e6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.136308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dfbf981c-8ae2-49aa-bfcc-406e852b77e0 req-0d954a10-0bf2-4416-b3cc-3e977c69c6e6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.165253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-dfbf981c-8ae2-49aa-bfcc-406e852b77e0 req-0d954a10-0bf2-4416-b3cc-3e977c69c6e6 service nova] Creating event network-vif-plugged:67f000bc-ddb0-4641-a111-92bb8cc56ac3 for instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 on nch1-master-1 May 07 21:51:15.171425 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-dfbf981c-8ae2-49aa-bfcc-406e852b77e0 req-0d954a10-0bf2-4416-b3cc-3e977c69c6e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066280 May 07 21:51:15.172639 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 929/1815] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:15.185388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:15.186927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:15.203484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.205545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.206603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.208700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.236903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lazy-loading 'flavor' on Instance uuid 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:51:15.384862 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61c2100b-f23c-4aae-a58a-becae6de41e9 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.197586 May 07 21:51:15.390482 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 930/1816] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:51:15 2022] POST /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:15.411000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:15.413267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:15.441408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.442024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.443015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.443904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.737451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:15.745203 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e327c8c-dcc1-4c9b-86b7-1b9a2090f854 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.353188 May 07 21:51:15.754545 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 931/1817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:15 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:15.767846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-235a0d90-fd9a-414d-bee6-8c071603058d req-6cfdd6ce-94f4-44df-90c2-2933bde298b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:15.780337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-235a0d90-fd9a-414d-bee6-8c071603058d req-6cfdd6ce-94f4-44df-90c2-2933bde298b0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.780880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-235a0d90-fd9a-414d-bee6-8c071603058d req-6cfdd6ce-94f4-44df-90c2-2933bde298b0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.798485 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-235a0d90-fd9a-414d-bee6-8c071603058d req-6cfdd6ce-94f4-44df-90c2-2933bde298b0 service nova] Creating event network-changed:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch1-master-1 May 07 21:51:15.805547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-235a0d90-fd9a-414d-bee6-8c071603058d req-6cfdd6ce-94f4-44df-90c2-2933bde298b0 service nova] Instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 21:51:15.817908 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-235a0d90-fd9a-414d-bee6-8c071603058d req-6cfdd6ce-94f4-44df-90c2-2933bde298b0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070214 May 07 21:51:15.819426 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 932/1818] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:15.826754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:15.827766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:15.835230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.835700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:15.836503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:15.836964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:16.069194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:16.080363 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-176eb15e-78b3-4ce0-9cd2-ba14d95f0811 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1476 microversion: 2.1 time: 0.259349 May 07 21:51:16.081367 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 933/1819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:15 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:16.088473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:16.089329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:16.102147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:16.102607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:16.105292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:16.105712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:16.218925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:16.236715 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5def0614-78f0-452d-b4ee-dff13e1ef14c tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1277 microversion: 2.1 time: 0.153895 May 07 21:51:16.246762 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 934/1820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:16 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:16.246762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:16.246762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:16.253276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:16.254140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:16.255061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:16.255586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:16.364664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:16.373642 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4e312750-dadc-4fea-81eb-cfdd9c279b58 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1469 microversion: 2.1 time: 1.306899 May 07 21:51:16.383911 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 887/1821] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:15 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1469 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:16.576257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:16.584911 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-47ac32f3-04eb-484f-a22e-42a6bfc6040e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1323 microversion: 2.1 time: 0.344541 May 07 21:51:16.592564 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 935/1822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:16 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1323 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:16.762436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:16.763002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:16.770386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:16.770863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:16.775181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:16.776433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.104344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:17.106282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:17.133550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.136596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:17.139803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.146449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.148804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.157389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7cc6394d-9b45-47c3-841b-179d70bd648c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.397315 May 07 21:51:17.158254 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 888/1823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:16 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:17.201722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-68fcc2ed-a41e-48df-aefa-6b15648d0641 req-1bb45179-d80e-4e04-8ad6-f0e64a4065f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd37e9-7131-4834-a215-e56f0fb30c5d", "name": "network-vif-plugged", "status": "completed", "tag": "bf4cdac7-29da-404a-9ec1-943fa91f5ab0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:17.218191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-68fcc2ed-a41e-48df-aefa-6b15648d0641 req-1bb45179-d80e-4e04-8ad6-f0e64a4065f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.218648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-68fcc2ed-a41e-48df-aefa-6b15648d0641 req-1bb45179-d80e-4e04-8ad6-f0e64a4065f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.239349 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-68fcc2ed-a41e-48df-aefa-6b15648d0641 req-1bb45179-d80e-4e04-8ad6-f0e64a4065f7 service nova] Creating event network-vif-plugged:bf4cdac7-29da-404a-9ec1-943fa91f5ab0 for instance a4bd37e9-7131-4834-a215-e56f0fb30c5d on nch2-master-1 May 07 21:51:17.245566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-68fcc2ed-a41e-48df-aefa-6b15648d0641 req-1bb45179-d80e-4e04-8ad6-f0e64a4065f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053246 May 07 21:51:17.246361 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 889/1824] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:51:17.256203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:17.257112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:17.265689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.266332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.267316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.267916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.413555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:17.446115 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-318162f6-4514-4fb6-85de-3e0b8d45acff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1275 microversion: 2.1 time: 0.179196 May 07 21:51:17.452001 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 890/1825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:17 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1275 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:17.466516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:17.467545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:17.474607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:17.477454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.479897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.482748 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0276f277-4cc1-409c-b089-c15b32feae5c tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1459 microversion: 2.1 time: 0.385178 May 07 21:51:17.483930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.484535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.488096 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 936/1826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:17 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1459 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:17.505873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9121947f-1827-4064-b2bf-825007e24940 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:17.506785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9121947f-1827-4064-b2bf-825007e24940 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:17.514073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9121947f-1827-4064-b2bf-825007e24940 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.514854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9121947f-1827-4064-b2bf-825007e24940 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.515847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9121947f-1827-4064-b2bf-825007e24940 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.517530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9121947f-1827-4064-b2bf-825007e24940 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.925037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:17.933789 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d88a057a-6f4d-4e0c-8e1f-2da9ecd6f343 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1469 microversion: 2.1 time: 0.480189 May 07 21:51:17.934391 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 891/1827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:17 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1469 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:17.956352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:17.957982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:17.971542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.972608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:17.974965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:17.978000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.199216 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9121947f-1827-4064-b2bf-825007e24940 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1610 microversion: 2.1 time: 0.698327 May 07 21:51:18.199938 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 937/1828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:17 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1610 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:18.216050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:18.220203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:18.229567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Searching by: {'deleted': False, 'project_id': '2a463927927b488ebe8a6e118484e8df'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:51:18.237713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.238189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.239668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.240121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.347263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:51:18.416266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-282be2cb-98ce-4347-bec7-559d29f64780 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.212989 May 07 21:51:18.416266 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 938/1829] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:51:18 2022] GET /compute/v2.1/servers => generated 340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:18.420862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:18.422029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:18.430122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.431012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.431975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.432835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.566009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:18.577693 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cdf17015-2df2-4629-9eac-dfb9f127af66 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1521 microversion: 2.1 time: 0.635692 May 07 21:51:18.579928 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 892/1830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:17 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:18.584993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85a42b48-bbd2-4082-98de-80e91022c357 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:18.597985 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:51:18.597985 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 21:51:18.597985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a42b48-bbd2-4082-98de-80e91022c357 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.597985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a42b48-bbd2-4082-98de-80e91022c357 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.597985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a42b48-bbd2-4082-98de-80e91022c357 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.597985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a42b48-bbd2-4082-98de-80e91022c357 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.630755 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85a42b48-bbd2-4082-98de-80e91022c357 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.049189 May 07 21:51:18.631867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 893/1831] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 21:51:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:18.637093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:18.641023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:18.641970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Searching by: {'deleted': False, 'project_id': '2a463927927b488ebe8a6e118484e8df'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:51:18.647558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.648096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.648973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.649500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.679505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:51:18.769028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:18.776952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.777484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.930464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:18.939512 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-04349653-51c9-4ecb-a4b4-be149c02f1a4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1316 microversion: 2.1 time: 0.523515 May 07 21:51:18.944822 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 939/1832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:18 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:18.951659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:18.952454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:18.967462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.970076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:18.980155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:18.980880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.255089 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21609fbd-3fc6-4061-8f43-6502a197c7a6 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.621961 May 07 21:51:19.256144 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 894/1833] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:51:18 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:19.262312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:19.262996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:19.273759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.274222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.275088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.275547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.285918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:19.307026 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-34cbdef6-92b4-442d-a5dc-561f7e797b66 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.351267 May 07 21:51:19.308637 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 940/1834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:18 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:19.313615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:19.319701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:19.332114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.334413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.335742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.340303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.393075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Lazy-loading 'flavor' on Instance uuid 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:51:19.418614 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 while it is in vm_state suspended May 07 21:51:19.419264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 while it is in vm_state suspended {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:19.420120 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a415cbfd-4430-45b5-970f-be7e444972a2 tempest-LiveMigrationNegativeTest-1153127132 tempest-LiveMigrationNegativeTest-1153127132-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1/action" status: 409 len: 155 microversion: 2.1 time: 0.110205 May 07 21:51:19.420709 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 941/1835] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:51:19 2022] POST /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1/action => generated 155 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 21:51:19.435692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:19.436321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:19.454666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.455172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.456259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.456919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.468746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:19.476936 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1cd26ab-fd5f-4200-9d63-a5c1a891bba3 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1521 microversion: 2.1 time: 0.219677 May 07 21:51:19.483166 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 895/1836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:19 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:19.501678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-01fa9c23-0a1f-4674-8d32-d0eec6ce0a53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:19.516015 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-01fa9c23-0a1f-4674-8d32-d0eec6ce0a53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031083 May 07 21:51:19.516848 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 896/1837] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:51:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:19.523296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:19.525508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:19.533845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.535150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.536381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.537053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.572603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:19.716438 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52a2e819-b48d-4757-8f81-da7eb6f598df tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "DELETE /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 204 len: 0 microversion: 2.1 time: 0.198041 May 07 21:51:19.717576 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 897/1838] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:19 2022] DELETE /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:19.726550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee6f2c80-a7f8-4188-9415-c20b89717894 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-355018024"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:19.728115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee6f2c80-a7f8-4188-9415-c20b89717894 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:19.736941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee6f2c80-a7f8-4188-9415-c20b89717894 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.737486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee6f2c80-a7f8-4188-9415-c20b89717894 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.738343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee6f2c80-a7f8-4188-9415-c20b89717894 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.738897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee6f2c80-a7f8-4188-9415-c20b89717894 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.791530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:19.812522 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-22ec991a-1f20-4ca6-96a6-252181b6caac tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1462 microversion: 2.1 time: 0.375058 May 07 21:51:19.825483 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 942/1839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:19 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1462 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:19.832562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:19.833874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:19.844534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.845366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:19.866199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:19.868004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.160294 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee6f2c80-a7f8-4188-9415-c20b89717894 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25/action" status: 202 len: 0 microversion: 2.1 time: 0.439463 May 07 21:51:20.163459 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 898/1840] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:51:19 2022] POST /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 21:51:20.175769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:20.185320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-619bdbd9-f188-41d7-8e18-6b5c7d118d54 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1465 microversion: 2.1 time: 0.358208 May 07 21:51:20.188700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-143f5e35-c8fa-4631-b697-10edd4f5044e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:20.192015 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 943/1841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:19 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1465 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:20.207767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-143f5e35-c8fa-4631-b697-10edd4f5044e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:20.213507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:20.214362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:20.222658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.223409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.224562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.225171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.236547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-143f5e35-c8fa-4631-b697-10edd4f5044e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.239735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-143f5e35-c8fa-4631-b697-10edd4f5044e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.241090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-143f5e35-c8fa-4631-b697-10edd4f5044e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.244986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-143f5e35-c8fa-4631-b697-10edd4f5044e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.284789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:20.431702 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fab2159-9f52-4172-bc61-e87b3ad07b01 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 204 len: 0 microversion: 2.1 time: 0.236831 May 07 21:51:20.437251 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 944/1842] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:20 2022] DELETE /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:20.459425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:20.460829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:20.468185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.469164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.470532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.471334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.606176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-143f5e35-c8fa-4631-b697-10edd4f5044e tempest-MigrationsAdminTest-1078114156 tempest-MigrationsAdminTest-1078114156-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1613 microversion: 2.1 time: 0.437382 May 07 21:51:20.612477 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 899/1843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:20 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1613 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:20.618381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f478261-04ae-4789-a18f-81e3c8b272c4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '.version_select at 0x7fc41d2c4d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:20.666269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:20.676336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-944b09c4-87c6-443b-aae1-b583b169242e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1503 microversion: 2.1 time: 0.237211 May 07 21:51:20.677694 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 945/1844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:20 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:20.808384 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f478261-04ae-4789-a18f-81e3c8b272c4 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/images/65b22d9f-bd49-4dcd-990e-ae275d305657" status: 204 len: 0 microversion: 2.1 time: 0.194192 May 07 21:51:20.809041 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 900/1845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:20 2022] DELETE /compute/v2.1/images/65b22d9f-bd49-4dcd-990e-ae275d305657 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:20.814473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:20.815456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:20.835331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.836313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.839377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.841364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:20.960697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0f7473c6-3f92-43c7-b308-8c607e838a1e req-fddf8251-5b36-4c1f-9c69-bb7bc2d7e6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e589d355-aaf2-4345-8239-14d71c2e31ef", "tag": "7ffe92b1-dfd2-4f6a-9df8-10bcc08bfa0c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:20.975424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0f7473c6-3f92-43c7-b308-8c607e838a1e req-fddf8251-5b36-4c1f-9c69-bb7bc2d7e6a8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:20.976197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0f7473c6-3f92-43c7-b308-8c607e838a1e req-fddf8251-5b36-4c1f-9c69-bb7bc2d7e6a8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.005574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0f7473c6-3f92-43c7-b308-8c607e838a1e req-fddf8251-5b36-4c1f-9c69-bb7bc2d7e6a8 service nova] Creating event network-changed:7ffe92b1-dfd2-4f6a-9df8-10bcc08bfa0c for instance e589d355-aaf2-4345-8239-14d71c2e31ef on nch2-master-1 May 07 21:51:21.032873 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0f7473c6-3f92-43c7-b308-8c607e838a1e req-fddf8251-5b36-4c1f-9c69-bb7bc2d7e6a8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353674 May 07 21:51:21.051768 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 946/1846] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:21.065786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:21.071983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:21.094120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.096265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.102538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.103584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.186588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:21.216784 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e0e29f91-2100-47af-b3b1-c908c9c7de36 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.404605 May 07 21:51:21.217510 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 901/1847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:20 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:21.238742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:21.239287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:21.253709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.254090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.254933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.255387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.323238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:21.394061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:21.407243 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-597f1885-04f0-4186-a361-756217048f53 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1714 microversion: 2.1 time: 0.352024 May 07 21:51:21.408336 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 947/1848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:21 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1714 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:21.414377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1599307591"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:21.415317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:21.423866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.424610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.425681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.426288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.457301 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e32fa8b4-7af8-487e-8cd6-534a4f3b9a7a tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 204 len: 0 microversion: 2.1 time: 0.238505 May 07 21:51:21.459840 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 902/1849] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:21 2022] DELETE /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:21.474146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de689b10-61b2-4573-9fa9-c9221bf81c5b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '.version_select at 0x7fc41ceb6940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:21.513437 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-de689b10-61b2-4573-9fa9-c9221bf81c5b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Image not found. May 07 21:51:21.514309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de689b10-61b2-4573-9fa9-c9221bf81c5b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:21.515726 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de689b10-61b2-4573-9fa9-c9221bf81c5b tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/images/65b22d9f-bd49-4dcd-990e-ae275d305657" status: 404 len: 62 microversion: 2.1 time: 0.054095 May 07 21:51:21.519442 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 903/1850] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:21 2022] GET /compute/v2.1/images/65b22d9f-bd49-4dcd-990e-ae275d305657 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:51:21.522551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:21.525745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:21.533174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.533821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.535791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:21.536358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:21.707302 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.network.security_group_api [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Adding security group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 to port bf4cdac7-29da-404a-9ec1-943fa91f5ab0 May 07 21:51:22.390641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:22.401643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5dcf5888-bd70-4505-8d73-782fd9462337 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1465 microversion: 2.1 time: 0.883393 May 07 21:51:22.406088 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 904/1851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:21 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1465 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:22.414878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:22.416461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:22.434477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:22.435266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:22.436437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:22.437452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:22.832652 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-73327582-387f-4482-8bf5-b31c2019e22b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d/action" status: 202 len: 0 microversion: 2.1 time: 1.423065 May 07 21:51:22.834400 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 948/1852] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:51:21 2022] POST /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d/action => generated 0 bytes in 1425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:22.840770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:22.841667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:22.855831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:22.856301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:22.857099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:22.857549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:23.338843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:23.350253 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2fb8e3fe-16db-45ab-9dc2-934e92aa0822 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1468 microversion: 2.1 time: 0.942716 May 07 21:51:23.365319 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 905/1853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:22 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1468 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:23.372039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:23.374565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:23.382131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:23.384124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:23.386417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:23.387555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:23.817748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:23.827305 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-460b827c-4b7b-47ae-952e-52e0f453353a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1539 microversion: 2.1 time: 0.991108 May 07 21:51:23.831378 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 949/1854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:22 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1539 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:23.843704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0fd502f2-5b87-44ad-95df-5d6fa882bdd4 req-85d9a3fd-c169-4622-a12e-16a50c38f5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "name": "network-vif-plugged", "status": "completed", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:23.868978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0fd502f2-5b87-44ad-95df-5d6fa882bdd4 req-85d9a3fd-c169-4622-a12e-16a50c38f5ae service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:23.879571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0fd502f2-5b87-44ad-95df-5d6fa882bdd4 req-85d9a3fd-c169-4622-a12e-16a50c38f5ae service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:23.902074 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0fd502f2-5b87-44ad-95df-5d6fa882bdd4 req-85d9a3fd-c169-4622-a12e-16a50c38f5ae service nova] Creating event network-vif-plugged:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch1-master-1 May 07 21:51:23.915708 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0fd502f2-5b87-44ad-95df-5d6fa882bdd4 req-85d9a3fd-c169-4622-a12e-16a50c38f5ae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082376 May 07 21:51:23.919894 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 950/1855] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:23.932360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:23.943568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:23.951546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:23.954621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:23.955617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:23.957828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.081176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:24.093012 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-141356d8-e2d5-4b88-92f3-033a987e52e7 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.725962 May 07 21:51:24.096113 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 906/1856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:23 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:24.108988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f3798ac6-dabe-4308-ba4c-f41db8040e8c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d091af0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:24.337732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:24.352226 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa3de714-bf5b-4137-9ddb-aea1905276c0 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1647 microversion: 2.1 time: 0.427225 May 07 21:51:24.354162 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 951/1857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:23 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1647 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:24.373884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9a29285f-c9b4-4aa7-b1a4-a51ed77210d8 req-1377a99c-5113-4708-84ff-0128b6eed457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bd37e9-7131-4834-a215-e56f0fb30c5d", "tag": "bf4cdac7-29da-404a-9ec1-943fa91f5ab0"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:24.394715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9a29285f-c9b4-4aa7-b1a4-a51ed77210d8 req-1377a99c-5113-4708-84ff-0128b6eed457 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.400413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9a29285f-c9b4-4aa7-b1a4-a51ed77210d8 req-1377a99c-5113-4708-84ff-0128b6eed457 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.423066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9a29285f-c9b4-4aa7-b1a4-a51ed77210d8 req-1377a99c-5113-4708-84ff-0128b6eed457 service nova] Creating event network-changed:bf4cdac7-29da-404a-9ec1-943fa91f5ab0 for instance a4bd37e9-7131-4834-a215-e56f0fb30c5d on nch2-master-1 May 07 21:51:24.465355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9a29285f-c9b4-4aa7-b1a4-a51ed77210d8 req-1377a99c-5113-4708-84ff-0128b6eed457 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072321 May 07 21:51:24.467561 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 952/1858] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:24.481601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:24.484474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:24.514911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.515464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.517748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.519071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.538549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-f3798ac6-dabe-4308-ba4c-f41db8040e8c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 in use.", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:24.540173 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f3798ac6-dabe-4308-ba4c-f41db8040e8c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security Group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 in use. May 07 21:51:24.540173 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-a47b98fe-47f9-4a0e-b40c-57a53cc7e9bb'] May 07 21:51:24.541034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f3798ac6-dabe-4308-ba4c-f41db8040e8c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 400 to user: Security Group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 in use. May 07 21:51:24.541034 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-a47b98fe-47f9-4a0e-b40c-57a53cc7e9bb'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:24.542132 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f3798ac6-dabe-4308-ba4c-f41db8040e8c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/3ab4642d-3355-41eb-ae9c-57c018ee1be1" status: 400 len: 185 microversion: 2.1 time: 0.444584 May 07 21:51:24.542893 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 907/1859] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:24 2022] DELETE /compute/v2.1/os-security-groups/3ab4642d-3355-41eb-ae9c-57c018ee1be1 => generated 185 bytes in 446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:51:24.548000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-493adddb-b405-4b08-b8d1-28cca94906fd req-68f0d479-a463-41bb-a102-7a2672c0a87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827a3df8-0013-4d92-a2f1-b9c40fcf5ef1", "name": "network-vif-deleted", "tag": "ff48314b-c114-4414-a45f-e2db275b1d72"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:24.582480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-493adddb-b405-4b08-b8d1-28cca94906fd req-68f0d479-a463-41bb-a102-7a2672c0a87a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.585517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-493adddb-b405-4b08-b8d1-28cca94906fd req-68f0d479-a463-41bb-a102-7a2672c0a87a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.638887 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-493adddb-b405-4b08-b8d1-28cca94906fd req-68f0d479-a463-41bb-a102-7a2672c0a87a service nova] Creating event network-vif-deleted:ff48314b-c114-4414-a45f-e2db275b1d72 for instance 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 on nch1-master-1 May 07 21:51:24.658433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.660760 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-493adddb-b405-4b08-b8d1-28cca94906fd req-68f0d479-a463-41bb-a102-7a2672c0a87a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114643 May 07 21:51:24.663559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.664369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lazy-loading 'fault' on Instance uuid 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:51:24.664876 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 908/1860] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:24.704260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:24.708126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:24.735689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.747528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.750979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.751654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.799125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:24.811711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2fc29881-6ff8-41ef-9f9f-38d073cb6aba tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 200 len: 1309 microversion: 2.1 time: 0.340443 May 07 21:51:24.812318 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 953/1861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:24 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 1309 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:24.832462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b285290-d8f5-4a5c-b846-2550f7ff3591 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:24.836980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b285290-d8f5-4a5c-b846-2550f7ff3591 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:24.852281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b285290-d8f5-4a5c-b846-2550f7ff3591 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.853046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b285290-d8f5-4a5c-b846-2550f7ff3591 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:24.855341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b285290-d8f5-4a5c-b846-2550f7ff3591 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:24.857153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b285290-d8f5-4a5c-b846-2550f7ff3591 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:25.036583 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b285290-d8f5-4a5c-b846-2550f7ff3591 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d/action" status: 202 len: 0 microversion: 2.1 time: 0.212070 May 07 21:51:25.037634 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 954/1862] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:51:24 2022] POST /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:25.064520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:25.065608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:25.076219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:25.077498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:25.078494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:25.079139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:25.207869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:25.225393 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07b1a412-5111-4f51-a0f9-2740dae0a981 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 200 len: 1468 microversion: 2.1 time: 0.555429 May 07 21:51:25.228781 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 909/1863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:24 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:25.240280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:25.240916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:25.247872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:25.248349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:25.249126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:25.249573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:25.841475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:25.849937 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f613a089-d763-4f35-aee8-4ef405f047c7 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1534 microversion: 2.1 time: 0.810937 May 07 21:51:25.857989 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 955/1864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:25 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1534 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:25.868019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:25.879236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:25.904110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:25.904863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:25.907417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:25.910434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.003001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:26.013958 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa93b0af-20cd-48e3-a014-ee2735eafde8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1574 microversion: 2.1 time: 0.783443 May 07 21:51:26.015181 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 910/1865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:25 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1574 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:26.025137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:26.035736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:26.042301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.043583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.044385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.044828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.122672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.123971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.127186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lazy-loading 'fault' on Instance uuid 5d774b77-243e-4663-a376-3bbd59bd54e5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:51:26.367507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:26.379316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d43cf914-138a-4650-a8cc-260bea18a3a2 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.517817 May 07 21:51:26.380398 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 956/1866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:25 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:26.394025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:26.394804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:26.401947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.402684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.403799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.404415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.423813 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] HTTP exception thrown: Instance 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 could not be found. May 07 21:51:26.424712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Returning 404 to user: Instance 827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:26.425778 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a55b553-7e61-451f-9280-929552a11e3d tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1" status: 404 len: 111 microversion: 2.1 time: 0.042459 May 07 21:51:26.426559 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 957/1867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:26 2022] GET /compute/v2.1/servers/827a3df8-0013-4d92-a2f1-b9c40fcf5ef1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:26.437133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:26.438076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: e8be6b3c-b434-467d-98b2-4d0d5763bed3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:26.448477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.449248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.450341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.451218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.478714 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] HTTP exception thrown: Instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 could not be found. May 07 21:51:26.482065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Returning 404 to user: Instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:26.489417 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a0231fb7-78d3-4550-80bf-dff6b1d9c4bd tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3" status: 404 len: 111 microversion: 2.1 time: 0.057688 May 07 21:51:26.490225 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 958/1868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:26 2022] GET /compute/v2.1/servers/e8be6b3c-b434-467d-98b2-4d0d5763bed3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:26.496745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:26.496976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:26.508133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.509295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.510703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.511565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.544232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:26.669668 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e896dfd7-6e53-4997-bc6f-a4ff7d1a6ab3 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 204 len: 0 microversion: 2.1 time: 0.177786 May 07 21:51:26.670606 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 959/1869] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:26 2022] DELETE /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:26.681040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c0013e43-df69-4348-a7cb-967a3aaa340e req-75bccfed-e6e3-4572-83e5-dde83a06ede0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8be6b3c-b434-467d-98b2-4d0d5763bed3", "name": "network-vif-deleted", "tag": "873114d2-cfcd-4b2f-9a14-3496ecd36990"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:26.689638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c0013e43-df69-4348-a7cb-967a3aaa340e req-75bccfed-e6e3-4572-83e5-dde83a06ede0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.690083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c0013e43-df69-4348-a7cb-967a3aaa340e req-75bccfed-e6e3-4572-83e5-dde83a06ede0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.705946 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c0013e43-df69-4348-a7cb-967a3aaa340e req-75bccfed-e6e3-4572-83e5-dde83a06ede0 service nova] Creating event network-vif-deleted:873114d2-cfcd-4b2f-9a14-3496ecd36990 for instance e8be6b3c-b434-467d-98b2-4d0d5763bed3 on nch1-master-1 May 07 21:51:26.714914 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c0013e43-df69-4348-a7cb-967a3aaa340e req-75bccfed-e6e3-4572-83e5-dde83a06ede0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038403 May 07 21:51:26.715431 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 960/1870] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:26.720727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:26.721475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:26.729476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.729934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.730729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.731328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.758495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:26.780432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd60e0534aac4bc697aafe66723e1ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a463927927b488ebe8a6e118484e8df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:26.796355 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88e3cf5f-c7e5-492a-a99b-b194fd05ee28 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 200 len: 1368 microversion: 2.1 time: 0.779752 May 07 21:51:26.797550 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 911/1871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:26 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 1368 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:26.804133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:26.806945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:26.819440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.820945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.822382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.823222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.882515 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0eedff4c-b7b9-42a0-b6ed-b1a7682d0b62 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 204 len: 0 microversion: 2.1 time: 0.160499 May 07 21:51:26.883179 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 961/1872] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:26 2022] DELETE /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:26.895320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-76713cb1-511f-4f99-a3e4-a505609ecdf7 req-3ebfc2f5-a404-4107-b3fb-e3642e0e58db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d774b77-243e-4663-a376-3bbd59bd54e5", "name": "network-vif-deleted", "tag": "667cf044-3f39-4bfe-97b5-7ac327708e49"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:26.918059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-76713cb1-511f-4f99-a3e4-a505609ecdf7 req-3ebfc2f5-a404-4107-b3fb-e3642e0e58db service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.918935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-76713cb1-511f-4f99-a3e4-a505609ecdf7 req-3ebfc2f5-a404-4107-b3fb-e3642e0e58db service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.935215 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-76713cb1-511f-4f99-a3e4-a505609ecdf7 req-3ebfc2f5-a404-4107-b3fb-e3642e0e58db service nova] Creating event network-vif-deleted:667cf044-3f39-4bfe-97b5-7ac327708e49 for instance 5d774b77-243e-4663-a376-3bbd59bd54e5 on nch2-master-1 May 07 21:51:26.942206 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-76713cb1-511f-4f99-a3e4-a505609ecdf7 req-3ebfc2f5-a404-4107-b3fb-e3642e0e58db service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056694 May 07 21:51:26.946022 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 962/1873] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:26.953104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:26.954494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:26.965142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.965970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:26.967029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:26.967689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.134648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:27.151332 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54314bb5-fd72-41c0-b256-3f3e3a13cbad tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1521 microversion: 2.1 time: 0.202160 May 07 21:51:27.152350 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 963/1874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:26 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:27.157071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:27.157971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:27.158970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:27.169957 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-25b78178-8d09-44ae-bfca-7708d8a7dbe6 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1474 microversion: 2.1 time: 0.371029 May 07 21:51:27.182856 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 912/1875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:26 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1474 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:27.188320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:27.190480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.192043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.192043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.192849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.193894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:27.204675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.205355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.206310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.207024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.402366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:27.416654 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e8485ad4-6f00-4651-855c-618883b31acf tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1533 microversion: 2.1 time: 0.261811 May 07 21:51:27.423558 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 964/1876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:27 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1533 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:27.433225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:27.435094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:27.441623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.442219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.443425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.443963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.471133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:27.567513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ad1701ce-ab3f-44ef-a73c-ccaa9fcff99c tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 204 len: 0 microversion: 2.1 time: 0.141402 May 07 21:51:27.569059 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 965/1877] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:27 2022] DELETE /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:27.576936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:27.578166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:27.586355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.587800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.588940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.589492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.643597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:27.679648 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ca9edc2-b6df-4398-ae5b-5478935b747d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1574 microversion: 2.1 time: 0.495096 May 07 21:51:27.698950 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 913/1878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:27 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1574 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:27.704195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:27.705060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:27.712911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.713627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.714920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:27.715535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:27.981026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:27.987702 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8d66f853-3cb1-4292-ba2f-ebb1beaa4f70 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.417311 May 07 21:51:27.988294 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 966/1879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:27 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:28.007139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:28.008072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] [instance: 5d774b77-243e-4663-a376-3bbd59bd54e5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:28.027151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.027869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.028831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.029440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.058996 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] HTTP exception thrown: Instance 5d774b77-243e-4663-a376-3bbd59bd54e5 could not be found. May 07 21:51:28.059913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Returning 404 to user: Instance 5d774b77-243e-4663-a376-3bbd59bd54e5 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:28.060957 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c456601c-6d9f-4ea8-bff6-3a14d9a2e774 tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5" status: 404 len: 111 microversion: 2.1 time: 0.067151 May 07 21:51:28.061708 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 967/1880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:27 2022] GET /compute/v2.1/servers/5d774b77-243e-4663-a376-3bbd59bd54e5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:28.069903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46885110-884f-44dc-887e-1c97c770ca2a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] Calling method '.version_select at 0x7fc41d73c430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:28.112953 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-46885110-884f-44dc-887e-1c97c770ca2a tempest-ServersTestManualDisk-709789573 tempest-ServersTestManualDisk-709789573-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665312064" status: 202 len: 0 microversion: 2.1 time: 0.046916 May 07 21:51:28.113854 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 968/1881] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665312064 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:51:28.188031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:28.188939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:28.204911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.206457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.207563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.210931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.422718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:28.432394 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa5c50c2-ab8f-45bf-ad2c-1abe0dbb1bee tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1527 microversion: 2.1 time: 0.731991 May 07 21:51:28.437564 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 914/1882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:27 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1527 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:28.459595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:28.461557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:28.489750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.494926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.497601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.499523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.840595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:28.848064 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e928730b-f840-43fd-ad94-9920f4145454 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1533 microversion: 2.1 time: 0.401546 May 07 21:51:28.849413 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 915/1883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:28 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1533 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:28.858297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:28.859291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:28.874852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.877355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.878414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:28.879170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:28.956276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:28.965421 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c74978d-5c6d-46f7-94be-d390bc00fa03 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1474 microversion: 2.1 time: 0.781162 May 07 21:51:28.974832 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 969/1884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:28 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1474 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:29.005661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:29.007487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:29.020339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:29.023461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:29.024574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:29.025251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:29.315480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:29.327898 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-892dd5f4-7f48-42f2-891b-2622691640f8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1574 microversion: 2.1 time: 0.473207 May 07 21:51:29.328848 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 916/1885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:28 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1574 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:29.454658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:29.455362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:29.462737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:29.467419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:29.468463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:29.469085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:30.374539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:30.383785 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-120fa81c-bc7a-4bda-8812-92688e26f33f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 1.382941 May 07 21:51:30.387865 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 970/1886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:28 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:30.392880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:30.400388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:30.418659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:30.419254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:30.419947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:30.420395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:30.849380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:30.867286 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c68d24a5-6e3e-4f94-ba08-6590d40419cb tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1527 microversion: 2.1 time: 1.412311 May 07 21:51:30.870164 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 917/1887] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:29 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1527 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:30.887507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:30.888412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:30.905279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:30.921319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:30.922225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:30.922681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:31.130518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6fd0a2daba417b9e39213a5e4c1f4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed0bf2e98fe4e67abb30f040a638365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:31.164452 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-50b1b2ba-f7d0-4123-a5fe-cf17c56bdc5b tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 200 len: 1432 microversion: 2.1 time: 0.291319 May 07 21:51:31.168334 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 918/1888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:30 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 1432 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:31.209605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:31.210690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:31.223515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:31.224573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:31.225971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:31.226599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:31.619964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:31.642646 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a424f0ca-a3c9-48e5-92d5-04941fa4cc08 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1572 microversion: 2.1 time: 0.469772 May 07 21:51:31.643962 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 919/1889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:31 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1572 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:31.656692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:31.657923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:31.674250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:31.674781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:31.676844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:31.677310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:31.771190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:31.781121 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e69de9d1-8bbe-426f-bc4f-a82b7c391e27 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 200 len: 1533 microversion: 2.1 time: 1.391367 May 07 21:51:31.795950 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 971/1890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:30 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 1533 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:31.814822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-899487bc-3361-4cf1-a44b-446bad65218e req-772d617f-2d14-4232-9849-ce19b6adc0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe177f0-906a-4fa9-aea9-ccd116bb7d25", "name": "network-vif-plugged", "status": "completed", "tag": "67f000bc-ddb0-4641-a111-92bb8cc56ac3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:31.840922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-899487bc-3361-4cf1-a44b-446bad65218e req-772d617f-2d14-4232-9849-ce19b6adc0c0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:31.841382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-899487bc-3361-4cf1-a44b-446bad65218e req-772d617f-2d14-4232-9849-ce19b6adc0c0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:31.856844 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-899487bc-3361-4cf1-a44b-446bad65218e req-772d617f-2d14-4232-9849-ce19b6adc0c0 service nova] Creating event network-vif-plugged:67f000bc-ddb0-4641-a111-92bb8cc56ac3 for instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 on nch1-master-1 May 07 21:51:31.867958 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-899487bc-3361-4cf1-a44b-446bad65218e req-772d617f-2d14-4232-9849-ce19b6adc0c0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070233 May 07 21:51:31.869067 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 972/1891] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:31.878835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-eb2a6d33-468c-4252-9c5e-c27dd486f6d7 req-ff4abefc-a243-403d-9ee2-b4917cb3f018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8f76a4-6ad3-415b-b1a9-6bd011fd0571", "name": "network-vif-deleted", "tag": "05c8f9e9-22a2-4423-bdc3-f8822a75ace8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:31.900503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-eb2a6d33-468c-4252-9c5e-c27dd486f6d7 req-ff4abefc-a243-403d-9ee2-b4917cb3f018 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:31.901256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-eb2a6d33-468c-4252-9c5e-c27dd486f6d7 req-ff4abefc-a243-403d-9ee2-b4917cb3f018 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:31.943966 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-eb2a6d33-468c-4252-9c5e-c27dd486f6d7 req-ff4abefc-a243-403d-9ee2-b4917cb3f018 service nova] Creating event network-vif-deleted:05c8f9e9-22a2-4423-bdc3-f8822a75ace8 for instance 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 on nch2-master-1 May 07 21:51:31.961445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-eb2a6d33-468c-4252-9c5e-c27dd486f6d7 req-ff4abefc-a243-403d-9ee2-b4917cb3f018 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087012 May 07 21:51:31.964633 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 973/1892] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:31.980845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-190477318"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:31.981548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:32.001508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.003773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.005232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.005695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.364727 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.network.security_group_api [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Adding security group a28eaf93-b857-4194-b86f-fca4dd6ce653 to port bf4cdac7-29da-404a-9ec1-943fa91f5ab0 May 07 21:51:32.547029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:32.554882 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8d2718de-4a65-4e08-9ce8-d12c7cc3ceba tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.909549 May 07 21:51:32.555465 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 920/1893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:31 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:32.587824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:32.588846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:32.600925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.603807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.606598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.607375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.736408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:32.750555 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-42111f66-89e1-48f7-bd22-8c8aa9a9c2e0 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 200 len: 1308 microversion: 2.1 time: 0.182679 May 07 21:51:32.759122 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 921/1894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:32 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:32.764208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:32.766690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] [instance: 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:32.786901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.787531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.788447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.791505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.816739 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] HTTP exception thrown: Instance 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 could not be found. May 07 21:51:32.817429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] Returning 404 to user: Instance 0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:32.818622 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8061db24-f904-400e-8df3-0e118671b828 tempest-LiveMigrationNegativeTest-1810878215 tempest-LiveMigrationNegativeTest-1810878215-project] 10.222.0.32 "GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571" status: 404 len: 111 microversion: 2.1 time: 0.058090 May 07 21:51:32.820168 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 922/1895] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:32 2022] GET /compute/v2.1/servers/0f8f76a4-6ad3-415b-b1a9-6bd011fd0571 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:32.838041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3e208a92-098f-4bd6-bb7b-b06e5e2baefe req-3c427487-c882-481b-8c54-4d68b8722781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe177f0-906a-4fa9-aea9-ccd116bb7d25", "name": "network-vif-deleted", "tag": "67f000bc-ddb0-4641-a111-92bb8cc56ac3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:32.858028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e208a92-098f-4bd6-bb7b-b06e5e2baefe req-3c427487-c882-481b-8c54-4d68b8722781 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.860016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e208a92-098f-4bd6-bb7b-b06e5e2baefe req-3c427487-c882-481b-8c54-4d68b8722781 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.885187 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3e208a92-098f-4bd6-bb7b-b06e5e2baefe req-3c427487-c882-481b-8c54-4d68b8722781 service nova] Creating event network-vif-deleted:67f000bc-ddb0-4641-a111-92bb8cc56ac3 for instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 on nch1-master-1 May 07 21:51:32.917334 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3e208a92-098f-4bd6-bb7b-b06e5e2baefe req-3c427487-c882-481b-8c54-4d68b8722781 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095127 May 07 21:51:32.919910 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 923/1896] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:32.932503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:32.937072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: bf92f729-2124-482e-b270-05ad87327f96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:32.945506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.946301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.948248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:32.948965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:32.978246 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] HTTP exception thrown: Instance bf92f729-2124-482e-b270-05ad87327f96 could not be found. May 07 21:51:32.983699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Returning 404 to user: Instance bf92f729-2124-482e-b270-05ad87327f96 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:32.998326 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e17200e5-fcf5-4260-92d3-7e2753fc822e tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96" status: 404 len: 111 microversion: 2.1 time: 0.074927 May 07 21:51:33.001940 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 924/1897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:32 2022] GET /compute/v2.1/servers/bf92f729-2124-482e-b270-05ad87327f96 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:33.007554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:33.008830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:33.019024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.019723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.023651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.024850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.092059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:33.270056 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e74d9160-7e32-40c3-9cc1-51bce2d6c42f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "DELETE /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 204 len: 0 microversion: 2.1 time: 0.265984 May 07 21:51:33.271072 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 925/1898] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:33 2022] DELETE /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 21:51:33.284330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:33.287664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:33.303435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.306344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.308221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.308942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.644757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:33.662166 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-33e663fb-bfa9-479c-b2cc-c6fc14390575 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1467 microversion: 2.1 time: 0.384527 May 07 21:51:33.681499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 926/1899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:33 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1467 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:33.688737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:33.689630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:33.695924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.697003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.697797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.698245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.847421 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0e248a6-1a36-4387-bd78-6496ef6ee629 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d/action" status: 202 len: 0 microversion: 2.1 time: 1.881447 May 07 21:51:33.848060 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 974/1900] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:51:31 2022] POST /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d/action => generated 0 bytes in 1883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:33.853071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:33.853682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:33.873682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.879985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.881328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:33.882019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:33.907664 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 could not be found. May 07 21:51:33.908651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:33.909714 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa6f092f-ea74-4a8a-a85c-51ffefcb2a0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 404 len: 111 microversion: 2.1 time: 0.060521 May 07 21:51:33.910867 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 975/1901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:33 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:33.916118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7bf9cb6-be4e-40dc-a959-542e931eff8e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d73c430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:34.012968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:34.030204 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a129b3a-91d1-4af8-b13b-9c9cdeb169f9 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.347172 May 07 21:51:34.032182 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 927/1902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:33 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:34.037279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4f8dfc2c-e5d5-4570-9c3f-f12662cef925 req-13fb27c2-5708-417a-bfc5-bebf58646848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf92f729-2124-482e-b270-05ad87327f96", "name": "network-vif-deleted", "tag": "671083f6-1511-4a4e-b623-b011d1104e75"}, {"name": "network-changed", "server_uuid": "a4bd37e9-7131-4834-a215-e56f0fb30c5d", "tag": "bf4cdac7-29da-404a-9ec1-943fa91f5ab0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:34.051012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f8dfc2c-e5d5-4570-9c3f-f12662cef925 req-13fb27c2-5708-417a-bfc5-bebf58646848 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:34.052312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f8dfc2c-e5d5-4570-9c3f-f12662cef925 req-13fb27c2-5708-417a-bfc5-bebf58646848 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:34.074368 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4f8dfc2c-e5d5-4570-9c3f-f12662cef925 req-13fb27c2-5708-417a-bfc5-bebf58646848 service nova] Creating event network-vif-deleted:671083f6-1511-4a4e-b623-b011d1104e75 for instance bf92f729-2124-482e-b270-05ad87327f96 on nch1-master-1 May 07 21:51:34.075608 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4f8dfc2c-e5d5-4570-9c3f-f12662cef925 req-13fb27c2-5708-417a-bfc5-bebf58646848 service nova] Creating event network-changed:bf4cdac7-29da-404a-9ec1-943fa91f5ab0 for instance a4bd37e9-7131-4834-a215-e56f0fb30c5d on nch2-master-1 May 07 21:51:34.087267 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4f8dfc2c-e5d5-4570-9c3f-f12662cef925 req-13fb27c2-5708-417a-bfc5-bebf58646848 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.052612 May 07 21:51:34.089703 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 928/1903] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:34.099640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1156087472", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:34.174813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] validate_networks() for [('b2fcd05a-fa57-478e-9f0c-05c502306fa7', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:51:34.971882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:51:34.975042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:51:34.975760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:51:34.976651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:51:34.977227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:51:35.001236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.003469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.005309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.009370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.074965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for project 00dedc5654754e7fbb60abf79a14666e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:51:35.086524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Getting quotas for user 29d121c7d37142d6a935ae607c0e062b and project 00dedc5654754e7fbb60abf79a14666e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:51:35.118481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:51:35.123192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:51:35.232951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-e7bf9cb6-be4e-40dc-a959-542e931eff8e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a28eaf93-b857-4194-b86f-fca4dd6ce653 in use.", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:35.234752 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e7bf9cb6-be4e-40dc-a959-542e931eff8e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security Group a28eaf93-b857-4194-b86f-fca4dd6ce653 in use. May 07 21:51:35.234752 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-bb67126c-6d24-4c16-b775-12e81f145c22'] May 07 21:51:35.235423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7bf9cb6-be4e-40dc-a959-542e931eff8e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 400 to user: Security Group a28eaf93-b857-4194-b86f-fca4dd6ce653 in use. May 07 21:51:35.235423 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-bb67126c-6d24-4c16-b775-12e81f145c22'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:35.236500 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e7bf9cb6-be4e-40dc-a959-542e931eff8e tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/a28eaf93-b857-4194-b86f-fca4dd6ce653" status: 400 len: 185 microversion: 2.1 time: 1.324240 May 07 21:51:35.237068 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 976/1904] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:33 2022] DELETE /compute/v2.1/os-security-groups/a28eaf93-b857-4194-b86f-fca4dd6ce653 => generated 185 bytes in 1325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:51:35.258626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-23104c2b-3b51-4463-8067-26dc0e7e95cc req-af6e6f11-390d-448d-a785-f023d967dfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e589d355-aaf2-4345-8239-14d71c2e31ef", "name": "network-vif-plugged", "status": "completed", "tag": "7ffe92b1-dfd2-4f6a-9df8-10bcc08bfa0c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:35.294505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-23104c2b-3b51-4463-8067-26dc0e7e95cc req-af6e6f11-390d-448d-a785-f023d967dfcc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.295149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-23104c2b-3b51-4463-8067-26dc0e7e95cc req-af6e6f11-390d-448d-a785-f023d967dfcc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.327144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-23104c2b-3b51-4463-8067-26dc0e7e95cc req-af6e6f11-390d-448d-a785-f023d967dfcc service nova] Creating event network-vif-plugged:7ffe92b1-dfd2-4f6a-9df8-10bcc08bfa0c for instance e589d355-aaf2-4345-8239-14d71c2e31ef on nch2-master-1 May 07 21:51:35.352309 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-23104c2b-3b51-4463-8067-26dc0e7e95cc req-af6e6f11-390d-448d-a785-f023d967dfcc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113595 May 07 21:51:35.353017 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 977/1905] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:35.369094 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-395fb71c-b363-4317-9ccb-1811c605f5bf tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.272090 May 07 21:51:35.370647 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 929/1906] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:51:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:51:35.373165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:35.373892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:35.395298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:35.395928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:35.402486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.408073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.409825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.414570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.415285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.418427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.424330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.429141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.876989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:35.884471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6bf24f72-855c-4c31-bd35-69369828b030 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 0.507921 May 07 21:51:35.889964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 930/1907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:35 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:35.901469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:35.901989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:35.916549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.917011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.917804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:35.918251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:35.966557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:36.082712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:36.122260 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f4979c3-ea1a-4f07-946d-a1149cd554e8 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1467 microversion: 2.1 time: 0.767940 May 07 21:51:36.132339 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 978/1908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:35 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1467 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:36.145209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:36.148703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:36.160498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:36.162903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:36.164075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:36.164541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:36.175488 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2e4244c6-9976-4e62-8d90-8f435571fb07 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 204 len: 0 microversion: 2.1 time: 0.284125 May 07 21:51:36.176433 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 931/1909] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:35 2022] DELETE /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:36.186192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:36.186959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:36.219531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:36.220231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:36.221209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:36.221821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:36.380632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:36.393440 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48e5c0eb-4ac2-49fe-86ec-8843cfdc028d tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1229 microversion: 2.1 time: 0.259423 May 07 21:51:36.396352 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 979/1910] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:36 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1229 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:36.623553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:36.635356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4f8d2da-cb27-4542-a6d7-908ee4b55e09 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1646 microversion: 2.1 time: 0.450139 May 07 21:51:36.640761 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 932/1911] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:36 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1646 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:36.905971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:36.906599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:36.923250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:36.923710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:36.924512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:36.924960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:37.140662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:37.141315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:37.154940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:37.157719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:37.158734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:37.159370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:37.686485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:37.709212 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cc0dbb74-ec4f-4a05-94f1-2aeb013ff538 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1467 microversion: 2.1 time: 0.568763 May 07 21:51:37.710202 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 933/1912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:37 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1467 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:37.735353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9a2ebdcc-4a8b-492b-ac5f-cf9eecd35d54 req-d1fe966f-a48b-4c74-834a-d189d6c61205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc3f76-02bb-44cb-82ab-79a357f42391", "name": "network-vif-unplugged", "status": "completed", "tag": "44436595-8caf-48e5-967e-1749f507e89e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:37.771584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9a2ebdcc-4a8b-492b-ac5f-cf9eecd35d54 req-d1fe966f-a48b-4c74-834a-d189d6c61205 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:37.779116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9a2ebdcc-4a8b-492b-ac5f-cf9eecd35d54 req-d1fe966f-a48b-4c74-834a-d189d6c61205 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:37.814245 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9a2ebdcc-4a8b-492b-ac5f-cf9eecd35d54 req-d1fe966f-a48b-4c74-834a-d189d6c61205 service nova] Creating event network-vif-unplugged:44436595-8caf-48e5-967e-1749f507e89e for instance 02cc3f76-02bb-44cb-82ab-79a357f42391 on nch2-master-1 May 07 21:51:37.831307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9a2ebdcc-4a8b-492b-ac5f-cf9eecd35d54 req-d1fe966f-a48b-4c74-834a-d189d6c61205 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115229 May 07 21:51:37.834639 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 934/1913] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:37.849125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:37.851643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:37.872243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:37.874991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:37.879294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:37.882315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:38.200745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:38.210498 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed96527b-54cd-4414-8bee-938dfbea90d2 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1283 microversion: 2.1 time: 0.374031 May 07 21:51:38.217143 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 935/1914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:37 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1283 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:38.238531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:38.239929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:38.271496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:38.272702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:38.278139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:38.279336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:39.101391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:39.115979 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f2f8e8d0-465d-4265-8beb-6f3c680bd0ff tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1317 microversion: 2.1 time: 2.210373 May 07 21:51:39.150095 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 980/1915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:36 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1317 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:39.172656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:39.183965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:39.215682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:39.230624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:39.238596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:39.240389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:39.985399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:39.996822 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4cd40568-d991-41a5-a920-016a6ce6e3a0 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 200 len: 1297 microversion: 2.1 time: 0.845040 May 07 21:51:39.998243 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 981/1916] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:39 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 1297 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:40.005558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-b9aa1f9a-40f5-4058-8440-af1c7eb693dd req-1406d10b-3501-443c-9051-cc26ed5ca03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc3f76-02bb-44cb-82ab-79a357f42391", "name": "network-vif-deleted", "tag": "44436595-8caf-48e5-967e-1749f507e89e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:40.032420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b9aa1f9a-40f5-4058-8440-af1c7eb693dd req-1406d10b-3501-443c-9051-cc26ed5ca03b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:40.033202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b9aa1f9a-40f5-4058-8440-af1c7eb693dd req-1406d10b-3501-443c-9051-cc26ed5ca03b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:40.048150 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-b9aa1f9a-40f5-4058-8440-af1c7eb693dd req-1406d10b-3501-443c-9051-cc26ed5ca03b service nova] Creating event network-vif-deleted:44436595-8caf-48e5-967e-1749f507e89e for instance 02cc3f76-02bb-44cb-82ab-79a357f42391 on nch2-master-1 May 07 21:51:40.053886 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-b9aa1f9a-40f5-4058-8440-af1c7eb693dd req-1406d10b-3501-443c-9051-cc26ed5ca03b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052861 May 07 21:51:40.055831 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 982/1917] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:40.062038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:40.063095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:40.072299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:40.073140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:40.075992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:40.076771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:40.187149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:40.206738 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77d9191d-6f30-4555-933f-fbb038e4f098 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1646 microversion: 2.1 time: 1.984522 May 07 21:51:40.207836 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 936/1918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:38 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1646 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:40.225285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:40.227051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:40.251623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:40.254691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:40.257359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:40.259993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:40.448933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:40.477226 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1aa3b7ef-8b4b-4429-92e8-3e97d5fc418e tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1283 microversion: 2.1 time: 0.417847 May 07 21:51:40.479451 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 983/1919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:40 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1283 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:41.175553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:41.185336 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7c20dffb-a696-4f0d-b5dc-ca16f8ab8b52 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1507 microversion: 2.1 time: 0.975498 May 07 21:51:41.203223 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 937/1920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:40 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1507 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:41.215677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1dc5d041-8db4-4609-abeb-ce5dbd4b17d4 req-3b19c67d-3ff4-4d1f-a784-029ab70fd781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bd37e9-7131-4834-a215-e56f0fb30c5d", "name": "network-vif-deleted", "tag": "bf4cdac7-29da-404a-9ec1-943fa91f5ab0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:41.251033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1dc5d041-8db4-4609-abeb-ce5dbd4b17d4 req-3b19c67d-3ff4-4d1f-a784-029ab70fd781 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.251879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1dc5d041-8db4-4609-abeb-ce5dbd4b17d4 req-3b19c67d-3ff4-4d1f-a784-029ab70fd781 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.301589 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1dc5d041-8db4-4609-abeb-ce5dbd4b17d4 req-3b19c67d-3ff4-4d1f-a784-029ab70fd781 service nova] Creating event network-vif-deleted:bf4cdac7-29da-404a-9ec1-943fa91f5ab0 for instance a4bd37e9-7131-4834-a215-e56f0fb30c5d on nch2-master-1 May 07 21:51:41.320881 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1dc5d041-8db4-4609-abeb-ce5dbd4b17d4 req-3b19c67d-3ff4-4d1f-a784-029ab70fd781 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114888 May 07 21:51:41.327104 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 938/1921] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:41.343901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa741497-e6a6-48e7-813b-a08598018687 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:41.349635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa741497-e6a6-48e7-813b-a08598018687 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:41.387587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa741497-e6a6-48e7-813b-a08598018687 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.391255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa741497-e6a6-48e7-813b-a08598018687 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.392473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa741497-e6a6-48e7-813b-a08598018687 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.400118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa741497-e6a6-48e7-813b-a08598018687 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.484109 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa741497-e6a6-48e7-813b-a08598018687 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef/ips" status: 200 len: 110 microversion: 2.1 time: 0.155379 May 07 21:51:41.501401 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 939/1922] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 21:51:41 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef/ips => generated 110 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:41.521709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:41.531558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:41.558153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.562238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.563351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.564980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.646611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:41.653756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 02cc3f76-02bb-44cb-82ab-79a357f42391] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:41.666632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.669447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.686370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.687372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.744207 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] HTTP exception thrown: Instance 02cc3f76-02bb-44cb-82ab-79a357f42391 could not be found. May 07 21:51:41.745294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Returning 404 to user: Instance 02cc3f76-02bb-44cb-82ab-79a357f42391 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:41.751492 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4747aa04-0ea1-42c4-bffb-a9cb6704222f tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391" status: 404 len: 111 microversion: 2.1 time: 0.734741 May 07 21:51:41.761635 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 984/1923] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:41 2022] GET /compute/v2.1/servers/02cc3f76-02bb-44cb-82ab-79a357f42391 => generated 111 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:41.770107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.774938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.775889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:41.778656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:41.779742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lazy-loading 'fault' on Instance uuid a4bd37e9-7131-4834-a215-e56f0fb30c5d {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:51:41.798283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.802525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.803708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:41.804414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:41.975468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:41.987172 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-801f028b-7b27-46a5-9b00-95173d2d24b4 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 200 len: 1306 microversion: 2.1 time: 0.476763 May 07 21:51:41.991195 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 940/1924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:41 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 1306 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:42.024232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d3f0c31b-c33f-4f08-9d24-028c7170d4a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:42.025353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d3f0c31b-c33f-4f08-9d24-028c7170d4a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:42.050978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3f0c31b-c33f-4f08-9d24-028c7170d4a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.051642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3f0c31b-c33f-4f08-9d24-028c7170d4a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.054228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3f0c31b-c33f-4f08-9d24-028c7170d4a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.056045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3f0c31b-c33f-4f08-9d24-028c7170d4a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.156444 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d3f0c31b-c33f-4f08-9d24-028c7170d4a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef/ips" status: 200 len: 110 microversion: 2.1 time: 0.146256 May 07 21:51:42.158842 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 941/1925] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 21:51:41 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef/ips => generated 110 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:42.174349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:42.179688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:42.207575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.208850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.218599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.219355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.265597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:42.528099 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cfc97dde-7ec6-46e2-bcb9-d8cc54c58475 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "DELETE /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 204 len: 0 microversion: 2.1 time: 0.365941 May 07 21:51:42.532762 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 942/1926] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:42 2022] DELETE /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:42.546508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d116401-2f7a-44bb-9032-51f1274a62cd tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:42.550697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d116401-2f7a-44bb-9032-51f1274a62cd tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:42.563026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d116401-2f7a-44bb-9032-51f1274a62cd tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.566934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d116401-2f7a-44bb-9032-51f1274a62cd tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.568438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d116401-2f7a-44bb-9032-51f1274a62cd tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.573109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d116401-2f7a-44bb-9032-51f1274a62cd tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.638350 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d116401-2f7a-44bb-9032-51f1274a62cd tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef/ips/tempest-ServerAddressesTestJSON-1023977453-network" status: 200 len: 95 microversion: 2.1 time: 0.101925 May 07 21:51:42.641826 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 943/1927] 10.222.0.32 () {58 vars in 1400 bytes} [Sat May 7 21:51:42 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef/ips/tempest-ServerAddressesTestJSON-1023977453-network => generated 95 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:51:42.664156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:42.664988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:42.691395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.691395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.691395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.691813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.801402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:42.815450 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-49386ed6-5ddc-4880-87df-2618c19e8587 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1325 microversion: 2.1 time: 1.045222 May 07 21:51:42.824103 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 985/1928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:41 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1325 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:42.847535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:42.850021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:42.872363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.873512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.875533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:42.876927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:42.928875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:42.941720 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a3c63a41-8cfe-48e9-8e86-bd9b1e018290 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1468 microversion: 2.1 time: 0.283097 May 07 21:51:42.945232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:42.951007 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 944/1929] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:42 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:43.009008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:43.009661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:43.023474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:43.025265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:43.026094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:43.026548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:43.076018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Instance a4bd37e9-7131-4834-a215-e56f0fb30c5d could not be found. May 07 21:51:43.077327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Instance a4bd37e9-7131-4834-a215-e56f0fb30c5d could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:43.078567 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2355402-d445-4351-a29c-262acc6b0cd6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 404 len: 111 microversion: 2.1 time: 0.074127 May 07 21:51:43.090979 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 945/1930] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:43 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:51:43.108187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3aa4f814-575b-47ab-9bb5-79625832886b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d53e040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:43.190487 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-68ad48fb-65e3-4bfa-8b7b-efd0642436a5 tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 204 len: 0 microversion: 2.1 time: 0.362265 May 07 21:51:43.191270 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 986/1931] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:42 2022] DELETE /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:43.202820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:43.203563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:43.223028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:43.223504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:43.224310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:43.224762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:43.969557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:43.977937 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb1c99df-c655-4f5a-a243-e0db0da26ebf tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1513 microversion: 2.1 time: 0.780599 May 07 21:51:43.979701 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3aa4f814-575b-47ab-9bb5-79625832886b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/3ab4642d-3355-41eb-ae9c-57c018ee1be1" status: 202 len: 0 microversion: 2.1 time: 0.887654 May 07 21:51:43.985881 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 946/1932] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:43 2022] DELETE /compute/v2.1/os-security-groups/3ab4642d-3355-41eb-ae9c-57c018ee1be1 => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:43.991650 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 987/1933] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:43 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1513 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:43.996389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:43.996560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:43.997120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:43.997682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:44.009189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:44.012266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:44.014584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:44.015366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:44.016791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:44.017272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:44.018070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:44.018522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:44.631332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:44.642255 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f259a2e2-f74f-4950-a95a-6830fed6e0b3 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1468 microversion: 2.1 time: 0.649189 May 07 21:51:44.657036 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 988/1934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:43 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1468 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:44.661759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:44.661954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e5bfeb47-191e-41f5-a5cc-4a6c435a817f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d479310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:44.673096 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-925dc796-f317-4bdc-8a7b-52728f155052 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1325 microversion: 2.1 time: 0.685767 May 07 21:51:44.682981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 947/1935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:43 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1325 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:44.688146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f88ac4ac-9335-412f-ac29-5b618bf82432 req-f0d4717a-015f-4836-85cf-9c3450f350d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b84a520-aa94-49be-b958-27f17df1b675", "tag": "06113eb7-cbb3-425a-b957-4e016a713395"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:44.737491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f88ac4ac-9335-412f-ac29-5b618bf82432 req-f0d4717a-015f-4836-85cf-9c3450f350d4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:44.746380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f88ac4ac-9335-412f-ac29-5b618bf82432 req-f0d4717a-015f-4836-85cf-9c3450f350d4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:44.775055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f88ac4ac-9335-412f-ac29-5b618bf82432 req-f0d4717a-015f-4836-85cf-9c3450f350d4 service nova] Creating event network-changed:06113eb7-cbb3-425a-b957-4e016a713395 for instance 1b84a520-aa94-49be-b958-27f17df1b675 on nch1-master-1 May 07 21:51:44.786363 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f88ac4ac-9335-412f-ac29-5b618bf82432 req-f0d4717a-015f-4836-85cf-9c3450f350d4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101709 May 07 21:51:44.788744 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 948/1936] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:45.010079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:45.014501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:45.040662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:45.044030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:45.045163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:45.045841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:45.583460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0cb82fc11df4dddb6401647d91d09df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0a7786f72343d6a66da6b4e40aee4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:45.592818 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b4d84fd-5cf7-4c2e-8e91-3c0e4ffeb61f tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 200 len: 1513 microversion: 2.1 time: 0.587516 May 07 21:51:45.601827 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 949/1937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:45 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 1513 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:45.615034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-631927482", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "7d94fb0d-311e-4c61-bc8a-1dac128f0023"}, {"uuid": "bce7d277-aca4-4e22-b67e-6c466c492a5e"}, {"uuid": "7d94fb0d-311e-4c61-bc8a-1dac128f0023"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:45.752327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] validate_networks() for [('7d94fb0d-311e-4c61-bc8a-1dac128f0023', None, None, None, None, None), ('bce7d277-aca4-4e22-b67e-6c466c492a5e', None, None, None, None, None), ('7d94fb0d-311e-4c61-bc8a-1dac128f0023', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:51:46.688100 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e5bfeb47-191e-41f5-a5cc-4a6c435a817f tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/a28eaf93-b857-4194-b86f-fca4dd6ce653" status: 202 len: 0 microversion: 2.1 time: 2.029806 May 07 21:51:46.688977 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 989/1938] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:44 2022] DELETE /compute/v2.1/os-security-groups/a28eaf93-b857-4194-b86f-fca4dd6ce653 => generated 0 bytes in 2031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:51:46.694608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:46.695523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:46.720118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:46.728970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:46.729870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:46.732765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:47.596093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb85bfb49aa4a519099c6f43ac77099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7789855db11445de842c4df75bd05e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:47.614388 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eafa5a66-53a4-49ad-a957-27fac8aa5fd5 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 200 len: 1468 microversion: 2.1 time: 0.923524 May 07 21:51:47.628398 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 990/1939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:46 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 1468 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:47.645907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:47.646552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:47.669354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:47.669823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:47.679509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:47.681749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:48.250321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:48.270013 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4cfc0f00-72e3-434c-8bfe-c6c9cb3c9f52 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1325 microversion: 2.1 time: 0.639802 May 07 21:51:48.272747 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 991/1940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:47 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:48.279969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:48.280834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] [instance: e589d355-aaf2-4345-8239-14d71c2e31ef] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:48.299571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:48.300246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:48.302352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:48.303054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:48.340692 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] HTTP exception thrown: Instance e589d355-aaf2-4345-8239-14d71c2e31ef could not be found. May 07 21:51:48.341621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] Returning 404 to user: Instance e589d355-aaf2-4345-8239-14d71c2e31ef could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:48.343015 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6c2c124a-a608-4c19-ac7d-97ee9c0afc8d tempest-ServerAddressesTestJSON-364676349 tempest-ServerAddressesTestJSON-364676349-project] 10.222.0.32 "GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef" status: 404 len: 111 microversion: 2.1 time: 0.068928 May 07 21:51:48.347617 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 992/1941] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:48 2022] GET /compute/v2.1/servers/e589d355-aaf2-4345-8239-14d71c2e31ef => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:48.356450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5ad6d5e-d203-46cc-913c-8fe426ef1add tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'create', calling method: .version_select at 0x7fc41cf01940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1529015829", "description": "tempest-description-1900025001"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:49.681733 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5ad6d5e-d203-46cc-913c-8fe426ef1add tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.332744 May 07 21:51:49.683500 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 993/1942] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:51:48 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:49.688380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-b6acb1cd-ed6b-4add-93f7-44233faef348 req-1d33ac2b-0a2c-4520-8f3a-ab5c7b62c721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e589d355-aaf2-4345-8239-14d71c2e31ef", "name": "network-vif-deleted", "tag": "7ffe92b1-dfd2-4f6a-9df8-10bcc08bfa0c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:49.715240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b6acb1cd-ed6b-4add-93f7-44233faef348 req-1d33ac2b-0a2c-4520-8f3a-ab5c7b62c721 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:49.718921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b6acb1cd-ed6b-4add-93f7-44233faef348 req-1d33ac2b-0a2c-4520-8f3a-ab5c7b62c721 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:49.741290 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-b6acb1cd-ed6b-4add-93f7-44233faef348 req-1d33ac2b-0a2c-4520-8f3a-ab5c7b62c721 service nova] Creating event network-vif-deleted:7ffe92b1-dfd2-4f6a-9df8-10bcc08bfa0c for instance e589d355-aaf2-4345-8239-14d71c2e31ef on nch2-master-1 May 07 21:51:49.758993 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-b6acb1cd-ed6b-4add-93f7-44233faef348 req-1d33ac2b-0a2c-4520-8f3a-ab5c7b62c721 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073692 May 07 21:51:49.762407 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 994/1943] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:49.776489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6cd72667-5567-43a2-87b7-99340b7b53e6 req-d2e0605b-6b8d-4dae-aad6-aab25675544e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12135950-7d5e-4835-8fe5-31c8e5e9c986", "name": "network-vif-deleted", "tag": "f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:49.822366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6cd72667-5567-43a2-87b7-99340b7b53e6 req-d2e0605b-6b8d-4dae-aad6-aab25675544e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:49.822995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6cd72667-5567-43a2-87b7-99340b7b53e6 req-d2e0605b-6b8d-4dae-aad6-aab25675544e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:49.867166 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6cd72667-5567-43a2-87b7-99340b7b53e6 req-d2e0605b-6b8d-4dae-aad6-aab25675544e service nova] Creating event network-vif-deleted:f17036f5-0ae3-4fe6-b2ed-c293b02ae9b9 for instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 on nch2-master-1 May 07 21:51:49.878653 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6cd72667-5567-43a2-87b7-99340b7b53e6 req-d2e0605b-6b8d-4dae-aad6-aab25675544e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111956 May 07 21:51:49.880790 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 995/1944] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:49.905070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:49.906098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] [instance: 12135950-7d5e-4835-8fe5-31c8e5e9c986] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:49.920141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:49.924561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:49.929679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:49.953734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:49.970658 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] HTTP exception thrown: Instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 could not be found. May 07 21:51:49.971543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] Returning 404 to user: Instance 12135950-7d5e-4835-8fe5-31c8e5e9c986 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:49.972574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bf9b29d0-7edc-4d8b-a9f4-1b0cbc46bc72 tempest-MigrationsAdminTest-1019677136 tempest-MigrationsAdminTest-1019677136-project] 10.222.0.32 "GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986" status: 404 len: 111 microversion: 2.1 time: 0.092184 May 07 21:51:49.978544 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 996/1945] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:49 2022] GET /compute/v2.1/servers/12135950-7d5e-4835-8fe5-31c8e5e9c986 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:49.984760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:49.985634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:49.996473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:49.997439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:49.998161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:50.000258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:50.535799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:50.565429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-98c519ed-ad42-4b78-94ef-7b6d371c0706 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1325 microversion: 2.1 time: 0.584697 May 07 21:51:50.573557 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 997/1946] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:49 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1325 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:50.590248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6b0b995-07a6-40d0-8a63-093d064b1ff6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Action: 'update', calling method: .version_select at 0x7fc41d088af0>, body: {"security_group": {"name": "tempest-sg-hth-1888150566", "description": "tempest-description-hth-1017548837"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:51.125237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:51:51.126542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:51:51.127228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:51:51.128018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:51:51.128627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:51:51.152770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:51.158449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:51.160082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:51.160082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:51.197170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Getting quotas for project 7a05b8a866c04fe78b04ec616e62b70f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:51:51.207189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Getting quotas for user 396f4d7fe37343dcb4aeeb0839383f6f and project 7a05b8a866c04fe78b04ec616e62b70f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:51:51.254237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:51:51.257800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:51:51.357275 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-094de91d-30ca-46bd-9b68-5af9f792c019 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.750149 May 07 21:51:51.358604 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 950/1947] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 5755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:51:51.376734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c02ab6fe-23ae-4a9e-812b-e75912faf3d2 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:51.380288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c02ab6fe-23ae-4a9e-812b-e75912faf3d2 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:51.481483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c02ab6fe-23ae-4a9e-812b-e75912faf3d2 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:51.492261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c02ab6fe-23ae-4a9e-812b-e75912faf3d2 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1212 microversion: 2.1 time: 0.127383 May 07 21:51:51.506385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 951/1948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:51 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:51.589072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:51.589767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:51.598559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:51.599700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:51.600605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:51.601159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:51.651742 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6b0b995-07a6-40d0-8a63-093d064b1ff6 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "PUT /compute/v2.1/os-security-groups/78cd5585-89bb-4392-b10b-cbda84ff5f6b" status: 200 len: 218 microversion: 2.1 time: 1.076742 May 07 21:51:51.659224 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 998/1949] 10.222.0.32 () {60 vars in 1289 bytes} [Sat May 7 21:51:50 2022] PUT /compute/v2.1/os-security-groups/78cd5585-89bb-4392-b10b-cbda84ff5f6b => generated 218 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:51.668388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b43ce028-f83c-4e47-b6a3-e17ec9f4ec04 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d03d8b0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:52.105338 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b43ce028-f83c-4e47-b6a3-e17ec9f4ec04 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/78cd5585-89bb-4392-b10b-cbda84ff5f6b" status: 200 len: 218 microversion: 2.1 time: 0.444942 May 07 21:51:52.108978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 999/1950] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:51:51 2022] GET /compute/v2.1/os-security-groups/78cd5585-89bb-4392-b10b-cbda84ff5f6b => generated 218 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:52.122024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39f7d096-1cc3-4718-a541-d1878f7d4819 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d478280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:52.217924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:52.236816 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-889973ef-3dbb-41b3-9b7a-11d034cef117 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1325 microversion: 2.1 time: 0.651935 May 07 21:51:52.246655 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 952/1951] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:51 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1325 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:52.704436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1108880500", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "a926715c-ecd2-4028-93be-018695e8216f"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:52.879552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] validate_networks() for [('a926715c-ecd2-4028-93be-018695e8216f', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:51:53.233223 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-39f7d096-1cc3-4718-a541-d1878f7d4819 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/78cd5585-89bb-4392-b10b-cbda84ff5f6b" status: 202 len: 0 microversion: 2.1 time: 1.115864 May 07 21:51:53.241771 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1000/1952] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:52 2022] DELETE /compute/v2.1/os-security-groups/78cd5585-89bb-4392-b10b-cbda84ff5f6b => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:51:53.247571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:53.248470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:53.279018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:53.279817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:53.281028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:53.284042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:53.558679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:53.567221 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8b117b97-2e04-4558-9fca-972d5f29e5ec tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1272 microversion: 2.1 time: 0.323421 May 07 21:51:53.575275 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1001/1953] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:53 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1272 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:53.589497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3dc73507-107c-4da4-81f9-8bd8e757f186 req-33c32332-3938-4f25-9948-6e5e359379e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b84a520-aa94-49be-b958-27f17df1b675", "name": "network-vif-plugged", "status": "completed", "tag": "06113eb7-cbb3-425a-b957-4e016a713395"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:53.621052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3dc73507-107c-4da4-81f9-8bd8e757f186 req-33c32332-3938-4f25-9948-6e5e359379e6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:53.625144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3dc73507-107c-4da4-81f9-8bd8e757f186 req-33c32332-3938-4f25-9948-6e5e359379e6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:53.660441 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3dc73507-107c-4da4-81f9-8bd8e757f186 req-33c32332-3938-4f25-9948-6e5e359379e6 service nova] Creating event network-vif-plugged:06113eb7-cbb3-425a-b957-4e016a713395 for instance 1b84a520-aa94-49be-b958-27f17df1b675 on nch1-master-1 May 07 21:51:53.666513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3dc73507-107c-4da4-81f9-8bd8e757f186 req-33c32332-3938-4f25-9948-6e5e359379e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088775 May 07 21:51:53.667717 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1002/1954] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:51:53.673049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:53.692045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:53.707563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:53.709723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:53.713107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:53.713739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:53.744811 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Instance a4bd37e9-7131-4834-a215-e56f0fb30c5d could not be found. May 07 21:51:53.749018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Instance a4bd37e9-7131-4834-a215-e56f0fb30c5d could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:53.750081 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5c905144-0df8-4c85-8288-46ddfbab0d24 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 404 len: 111 microversion: 2.1 time: 0.081096 May 07 21:51:53.752607 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1003/1955] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:53 2022] DELETE /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:53.764718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:53.766380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:53.789002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:53.790020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:53.790839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:53.792454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:54.368232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:51:54.368727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:51:54.369119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:51:54.370171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:51:54.370807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:51:54.389846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:54.390520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:54.398182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:54.399586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:54.439104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Getting quotas for project 85f29512cce1477d94e91ae394ecbbcb. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:51:54.449192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Getting quotas for user 809d6c48e931489cba4e521b9a42e097 and project 85f29512cce1477d94e91ae394ecbbcb. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:51:54.482589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:51:54.485162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:51:54.584142 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7eca8b22-152d-4f35-8aa8-b07bf0761457 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336035 May 07 21:51:54.589596 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 953/1956] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:51:54.594698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:54.595343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: a4bd37e9-7131-4834-a215-e56f0fb30c5d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:54.611835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:54.615451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:54.618270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:54.618961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:54.645968 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Instance a4bd37e9-7131-4834-a215-e56f0fb30c5d could not be found. May 07 21:51:54.650507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Instance a4bd37e9-7131-4834-a215-e56f0fb30c5d could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:54.660103 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef39a829-cbde-4afd-b16a-6b4ca769afec tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d" status: 404 len: 111 microversion: 2.1 time: 0.069378 May 07 21:51:54.664067 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 954/1957] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:54 2022] GET /compute/v2.1/servers/a4bd37e9-7131-4834-a215-e56f0fb30c5d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:54.669318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:54.670154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:54.688041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:54.688755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:54.690327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:54.691034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:54.786736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:54.800251 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53a08ad1-251e-443d-b0ef-63773a25a8a1 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1325 microversion: 2.1 time: 1.044843 May 07 21:51:54.813019 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1004/1958] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:53 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1325 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:54.819099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9cf402fa-fe86-4ffa-95cb-575049aeb496 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:54.820106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9cf402fa-fe86-4ffa-95cb-575049aeb496 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:54.871283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:54.888087 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c36749f-1bcf-4d51-84cb-3a561a5e5c3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1270 microversion: 2.1 time: 0.221863 May 07 21:51:54.888682 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 955/1959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:54 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:54.897948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b32d3d2d-f7c3-41f1-a905-815926623647 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cab0c10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:54.932274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9cf402fa-fe86-4ffa-95cb-575049aeb496 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:54.939703 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9cf402fa-fe86-4ffa-95cb-575049aeb496 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1218 microversion: 2.1 time: 0.125472 May 07 21:51:54.940299 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1005/1960] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:54 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:54.961644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-b32d3d2d-f7c3-41f1-a905-815926623647 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a28eaf93-b857-4194-b86f-fca4dd6ce653 does not exist", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:54.962467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.security_group_api [None req-b32d3d2d-f7c3-41f1-a905-815926623647 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group a28eaf93-b857-4194-b86f-fca4dd6ce653 not found {{(pid=136682) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:51:54.963244 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b32d3d2d-f7c3-41f1-a905-815926623647 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group a28eaf93-b857-4194-b86f-fca4dd6ce653 does not exist May 07 21:51:54.963244 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-e99c50ba-c926-4657-9931-0a943e6305b4'] May 07 21:51:54.964150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b32d3d2d-f7c3-41f1-a905-815926623647 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group a28eaf93-b857-4194-b86f-fca4dd6ce653 does not exist May 07 21:51:54.964150 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-e99c50ba-c926-4657-9931-0a943e6305b4'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:54.965285 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b32d3d2d-f7c3-41f1-a905-815926623647 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/a28eaf93-b857-4194-b86f-fca4dd6ce653" status: 404 len: 194 microversion: 2.1 time: 0.072967 May 07 21:51:54.966046 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 956/1961] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:54 2022] DELETE /compute/v2.1/os-security-groups/a28eaf93-b857-4194-b86f-fca4dd6ce653 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:54.974722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f5f750a3-41db-436f-8a32-0ff7bea07a63 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d03d8b0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.014427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-f5f750a3-41db-436f-8a32-0ff7bea07a63 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:55.015682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-f5f750a3-41db-436f-8a32-0ff7bea07a63 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:51:55.015682 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-f5f750a3-41db-436f-8a32-0ff7bea07a63 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 does not exist May 07 21:51:55.015682 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-26c92466-6807-4e55-9121-898d8d5c2c25'] May 07 21:51:55.016166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f5f750a3-41db-436f-8a32-0ff7bea07a63 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group 3ab4642d-3355-41eb-ae9c-57c018ee1be1 does not exist May 07 21:51:55.016166 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-26c92466-6807-4e55-9121-898d8d5c2c25'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:55.017004 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f5f750a3-41db-436f-8a32-0ff7bea07a63 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/3ab4642d-3355-41eb-ae9c-57c018ee1be1" status: 404 len: 194 microversion: 2.1 time: 0.046845 May 07 21:51:55.017563 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1006/1962] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:54 2022] DELETE /compute/v2.1/os-security-groups/3ab4642d-3355-41eb-ae9c-57c018ee1be1 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:55.026799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9835360-6cf1-43c9-b79a-b2938bf3d440 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc422623e50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.071193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-d9835360-6cf1-43c9-b79a-b2938bf3d440 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 does not exist", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:55.071792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.security_group_api [None req-d9835360-6cf1-43c9-b79a-b2938bf3d440 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 not found {{(pid=136682) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:51:55.072507 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d9835360-6cf1-43c9-b79a-b2938bf3d440 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 does not exist May 07 21:51:55.072507 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-2e163063-4d49-4d12-94ad-5904c586b058'] May 07 21:51:55.075691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9835360-6cf1-43c9-b79a-b2938bf3d440 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group 3d7ed19c-884e-429f-a70b-6e56a4844de9 does not exist May 07 21:51:55.075691 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-2e163063-4d49-4d12-94ad-5904c586b058'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:55.077063 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9835360-6cf1-43c9-b79a-b2938bf3d440 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/3d7ed19c-884e-429f-a70b-6e56a4844de9" status: 404 len: 194 microversion: 2.1 time: 0.055032 May 07 21:51:55.079058 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 957/1963] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:55 2022] DELETE /compute/v2.1/os-security-groups/3d7ed19c-884e-429f-a70b-6e56a4844de9 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:55.087343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-213dcf65-8d6f-46a5-9902-77429e602fba tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d03d0d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.122012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-213dcf65-8d6f-46a5-9902-77429e602fba tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:55.123060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-213dcf65-8d6f-46a5-9902-77429e602fba tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:51:55.123767 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-213dcf65-8d6f-46a5-9902-77429e602fba tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b does not exist May 07 21:51:55.123767 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-3f321a46-3e2c-4e4a-bc3b-84becf08aaa1'] May 07 21:51:55.124627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-213dcf65-8d6f-46a5-9902-77429e602fba tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group 22f8b829-fe56-4e5e-bfc9-213bd3ef066b does not exist May 07 21:51:55.124627 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-3f321a46-3e2c-4e4a-bc3b-84becf08aaa1'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:55.125872 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-213dcf65-8d6f-46a5-9902-77429e602fba tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/22f8b829-fe56-4e5e-bfc9-213bd3ef066b" status: 404 len: 194 microversion: 2.1 time: 0.043183 May 07 21:51:55.126590 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1007/1964] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:55 2022] DELETE /compute/v2.1/os-security-groups/22f8b829-fe56-4e5e-bfc9-213bd3ef066b => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:55.135645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94e1670f-82c1-400b-8bc9-bd70844ec1c0 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41ceceb80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.228910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-94e1670f-82c1-400b-8bc9-bd70844ec1c0 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f does not exist", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:55.229511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.security_group_api [None req-94e1670f-82c1-400b-8bc9-bd70844ec1c0 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f not found {{(pid=136682) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:51:55.230047 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-94e1670f-82c1-400b-8bc9-bd70844ec1c0 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f does not exist May 07 21:51:55.230047 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-241b7b46-943f-4030-9533-1c524d4b2114'] May 07 21:51:55.230848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94e1670f-82c1-400b-8bc9-bd70844ec1c0 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f does not exist May 07 21:51:55.230848 ncdv-master-1 devstack@n-api.service[136682]: Neutron server returns request_ids: ['req-241b7b46-943f-4030-9533-1c524d4b2114'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:55.232231 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94e1670f-82c1-400b-8bc9-bd70844ec1c0 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f" status: 404 len: 194 microversion: 2.1 time: 0.101243 May 07 21:51:55.232822 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 958/1965] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:55 2022] DELETE /compute/v2.1/os-security-groups/d0352f2c-c2c0-491c-a5fb-c9a6a8ee657f => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:51:55.241496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13e25622-9250-430d-aab8-beaa6ebd9523 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41d479700>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.283295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-13e25622-9250-430d-aab8-beaa6ebd9523 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:51:55.284338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-13e25622-9250-430d-aab8-beaa6ebd9523 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Neutron security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:51:55.285090 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-13e25622-9250-430d-aab8-beaa6ebd9523 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd does not exist May 07 21:51:55.285090 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-0726f4f8-7134-4f37-a740-378df36374bd'] May 07 21:51:55.285973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13e25622-9250-430d-aab8-beaa6ebd9523 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Security group 5e51b624-9e15-4237-ba0e-f2ecf89247bd does not exist May 07 21:51:55.285973 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-0726f4f8-7134-4f37-a740-378df36374bd'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:51:55.287166 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13e25622-9250-430d-aab8-beaa6ebd9523 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd" status: 404 len: 194 microversion: 2.1 time: 0.050099 May 07 21:51:55.287932 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1008/1966] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:51:55 2022] DELETE /compute/v2.1/os-security-groups/5e51b624-9e15-4237-ba0e-f2ecf89247bd => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:51:55.297326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.297990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:55.322816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:55.330530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:55.333522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:55.339598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:55.492947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:55.750425 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d113cbbc-eb77-4e92-b2a8-7bff065127d8 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 204 len: 0 microversion: 2.1 time: 0.457254 May 07 21:51:55.751403 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 959/1967] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:55 2022] DELETE /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:55.762491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.763344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:55.775772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:55.776469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:55.777439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:55.779486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:55.821766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:55.821766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:55.834671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:55.835501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:55.837074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:55.837714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.223990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:56.236149 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-634e3afa-f5d6-491b-9571-befa85f2a443 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1643 microversion: 2.1 time: 0.480043 May 07 21:51:56.248815 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1009/1968] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:55 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1643 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:56.262630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:56.267673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:56.285309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.289105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:56.289508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.290609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.291480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.297881 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ed6b09d-574f-4274-ba8f-0b66fdc96989 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1522 microversion: 2.1 time: 0.483325 May 07 21:51:56.305810 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 960/1969] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:55 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:56.317529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:56.322000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:56.340766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.346269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.347293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.349077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.541409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:56.575468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ec55206-7bcf-4c34-90ce-15b7bc3acd32 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1278 microversion: 2.1 time: 0.267920 May 07 21:51:56.576366 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 961/1970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:56 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:56.584905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:56.590735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:56.601158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.605987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.607866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.612537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.662707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:51:56.728669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:56.761919 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-75d3dffb-e7bc-4f36-afee-719fd145e94c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1312 microversion: 2.1 time: 0.500952 May 07 21:51:56.764149 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1010/1971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:56 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1312 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:56.874013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-81caf749-291c-4069-b796-9b50142ba090 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 204 len: 0 microversion: 2.1 time: 0.293140 May 07 21:51:56.879232 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 962/1972] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:51:56 2022] DELETE /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:51:56.884283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:56.885647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:56.903213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.914223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:56.916584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:56.917081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:57.256696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:57.259029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:57.272476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:57.273553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:57.276132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:57.277413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:57.333898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:57.345441 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71d56303-7e7d-4723-8e1f-e082bb5457f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1528 microversion: 2.1 time: 0.463558 May 07 21:51:57.347859 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1011/1973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:56 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1528 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:57.689065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:57.702173 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd2f0cd5-0049-49b2-98a7-49a710c50c2d tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1643 microversion: 2.1 time: 0.452334 May 07 21:51:57.711911 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 963/1974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:57 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1643 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:57.717419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5fb04dd2-e6ba-4bc8-993d-5abc851df6e0 tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] Calling method '.version_select at 0x7fc41d479d30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:57.718184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:57.718539 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:51:57.718539 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:51:57.719447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:57.733024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:57.733688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:57.734649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:57.736578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:57.754039 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5fb04dd2-e6ba-4bc8-993d-5abc851df6e0 tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.218271 May 07 21:51:57.761597 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1012/1975] 10.222.0.32 () {60 vars in 1225 bytes} [Sat May 7 21:51:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:57.783584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-afeb1425-f0c6-4333-95d9-5a0854cc8970 tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d088670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:57.786065 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:51:57.786065 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:51:57.858204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:57.873087 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d5383e2e-626b-4326-8070-df5ff8810370 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1276 microversion: 2.1 time: 0.159723 May 07 21:51:57.876270 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 964/1976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:57 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:57.891711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:57.894058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:57.912105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:57.912815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:57.914133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:57.914807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:57.988881 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-afeb1425-f0c6-4333-95d9-5a0854cc8970 tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.220300 May 07 21:51:57.996241 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1013/1977] 10.222.0.32 () {62 vars in 1246 bytes} [Sat May 7 21:51:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:58.002314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f77d7234-46f2-45df-beda-c3fcc24f8d9c tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] Calling method '.version_select at 0x7fc41d0885e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:58.016790 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f77d7234-46f2-45df-beda-c3fcc24f8d9c tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.018469 May 07 21:51:58.032343 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1014/1978] 10.222.0.32 () {60 vars in 1225 bytes} [Sat May 7 21:51:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:58.038062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5afbb8af-e17b-43cf-84f1-8018cc2c3000 tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] Action: 'update', calling method: .version_select at 0x7fc41d088ee0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:58.177768 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5afbb8af-e17b-43cf-84f1-8018cc2c3000 tempest-QuotaClassesAdmin257Test-293604500 tempest-QuotaClassesAdmin257Test-293604500-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.139906 May 07 21:51:58.179069 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1015/1979] 10.222.0.32 () {62 vars in 1246 bytes} [Sat May 7 21:51:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:51:58.363793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:58.364398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:58.373425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:58.380173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:58.381287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:58.383134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:58.628395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:58.636636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e7feaf9-0d45-4931-b3c0-1d75628a71f5 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1312 microversion: 2.1 time: 0.758285 May 07 21:51:58.639044 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 965/1980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:57 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1312 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:58.727383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:58.728035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:58.739513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:58.740237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:58.741274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:58.741950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:58.841214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29d121c7d37142d6a935ae607c0e062b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dedc5654754e7fbb60abf79a14666e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:58.849316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-35505057-144f-4bf9-8af3-e23d96539109 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 200 len: 1528 microversion: 2.1 time: 0.489794 May 07 21:51:58.850116 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1016/1981] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:58 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 1528 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:51:58.896743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:51:58.897370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:51:58.905011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:58.905683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:58.906652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:51:58.907284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:51:59.386673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:51:59.403245 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4bcdfc9b-c5d4-40ab-9309-118f0828a06f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1318 microversion: 2.1 time: 0.510270 May 07 21:51:59.403846 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1017/1982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:58 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:51:59.833278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-971925266", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "bbfe0822-d3c9-4ae0-93fe-d0c511147e67"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:51:59.959710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] validate_networks() for [('bbfe0822-d3c9-4ae0-93fe-d0c511147e67', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:52:00.060126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:00.069110 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3808637b-5192-42d9-928a-fd6c454eb127 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1643 microversion: 2.1 time: 1.345564 May 07 21:52:00.073643 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 966/1983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:51:58 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1643 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:00.090822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:00.091719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:00.098190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.098650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.099473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.099925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.657958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:00.673572 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2708dc2d-4591-4230-9708-1f1cfb474329 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1333 microversion: 2.1 time: 0.598089 May 07 21:52:00.685186 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 967/1984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:00 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1333 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:00.698114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-71c22c8d-22f7-40cd-ad73-d747a5faa13b req-517fbb53-e415-4220-a5d1-d85219202737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b84a520-aa94-49be-b958-27f17df1b675", "name": "network-vif-deleted", "tag": "06113eb7-cbb3-425a-b957-4e016a713395"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:00.723749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-71c22c8d-22f7-40cd-ad73-d747a5faa13b req-517fbb53-e415-4220-a5d1-d85219202737 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.725694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-71c22c8d-22f7-40cd-ad73-d747a5faa13b req-517fbb53-e415-4220-a5d1-d85219202737 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.762756 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-71c22c8d-22f7-40cd-ad73-d747a5faa13b req-517fbb53-e415-4220-a5d1-d85219202737 service nova] Creating event network-vif-deleted:06113eb7-cbb3-425a-b957-4e016a713395 for instance 1b84a520-aa94-49be-b958-27f17df1b675 on nch1-master-1 May 07 21:52:00.772559 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-71c22c8d-22f7-40cd-ad73-d747a5faa13b req-517fbb53-e415-4220-a5d1-d85219202737 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085690 May 07 21:52:00.775163 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 968/1985] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:00.782351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:00.783784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:00.784548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:00.785206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:00.785966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:00.789166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:00.791477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 1b84a520-aa94-49be-b958-27f17df1b675] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:00.799335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.802044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.803440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.804103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.805212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.809518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.810149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.810463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.833848 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Instance 1b84a520-aa94-49be-b958-27f17df1b675 could not be found. May 07 21:52:00.834852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Instance 1b84a520-aa94-49be-b958-27f17df1b675 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:00.835866 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f628bd87-6ccd-4d7b-8214-3ae3c3be86fa tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675" status: 404 len: 111 microversion: 2.1 time: 0.059180 May 07 21:52:00.837430 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 969/1986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:00 2022] GET /compute/v2.1/servers/1b84a520-aa94-49be-b958-27f17df1b675 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:00.842699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:00.843671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:00.848682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Getting quotas for project aa1cd49355d840abbda4ccda9d86705f. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:00.851917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.853094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.854077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:00.854700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:00.865823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Getting quotas for user eedcf10ae62840029976cb842190a948 and project aa1cd49355d840abbda4ccda9d86705f. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:00.902983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:52:00.908861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:01.003857 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fa50bbe0-8e87-41d9-ad53-73f86e839ca4 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.427813 May 07 21:52:01.011552 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1018/1987] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:52:01.385501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2056657630", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "2b0d1583-486b-43fb-abb3-b530c0697dca"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:01.461703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:01.487094 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-05dfa555-f337-465f-8279-913df46ee4ec tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1318 microversion: 2.1 time: 0.644232 May 07 21:52:01.502196 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 970/1988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:00 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1318 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:01.502196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88871d2c-fb91-45f1-912a-495b82ee21f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '.version_select at 0x7fc42261fc10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:01.563582 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-88871d2c-fb91-45f1-912a-495b82ee21f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Image not found. May 07 21:52:01.564194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88871d2c-fb91-45f1-912a-495b82ee21f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:01.565248 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88871d2c-fb91-45f1-912a-495b82ee21f6 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/images/65b22d9f-bd49-4dcd-990e-ae275d305657" status: 404 len: 62 microversion: 2.1 time: 0.069969 May 07 21:52:01.569885 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 971/1989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:01 2022] DELETE /compute/v2.1/images/65b22d9f-bd49-4dcd-990e-ae275d305657 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:52:01.598843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-401ecc54-06e7-4e2f-8801-44e97638bc63 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:01.599913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-401ecc54-06e7-4e2f-8801-44e97638bc63 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:01.601804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] validate_networks() for [('2b0d1583-486b-43fb-abb3-b530c0697dca', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:52:01.755415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-401ecc54-06e7-4e2f-8801-44e97638bc63 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:01.763915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-401ecc54-06e7-4e2f-8801-44e97638bc63 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:01.775051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-401ecc54-06e7-4e2f-8801-44e97638bc63 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:01.780128 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-401ecc54-06e7-4e2f-8801-44e97638bc63 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1261 microversion: 2.26 time: 0.206893 May 07 21:52:01.783242 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 972/1990] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:01 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:01.800454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:01.803176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:01.852389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:01.856312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:01.858726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:01.864003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:01.941451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:01.942367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:01.943341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lazy-loading 'fault' on Instance uuid 94a90838-d258-4958-946b-46c5f06a0e4c {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:02.006907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5c73f7347e64178b56a8331649c576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b3dd3880d475b939a8543d9bbf481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:02.015754 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a172bb6f-77f8-49c8-917c-1c8e7c06a51b tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 200 len: 1306 microversion: 2.1 time: 0.231216 May 07 21:52:02.017610 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 973/1991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:01 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 1306 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:02.023176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9aaf669b-2a0b-4551-a1d6-81625375d445 req-54ece4ba-2488-4c79-884d-25c1eb17b55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94a90838-d258-4958-946b-46c5f06a0e4c", "name": "network-vif-deleted", "tag": "f4e84972-b5b8-4161-be41-2a7625450b34"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:02.032724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9aaf669b-2a0b-4551-a1d6-81625375d445 req-54ece4ba-2488-4c79-884d-25c1eb17b55d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.033495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9aaf669b-2a0b-4551-a1d6-81625375d445 req-54ece4ba-2488-4c79-884d-25c1eb17b55d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.083866 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9aaf669b-2a0b-4551-a1d6-81625375d445 req-54ece4ba-2488-4c79-884d-25c1eb17b55d service nova] Creating event network-vif-deleted:f4e84972-b5b8-4161-be41-2a7625450b34 for instance 94a90838-d258-4958-946b-46c5f06a0e4c on nch1-master-1 May 07 21:52:02.090756 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9aaf669b-2a0b-4551-a1d6-81625375d445 req-54ece4ba-2488-4c79-884d-25c1eb17b55d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070793 May 07 21:52:02.095022 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 974/1992] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:02.110727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:02.111708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:02.126360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.130267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.131535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.133857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.156594 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 could not be found. May 07 21:52:02.157507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:02.159325 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-902f7221-eccf-4df9-8e1e-cd9867405b73 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 404 len: 111 microversion: 2.1 time: 0.062877 May 07 21:52:02.163526 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 975/1993] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:52:02 2022] DELETE /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:02.169167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:02.170099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:02.179132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.182708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.184350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.184916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.443836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:02.444466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:02.445123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:02.446622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:02.447436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:02.465461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.466050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.467059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.467507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.497752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Getting quotas for project aae91bd9874141989a0896953655d3de. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:02.504731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Getting quotas for user 8e35b8f3a2eb4ed98800638dd51618ff and project aae91bd9874141989a0896953655d3de. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:02.521862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Going to run 2 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:52:02.525718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 291bb30f-04fe-44bf-a1e3-ab8f39264f74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:02.571423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=291bb30f-04fe-44bf-a1e3-ab8f39264f74,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:02.647963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:02.658843 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f68d52d-7f9a-4e3d-85b0-703dbab8d0ed tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.492122 May 07 21:52:02.661191 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec84969a-7f94-440a-9c0b-072962fe809c tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648091 May 07 21:52:02.661957 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1019/1994] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:52:02.671092 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 976/1995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:02 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:02.674315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:02.675190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: 5fe177f0-906a-4fa9-aea9-ccd116bb7d25] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:02.683716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.684388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.689661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:02.690544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:02.693735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.698093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.716259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.719613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.720841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.721506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.755482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 could not be found. May 07 21:52:02.756096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Instance 5fe177f0-906a-4fa9-aea9-ccd116bb7d25 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:02.756946 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13f689a0-928c-4b8a-97c3-0bd5ed3292ff tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25" status: 404 len: 111 microversion: 2.1 time: 0.089024 May 07 21:52:02.766218 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1020/1996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:02 2022] GET /compute/v2.1/servers/5fe177f0-906a-4fa9-aea9-ccd116bb7d25 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:02.782091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:02.791241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:02.793875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Searching by: {'deleted': False, 'project_id': 'aae91bd9874141989a0896953655d3de'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:52:02.837745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.838354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.840240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:02.841337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:02.905900 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5efc169-b612-4ad5-b190-ed6849aab819 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.138439 May 07 21:52:02.915736 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1021/1997] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:52:02 2022] GET /compute/v2.1/servers => generated 677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:02.921721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-72c8aef7-3ef2-4558-9290-05e0d89e078a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '.version_select at 0x7fc41ce9b0d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:02.957246 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-72c8aef7-3ef2-4558-9290-05e0d89e078a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188137537" status: 202 len: 0 microversion: 2.1 time: 0.044958 May 07 21:52:02.958951 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1022/1998] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 21:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188137537 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:02.981384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7d61d073-5b4d-4b3d-b1f0-a5edc3809938 req-addc4415-3ee2-4dc7-9d0c-8b3ec89e318b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297e9f98-e053-44b1-af31-98785ad115af", "tag": "c398ed68-1c9f-4a4c-92f2-c58a298dedb0"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:03.005911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7d61d073-5b4d-4b3d-b1f0-a5edc3809938 req-addc4415-3ee2-4dc7-9d0c-8b3ec89e318b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:03.007430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7d61d073-5b4d-4b3d-b1f0-a5edc3809938 req-addc4415-3ee2-4dc7-9d0c-8b3ec89e318b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:03.052674 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7d61d073-5b4d-4b3d-b1f0-a5edc3809938 req-addc4415-3ee2-4dc7-9d0c-8b3ec89e318b service nova] Creating event network-changed:c398ed68-1c9f-4a4c-92f2-c58a298dedb0 for instance 297e9f98-e053-44b1-af31-98785ad115af on nch2-master-1 May 07 21:52:03.069712 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7d61d073-5b4d-4b3d-b1f0-a5edc3809938 req-addc4415-3ee2-4dc7-9d0c-8b3ec89e318b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109483 May 07 21:52:03.071242 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1023/1999] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:03.076927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:03.078025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:03.104701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:03.115931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:03.116834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:03.117299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:03.310944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:03.324642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:03.330065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:03.332916 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-40195ae9-0f4c-4cc0-9f0c-466a9d3cb43b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1319 microversion: 2.26 time: 0.260192 May 07 21:52:03.337916 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1024/2000] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:03 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:03.352742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6787558-f3af-432e-a38a-2b5c24d96b42 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:03.353708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6787558-f3af-432e-a38a-2b5c24d96b42 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:03.484944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6787558-f3af-432e-a38a-2b5c24d96b42 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:03.495122 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6787558-f3af-432e-a38a-2b5c24d96b42 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1220 microversion: 2.1 time: 0.154529 May 07 21:52:03.498566 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1025/2001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:03 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:03.510239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:03.512897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] [instance: 94a90838-d258-4958-946b-46c5f06a0e4c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:03.514424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:03.528740 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-49399b73-a772-4a03-aa02-aea5c2da7428 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1318 microversion: 2.1 time: 0.856232 May 07 21:52:03.532601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:03.534487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 977/2002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:02 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:03.534646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:03.535618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:03.536307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:03.574039 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] HTTP exception thrown: Instance 94a90838-d258-4958-946b-46c5f06a0e4c could not be found. May 07 21:52:03.576159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Returning 404 to user: Instance 94a90838-d258-4958-946b-46c5f06a0e4c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:03.577332 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e8f7e2d-cc11-4200-a393-9c5038ab7c2c tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c" status: 404 len: 111 microversion: 2.1 time: 0.077696 May 07 21:52:03.584540 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1026/2003] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:03 2022] GET /compute/v2.1/servers/94a90838-d258-4958-946b-46c5f06a0e4c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:03.590294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b154cc8a-6ecc-48f9-916d-8192135bc82a tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc4226188b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:03.687530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:03.688527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:03.698646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:03.699371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:03.700476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:03.701136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:04.357295 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b154cc8a-6ecc-48f9-916d-8192135bc82a tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/fc246f2c-2527-4352-9411-bbd768681e49" status: 202 len: 0 microversion: 2.1 time: 0.771221 May 07 21:52:04.358822 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 978/2004] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:03 2022] DELETE /compute/v2.1/os-security-groups/fc246f2c-2527-4352-9411-bbd768681e49 => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:04.365101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:04.365952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:04.383917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:04.384720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:04.385814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:04.386255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:04.545076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:04.554711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:04.557468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:04.558889 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bebbb7fb-32ac-4e83-bee4-31a2a52b4581 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1319 microversion: 2.26 time: 0.198818 May 07 21:52:04.559808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 979/2005] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:04 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:04.572965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4c2bddc-7e8f-433e-b1a2-23db0acde339 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] Calling method '.version_select at 0x7fc41cab0700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:05.514365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:05.526700 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-383bdbe2-967e-4839-a2ea-b7b393a7892e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 1.842794 May 07 21:52:05.539706 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1027/2006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:03 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:05.546263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:05.547310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:05.549577 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4c2bddc-7e8f-433e-b1a2-23db0acde339 tempest-SecurityGroupsTestJSON-1398230058 tempest-SecurityGroupsTestJSON-1398230058-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/6822a52d-a9a1-47aa-af0c-ed993dc876ed" status: 202 len: 0 microversion: 2.1 time: 0.981331 May 07 21:52:05.553999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 980/2007] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:04 2022] DELETE /compute/v2.1/os-security-groups/6822a52d-a9a1-47aa-af0c-ed993dc876ed => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:05.561970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:05.562827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:05.564280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:05.564936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:05.568778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:05.569547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:05.606998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:05.610933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:05.613368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:05.616961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:05.951862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:05.966735 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53877e39-3d71-4d53-bc97-3931553228f8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1278 microversion: 2.1 time: 0.425080 May 07 21:52:05.967701 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1028/2008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:05 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1278 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:06.201783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:06.211741 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f45f3768-0e00-4b41-bec9-5e48b323ccbc tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1318 microversion: 2.1 time: 0.656870 May 07 21:52:06.218552 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 981/2009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:05 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:06.223549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3cd98bd5-ddc7-45d7-80cf-d1715f9883a2 req-43b295a0-f793-4227-80d3-f38eabcbd55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "tag": "df7809e8-4b3a-419d-9177-98b732729c4a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:06.247487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3cd98bd5-ddc7-45d7-80cf-d1715f9883a2 req-43b295a0-f793-4227-80d3-f38eabcbd55a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:06.248304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3cd98bd5-ddc7-45d7-80cf-d1715f9883a2 req-43b295a0-f793-4227-80d3-f38eabcbd55a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:06.274315 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3cd98bd5-ddc7-45d7-80cf-d1715f9883a2 req-43b295a0-f793-4227-80d3-f38eabcbd55a service nova] Creating event network-changed:df7809e8-4b3a-419d-9177-98b732729c4a for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:06.284418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3cd98bd5-ddc7-45d7-80cf-d1715f9883a2 req-43b295a0-f793-4227-80d3-f38eabcbd55a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063673 May 07 21:52:06.285014 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 982/2010] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:06.292883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a503979a-5f70-4ca0-87ed-7245b5ac66cd tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] Action: 'create', calling method: .version_select at 0x7fc41d73ca60>, body: {"security_group": {"name": "tempest-securitygroup-801920959", "description": "tempest-description-1358832003"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:06.297760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:06.298477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:06.319906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:06.322224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:06.323746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:06.324567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:06.907253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:06.923563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:06.926399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:06.928513 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-898b5612-ad7c-47d2-9b77-169eeb25485e tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1361 microversion: 2.26 time: 0.639130 May 07 21:52:06.930700 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 983/2011] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:06 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1361 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:06.937966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:06.939622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:06.964142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:06.964959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:06.966021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:06.966632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:07.438232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:07.496852 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93e5fec7-6a92-479d-9926-85a47001b647 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.558967 May 07 21:52:07.498850 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 984/2012] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:06 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:07.504080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13e91d05-793f-482b-91f0-7b0eb331d227 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '.version_select at 0x7fc41cf0aa60>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:07.532737 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-13e91d05-793f-482b-91f0-7b0eb331d227 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Image not found. May 07 21:52:07.533350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13e91d05-793f-482b-91f0-7b0eb331d227 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Image not found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:07.534199 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-13e91d05-793f-482b-91f0-7b0eb331d227 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/images/32946ea2-2fa3-4906-8955-d46f1e0a61e0" status: 404 len: 62 microversion: 2.1 time: 0.034313 May 07 21:52:07.538473 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 985/2013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:07 2022] DELETE /compute/v2.1/images/32946ea2-2fa3-4906-8955-d46f1e0a61e0 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:52:07.541092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:07.541720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:07.568144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:07.568616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:07.569417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:07.571860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:07.726608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:07.737015 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bf351594-3e33-4336-a8b9-992db4ee138f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1278 microversion: 2.1 time: 0.200764 May 07 21:52:07.738015 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 986/2014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:07 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:07.742902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a02f4c20-a5cd-4de9-920c-d8b4344dc8d7 req-d6c08fb8-cbf1-4fbc-99e2-cd93f812f6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297e9f98-e053-44b1-af31-98785ad115af", "name": "network-vif-plugged", "status": "completed", "tag": "c398ed68-1c9f-4a4c-92f2-c58a298dedb0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:07.760529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a02f4c20-a5cd-4de9-920c-d8b4344dc8d7 req-d6c08fb8-cbf1-4fbc-99e2-cd93f812f6ea service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:07.761344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a02f4c20-a5cd-4de9-920c-d8b4344dc8d7 req-d6c08fb8-cbf1-4fbc-99e2-cd93f812f6ea service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:07.776749 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a02f4c20-a5cd-4de9-920c-d8b4344dc8d7 req-d6c08fb8-cbf1-4fbc-99e2-cd93f812f6ea service nova] Creating event network-vif-plugged:c398ed68-1c9f-4a4c-92f2-c58a298dedb0 for instance 297e9f98-e053-44b1-af31-98785ad115af on nch2-master-1 May 07 21:52:07.784654 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a02f4c20-a5cd-4de9-920c-d8b4344dc8d7 req-d6c08fb8-cbf1-4fbc-99e2-cd93f812f6ea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045204 May 07 21:52:07.786425 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 987/2015] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:07.794612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:07.795537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:07.802883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:07.803639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:07.804632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:07.805304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:08.145361 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a503979a-5f70-4ca0-87ed-7245b5ac66cd tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.174831 May 07 21:52:08.147112 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1029/2016] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:08.152376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:08.154719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:08.169143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:08.171681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:08.173475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:08.177789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:08.224579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 could not be found. May 07 21:52:08.227366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:08.228273 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b0fedcd8-df26-4ac0-a445-d599438f4585 tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 404 len: 111 microversion: 2.1 time: 0.079771 May 07 21:52:08.228857 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1030/2017] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:52:08 2022] DELETE /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:08.239850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:08.243593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:08.256904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:08.257653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:08.259208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:08.259840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:08.756835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:08.769023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:08.770978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:08.775783 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7759587f-3648-4ec7-9556-80d92636b675 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1361 microversion: 2.26 time: 0.543040 May 07 21:52:08.776834 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1031/2018] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:08 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1361 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:08.794361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bde4d2e9-7986-47e6-b736-10f5108df541 tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] Action: 'create', calling method: .version_select at 0x7fc41d499f70>, body: {"security_group": {"name": "tempest-securitygroup-448265998", "description": "tempest-description-877820774"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:08.866151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:08.878904 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-967bd5fb-0e05-45b2-ba9d-9555dcf5a762 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1318 microversion: 2.1 time: 1.089431 May 07 21:52:08.879892 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 988/2019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:07 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:08.888966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:08.891591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] [instance: ddd9b73d-94f5-48f0-9bd4-f06f09d7b556] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:08.913960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:08.919158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:08.935314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:08.936578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:08.991960 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] HTTP exception thrown: Instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 could not be found. May 07 21:52:08.993095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] Returning 404 to user: Instance ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:08.994314 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92f49d49-3317-4c07-90b3-50ca948f8f0a tempest-ImagesOneServerNegativeTestJSON-1354668230 tempest-ImagesOneServerNegativeTestJSON-1354668230-project] 10.222.0.32 "GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556" status: 404 len: 111 microversion: 2.1 time: 0.111959 May 07 21:52:08.995458 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 989/2020] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:08 2022] GET /compute/v2.1/servers/ddd9b73d-94f5-48f0-9bd4-f06f09d7b556 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:09.002050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7659f3d0-04f8-4d43-8ec9-99de36c0092b req-489de9a9-d0ab-4e53-b28a-1916baae04cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "tag": "bb1a4932-726b-4649-982e-cde502e2aff1"}, {"name": "network-changed", "server_uuid": "094c249f-bac0-48b7-be4c-614af1acfbf5", "tag": "5bf0d3b1-6d14-4171-84b6-a6256304ad16"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:09.019522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7659f3d0-04f8-4d43-8ec9-99de36c0092b req-489de9a9-d0ab-4e53-b28a-1916baae04cc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:09.020443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7659f3d0-04f8-4d43-8ec9-99de36c0092b req-489de9a9-d0ab-4e53-b28a-1916baae04cc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:09.043434 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7659f3d0-04f8-4d43-8ec9-99de36c0092b req-489de9a9-d0ab-4e53-b28a-1916baae04cc service nova] Creating event network-changed:bb1a4932-726b-4649-982e-cde502e2aff1 for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:09.044729 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7659f3d0-04f8-4d43-8ec9-99de36c0092b req-489de9a9-d0ab-4e53-b28a-1916baae04cc service nova] Creating event network-changed:5bf0d3b1-6d14-4171-84b6-a6256304ad16 for instance 094c249f-bac0-48b7-be4c-614af1acfbf5 on nch1-master-1 May 07 21:52:09.069963 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7659f3d0-04f8-4d43-8ec9-99de36c0092b req-489de9a9-d0ab-4e53-b28a-1916baae04cc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061779 May 07 21:52:09.075831 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 990/2021] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:09.088010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:09.089150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:09.098992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:09.099823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:09.101412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:09.102673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:09.852112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:09.866016 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-56a42e0a-279e-4225-b94b-19bf520e640b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.787081 May 07 21:52:09.870539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 991/2022] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:09 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:09.883937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:09.885264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:09.901224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:09.901973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:09.903003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:09.903614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:09.981499 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bde4d2e9-7986-47e6-b736-10f5108df541 tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.203115 May 07 21:52:09.987303 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1032/2023] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:08 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:09.993974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:10.007149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:10.017812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:10.021656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:10.022953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:10.023856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:10.160717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:10.169446 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff48a1ae-7df7-4bf4-9acb-05cfa960c5d2 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.296632 May 07 21:52:10.173312 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 992/2024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:09 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:10.185834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:10.187435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:10.221332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:10.221829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:10.226273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:10.227608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:10.613385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:10.640977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:10.642824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:10.644698 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1967c89-2b47-4e9f-a40e-8e2474defa90 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1361 microversion: 2.26 time: 0.656216 May 07 21:52:10.647451 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1033/2025] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:09 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1361 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:10.709334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:10.726285 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-72d44b43-4164-47ff-9834-4b3c138c4f44 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1507 microversion: 2.1 time: 0.551310 May 07 21:52:10.738320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 993/2026] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:10 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:10.744448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e7d8bb98-ff64-425f-a108-99272e00bc02 req-7e9eb263-1e47-4f7a-b4cc-790d7c336b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "tag": "f7bd0dbf-a440-4d9e-8f71-48688376777e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:10.763019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e7d8bb98-ff64-425f-a108-99272e00bc02 req-7e9eb263-1e47-4f7a-b4cc-790d7c336b1c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:10.770406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e7d8bb98-ff64-425f-a108-99272e00bc02 req-7e9eb263-1e47-4f7a-b4cc-790d7c336b1c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:10.797434 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e7d8bb98-ff64-425f-a108-99272e00bc02 req-7e9eb263-1e47-4f7a-b4cc-790d7c336b1c service nova] Creating event network-changed:f7bd0dbf-a440-4d9e-8f71-48688376777e for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:10.807451 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e7d8bb98-ff64-425f-a108-99272e00bc02 req-7e9eb263-1e47-4f7a-b4cc-790d7c336b1c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067427 May 07 21:52:10.815584 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 994/2027] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:10.887324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:10.888203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:10.905681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:10.907019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:10.907866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:10.911690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:11.018347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-789702a8-f577-4381-a707-e06959c018fe tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] Action: 'create', calling method: .version_select at 0x7fc41d703ca0>, body: {"security_group": {"name": "tempest-securitygroup-779528212", "description": "tempest-description-699084880"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:11.947289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:11.965005 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00196492-0ce7-44ea-992c-4d88e1bf7e2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 1.085021 May 07 21:52:11.973432 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 995/2028] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:10 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:11.989581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:11.990484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:12.006273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:12.007042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:12.009862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:12.010560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:12.274179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:12.283051 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-34d0900d-da0b-4ada-87cc-cc53f24acfcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.307984 May 07 21:52:12.285273 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 996/2029] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:11 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:12.303162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:12.304097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:12.324856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:12.325614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:12.326536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:12.327070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:12.586243 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-789702a8-f577-4381-a707-e06959c018fe tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.937416 May 07 21:52:12.590530 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1034/2030] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:10 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:12.596954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a97af2f-9f40-4145-9032-48c7ab72900c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:12.598646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:12.623286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:12.624130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:12.625290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:12.626042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:12.706872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:12.720402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:12.725990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:12.728700 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f441b8b8-d8cd-4123-abd9-c7b2794b4e2b tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1361 microversion: 2.26 time: 0.428851 May 07 21:52:12.729491 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 997/2031] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:12 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1361 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:12.743799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-138e3d27-761a-4aca-beaf-1ec39f21cd02 tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] Action: 'create', calling method: .version_select at 0x7fc422618f70>, body: {"security_group": {"name": "tempest-securitygroup-1754565708", "description": "tempest-description-417482777"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:13.064175 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dc7d17cd-d310-40b2-91f5-3efe4133a1fa tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "POST /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471851 May 07 21:52:13.065527 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1035/2032] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 21:52:12 2022] POST /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:13.075885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d96b30a8-6a0e-45d5-addb-baf3c21a5fd6 req-36449f7a-d733-4d1e-b470-247cea2dda63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291bb30f-04fe-44bf-a1e3-ab8f39264f74", "tag": "3f62d3bb-3e19-4105-8761-7215be7ce835"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:13.098942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d96b30a8-6a0e-45d5-addb-baf3c21a5fd6 req-36449f7a-d733-4d1e-b470-247cea2dda63 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:13.106240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d96b30a8-6a0e-45d5-addb-baf3c21a5fd6 req-36449f7a-d733-4d1e-b470-247cea2dda63 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:13.132438 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d96b30a8-6a0e-45d5-addb-baf3c21a5fd6 req-36449f7a-d733-4d1e-b470-247cea2dda63 service nova] Creating event network-changed:3f62d3bb-3e19-4105-8761-7215be7ce835 for instance 291bb30f-04fe-44bf-a1e3-ab8f39264f74 on nch1-master-1 May 07 21:52:13.167447 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d96b30a8-6a0e-45d5-addb-baf3c21a5fd6 req-36449f7a-d733-4d1e-b470-247cea2dda63 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100195 May 07 21:52:13.172085 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1036/2033] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:13.184617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:13.185759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:13.218811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:13.219386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:13.221772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:13.222432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:13.532541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-138e3d27-761a-4aca-beaf-1ec39f21cd02 tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.800448 May 07 21:52:13.538574 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 998/2034] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:12 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:13.540592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:13.541242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:13.568615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:13.569091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:13.576020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:13.576606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:13.940153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:13.949211 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e9b33c93-8513-4093-87b3-ea4ea004e139 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.775670 May 07 21:52:13.954795 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1037/2035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:13 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:13.959927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd884533-b091-4670-9c25-e26dda46cf97 tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] Calling method '.version_select at 0x7fc41caad160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:14.140212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:14.157252 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-262c212b-0b0b-4775-baab-38b3798fe368 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.622004 May 07 21:52:14.159720 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 999/2036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:13 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:14.188770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:14.192352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:14.232152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:14.232957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:14.235412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:14.278496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:14.769672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:14.781832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:14.784524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:14.785725 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1289f3db-9538-48ad-a24e-2e84289b6622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1361 microversion: 2.26 time: 0.619796 May 07 21:52:14.792859 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1000/2037] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:14 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1361 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:15.051138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1fa73101-9ada-41a6-a9e7-c83b811629c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Action: 'create', calling method: .version_select at 0x7fc42261f550>, body: {"keypair": {"name": "tempest-keypair-1438918361"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:15.105491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1fa73101-9ada-41a6-a9e7-c83b811629c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:15.122601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1fa73101-9ada-41a6-a9e7-c83b811629c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:15.349101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1fa73101-9ada-41a6-a9e7-c83b811629c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:15.359258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1fa73101-9ada-41a6-a9e7-c83b811629c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:15.384195 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1fa73101-9ada-41a6-a9e7-c83b811629c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.587822 May 07 21:52:15.389984 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1001/2038] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:52:14 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:15.396501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-db029cfc-f884-489b-b9cc-e6079138c7d2 req-0bc8777e-83b8-4239-8852-ecb7118aeab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094c249f-bac0-48b7-be4c-614af1acfbf5", "name": "network-vif-plugged", "status": "completed", "tag": "5bf0d3b1-6d14-4171-84b6-a6256304ad16"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:15.407054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-db029cfc-f884-489b-b9cc-e6079138c7d2 req-0bc8777e-83b8-4239-8852-ecb7118aeab2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:15.407912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-db029cfc-f884-489b-b9cc-e6079138c7d2 req-0bc8777e-83b8-4239-8852-ecb7118aeab2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:15.432850 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-db029cfc-f884-489b-b9cc-e6079138c7d2 req-0bc8777e-83b8-4239-8852-ecb7118aeab2 service nova] Creating event network-vif-plugged:5bf0d3b1-6d14-4171-84b6-a6256304ad16 for instance 094c249f-bac0-48b7-be4c-614af1acfbf5 on nch1-master-1 May 07 21:52:15.443656 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-db029cfc-f884-489b-b9cc-e6079138c7d2 req-0bc8777e-83b8-4239-8852-ecb7118aeab2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051128 May 07 21:52:15.445585 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1002/2039] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:15.457728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:15.460758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:15.474588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:15.475280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:15.477247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:15.477876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:16.320304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:16.329667 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb666178-1642-49db-ac90-31bf1cbf296c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.881131 May 07 21:52:16.331106 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1003/2040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:15 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:16.337765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:16.338751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:16.351306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:16.353131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:16.361029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:16.361858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:16.633188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:16.640922 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-104a9e5b-3ac2-4ed7-acc9-9d295f0eef17 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.308526 May 07 21:52:16.654015 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1004/2041] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:16 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:16.660536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dd0513ba-9c71-4432-a2d2-b70c6354e6a5 req-eb53e078-034e-4c47-9732-05f228cf0447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "510e9ced-c683-45b2-bff6-88ab05c23bb6", "tag": "9dc2b760-de86-4db6-bfb4-a511993e37c6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:16.670476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dd0513ba-9c71-4432-a2d2-b70c6354e6a5 req-eb53e078-034e-4c47-9732-05f228cf0447 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:16.671356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dd0513ba-9c71-4432-a2d2-b70c6354e6a5 req-eb53e078-034e-4c47-9732-05f228cf0447 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:16.691852 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dd0513ba-9c71-4432-a2d2-b70c6354e6a5 req-eb53e078-034e-4c47-9732-05f228cf0447 service nova] Creating event network-changed:9dc2b760-de86-4db6-bfb4-a511993e37c6 for instance 510e9ced-c683-45b2-bff6-88ab05c23bb6 on nch1-master-1 May 07 21:52:16.698884 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dd0513ba-9c71-4432-a2d2-b70c6354e6a5 req-eb53e078-034e-4c47-9732-05f228cf0447 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042202 May 07 21:52:16.699895 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1005/2042] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:16.705863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5310eb71-b4a6-4737-b837-d30f7ec71cea tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc42260e3a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:16.718566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5310eb71-b4a6-4737-b837-d30f7ec71cea tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-1438918361" status: 200 len: 692 microversion: 2.1 time: 0.017205 May 07 21:52:16.719554 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1006/2043] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 21:52:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1438918361 => generated 692 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:16.856489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9547303e-ae8a-4aaa-9154-6d5707a80a6c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Action: 'create', calling method: .version_select at 0x7fc4226201f0>, body: {"keypair": {"name": "tempest-keypair-1610722317"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:16.872537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9547303e-ae8a-4aaa-9154-6d5707a80a6c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Getting quotas for project 62b1d2f38652407eaa85fbb15aff6307. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:16.878473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9547303e-ae8a-4aaa-9154-6d5707a80a6c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Getting quotas for user a2d5596fa4984ceab3525ffc0a14d48f and project 62b1d2f38652407eaa85fbb15aff6307. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:17.215779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9547303e-ae8a-4aaa-9154-6d5707a80a6c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Getting quotas for project 62b1d2f38652407eaa85fbb15aff6307. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:17.224344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9547303e-ae8a-4aaa-9154-6d5707a80a6c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Getting quotas for user a2d5596fa4984ceab3525ffc0a14d48f and project 62b1d2f38652407eaa85fbb15aff6307. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:17.265420 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9547303e-ae8a-4aaa-9154-6d5707a80a6c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.540653 May 07 21:52:17.266706 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1007/2044] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:52:16 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:17.272334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:17.273259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:17.280788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:17.281254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:17.282198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:17.282852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:17.578214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:17.593348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:17.594951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:17.599444 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4c19f5ab-c2f2-4e18-9b84-a781d2674776 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1361 microversion: 2.26 time: 0.328049 May 07 21:52:17.604023 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1008/2045] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:17 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1361 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:17.614304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-070df3dc-96c5-494a-b2ee-f9838d74988f tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc4225bea60>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:17.654480 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-070df3dc-96c5-494a-b2ee-f9838d74988f tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438918361" status: 202 len: 0 microversion: 2.1 time: 0.049096 May 07 21:52:17.655598 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1009/2046] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:52:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438918361 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:17.662754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:17.665087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:17.672342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:17.673598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:17.675285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:17.676752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:17.924076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:17.931687 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-347d6ce6-867d-45c3-9327-c48afdfd3b48 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.274843 May 07 21:52:17.934719 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1010/2047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:17 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:17.939663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:17.940291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:17.947144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:17.947607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:17.948396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:17.948856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:18.218738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:18.227679 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9975c0e4-b815-4d8f-8738-0b96dcc7e65f tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.291830 May 07 21:52:18.228955 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1011/2048] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:17 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:18.233984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed3b93e5-026c-4c3c-a18f-ba9a387d085a tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Action: 'create', calling method: .version_select at 0x7fc41d230ca0>, body: {"keypair": {"name": "tempest-keypair-1099470205"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:18.249686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ed3b93e5-026c-4c3c-a18f-ba9a387d085a tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:18.255031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ed3b93e5-026c-4c3c-a18f-ba9a387d085a tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:18.352740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ed3b93e5-026c-4c3c-a18f-ba9a387d085a tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:18.358796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ed3b93e5-026c-4c3c-a18f-ba9a387d085a tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:18.375699 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed3b93e5-026c-4c3c-a18f-ba9a387d085a tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.145584 May 07 21:52:18.376417 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1012/2049] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:52:18 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:18.515553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c4dbd0f8-443d-49d4-bad0-ae63053a59d3"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:18.516799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:18.523589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:18.524275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:18.525060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:18.525676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:18.631985 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] HTTP exception thrown: Volume c4dbd0f8-443d-49d4-bad0-ae63053a59d3 could not be found. May 07 21:52:18.633361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Returning 400 to user: Volume c4dbd0f8-443d-49d4-bad0-ae63053a59d3 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:18.634354 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03de8523-cde9-41ae-b4a4-d8d576f1466b tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] 10.222.0.32 "PUT /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments/3a97af2f-9f40-4145-9032-48c7ab72900c" status: 400 len: 107 microversion: 2.1 time: 0.252413 May 07 21:52:18.635175 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1013/2050] 10.222.0.32 () {60 vars in 1432 bytes} [Sat May 7 21:52:18 2022] PUT /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments/3a97af2f-9f40-4145-9032-48c7ab72900c => generated 107 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:52:18.641958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e0a0e0c-93bd-4864-b45c-a4c2505d3216 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc42260ec10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:18.668749 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e0a0e0c-93bd-4864-b45c-a4c2505d3216 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099470205" status: 202 len: 0 microversion: 2.1 time: 0.031920 May 07 21:52:18.676549 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1014/2051] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1099470205 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:18.681941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-22043716-660e-404e-8dbb-67c76afcfb2f req-1191ce45-0dd7-4feb-8f16-03c420f870e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291bb30f-04fe-44bf-a1e3-ab8f39264f74", "name": "network-vif-plugged", "status": "completed", "tag": "3f62d3bb-3e19-4105-8761-7215be7ce835"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:18.695181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-22043716-660e-404e-8dbb-67c76afcfb2f req-1191ce45-0dd7-4feb-8f16-03c420f870e8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:18.695998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-22043716-660e-404e-8dbb-67c76afcfb2f req-1191ce45-0dd7-4feb-8f16-03c420f870e8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:18.710262 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-22043716-660e-404e-8dbb-67c76afcfb2f req-1191ce45-0dd7-4feb-8f16-03c420f870e8 service nova] Creating event network-vif-plugged:3f62d3bb-3e19-4105-8761-7215be7ce835 for instance 291bb30f-04fe-44bf-a1e3-ab8f39264f74 on nch1-master-1 May 07 21:52:18.716907 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-22043716-660e-404e-8dbb-67c76afcfb2f req-1191ce45-0dd7-4feb-8f16-03c420f870e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038494 May 07 21:52:18.717976 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1015/2052] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:18.725920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:18.728064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:18.737579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:18.737831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:18.740256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:18.741058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:18.902354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:18.911623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:18.913146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:18.915143 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d44f2b4c-e34d-4227-b000-0740faaf92dd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1545 microversion: 2.26 time: 0.195365 May 07 21:52:18.916001 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1016/2053] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:18 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1545 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:18.921548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf647160-7412-4ede-a83e-792b4f64fbe9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Action: 'create', calling method: .version_select at 0x7fc42261fe50>, body: {"keypair": {"name": "tempest-keypair-166240940", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:18.941063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-cf647160-7412-4ede-a83e-792b4f64fbe9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:18.948661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-cf647160-7412-4ede-a83e-792b4f64fbe9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:18.976863 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf647160-7412-4ede-a83e-792b4f64fbe9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.059039 May 07 21:52:18.978154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1017/2054] 10.222.0.32 () {60 vars in 1158 bytes} [Sat May 7 21:52:18 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:18.984613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:18.985130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:18.992163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:18.992745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:18.993549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:18.994001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.126721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lazy-loading 'services' on Instance uuid 297e9f98-e053-44b1-af31-98785ad115af {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:19.256896 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86037b7a-adcb-424c-bd63-a7e39e1519ff tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "DELETE /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments/3a97af2f-9f40-4145-9032-48c7ab72900c" status: 202 len: 0 microversion: 2.1 time: 0.276831 May 07 21:52:19.257956 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1018/2055] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 21:52:18 2022] DELETE /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments/3a97af2f-9f40-4145-9032-48c7ab72900c => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:19.263999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc422618550>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:19.273018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.273866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.274138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:19.280635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.281023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.282504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.282975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.318814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.320485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.345442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.346975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.389696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:19.409133 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-100e9cb0-bdb5-4dcb-90f4-1a6f7daa7a11 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1473723435" status: 201 len: 0 microversion: 2.26 time: 0.149393 May 07 21:52:19.415289 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1019/2056] 10.222.0.32 () {62 vars in 1379 bytes} [Sat May 7 21:52:19 2022] PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1473723435 => generated 0 bytes in 157 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 07 21:52:19.420708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:19.420920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:19.429747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.430216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.431110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.431611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.643573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:19.658354 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-06f8a32e-3fd2-4c89-b8c8-d2c99583bb92 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.241611 May 07 21:52:19.669533 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1020/2057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:19 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:19.674806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ecb48200-04ec-4779-9455-2200d48a82f2 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc4225d4b80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:19.701713 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ecb48200-04ec-4779-9455-2200d48a82f2 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166240940" status: 202 len: 0 microversion: 2.1 time: 0.031005 May 07 21:52:19.707745 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1021/2058] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 21:52:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166240940 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:19.719650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:19.721033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:19.728799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.729566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.730668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:19.732664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:19.971514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:19.979746 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-615d8635-c298-4980-bc20-da9df37ff8d0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.271005 May 07 21:52:19.981474 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1022/2059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:19 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:19.986451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1418eb56-4b5c-4099-a2f4-146f88cde15f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:19.987811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1418eb56-4b5c-4099-a2f4-146f88cde15f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:19.998395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1418eb56-4b5c-4099-a2f4-146f88cde15f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.005157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1418eb56-4b5c-4099-a2f4-146f88cde15f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.008002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1418eb56-4b5c-4099-a2f4-146f88cde15f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.010385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1418eb56-4b5c-4099-a2f4-146f88cde15f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.077669 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1418eb56-4b5c-4099-a2f4-146f88cde15f tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094833 May 07 21:52:20.078296 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1023/2060] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:52:19 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:20.083522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4916a65a-e683-4057-8cbd-8c088dd79df2 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc422567160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:20.091604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4916a65a-e683-4057-8cbd-8c088dd79df2 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.092191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4916a65a-e683-4057-8cbd-8c088dd79df2 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.112050 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4916a65a-e683-4057-8cbd-8c088dd79df2 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1473723435" status: 204 len: 0 microversion: 2.26 time: 0.032404 May 07 21:52:20.114907 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1024/2061] 10.222.0.32 () {60 vars in 1360 bytes} [Sat May 7 21:52:20 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1473723435 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:20.119567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3c11059b-4d70-49f8-9c26-95e1598dd4c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Action: 'create', calling method: .version_select at 0x7fc422567280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-780509195"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:20.126341 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bd884533-b091-4670-9c25-e26dda46cf97 tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] 10.222.0.32 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9745 microversion: 2.1 time: 6.169571 May 07 21:52:20.141236 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1038/2062] 10.222.0.32 () {58 vars in 1190 bytes} [Sat May 7 21:52:13 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9745 bytes in 6185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:20.147778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3c11059b-4d70-49f8-9c26-95e1598dd4c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:20.149349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc41d3b6430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:20.159585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.161454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.162292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:20.163750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3c11059b-4d70-49f8-9c26-95e1598dd4c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:20.179259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.181312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.184755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.186290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.271587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.272446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.303623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:20.389546 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f913652d-9de0-4bed-bc00-0028bf9284bd tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 204 len: 0 microversion: 2.26 time: 0.246818 May 07 21:52:20.392124 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1039/2063] 10.222.0.32 () {60 vars in 1294 bytes} [Sat May 7 21:52:20 2022] DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:20.403549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-25b019b6-b2de-447d-8ae5-1453a22d97f7 tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] Calling method '.version_select at 0x7fc41d73c280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:20.406697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3c11059b-4d70-49f8-9c26-95e1598dd4c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:20.421153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3c11059b-4d70-49f8-9c26-95e1598dd4c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:20.439573 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3c11059b-4d70-49f8-9c26-95e1598dd4c9 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.325380 May 07 21:52:20.440292 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1025/2064] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:52:20 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:20.447581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-617e04b1-ee5a-47de-b2e3-28c04edab13c tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc42261f310>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:20.461680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617e04b1-ee5a-47de-b2e3-28c04edab13c tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.462156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617e04b1-ee5a-47de-b2e3-28c04edab13c tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.471590 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-617e04b1-ee5a-47de-b2e3-28c04edab13c tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 200 len: 12 microversion: 2.26 time: 0.030248 May 07 21:52:20.472664 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1026/2065] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:52:20 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:20.478476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-758dfab5-b40e-4d87-9293-d5e65d204183 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Action: 'create', calling method: .version_select at 0x7fc4225d4670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1278862996"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:20.493473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-758dfab5-b40e-4d87-9293-d5e65d204183 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:20.503252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-758dfab5-b40e-4d87-9293-d5e65d204183 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:20.942423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-758dfab5-b40e-4d87-9293-d5e65d204183 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:20.949510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-758dfab5-b40e-4d87-9293-d5e65d204183 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:20.960756 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-25b019b6-b2de-447d-8ae5-1453a22d97f7 tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.563615 May 07 21:52:20.965515 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1040/2066] 10.222.0.32 () {58 vars in 1190 bytes} [Sat May 7 21:52:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:20.971983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc41cc081f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:20.975422 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-758dfab5-b40e-4d87-9293-d5e65d204183 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.502035 May 07 21:52:20.976490 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1027/2067] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:52:20 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:20.981324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:20.982065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:20.989072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.991832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.993938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.994486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:20.999086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:20.999562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.000059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:21.014515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.015017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.015846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.016349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.056879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.057609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.074215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.074965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.108606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:21.128842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8b6247af-df4b-4865-94bb-ab60e023cdef tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-595578568" status: 201 len: 0 microversion: 2.26 time: 0.162142 May 07 21:52:21.130696 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1041/2068] 10.222.0.32 () {62 vars in 1376 bytes} [Sat May 7 21:52:20 2022] PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-595578568 => generated 0 bytes in 164 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 07 21:52:21.139445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a1ffbe5c-f2c7-484d-a5ca-fb2c5c948424 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Action: 'create', calling method: .version_select at 0x7fc41caf0550>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-969098395"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:21.157435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a1ffbe5c-f2c7-484d-a5ca-fb2c5c948424 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:21.164728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a1ffbe5c-f2c7-484d-a5ca-fb2c5c948424 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:21.294826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:21.303486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a3a8fee-94f4-4053-b03e-0cab9f62607c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.325769 May 07 21:52:21.305568 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1028/2069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:20 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:21.312870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:21.313771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:21.320970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.321865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.322945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.323589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.459152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a1ffbe5c-f2c7-484d-a5ca-fb2c5c948424 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:21.466081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a1ffbe5c-f2c7-484d-a5ca-fb2c5c948424 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Getting quotas for user 92aa3e30b4984c7db37325d0ce498d3d and project 561130cf49e5493988451055404d1146. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:21.495936 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a1ffbe5c-f2c7-484d-a5ca-fb2c5c948424 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.364089 May 07 21:52:21.497024 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1042/2070] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:52:21 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:21.502225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8ea16c62-4837-4266-8554-318c00acd38f tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] Calling method '.version_select at 0x7fc41d113ca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:21.522329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:21.541232 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-16d05071-5a32-463d-b43a-904721fd83c4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.234339 May 07 21:52:21.550520 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1029/2071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:21 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:21.550520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff436afb-580c-412d-969d-608278467c5d tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:21.551533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff436afb-580c-412d-969d-608278467c5d tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:21.565271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff436afb-580c-412d-969d-608278467c5d tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.565271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff436afb-580c-412d-969d-608278467c5d tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.567351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff436afb-580c-412d-969d-608278467c5d tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.568377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff436afb-580c-412d-969d-608278467c5d tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.615734 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff436afb-580c-412d-969d-608278467c5d tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072046 May 07 21:52:21.616933 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1030/2072] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:52:21 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:52:21.625265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9b4cfdf-a23e-4226-b601-3bee7c83c333 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc42250eee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:21.633788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9b4cfdf-a23e-4226-b601-3bee7c83c333 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:21.634590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9b4cfdf-a23e-4226-b601-3bee7c83c333 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:21.646812 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9b4cfdf-a23e-4226-b601-3bee7c83c333 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 200 len: 35 microversion: 2.26 time: 0.028546 May 07 21:52:21.652835 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1031/2073] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:52:21 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 35 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:21.658374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed7aadd0-a45e-4323-a817-64e60b5ecd3d tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc422620f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:21.661258 ncdv-master-1 devstack@n-api.service[136682]: WARNING oslo_db.sqlalchemy.utils [None req-ed7aadd0-a45e-4323-a817-64e60b5ecd3d tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Unique keys not in sort_keys. The sorting order may be unstable. May 07 21:52:21.669741 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed7aadd0-a45e-4323-a817-64e60b5ecd3d tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 1674 microversion: 2.1 time: 0.015553 May 07 21:52:21.676513 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1032/2074] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:52:21 2022] GET /compute/v2.1/os-keypairs => generated 1674 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:21.682591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-864335841", "imageRef": "6086c33e-2892-4cad-b252-407976cfc0e4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "55393a4f-e493-4098-b37d-93ec9341a6b2"}], "security_groups": [{"name": "tempest-securitygroup--1690594976"}], "key_name": "tempest-keypair-1610722317", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:21.825253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] validate_networks() for [('55393a4f-e493-4098-b37d-93ec9341a6b2', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:52:22.116108 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8ea16c62-4837-4266-8554-318c00acd38f tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/cfdfe42a-25c5-40aa-aa35-1f8d388173af" status: 202 len: 0 microversion: 2.1 time: 0.616718 May 07 21:52:22.118139 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1043/2075] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:21 2022] DELETE /compute/v2.1/os-security-groups/cfdfe42a-25c5-40aa-aa35-1f8d388173af => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:22.129392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc42266dca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.170296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.170877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.171669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:22.178442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.179245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.180762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.181274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.224681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.228001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.266253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:22.299453 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29eb183f-37b4-4d01-8bf9-bb78ca045622 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-595578568" status: 204 len: 0 microversion: 2.26 time: 0.173639 May 07 21:52:22.300360 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1044/2076] 10.222.0.32 () {60 vars in 1360 bytes} [Sat May 7 21:52:22 2022] DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-595578568 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:22.307245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f3abfec-6088-4d4f-9731-73ba121130b4 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc41ce360d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.333054 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f3abfec-6088-4d4f-9731-73ba121130b4 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-969098395" status: 202 len: 0 microversion: 2.1 time: 0.031596 May 07 21:52:22.339997 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1045/2077] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-969098395 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:22.345195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c4456d2a-df8e-4dba-86c3-15ee018540a9 tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] Calling method '.version_select at 0x7fc41d479820>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.475186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:22.475799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:22.476449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:22.477506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:22.478187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:22.490106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.490859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.491915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.492766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.515688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Getting quotas for project 62b1d2f38652407eaa85fbb15aff6307. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:22.525458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Getting quotas for user a2d5596fa4984ceab3525ffc0a14d48f and project 62b1d2f38652407eaa85fbb15aff6307. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:22.543024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:52:22.546615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6086c33e-2892-4cad-b252-407976cfc0e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:22.577844 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c4456d2a-df8e-4dba-86c3-15ee018540a9 tempest-SecurityGroupsTestAdminJSON-1267154241 tempest-SecurityGroupsTestAdminJSON-1267154241-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/67c6f174-7275-4b11-bae8-6b9c1e53341d" status: 202 len: 0 microversion: 2.1 time: 0.236616 May 07 21:52:22.578441 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1046/2078] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:22 2022] DELETE /compute/v2.1/os-security-groups/67c6f174-7275-4b11-bae8-6b9c1e53341d => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:22.588368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-be9b44f1-3d24-451f-9243-530b38112c11 req-9b0e00e5-12b4-446a-b5a9-8f196b054263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510e9ced-c683-45b2-bff6-88ab05c23bb6", "name": "network-vif-plugged", "status": "completed", "tag": "9dc2b760-de86-4db6-bfb4-a511993e37c6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:22.607764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-be9b44f1-3d24-451f-9243-530b38112c11 req-9b0e00e5-12b4-446a-b5a9-8f196b054263 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.608480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-be9b44f1-3d24-451f-9243-530b38112c11 req-9b0e00e5-12b4-446a-b5a9-8f196b054263 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.617123 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aea8e086-83ef-40aa-b1fe-2cad68fcbaf0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.937234 May 07 21:52:22.624331 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-be9b44f1-3d24-451f-9243-530b38112c11 req-9b0e00e5-12b4-446a-b5a9-8f196b054263 service nova] Creating event network-vif-plugged:9dc2b760-de86-4db6-bfb4-a511993e37c6 for instance 510e9ced-c683-45b2-bff6-88ab05c23bb6 on nch1-master-1 May 07 21:52:22.624654 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1033/2079] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:52:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:52:22.631456 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-be9b44f1-3d24-451f-9243-530b38112c11 req-9b0e00e5-12b4-446a-b5a9-8f196b054263 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047802 May 07 21:52:22.633321 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1047/2080] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:22.635388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-11564703-e6e7-4a7d-8085-d88221066731 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc42250e4c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.644777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11564703-e6e7-4a7d-8085-d88221066731 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.645243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11564703-e6e7-4a7d-8085-d88221066731 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.654195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.655258 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-11564703-e6e7-4a7d-8085-d88221066731 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 200 len: 12 microversion: 2.26 time: 0.029418 May 07 21:52:22.656477 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1034/2081] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:52:22 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:22.669317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:22.673897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af4a8376-8b25-4b0b-9a64-dcde470f4023 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc42250e430>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.685611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.686579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.688486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.689590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.700349 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af4a8376-8b25-4b0b-9a64-dcde470f4023 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1278862996" status: 202 len: 0 microversion: 2.1 time: 0.042357 May 07 21:52:22.701748 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1035/2082] 10.222.0.32 () {58 vars in 1277 bytes} [Sat May 7 21:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1278862996 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:22.708345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.709641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:22.719873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.722041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.723180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:22.724538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:22.936353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:22.947844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:22.959468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b6e1cf7-5f80-4103-b0d6-a73b78b4d962 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1320 microversion: 2.1 time: 0.256141 May 07 21:52:22.960237 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1036/2083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:22 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:22.969396 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c33e403d-8f70-4198-8027-80d6d3b02bb3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.328421 May 07 21:52:22.973882 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1048/2084] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:22 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:22.978438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e7f5c3fc-1956-4965-8635-e28ba378000c tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] Calling method '.version_select at 0x7fc4226a45e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.978743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3974f462-a997-404c-9eba-4e1b6e1563f9 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:22.979443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3974f462-a997-404c-9eba-4e1b6e1563f9 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:23.048399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3974f462-a997-404c-9eba-4e1b6e1563f9 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:23.058236 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3974f462-a997-404c-9eba-4e1b6e1563f9 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1245 microversion: 2.1 time: 0.083221 May 07 21:52:23.059715 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1049/2085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:22 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:23.072393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-afa85cb7-f782-4d23-9b98-20f2f93850c2 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] Calling method '.version_select at 0x7fc41d73cd30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:23.125103 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-afa85cb7-f782-4d23-9b98-20f2f93850c2 tempest-KeyPairsV2TestJSON-1857793092 tempest-KeyPairsV2TestJSON-1857793092-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-780509195" status: 202 len: 0 microversion: 2.1 time: 0.036895 May 07 21:52:23.134645 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1050/2086] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-780509195 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:23.146078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc41ca84af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:23.209100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.215550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.216238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:23.241869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.242898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.243686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.253762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.307451 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e7f5c3fc-1956-4965-8635-e28ba378000c tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/d0e4d467-e7ed-4654-ac7a-667b8a7ccb40" status: 202 len: 0 microversion: 2.1 time: 0.334849 May 07 21:52:23.312341 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1037/2087] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:22 2022] DELETE /compute/v2.1/os-security-groups/d0e4d467-e7ed-4654-ac7a-667b8a7ccb40 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:23.318366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "81adfd75-e86e-4ab0-a95b-5663589c83d6"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:23.321251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:23.344262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.344718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.347486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.349472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.352959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.353682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.385642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:23.434512 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-528cdbda-1cd2-4b56-a419-bea20ac21b5f tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 204 len: 0 microversion: 2.26 time: 0.298054 May 07 21:52:23.436658 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1051/2088] 10.222.0.32 () {60 vars in 1294 bytes} [Sat May 7 21:52:23 2022] DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:23.451979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-797e5bc8-c68f-460e-849b-b03ba8f50753 tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] Calling method '.version_select at 0x7fc41d573ee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:23.518060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] HTTP exception thrown: Volume 08df160d-1ff7-431b-9acd-21ea16231f52 could not be found. May 07 21:52:23.524558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] Returning 404 to user: Volume 08df160d-1ff7-431b-9acd-21ea16231f52 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:23.525776 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69bab4c9-8b1a-445b-839c-2d486907651a tempest-VolumesAdminNegativeTest-2000688803 tempest-VolumesAdminNegativeTest-2000688803-project-admin] 10.222.0.32 "PUT /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments/08df160d-1ff7-431b-9acd-21ea16231f52" status: 404 len: 109 microversion: 2.1 time: 0.212197 May 07 21:52:23.528091 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1038/2089] 10.222.0.32 () {60 vars in 1432 bytes} [Sat May 7 21:52:23 2022] PUT /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af/os-volume_attachments/08df160d-1ff7-431b-9acd-21ea16231f52 => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:23.534444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc42250e550>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:23.563281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.570414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.578807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:23.590258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.601051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.603979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.615446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.690642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.708910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.741512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.749811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.819799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:23.875019 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-01e31d49-9ed3-4596-9e68-f3bc78550cfb tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1026753339" status: 201 len: 0 microversion: 2.26 time: 0.343492 May 07 21:52:23.880264 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1039/2090] 10.222.0.32 () {62 vars in 1379 bytes} [Sat May 7 21:52:23 2022] PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1026753339 => generated 0 bytes in 351 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 07 21:52:23.896608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc42250eee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:23.931534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.932346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.933023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:23.953193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.954589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:23.954589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:23.954946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.035551 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-797e5bc8-c68f-460e-849b-b03ba8f50753 tempest-SecurityGroupsTestAdminJSON-1190420583 tempest-SecurityGroupsTestAdminJSON-1190420583-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/203f5d51-b685-4bb0-afef-4c49b516a3b4" status: 202 len: 0 microversion: 2.1 time: 0.596042 May 07 21:52:24.036435 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1052/2091] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:23 2022] DELETE /compute/v2.1/os-security-groups/203f5d51-b685-4bb0-afef-4c49b516a3b4 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:24.064632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.067415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.077660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:24.082234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:24.106855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.113326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.133291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.135439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.140287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.141680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.190035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:24.262969 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b77eec8a-6717-43b0-8b51-5b3c576ad77a tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-416278253" status: 201 len: 0 microversion: 2.26 time: 0.379948 May 07 21:52:24.274620 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1040/2092] 10.222.0.32 () {62 vars in 1376 bytes} [Sat May 7 21:52:23 2022] PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-416278253 => generated 0 bytes in 393 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 07 21:52:24.300090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:24.301064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:24.309367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.309875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.310625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.313463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.666237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:24.686009 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12127e06-6236-4436-a32c-3e551c5037de tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 200 len: 1508 microversion: 2.1 time: 0.635075 May 07 21:52:24.686620 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1053/2093] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:24 2022] GET /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:24.714839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:24.716122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:24.717234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:24.725105 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8003e851-1db0-47e4-8664-514acf6e37b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 0.449161 May 07 21:52:24.734926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.735468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.738151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.740317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.747624 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1041/2094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:24 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:24.761299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc4225d45e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:24.812454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.818365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.819970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:24.845976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.852250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.857962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.859319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.903631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:24.904420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:24.937563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:24.986477 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69d542f5-39b2-4a64-a648-f296f5408125 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 204 len: 0 microversion: 2.26 time: 0.237318 May 07 21:52:24.991718 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1042/2095] 10.222.0.32 () {60 vars in 1294 bytes} [Sat May 7 21:52:24 2022] DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:24.999188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-57d61c71-ea5a-4a24-9aba-703b6f6b93b4 req-3d697214-80fb-4589-b9e1-26177ff58e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "name": "network-vif-plugged", "status": "completed", "tag": "f7bd0dbf-a440-4d9e-8f71-48688376777e"}, {"server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "name": "network-vif-plugged", "status": "completed", "tag": "bb1a4932-726b-4649-982e-cde502e2aff1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:25.017279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-57d61c71-ea5a-4a24-9aba-703b6f6b93b4 req-3d697214-80fb-4589-b9e1-26177ff58e4b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.018016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-57d61c71-ea5a-4a24-9aba-703b6f6b93b4 req-3d697214-80fb-4589-b9e1-26177ff58e4b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.032983 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-57d61c71-ea5a-4a24-9aba-703b6f6b93b4 req-3d697214-80fb-4589-b9e1-26177ff58e4b service nova] Creating event network-vif-plugged:f7bd0dbf-a440-4d9e-8f71-48688376777e for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:25.033756 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-57d61c71-ea5a-4a24-9aba-703b6f6b93b4 req-3d697214-80fb-4589-b9e1-26177ff58e4b service nova] Creating event network-vif-plugged:bb1a4932-726b-4649-982e-cde502e2aff1 for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:25.040651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-57d61c71-ea5a-4a24-9aba-703b6f6b93b4 req-3d697214-80fb-4589-b9e1-26177ff58e4b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046062 May 07 21:52:25.041806 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1043/2096] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:25.049500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:25.053444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 291bb30f-04fe-44bf-a1e3-ab8f39264f74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:25.082095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.083057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.085973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.087794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.321636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:25.335302 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3c49333-5feb-4522-96b8-b63a85210bca tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1297 microversion: 2.1 time: 0.637859 May 07 21:52:25.337457 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1054/2097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:24 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1297 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:25.366809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4494556b-90d8-402f-b100-a3529fbb0fad tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc41d4790d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:25.430260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4494556b-90d8-402f-b100-a3529fbb0fad tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.433103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4494556b-90d8-402f-b100-a3529fbb0fad tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.477613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:25.478798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4494556b-90d8-402f-b100-a3529fbb0fad tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 200 len: 12 microversion: 2.26 time: 0.138722 May 07 21:52:25.482095 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1055/2098] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:52:25 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 12 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:25.491213 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ef55e66-8578-47c6-9193-fd8fbbc83914 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/291bb30f-04fe-44bf-a1e3-ab8f39264f74" status: 200 len: 1507 microversion: 2.1 time: 0.447919 May 07 21:52:25.491768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1044/2099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:25 2022] GET /compute/v2.1/servers/291bb30f-04fe-44bf-a1e3-ab8f39264f74 => generated 1507 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:25.496929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc41caad160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:25.508287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:25.509280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 291bb30f-04fe-44bf-a1e3-ab8f39264f74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:25.519282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.520470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.521264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.521826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.522157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.524356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:25.524877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.544649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.547249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.550795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.551618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.594430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 291bb30f-04fe-44bf-a1e3-ab8f39264f74] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:52:25.647063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.648338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.678018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:25.705932 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-765ebeaa-2171-4ecb-9af9-9762430a4c34 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 204 len: 0 microversion: 2.26 time: 0.216783 May 07 21:52:25.707376 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1056/2100] 10.222.0.32 () {60 vars in 1294 bytes} [Sat May 7 21:52:25 2022] DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:25.717927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc41ce36dc0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:25.729874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.730915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.731889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:25.740432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.741148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.744241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.745044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.781191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.782224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.802081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.803616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.818011 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d0f58a0c-896e-48cf-86b9-f8a4e1fee96b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "DELETE /compute/v2.1/servers/291bb30f-04fe-44bf-a1e3-ab8f39264f74" status: 204 len: 0 microversion: 2.1 time: 0.313540 May 07 21:52:25.820306 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1045/2101] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:52:25 2022] DELETE /compute/v2.1/servers/291bb30f-04fe-44bf-a1e3-ab8f39264f74 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:52:25.837214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:25.839411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:25.853487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.861984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.865957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.866625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:25.900201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:25.938306 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8fe6e3ce-ce2e-468a-87c8-46b6c1596379 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-90304054" status: 201 len: 0 microversion: 2.26 time: 0.223501 May 07 21:52:25.941637 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1057/2102] 10.222.0.32 () {62 vars in 1373 bytes} [Sat May 7 21:52:25 2022] PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-90304054 => generated 0 bytes in 228 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) May 07 21:52:25.956582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:25.959557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:25.976079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:25.977307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.000019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.001742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.115717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 510e9ced-c683-45b2-bff6-88ab05c23bb6] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:52:26.401809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fc41d0b6-1b35-4808-bfdf-3237c46765f4 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "DELETE /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6" status: 204 len: 0 microversion: 2.1 time: 0.455940 May 07 21:52:26.407338 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1058/2103] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:52:25 2022] DELETE /compute/v2.1/servers/510e9ced-c683-45b2-bff6-88ab05c23bb6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:52:26.418360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc41cc08c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:26.460666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.474982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.482588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:26.506792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.507327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.508289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.508777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.623967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.625288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.648051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.651352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.718946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:26.778546 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff48bcb2-63b8-4384-9861-fa0f6e047321 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1193868087" status: 201 len: 0 microversion: 2.26 time: 0.365808 May 07 21:52:26.780218 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1059/2104] 10.222.0.32 () {62 vars in 1379 bytes} [Sat May 7 21:52:26 2022] PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags/tempest-tag-1193868087 => generated 0 bytes in 372 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 07 21:52:26.791103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:26.799982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:26.825870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:26.827010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.827846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.833058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.842820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.848608 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ca7a2ec6-b765-4fdb-a6cf-6e0216287530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 1.026737 May 07 21:52:26.859239 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1046/2105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:25 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:26.859239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:26.859520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:26.903339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.903802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.904718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:26.905022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:26.968012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:52:27.129916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:27.134061 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-19f7e552-8c7f-46b3-9f33-0407ec016da4 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1303 microversion: 2.1 time: 0.280368 May 07 21:52:27.142147 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1047/2106] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:26 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1303 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:27.177831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1154913858", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "2b0d1583-486b-43fb-abb3-b530c0697dca"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:27.333418 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c984a5ff-8918-4e0f-a098-2af12fd16e15 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "DELETE /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 204 len: 0 microversion: 2.1 time: 0.551825 May 07 21:52:27.334304 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1060/2107] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:52:26 2022] DELETE /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:52:27.347221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] validate_networks() for [('2b0d1583-486b-43fb-abb3-b530c0697dca', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:52:27.358145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Action: 'update_all', calling method: .version_select at 0x7fc41d2fb790>, body: {"tags": ["tempest-tag-713286441", "tempest-tag-461095760"]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:27.405460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:27.406276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:27.427391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:27.449704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:27.463584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:27.467444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:27.473746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:27.537520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:27.538260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:27.576781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:27.621954 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a7ce45bb-6bc2-4fe1-9ee5-fb85f7ff3646 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 200 len: 60 microversion: 2.26 time: 0.286180 May 07 21:52:27.623450 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1061/2108] 10.222.0.32 () {62 vars in 1311 bytes} [Sat May 7 21:52:27 2022] PUT /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 60 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:27.631952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ed81af2f-399f-4c15-8559-8b582418996d req-4bd9fcb8-5bd9-4c9d-983a-27c931cf9f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "name": "network-vif-plugged", "status": "completed", "tag": "df7809e8-4b3a-419d-9177-98b732729c4a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:27.656285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ed81af2f-399f-4c15-8559-8b582418996d req-4bd9fcb8-5bd9-4c9d-983a-27c931cf9f2e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:27.660816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ed81af2f-399f-4c15-8559-8b582418996d req-4bd9fcb8-5bd9-4c9d-983a-27c931cf9f2e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:27.698395 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ed81af2f-399f-4c15-8559-8b582418996d req-4bd9fcb8-5bd9-4c9d-983a-27c931cf9f2e service nova] Creating event network-vif-plugged:df7809e8-4b3a-419d-9177-98b732729c4a for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:27.711664 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ed81af2f-399f-4c15-8559-8b582418996d req-4bd9fcb8-5bd9-4c9d-983a-27c931cf9f2e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086092 May 07 21:52:27.714145 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1062/2109] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:27.725536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:27.727686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:27.746051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:27.746845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:27.747994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:27.748703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:28.224954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:28.227255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:28.228110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:28.230155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:28.231052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:28.242716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:28.243595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:28.244742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:28.245658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:28.277717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Getting quotas for project aae91bd9874141989a0896953655d3de. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:28.283947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Getting quotas for user 8e35b8f3a2eb4ed98800638dd51618ff and project aae91bd9874141989a0896953655d3de. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:28.299687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Going to run 2 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:52:28.302969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 4deb7455-0b67-4b88-9494-f544b1b73fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:28.354332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=4deb7455-0b67-4b88-9494-f544b1b73fce,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:28.463386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:28.468276 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86b3c4fc-4c29-482d-a3f9-ebb32f817bab tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.318631 May 07 21:52:28.473150 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1048/2110] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:52:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 07 21:52:28.480384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8747897-9297-48c5-a807-a6499e0c5a30 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc4225671f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:28.504729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8747897-9297-48c5-a807-a6499e0c5a30 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:28.506226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8747897-9297-48c5-a807-a6499e0c5a30 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:28.522960 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2c07fc7-d91c-4a78-88e3-3f065f105590 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1513 microversion: 2.1 time: 0.757501 May 07 21:52:28.524960 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1063/2111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:27 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1513 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:28.531101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:28.532375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:28.542990 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c8747897-9297-48c5-a807-a6499e0c5a30 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 200 len: 60 microversion: 2.26 time: 0.067764 May 07 21:52:28.548934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:28.549738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:28.550843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:28.551449 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1049/2112] 10.222.0.32 () {60 vars in 1291 bytes} [Sat May 7 21:52:28 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 60 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:28.551703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:28.559314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:28.562015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:28.594115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:28.597571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:28.598704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:28.601474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:29.588974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:29.604402 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d3a90320-cb1b-483e-a9dd-6c377927cdbb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 1.051746 May 07 21:52:29.605021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1050/2113] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:28 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:29.631745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:29.642628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:29.643715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Searching by: {'deleted': False, 'project_id': 'aae91bd9874141989a0896953655d3de'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:52:29.687932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:29.688338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:29.689136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:29.689580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:29.780342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:52:29.880290 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-46f0442a-843f-49e1-8ec0-cb9d842bad6b tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.267236 May 07 21:52:29.880882 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1051/2114] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:52:29 2022] GET /compute/v2.1/servers => generated 1337 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:29.901413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '.version_select at 0x7fc4225cfb80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:29.924724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:29.927411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:29.929022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:29.961551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:29.962552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:29.979200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:29.979941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.073052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.078967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.118537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'flavor' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:30.151873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:30.168157 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f9d6cf24-0810-4024-9d8a-f3f4838f1e31 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 1.641778 May 07 21:52:30.172587 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1064/2115] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:28 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:30.177209 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a689861e-f03c-4025-8d7a-ee3d97a53dbc tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags" status: 204 len: 0 microversion: 2.26 time: 0.295077 May 07 21:52:30.178209 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1052/2116] 10.222.0.32 () {60 vars in 1294 bytes} [Sat May 7 21:52:29 2022] DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5/tags => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:30.193295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:30.198513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:30.206509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:30.217935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:30.236437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.241013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.244261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.247907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.252587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.253302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.263525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.266346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.436776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:30.450689 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12efd443-94e6-4174-aeff-dde0c5903c3d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1222 microversion: 2.1 time: 0.263008 May 07 21:52:30.453980 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1053/2117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:30 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1222 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:30.472495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:30.478281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:30.503269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.509388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.516753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.517565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.604209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:52:30.822467 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8c62584d-d96e-456a-b790-d9e52c68bd78 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 204 len: 0 microversion: 2.26 time: 0.364512 May 07 21:52:30.823572 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1054/2118] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:52:30 2022] DELETE /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:52:30.849344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:30.852560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:30.881053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.881522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:30.887689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:30.889801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:31.376135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:31.392369 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2257cda2-2889-40bd-9c70-6b8da9111393 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1513 microversion: 2.1 time: 1.217976 May 07 21:52:31.393572 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1065/2119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:30 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1513 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:31.401594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:31.403737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:31.416779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:31.418384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:31.419652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:31.420752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:31.605540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:31.614106 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-74316817-b799-4e46-9bf6-1eb9ad7d770d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.789255 May 07 21:52:31.619621 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1055/2120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:30 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:31.632043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:31.644747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:31.656927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:31.663363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:31.665239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:31.669857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:32.491117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:32.507868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:32.510269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:32.511819 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fe1b79f0-98cd-4d34-86a2-92ff4ee6c632 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1551 microversion: 2.26 time: 1.116254 May 07 21:52:32.522654 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1066/2121] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:31 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1551 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:32.528572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:32.539753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:32.554380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:32.555250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:32.556419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:32.561991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:32.690982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:32.707225 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-399803ca-705b-402f-88b4-d0f42ac42910 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1354 microversion: 2.1 time: 1.086102 May 07 21:52:32.724084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1056/2122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:31 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1354 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:32.784646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:32.802159 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f968105b-ba1f-4960-af8b-5a2a874b8b03 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1278 microversion: 2.1 time: 0.277249 May 07 21:52:32.806236 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1067/2123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:32 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:32.823021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5bb80174-f57e-4ce0-9fe6-5e4c67e2460a req-915c7f62-deb4-4896-b742-bf8ca1fccc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510e9ced-c683-45b2-bff6-88ab05c23bb6", "name": "network-vif-unplugged", "status": "completed", "tag": "9dc2b760-de86-4db6-bfb4-a511993e37c6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:32.850049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5bb80174-f57e-4ce0-9fe6-5e4c67e2460a req-915c7f62-deb4-4896-b742-bf8ca1fccc58 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:32.850921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5bb80174-f57e-4ce0-9fe6-5e4c67e2460a req-915c7f62-deb4-4896-b742-bf8ca1fccc58 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:32.877615 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5bb80174-f57e-4ce0-9fe6-5e4c67e2460a req-915c7f62-deb4-4896-b742-bf8ca1fccc58 service nova] Creating event network-vif-unplugged:9dc2b760-de86-4db6-bfb4-a511993e37c6 for instance 510e9ced-c683-45b2-bff6-88ab05c23bb6 on nch1-master-1 May 07 21:52:32.896379 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5bb80174-f57e-4ce0-9fe6-5e4c67e2460a req-915c7f62-deb4-4896-b742-bf8ca1fccc58 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087205 May 07 21:52:32.899735 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1068/2124] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:32.910992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ea6bf0ba-0a58-4c1c-958a-c3c340a44deb req-d665ed2f-64a1-402f-8a03-3b85f8d9920a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291bb30f-04fe-44bf-a1e3-ab8f39264f74", "name": "network-vif-deleted", "tag": "3f62d3bb-3e19-4105-8761-7215be7ce835"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:32.935395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ea6bf0ba-0a58-4c1c-958a-c3c340a44deb req-d665ed2f-64a1-402f-8a03-3b85f8d9920a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:32.936427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ea6bf0ba-0a58-4c1c-958a-c3c340a44deb req-d665ed2f-64a1-402f-8a03-3b85f8d9920a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:32.955061 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ea6bf0ba-0a58-4c1c-958a-c3c340a44deb req-d665ed2f-64a1-402f-8a03-3b85f8d9920a service nova] Creating event network-vif-deleted:3f62d3bb-3e19-4105-8761-7215be7ce835 for instance 291bb30f-04fe-44bf-a1e3-ab8f39264f74 on nch1-master-1 May 07 21:52:32.961548 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ea6bf0ba-0a58-4c1c-958a-c3c340a44deb req-d665ed2f-64a1-402f-8a03-3b85f8d9920a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056831 May 07 21:52:32.962742 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1069/2125] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:32.971514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:32.972784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:32.984014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:32.985035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:32.986069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:32.986811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:33.024697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2012714840", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:33.205384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:52:33.579934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:33.593832 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aab70c4d-9d10-4599-aa51-a27a2dd011e7 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1471 microversion: 2.1 time: 0.627225 May 07 21:52:33.594796 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1070/2126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:32 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1471 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:33.610149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:33.611555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:33.635564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:33.637205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:33.640929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:33.642627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:33.882225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:33.883858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:33.884503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:33.885081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:33.885665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:33.901916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:33.905027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:33.906167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:33.906858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:33.947803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Getting quotas for project 4642753b5d1548038be79eb12ce7b20b. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:33.953995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Getting quotas for user bc1c955ccc0c48dcbb11eba3718d7865 and project 4642753b5d1548038be79eb12ce7b20b. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:33.985632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:52:34.000498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:34.074660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bfa8ac46-5137-4450-8be2-4479336a6f17 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349224 May 07 21:52:34.075822 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1057/2127] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:52:34.081337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a4e3bebc-2260-4843-9002-ae7dae028c83 req-8e5aa89a-c76b-4cc3-95e6-b6d62a67d3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297e9f98-e053-44b1-af31-98785ad115af", "name": "network-vif-deleted", "tag": "c398ed68-1c9f-4a4c-92f2-c58a298dedb0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:34.095333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a4e3bebc-2260-4843-9002-ae7dae028c83 req-8e5aa89a-c76b-4cc3-95e6-b6d62a67d3ed service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.095989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a4e3bebc-2260-4843-9002-ae7dae028c83 req-8e5aa89a-c76b-4cc3-95e6-b6d62a67d3ed service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.109812 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a4e3bebc-2260-4843-9002-ae7dae028c83 req-8e5aa89a-c76b-4cc3-95e6-b6d62a67d3ed service nova] Creating event network-vif-deleted:c398ed68-1c9f-4a4c-92f2-c58a298dedb0 for instance 297e9f98-e053-44b1-af31-98785ad115af on nch2-master-1 May 07 21:52:34.125512 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a4e3bebc-2260-4843-9002-ae7dae028c83 req-8e5aa89a-c76b-4cc3-95e6-b6d62a67d3ed service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048153 May 07 21:52:34.126350 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1058/2128] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:34.152302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:34.153461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:34.160458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.161097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.161983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.162585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.470473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:34.483381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:34.485148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:34.486392 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1906e8f-88c9-4d12-bd8e-822873402c04 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1551 microversion: 2.26 time: 0.343634 May 07 21:52:34.490938 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1059/2129] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:34 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1551 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:34.508459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:34.509339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:34.522401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.524464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.525431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.532170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.840491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:34.853893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:34.859506 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c922e3bb-4925-43c6-b056-9b6a73a62e06 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1803 microversion: 2.1 time: 0.366932 May 07 21:52:34.861409 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1060/2130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:34 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1803 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:34.867573 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-966c8052-a282-4070-be81-48e6e4c07ba0 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 1.271520 May 07 21:52:34.868519 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1071/2131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:33 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:34.881386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:34.882153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:34.887222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:34.887222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:34.893720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.897787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.905398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.907109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.907486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.908064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:34.909251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:34.909894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:35.052529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:35.069575 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-600cca73-af84-4cb2-b735-633591a81412 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1288 microversion: 2.1 time: 0.205616 May 07 21:52:35.071552 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1061/2132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:34 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1288 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:35.222235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5c5c2e8-ba9a-4688-90b3-8df7186d2042 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4225d4280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-265076914", "description": "tempest-description-54162938"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:35.496935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:35.519377 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3e40622f-b155-461f-90ba-46e02fd9be3f tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1227 microversion: 2.1 time: 0.648011 May 07 21:52:35.526158 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1072/2133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:34 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1227 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:35.556179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:35.557374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:35.565002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:35.569680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:35.572152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:35.577069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.073060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5c5c2e8-ba9a-4688-90b3-8df7186d2042 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.998931 May 07 21:52:36.074690 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1062/2134] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:35 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:36.082286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef865068-e6cc-4e8c-bf4e-49684178db2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:36.083287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef865068-e6cc-4e8c-bf4e-49684178db2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:36.107784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:36.115462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef865068-e6cc-4e8c-bf4e-49684178db2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:36.116209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef865068-e6cc-4e8c-bf4e-49684178db2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.119598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef865068-e6cc-4e8c-bf4e-49684178db2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:36.120162 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c27558c9-e338-4413-8ffe-3fb31b7b7228 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1303 microversion: 2.1 time: 0.587809 May 07 21:52:36.120635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef865068-e6cc-4e8c-bf4e-49684178db2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.123133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1073/2135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:35 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1303 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:36.128305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:36.142077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:36.159796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:36.169792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.183952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:36.187118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.237119 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef865068-e6cc-4e8c-bf4e-49684178db2b tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273/ips" status: 200 len: 217 microversion: 2.1 time: 0.160829 May 07 21:52:36.241554 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1063/2136] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 21:52:36 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273/ips => generated 217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:36.266212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-40dd317e-74f9-470a-9bc4-d71edc97848b req-36087b97-013b-4d81-a9ad-578ab51470f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "510e9ced-c683-45b2-bff6-88ab05c23bb6", "name": "network-vif-deleted", "tag": "9dc2b760-de86-4db6-bfb4-a511993e37c6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:36.280122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-40dd317e-74f9-470a-9bc4-d71edc97848b req-36087b97-013b-4d81-a9ad-578ab51470f8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:36.295554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-40dd317e-74f9-470a-9bc4-d71edc97848b req-36087b97-013b-4d81-a9ad-578ab51470f8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.327640 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-40dd317e-74f9-470a-9bc4-d71edc97848b req-36087b97-013b-4d81-a9ad-578ab51470f8 service nova] Creating event network-vif-deleted:9dc2b760-de86-4db6-bfb4-a511993e37c6 for instance 510e9ced-c683-45b2-bff6-88ab05c23bb6 on nch1-master-1 May 07 21:52:36.333637 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-40dd317e-74f9-470a-9bc4-d71edc97848b req-36087b97-013b-4d81-a9ad-578ab51470f8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090307 May 07 21:52:36.335034 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1064/2137] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:36.343386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:36.347926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:36.370570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:36.377120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.378259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:36.378966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:36.836223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:36.847177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91055088-602a-46b0-8b5a-72b0561906f1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.509727 May 07 21:52:36.848601 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1065/2138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:36 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:36.855219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-107d3c11-743d-4d4a-b1c2-f06a915b6a19 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224c7ee0>, body: {"security_group_rule": {"parent_group_id": "5477615f-d78c-49b0-a8c4-eec43baa1312", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:37.393824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:37.416183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:37.424307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:37.438714 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-107d3c11-743d-4d4a-b1c2-f06a915b6a19 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.588735 May 07 21:52:37.439840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f011dfca-7db8-445a-8e17-8679c42fecd6 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1551 microversion: 2.26 time: 1.312595 May 07 21:52:37.447493 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1066/2139] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:37.453777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:37.454641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:37.456318 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1074/2140] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:36 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1551 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:37.462248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.463093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.464151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.464756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.476188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:37.490764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:37.520105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.521788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.524992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.527632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.602400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:52:37.625083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:37.654078 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3871f763-7731-4539-9966-ecce9986478a tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1276 microversion: 2.1 time: 0.205074 May 07 21:52:37.681307 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1067/2141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:37 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:37.686161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:37.686815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:37.702844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.703311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.704126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.704570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.716043 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f66f7497-0037-41d1-8548-7c5b342fd362 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 204 len: 0 microversion: 2.1 time: 0.257325 May 07 21:52:37.717588 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1075/2142] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:52:37 2022] DELETE /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:52:37.726423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-36822c92-0f7a-4e40-a75b-0caaf1f606ef req-7cc39c8e-d549-4e87-a21c-8a4100f65ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4deb7455-0b67-4b88-9494-f544b1b73fce", "tag": "8bb18da3-f8df-435d-b4c9-cb0c6b3e540d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:37.744312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-36822c92-0f7a-4e40-a75b-0caaf1f606ef req-7cc39c8e-d549-4e87-a21c-8a4100f65ee7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.745414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-36822c92-0f7a-4e40-a75b-0caaf1f606ef req-7cc39c8e-d549-4e87-a21c-8a4100f65ee7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.765955 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-36822c92-0f7a-4e40-a75b-0caaf1f606ef req-7cc39c8e-d549-4e87-a21c-8a4100f65ee7 service nova] Creating event network-changed:8bb18da3-f8df-435d-b4c9-cb0c6b3e540d for instance 4deb7455-0b67-4b88-9494-f544b1b73fce on nch1-master-1 May 07 21:52:37.780609 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-36822c92-0f7a-4e40-a75b-0caaf1f606ef req-7cc39c8e-d549-4e87-a21c-8a4100f65ee7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060991 May 07 21:52:37.781509 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1076/2143] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:37.790395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:37.798144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:37.814306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.815153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.816169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.819572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.856323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:37.869088 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3459ba7d-fe66-43cd-816e-dc1d54859913 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1281 microversion: 2.1 time: 0.186598 May 07 21:52:37.869874 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1068/2144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:37 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:37.876446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1e2daa4-2289-4ff4-8d64-7d2389d6833f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224c7280>, body: {"security_group_rule": {"parent_group_id": "5477615f-d78c-49b0-a8c4-eec43baa1312", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:37.897943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.898949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.899423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lazy-loading 'fault' on Instance uuid 297e9f98-e053-44b1-af31-98785ad115af {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:37.948956 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-e1e2daa4-2289-4ff4-8d64-7d2389d6833f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: This rule already exists in group 5477615f-d78c-49b0-a8c4-eec43baa1312 May 07 21:52:37.949646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1e2daa4-2289-4ff4-8d64-7d2389d6833f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 400 to user: This rule already exists in group 5477615f-d78c-49b0-a8c4-eec43baa1312 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:37.950575 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1e2daa4-2289-4ff4-8d64-7d2389d6833f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.079260 May 07 21:52:37.956033 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1069/2145] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:37 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:52:37.961968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:37.963592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:37.971916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.978194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:37.984400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:37.984955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.248466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:38.265389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be26cd5d-5fcb-46df-84cb-7da49602c83e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1809 microversion: 2.1 time: 0.307516 May 07 21:52:38.270638 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1070/2146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:37 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:38.276626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:38.280523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:38.291924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:38.299876 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c5ed711c-f294-4ba9-8048-9058faf02c3a tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1308 microversion: 2.1 time: 0.515832 May 07 21:52:38.300463 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1077/2147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:37 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1308 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:38.300966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.301817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.302901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.303546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.314038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91e39102-1ed9-470a-ba8f-c4496041397d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Calling method '.version_select at 0x7fc41ca84d30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:38.524846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:38.534047 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c41ee579-17f8-4e8c-9c15-c1d4e2912d9d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.261973 May 07 21:52:38.535109 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1071/2148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:38 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:38.540433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:38.541634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:38.548378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.549426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.551390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.552075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.598097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.598701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.599466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lazy-loading 'fault' on Instance uuid 094c249f-bac0-48b7-be4c-614af1acfbf5 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:38.671252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:38.682049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:38.687076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eedcf10ae62840029976cb842190a948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1cd49355d840abbda4ccda9d86705f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:38.691781 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f373bf5-9c45-458f-bca4-aa099bc31603 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 200 len: 1351 microversion: 2.26 time: 0.155305 May 07 21:52:38.695318 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1072/2149] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:38 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 1351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:38.711511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:38.712556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:38.726905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.728071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.730537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.731229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.853850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:38.861997 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9c7f4c5-81a0-4836-8182-0928f1e8d2fc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1276 microversion: 2.1 time: 0.164476 May 07 21:52:38.862814 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1073/2150] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:38 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:38.867847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-013ca5f2-c3a3-4d46-8c8e-bd86734c9675 req-8f3080bc-ef49-4278-8695-5035e352f2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094c249f-bac0-48b7-be4c-614af1acfbf5", "name": "network-vif-deleted", "tag": "5bf0d3b1-6d14-4171-84b6-a6256304ad16"}, {"name": "network-changed", "server_uuid": "83fafb82-09d3-47de-827f-770202f22005", "tag": "0cb8be1d-eb20-4313-adab-53f509d88a67"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:38.878260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-013ca5f2-c3a3-4d46-8c8e-bd86734c9675 req-8f3080bc-ef49-4278-8695-5035e352f2e5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.878712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-013ca5f2-c3a3-4d46-8c8e-bd86734c9675 req-8f3080bc-ef49-4278-8695-5035e352f2e5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.894017 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-013ca5f2-c3a3-4d46-8c8e-bd86734c9675 req-8f3080bc-ef49-4278-8695-5035e352f2e5 service nova] Creating event network-vif-deleted:5bf0d3b1-6d14-4171-84b6-a6256304ad16 for instance 094c249f-bac0-48b7-be4c-614af1acfbf5 on nch1-master-1 May 07 21:52:38.894534 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-013ca5f2-c3a3-4d46-8c8e-bd86734c9675 req-8f3080bc-ef49-4278-8695-5035e352f2e5 service nova] Creating event network-changed:0cb8be1d-eb20-4313-adab-53f509d88a67 for instance 83fafb82-09d3-47de-827f-770202f22005 on nch2-master-1 May 07 21:52:38.904208 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-013ca5f2-c3a3-4d46-8c8e-bd86734c9675 req-8f3080bc-ef49-4278-8695-5035e352f2e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039679 May 07 21:52:38.904996 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1074/2151] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:38.909978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:38.910809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:38.917261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.917741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.918522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:38.919591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:38.999086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:39.009475 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c04932b-0d1e-49b1-8e7e-c9c3ff6fbb62 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1281 microversion: 2.1 time: 0.103416 May 07 21:52:39.019432 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1075/2152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:38 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:39.228322 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91e39102-1ed9-470a-ba8f-c4496041397d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-group-rules/e4071293-0210-440c-9790-0e86567fb105" status: 202 len: 0 microversion: 2.1 time: 0.926744 May 07 21:52:39.229604 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1078/2153] 10.222.0.32 () {58 vars in 1286 bytes} [Sat May 7 21:52:38 2022] DELETE /compute/v2.1/os-security-group-rules/e4071293-0210-440c-9790-0e86567fb105 => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:39.238791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e36fd62c-16af-4ff7-a4b4-2730a85b8535 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc41cab0af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1917636923", "description": "tempest-description-1852186006"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:39.290888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:39.291759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:39.299815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:39.300613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:39.301513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:39.302067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:39.407196 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e36fd62c-16af-4ff7-a4b4-2730a85b8535 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.172000 May 07 21:52:39.414269 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1076/2154] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:39 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:39.419437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:39.420110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:39.426166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:39.426622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:39.427440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:39.427883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:39.460317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:39.460831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:39.461900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lazy-loading 'fault' on Instance uuid 297e9f98-e053-44b1-af31-98785ad115af {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:52:39.517936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '809d6c48e931489cba4e521b9a42e097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85f29512cce1477d94e91ae394ecbbcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:39.532100 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d340ad67-932f-45be-ad82-8a79e7c4a459 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 200 len: 1308 microversion: 2.1 time: 0.116510 May 07 21:52:39.533764 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1077/2155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:39 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:39.539926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00af2099-ba2f-4fe2-be70-f249a6270728 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc422618ca0>, body: {"security_group_rule": {"parent_group_id": "23dc9e30-b444-489e-974c-08338f2f965a", "ip_protocol": "tcp", "from_port": 1312305900, "to_port": 22}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:39.628483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:39.638919 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0832bfe8-145d-4e79-9d3c-51492eb905f6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1809 microversion: 2.1 time: 0.355090 May 07 21:52:39.639523 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1079/2156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:39 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1809 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:39.644914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:39.646492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:39.659133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:39.659894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:39.661609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:39.662240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:39.665230 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-00af2099-ba2f-4fe2-be70-f249a6270728 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: Invalid port range 1312305900:22. Former value cannot be greater than the later May 07 21:52:39.666884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00af2099-ba2f-4fe2-be70-f249a6270728 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 400 to user: Invalid port range 1312305900:22. Former value cannot be greater than the later {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:39.667974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00af2099-ba2f-4fe2-be70-f249a6270728 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.133056 May 07 21:52:39.669050 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1078/2157] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:39 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:52:39.681254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e3f59e7-d579-4e7b-832b-2cf095a3cdc5 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224f0040>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1558691336", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:39.684960 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-7e3f59e7-d579-4e7b-832b-2cf095a3cdc5 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: Security group id should be uuid May 07 21:52:39.685548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e3f59e7-d579-4e7b-832b-2cf095a3cdc5 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 400 to user: Security group id should be uuid {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:39.686390 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7e3f59e7-d579-4e7b-832b-2cf095a3cdc5 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009595 May 07 21:52:39.686966 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1079/2158] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:39 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:52:39.708235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be0a25aa-928b-4090-8001-a651e8a9df3d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224f0dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1655473339", "description": "tempest-description-1631133272"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:40.045108 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be0a25aa-928b-4090-8001-a651e8a9df3d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.348151 May 07 21:52:40.051542 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1080/2159] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:39 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:40.062263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:40.065372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] [instance: 094c249f-bac0-48b7-be4c-614af1acfbf5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:40.076536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.077279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.078262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.078906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.095687 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] HTTP exception thrown: Instance 094c249f-bac0-48b7-be4c-614af1acfbf5 could not be found. May 07 21:52:40.096375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] Returning 404 to user: Instance 094c249f-bac0-48b7-be4c-614af1acfbf5 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:40.098082 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f2482ea7-fe66-4af0-9c6f-cf8b7334c642 tempest-ServerTagsTestJSON-1974203414 tempest-ServerTagsTestJSON-1974203414-project] 10.222.0.32 "GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5" status: 404 len: 111 microversion: 2.26 time: 0.045215 May 07 21:52:40.099521 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1081/2160] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:40 2022] GET /compute/v2.1/servers/094c249f-bac0-48b7-be4c-614af1acfbf5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:52:40.105900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:40.106785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:40.115445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.116254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.117969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.118625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.423704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:40.461891 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c0db336-327f-493b-b216-71bf23cad611 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.814280 May 07 21:52:40.463578 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1080/2161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:39 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:40.471837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:40.474419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:40.491105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.494398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.495527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.498253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.499360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:40.507064 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47043aab-00c5-414b-ade0-2d6e26eb161d tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.405706 May 07 21:52:40.511895 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1082/2162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:40 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:40.523894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e8db037-e42d-483c-92ae-7a20eae1eac9 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224fe280>, body: {"security_group_rule": {"parent_group_id": "c14e41d7-1be8-413a-97d1-7878993279b2", "ip_protocol": "tempest-999-1608908007", "from_port": 22, "to_port": 22}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:40.855361 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-6e8db037-e42d-483c-92ae-7a20eae1eac9 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: Invalid IP protocol tempest-999-1608908007. May 07 21:52:40.858068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e8db037-e42d-483c-92ae-7a20eae1eac9 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 400 to user: Invalid IP protocol tempest-999-1608908007. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:40.865116 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e8db037-e42d-483c-92ae-7a20eae1eac9 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.350309 May 07 21:52:40.867115 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1083/2163] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:40 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:52:40.881043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:40.883104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] [instance: 297e9f98-e053-44b1-af31-98785ad115af] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:40.892802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.893573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.895881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.899689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.919105 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] HTTP exception thrown: Instance 297e9f98-e053-44b1-af31-98785ad115af could not be found. May 07 21:52:40.920057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] Returning 404 to user: Instance 297e9f98-e053-44b1-af31-98785ad115af could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:40.921636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0b92ac1b-4670-43b9-8caf-a626e42cf989 tempest-VolumesAdminNegativeTest-1445857849 tempest-VolumesAdminNegativeTest-1445857849-project] 10.222.0.32 "GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af" status: 404 len: 111 microversion: 2.1 time: 0.053056 May 07 21:52:40.926327 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1084/2164] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:40 2022] GET /compute/v2.1/servers/297e9f98-e053-44b1-af31-98785ad115af => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:40.929637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:40.933448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:40.934373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:40.941730 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d2020be3-9fb5-408c-b614-e61ff5fb9284 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.476797 May 07 21:52:40.951550 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1081/2165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:40 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:40.951550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb856b4a-b0db-4630-a275-3f2feb58cab8 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc41ca84550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2142503762", "description": "tempest-description-766446704"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:40.955168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.955930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:40.956988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:40.958396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:41.955340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:41.966274 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-acf2c5d5-b722-49aa-b698-acf1e9baff1c tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1809 microversion: 2.1 time: 1.038309 May 07 21:52:41.976197 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1085/2166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:40 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1809 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:41.978614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:41.979534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:41.990913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:41.992219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:41.993364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:41.993956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:42.181878 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb856b4a-b0db-4630-a275-3f2feb58cab8 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.237766 May 07 21:52:42.184522 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1082/2167] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:40 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:42.189539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:42.190461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:42.199187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:42.200030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:42.201087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:42.202027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:42.582058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:42.603011 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a971b2b1-fb41-4a8a-a1d6-56bb4a557a11 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.415496 May 07 21:52:42.607282 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1083/2168] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:42 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:42.650367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:42.651449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:42.668340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:42.669711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:42.670836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:42.671517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:42.800844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:42.808774 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-138fb84a-8f33-4a71-804b-26e8d265c1bb tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.840368 May 07 21:52:42.812466 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1086/2169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:41 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:42.824843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ebef01df-8a02-43f8-abf2-fa2487f72b19 req-6fd0df26-0ddc-4c5f-899d-0effbd3b847b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deb7455-0b67-4b88-9494-f544b1b73fce", "name": "network-vif-plugged", "status": "completed", "tag": "8bb18da3-f8df-435d-b4c9-cb0c6b3e540d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:42.844319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ebef01df-8a02-43f8-abf2-fa2487f72b19 req-6fd0df26-0ddc-4c5f-899d-0effbd3b847b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:42.844572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ebef01df-8a02-43f8-abf2-fa2487f72b19 req-6fd0df26-0ddc-4c5f-899d-0effbd3b847b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:42.865306 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ebef01df-8a02-43f8-abf2-fa2487f72b19 req-6fd0df26-0ddc-4c5f-899d-0effbd3b847b service nova] Creating event network-vif-plugged:8bb18da3-f8df-435d-b4c9-cb0c6b3e540d for instance 4deb7455-0b67-4b88-9494-f544b1b73fce on nch1-master-1 May 07 21:52:42.871375 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ebef01df-8a02-43f8-abf2-fa2487f72b19 req-6fd0df26-0ddc-4c5f-899d-0effbd3b847b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057163 May 07 21:52:42.872921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1087/2170] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:42.880971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e753d9f1-cce3-4160-9a98-0a288b4c9e2f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224f0310>, body: {"security_group_rule": {"parent_group_id": "7a851740-67b8-422e-939b-5dc3524c3a81", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:43.126953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:43.140982 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a1a21d8-baea-4f29-b586-89c646f35a3d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.528790 May 07 21:52:43.148644 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1084/2171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:42 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:43.153838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-8ce92e5c-1828-4881-a8e1-b0bc220e159a req-704a6f1e-d25a-40b2-9592-f0c6ca4381d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7", "tag": "7ff85673-73cb-4149-a173-2c468116cf99"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:43.166928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8ce92e5c-1828-4881-a8e1-b0bc220e159a req-704a6f1e-d25a-40b2-9592-f0c6ca4381d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:43.167610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8ce92e5c-1828-4881-a8e1-b0bc220e159a req-704a6f1e-d25a-40b2-9592-f0c6ca4381d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:43.181885 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-8ce92e5c-1828-4881-a8e1-b0bc220e159a req-704a6f1e-d25a-40b2-9592-f0c6ca4381d2 service nova] Creating event network-changed:7ff85673-73cb-4149-a173-2c468116cf99 for instance 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 on nch1-master-1 May 07 21:52:43.188605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-8ce92e5c-1828-4881-a8e1-b0bc220e159a req-704a6f1e-d25a-40b2-9592-f0c6ca4381d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038220 May 07 21:52:43.189694 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1085/2172] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:43.203911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:43.204149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:43.227371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:43.227841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:43.240306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:43.240791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:43.438750 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-e753d9f1-cce3-4160-9a98-0a288b4c9e2f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 07 21:52:43.439432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e753d9f1-cce3-4160-9a98-0a288b4c9e2f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:43.440249 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e753d9f1-cce3-4160-9a98-0a288b4c9e2f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.566051 May 07 21:52:43.445886 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1088/2173] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:42 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 572 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:52:43.450705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a230811-61de-4d2e-ac4f-953ab9f29508 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224fe310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1193859572", "description": "tempest-description-1445973565"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:43.889382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:43.903813 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a04ca65e-0a13-41cb-bb2e-6d8e3935fdd6 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1788 microversion: 2.1 time: 0.712515 May 07 21:52:43.916521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1086/2174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:43 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1788 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:43.927177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:43.928244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:43.946929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:43.948122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:43.948769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:43.949372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:44.300367 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a230811-61de-4d2e-ac4f-953ab9f29508 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.853350 May 07 21:52:44.301517 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1089/2175] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:52:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:44.307907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:44.309017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:44.315808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:44.316551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:44.318283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:44.318992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:44.615213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:44.631413 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6612f6af-b2f7-4dba-afa4-f97631262880 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.713413 May 07 21:52:44.633778 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1087/2176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:43 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:44.641961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:44.642701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:44.650759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:44.651333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:44.652200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:44.652791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:44.668503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:44.683986 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-651c6eb6-25bd-4b37-b9a0-0062ffac16dc tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.380592 May 07 21:52:44.685347 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1090/2177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:44 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:44.723072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2fad4c0-3586-4031-9bc2-0fbbe079c2a1 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc4224e1a60>, body: {"security_group_rule": {"parent_group_id": "7d93018e-60ef-4074-b3af-91716b45370a", "ip_protocol": "tcp", "from_port": 22, "to_port": 1548974642}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:44.932956 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d2fad4c0-3586-4031-9bc2-0fbbe079c2a1 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: Invalid port range 22:1548974642. Valid TCP ports should be between 1-65535 May 07 21:52:44.933920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2fad4c0-3586-4031-9bc2-0fbbe079c2a1 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 400 to user: Invalid port range 22:1548974642. Valid TCP ports should be between 1-65535 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:44.935242 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2fad4c0-3586-4031-9bc2-0fbbe079c2a1 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.246731 May 07 21:52:44.943486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1091/2178] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:44 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:52:44.948233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:44.949047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:44.961706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:44.962152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:44.963036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:44.963441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:45.220701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:45.242219 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c536bb1c-0afb-48db-8a34-125a5672e615 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.596663 May 07 21:52:45.251928 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1088/2179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:44 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:45.263635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee393841-e51c-4566-89fe-bb922ce72c6e tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Action: 'create', calling method: .version_select at 0x7fc41d4799d0>, body: {"security_group_rule": {"parent_group_id": "683ccf73-36b0-4cd7-9398-9d7a993fdd7d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:45.409831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-ee393841-e51c-4566-89fe-bb922ce72c6e tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 683ccf73-36b0-4cd7-9398-9d7a993fdd7d does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:52:45.410439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-ee393841-e51c-4566-89fe-bb922ce72c6e tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Neutron security group 683ccf73-36b0-4cd7-9398-9d7a993fdd7d not found {{(pid=136681) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 07 21:52:45.411023 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ee393841-e51c-4566-89fe-bb922ce72c6e tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: Security group 683ccf73-36b0-4cd7-9398-9d7a993fdd7d does not exist May 07 21:52:45.411023 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-6375e8a0-f461-4a9d-8e01-00fc05981f72'] May 07 21:52:45.411629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee393841-e51c-4566-89fe-bb922ce72c6e tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 404 to user: Security group 683ccf73-36b0-4cd7-9398-9d7a993fdd7d does not exist May 07 21:52:45.411629 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-6375e8a0-f461-4a9d-8e01-00fc05981f72'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:45.412755 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee393841-e51c-4566-89fe-bb922ce72c6e tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.159593 May 07 21:52:45.414588 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1089/2180] 10.222.0.32 () {60 vars in 1194 bytes} [Sat May 7 21:52:45 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:45.420839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3bc50793-edec-4a75-bc39-eb193b310a88 req-5bdcbd8c-aa41-4e52-8983-77da2840c509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "name": "network-vif-unplugged", "status": "completed", "tag": "df7809e8-4b3a-419d-9177-98b732729c4a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:45.446028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3bc50793-edec-4a75-bc39-eb193b310a88 req-5bdcbd8c-aa41-4e52-8983-77da2840c509 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:45.449695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3bc50793-edec-4a75-bc39-eb193b310a88 req-5bdcbd8c-aa41-4e52-8983-77da2840c509 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:45.469288 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3bc50793-edec-4a75-bc39-eb193b310a88 req-5bdcbd8c-aa41-4e52-8983-77da2840c509 service nova] Creating event network-vif-unplugged:df7809e8-4b3a-419d-9177-98b732729c4a for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:45.486824 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3bc50793-edec-4a75-bc39-eb193b310a88 req-5bdcbd8c-aa41-4e52-8983-77da2840c509 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070118 May 07 21:52:45.492503 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1090/2181] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:45.497977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-29068a1f-d654-4b36-a094-0c331bb1cb6c req-7e8ba497-8e70-4eda-9549-108fb6c0a435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4261bef-6bf5-48f6-8976-9ffb930ee47e", "tag": "40b1718c-d35e-4a5e-8773-22fb9e1c85d5"}, {"server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "name": "network-vif-deleted", "tag": "bb1a4932-726b-4649-982e-cde502e2aff1"}, {"server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "name": "network-vif-deleted", "tag": "f7bd0dbf-a440-4d9e-8f71-48688376777e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:45.552556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-29068a1f-d654-4b36-a094-0c331bb1cb6c req-7e8ba497-8e70-4eda-9549-108fb6c0a435 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:45.553020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-29068a1f-d654-4b36-a094-0c331bb1cb6c req-7e8ba497-8e70-4eda-9549-108fb6c0a435 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:45.579350 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-29068a1f-d654-4b36-a094-0c331bb1cb6c req-7e8ba497-8e70-4eda-9549-108fb6c0a435 service nova] Creating event network-changed:40b1718c-d35e-4a5e-8773-22fb9e1c85d5 for instance a4261bef-6bf5-48f6-8976-9ffb930ee47e on nch2-master-1 May 07 21:52:45.579870 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-29068a1f-d654-4b36-a094-0c331bb1cb6c req-7e8ba497-8e70-4eda-9549-108fb6c0a435 service nova] Creating event network-vif-deleted:bb1a4932-726b-4649-982e-cde502e2aff1 for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:45.580383 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-29068a1f-d654-4b36-a094-0c331bb1cb6c req-7e8ba497-8e70-4eda-9549-108fb6c0a435 service nova] Creating event network-vif-deleted:f7bd0dbf-a440-4d9e-8f71-48688376777e for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:45.600636 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-29068a1f-d654-4b36-a094-0c331bb1cb6c req-7e8ba497-8e70-4eda-9549-108fb6c0a435 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.106412 May 07 21:52:45.601835 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1091/2182] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:45.607108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-933b5f1d-33a3-4a3f-8ae7-d4a034c9ed9d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Calling method '.version_select at 0x7fc42257a790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:45.682100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-933b5f1d-33a3-4a3f-8ae7-d4a034c9ed9d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 16597976-8838-4a13-90bc-acc1430de923 does not exist", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:52:45.682836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-933b5f1d-33a3-4a3f-8ae7-d4a034c9ed9d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Neutron security group rule 16597976-8838-4a13-90bc-acc1430de923 not found {{(pid=136681) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 07 21:52:45.683888 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-933b5f1d-33a3-4a3f-8ae7-d4a034c9ed9d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] HTTP exception thrown: Security group rule 16597976-8838-4a13-90bc-acc1430de923 does not exist May 07 21:52:45.683888 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-55018af1-306c-4a0b-9b51-c9c8b02a24c5'] May 07 21:52:45.684819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-933b5f1d-33a3-4a3f-8ae7-d4a034c9ed9d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Returning 404 to user: Security group rule 16597976-8838-4a13-90bc-acc1430de923 does not exist May 07 21:52:45.684819 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-55018af1-306c-4a0b-9b51-c9c8b02a24c5'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:45.686314 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-933b5f1d-33a3-4a3f-8ae7-d4a034c9ed9d tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-group-rules/16597976-8838-4a13-90bc-acc1430de923" status: 404 len: 199 microversion: 2.1 time: 0.083345 May 07 21:52:45.687402 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1092/2183] 10.222.0.32 () {58 vars in 1286 bytes} [Sat May 7 21:52:45 2022] DELETE /compute/v2.1/os-security-group-rules/16597976-8838-4a13-90bc-acc1430de923 => generated 199 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:45.694274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:45.696517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:45.708188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:45.709177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:45.719712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:45.719712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:46.037759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:46.045041 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7d5cf09f-dc68-4eea-aa44-410bdaada5a3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.356454 May 07 21:52:46.055352 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1093/2184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:45 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:46.061823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-755d81ac-87d0-46cc-9a35-09ec65dc2310 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Calling method '.version_select at 0x7fc41d2fb9d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:46.108451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:46.146353 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a44f3056-c226-43ae-8dca-119f1d6aaf67 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 200 len: 1767 microversion: 2.1 time: 1.205833 May 07 21:52:46.157251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1092/2185] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:44 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 1767 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:46.160502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:46.161202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:46.173368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:46.173835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:46.177722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:46.178189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:46.430811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:46.440313 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-13541d59-a9f6-41cb-a2b1-e6f8523a3ae1 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.291348 May 07 21:52:46.440909 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1093/2186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:46 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:46.688368 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-755d81ac-87d0-46cc-9a35-09ec65dc2310 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/7d93018e-60ef-4074-b3af-91716b45370a" status: 202 len: 0 microversion: 2.1 time: 0.631536 May 07 21:52:46.689273 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1094/2187] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:46 2022] DELETE /compute/v2.1/os-security-groups/7d93018e-60ef-4074-b3af-91716b45370a => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:46.694670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:46.696096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:46.717840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:46.718626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:46.719997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:46.720669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:46.856095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1904297456", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": "none"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:46.958356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:46.960396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:46.961366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:46.963215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:46.964057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:46.975667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:46.978252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:46.981313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:46.982753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:47.033145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Getting quotas for project 09fe0f4d227c4e7d9c5c8afafd82f975. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:47.040400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Getting quotas for user 5d64d1550858400a8a7804dcdb7a0110 and project 09fe0f4d227c4e7d9c5c8afafd82f975. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:47.075698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:52:47.082540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:47.120185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:47.133922 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d23e6f04-3e4f-4b51-b902-5d9c149876b6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.443553 May 07 21:52:47.150494 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1095/2188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:46 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:47.155856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-67120198-8dc5-474d-8512-35fbb7044223 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Calling method '.version_select at 0x7fc41d2fb790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:47.205218 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92895f27-0276-4af4-be52-27dd4d8802d1 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.762357 May 07 21:52:47.208005 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1094/2189] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:52:47.216852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:47.219987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:47.234724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:47.237420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:47.238974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:47.239647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:47.665528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:47.680732 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-330d924d-e26d-4466-89c7-a93f8d504aec tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.471520 May 07 21:52:47.686449 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1095/2190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:47 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:47.711352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:47.716862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:47.732870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:47.733632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:47.735493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:47.736124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:47.763727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] HTTP exception thrown: Instance f3ba0813-ab71-47d9-8c7c-607769a67273 could not be found. May 07 21:52:47.764651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Returning 404 to user: Instance f3ba0813-ab71-47d9-8c7c-607769a67273 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:47.766456 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c723c803-c089-4745-92df-8a97f046a25e tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 404 len: 111 microversion: 2.1 time: 0.077052 May 07 21:52:47.771226 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1096/2191] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:47 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:47.779344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4d7580f-3d12-46da-b70e-d6ea51345b34 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:47.780285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a4d7580f-3d12-46da-b70e-d6ea51345b34 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:47.946681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4d7580f-3d12-46da-b70e-d6ea51345b34 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:47.968705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4d7580f-3d12-46da-b70e-d6ea51345b34 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:47.978682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4d7580f-3d12-46da-b70e-d6ea51345b34 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:47.983228 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4d7580f-3d12-46da-b70e-d6ea51345b34 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1278 microversion: 2.57 time: 0.210220 May 07 21:52:47.996082 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1097/2192] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:47 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:48.009014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:48.012882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:48.027785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:48.030206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:48.045606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:48.052882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:48.144355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-67120198-8dc5-474d-8512-35fbb7044223 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/7a851740-67b8-422e-939b-5dc3524c3a81" status: 202 len: 0 microversion: 2.1 time: 0.992206 May 07 21:52:48.148151 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1096/2193] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:47 2022] DELETE /compute/v2.1/os-security-groups/7a851740-67b8-422e-939b-5dc3524c3a81 => generated 0 bytes in 997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:48.155599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-697bf7d2-1960-4497-8afc-97dd9ad43e6c req-fc9fbb70-4fe5-4faf-87ad-51276b182d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ba0813-ab71-47d9-8c7c-607769a67273", "name": "network-vif-deleted", "tag": "df7809e8-4b3a-419d-9177-98b732729c4a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:48.187736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-697bf7d2-1960-4497-8afc-97dd9ad43e6c req-fc9fbb70-4fe5-4faf-87ad-51276b182d5f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:48.188361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-697bf7d2-1960-4497-8afc-97dd9ad43e6c req-fc9fbb70-4fe5-4faf-87ad-51276b182d5f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:48.227289 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-697bf7d2-1960-4497-8afc-97dd9ad43e6c req-fc9fbb70-4fe5-4faf-87ad-51276b182d5f service nova] Creating event network-vif-deleted:df7809e8-4b3a-419d-9177-98b732729c4a for instance f3ba0813-ab71-47d9-8c7c-607769a67273 on nch2-master-1 May 07 21:52:48.245954 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-697bf7d2-1960-4497-8afc-97dd9ad43e6c req-fc9fbb70-4fe5-4faf-87ad-51276b182d5f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095761 May 07 21:52:48.254017 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1097/2194] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:48.265086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d27558b7-0618-4cd9-8efc-870f3d934e1f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Calling method '.version_select at 0x7fc41d4998b0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:48.552058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:48.563583 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5e5b9c72-2134-46ed-b40b-322b6d5b2417 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.573351 May 07 21:52:48.575347 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1098/2195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:47 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:48.621569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:48.628511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:48.656020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:48.657934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:48.660642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:48.661846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:49.045006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:49.057809 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4d768d0-041e-48f3-848d-5b7ba041ebc6 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.463565 May 07 21:52:49.071626 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1099/2196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:48 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:49.080147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:49.086390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:49.110684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:49.123026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:49.135407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:49.138073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:49.180276 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d27558b7-0618-4cd9-8efc-870f3d934e1f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/c14e41d7-1be8-413a-97d1-7878993279b2" status: 202 len: 0 microversion: 2.1 time: 0.924800 May 07 21:52:49.185119 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1098/2197] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:48 2022] DELETE /compute/v2.1/os-security-groups/c14e41d7-1be8-413a-97d1-7878993279b2 => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:49.190976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:49.191913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:49.211155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:49.213446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:49.214363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:49.215032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:49.411357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:49.426653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:49.435567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:49.436808 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-501936e7-ba88-4a0a-9c2e-d5279cca521b tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1330 microversion: 2.57 time: 0.250124 May 07 21:52:49.446554 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1099/2198] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:49 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1330 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:49.462039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb23978e-0341-4699-ae71-1c5fd7572730 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Calling method '.version_select at 0x7fc422627dc0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:49.484455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:49.493604 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bf46d9d4-3b5e-4415-974d-1c80f973e71e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.429139 May 07 21:52:49.494621 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1100/2199] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:49 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:49.602924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:49.604444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:49.622327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:49.623191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:49.626731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:49.627625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:49.952069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:49.964317 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-171bb0d6-8017-4212-bc34-76072d2eeb03 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.370609 May 07 21:52:49.965864 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1101/2200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:49 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:50.081464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:50.082341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:50.089787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:50.090636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:50.091757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:50.092525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:50.284701 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb23978e-0341-4699-ae71-1c5fd7572730 tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/23dc9e30-b444-489e-974c-08338f2f965a" status: 202 len: 0 microversion: 2.1 time: 0.833625 May 07 21:52:50.288284 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1100/2201] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:49 2022] DELETE /compute/v2.1/os-security-groups/23dc9e30-b444-489e-974c-08338f2f965a => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:50.308311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fa4a3e26-73fd-4469-9bc4-d71f27c56b6f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] Calling method '.version_select at 0x7fc422539310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:50.405168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:50.417598 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69ac1585-4c0c-4cbe-8819-8d040b48e6d4 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.340199 May 07 21:52:50.418511 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1102/2202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:50 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:50.626453 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fa4a3e26-73fd-4469-9bc4-d71f27c56b6f tempest-SecurityGroupRulesNegativeTestJSON-911075500 tempest-SecurityGroupRulesNegativeTestJSON-911075500-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/5477615f-d78c-49b0-a8c4-eec43baa1312" status: 202 len: 0 microversion: 2.1 time: 0.333392 May 07 21:52:50.627133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1101/2203] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:50 2022] DELETE /compute/v2.1/os-security-groups/5477615f-d78c-49b0-a8c4-eec43baa1312 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:52:50.632920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:50.633558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:50.646962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:50.647241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:50.647884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:50.649610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:50.724320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-220ae0c6-e941-44bd-988c-a64d0e7f2453 tempest-FlavorsV2NegativeTest-1532377664 tempest-FlavorsV2NegativeTest-1532377664-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:50.752366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-220ae0c6-e941-44bd-988c-a64d0e7f2453 tempest-FlavorsV2NegativeTest-1532377664 tempest-FlavorsV2NegativeTest-1532377664-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.332528 May 07 21:52:50.753377 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1103/2204] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:52:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:50.761027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e752613e-00b6-4efd-a6d5-94748d368d04 req-c6dcaa5f-495c-4481-b74e-a4db2335e108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fafb82-09d3-47de-827f-770202f22005", "name": "network-vif-plugged", "status": "completed", "tag": "0cb8be1d-eb20-4313-adab-53f509d88a67"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:50.785725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e752613e-00b6-4efd-a6d5-94748d368d04 req-c6dcaa5f-495c-4481-b74e-a4db2335e108 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:50.786115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e752613e-00b6-4efd-a6d5-94748d368d04 req-c6dcaa5f-495c-4481-b74e-a4db2335e108 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:50.806248 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e752613e-00b6-4efd-a6d5-94748d368d04 req-c6dcaa5f-495c-4481-b74e-a4db2335e108 service nova] Creating event network-vif-plugged:0cb8be1d-eb20-4313-adab-53f509d88a67 for instance 83fafb82-09d3-47de-827f-770202f22005 on nch2-master-1 May 07 21:52:50.819492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e752613e-00b6-4efd-a6d5-94748d368d04 req-c6dcaa5f-495c-4481-b74e-a4db2335e108 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064510 May 07 21:52:50.821846 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1104/2205] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:50.822695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:50.828586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:50.829749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:50.837006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:50.840408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:50.841143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:50.841730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:50.843136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:50.843807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:50.846089 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-64b26aa4-8000-48ec-8a2b-d7824abe0873 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1336 microversion: 2.57 time: 0.214843 May 07 21:52:50.860435 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1102/2206] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:50 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1336 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:50.991055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:50.991943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:50.999375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:51.000105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:51.000890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:51.001609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:51.275073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:51.291999 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-553fab12-df2c-4682-bf50-8bf93b420705 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.467621 May 07 21:52:51.301897 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1105/2207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:50 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:51.439852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:51.440932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:51.462325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:51.462847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:51.464000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:51.465873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:51.876627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:51.887106 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e1bbdaa9-4775-4c5b-9b80-55e2916375f6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.907916 May 07 21:52:51.888407 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1103/2208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:50 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:51.900214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:51.907553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b601f6db-6178-492b-92c1-e5a815e02dae tempest-FlavorsV2NegativeTest-1532377664 tempest-FlavorsV2NegativeTest-1532377664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1952852118", "imageRef": "e9b7def1-090f-4e75-8451-6823c6f91b3b", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:51.913893 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-29599d21-a9f4-4326-8382-72e76cf8ebcc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.481226 May 07 21:52:51.923201 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1106/2209] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:51 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:51.929906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:51.935570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:51.954642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:51.955177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:51.956953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:51.957484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:51.976501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-b601f6db-6178-492b-92c1-e5a815e02dae tempest-FlavorsV2NegativeTest-1532377664 tempest-FlavorsV2NegativeTest-1532377664-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:52:52.107129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:52.121823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:52.123733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:52.124926 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9fa5fabe-f243-494d-a688-e8cb9b751ebd tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1357 microversion: 2.57 time: 0.200462 May 07 21:52:52.125989 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1107/2210] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:51 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:52.158727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:52.161164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:52.169919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.170733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.171956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.172627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.269270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:52.269693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:52.270201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:52.270605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:52.271060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:52.394893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:52.403084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.403747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.404922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.405534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.422825 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b601f6db-6178-492b-92c1-e5a815e02dae tempest-FlavorsV2NegativeTest-1532377664 tempest-FlavorsV2NegativeTest-1532377664-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 07 21:52:52.423685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b601f6db-6178-492b-92c1-e5a815e02dae tempest-FlavorsV2NegativeTest-1532377664 tempest-FlavorsV2NegativeTest-1532377664-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:52.425477 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b601f6db-6178-492b-92c1-e5a815e02dae tempest-FlavorsV2NegativeTest-1532377664 tempest-FlavorsV2NegativeTest-1532377664-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.535914 May 07 21:52:52.426239 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1104/2211] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:52:51 2022] POST /compute/v2.1/servers => generated 93 bytes in 537 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:52:52.452219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:52.455510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:52.465198 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cd230b9e-68fe-4fe8-bc0f-7737b8a2afe9 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "POST /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529/action" status: 202 len: 1138 microversion: 2.57 time: 0.319944 May 07 21:52:52.470473 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1108/2212] 10.222.0.32 () {62 vars in 1319 bytes} [Sat May 7 21:52:52 2022] POST /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529/action => generated 1138 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 07 21:52:52.472752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.473224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.474035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.474486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.484287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:52.485851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:52.497502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.498255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.499430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.499979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.633023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:52.649926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:52.651508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:52.658506 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd134bbe-6079-4865-94fc-f8ed53c0a821 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.174684 May 07 21:52:52.660363 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1109/2213] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:52 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:52:52.745515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:52.755821 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5c377a19-2c8c-4b9b-9488-a948435dae39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.327014 May 07 21:52:52.766439 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1105/2214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:52 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:52.847762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-aeb9a8f2-3403-4c76-9527-7af53279bd72 req-a6b9f52c-4fc0-4559-aa48-eb16195907b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7", "name": "network-vif-plugged", "status": "completed", "tag": "7ff85673-73cb-4149-a173-2c468116cf99"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:52.864973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aeb9a8f2-3403-4c76-9527-7af53279bd72 req-a6b9f52c-4fc0-4559-aa48-eb16195907b2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.865661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aeb9a8f2-3403-4c76-9527-7af53279bd72 req-a6b9f52c-4fc0-4559-aa48-eb16195907b2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.905316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:52.906638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:52.919097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.920055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.922710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.923404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.926687 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-aeb9a8f2-3403-4c76-9527-7af53279bd72 req-a6b9f52c-4fc0-4559-aa48-eb16195907b2 service nova] Creating event network-vif-plugged:7ff85673-73cb-4149-a173-2c468116cf99 for instance 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 on nch1-master-1 May 07 21:52:52.949173 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-aeb9a8f2-3403-4c76-9527-7af53279bd72 req-a6b9f52c-4fc0-4559-aa48-eb16195907b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103215 May 07 21:52:52.952500 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1110/2215] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:52.970782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:52.975726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:52.984118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.984845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:52.985894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:52.986565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:53.395382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:53.408920 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77ea8fc9-f738-4015-b897-44f97d69f27a tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.451458 May 07 21:52:53.409935 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1111/2216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:52 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:53.625841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:53.693995 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-43e7d894-af74-4824-a79c-263b96d8d08a tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1371 microversion: 2.1 time: 0.792528 May 07 21:52:53.697538 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1106/2217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:52 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1371 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:53.711305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:53.712407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:53.719632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:53.720377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:53.721380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:53.721996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:53.774848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:53.776365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:53.796363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:53.801115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:53.802228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:53.804914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:53.891602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:53.903694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:53.909508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:53.911795 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ae4541b-e177-48ed-9379-56d8a2e69cf3 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.222920 May 07 21:52:53.914157 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1112/2218] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:53 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:54.162885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:54.173866 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-abded878-cf71-480b-aed9-042a1398a0e0 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.404546 May 07 21:52:54.175312 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1107/2219] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:53 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:54.365732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ee0b820-c0f7-43bc-a313-29de9f1fc7bf tempest-AZV2TestJSON-2079190625 tempest-AZV2TestJSON-2079190625-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:54.368763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee0b820-c0f7-43bc-a313-29de9f1fc7bf tempest-AZV2TestJSON-2079190625 tempest-AZV2TestJSON-2079190625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.369337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee0b820-c0f7-43bc-a313-29de9f1fc7bf tempest-AZV2TestJSON-2079190625 tempest-AZV2TestJSON-2079190625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:54.370229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee0b820-c0f7-43bc-a313-29de9f1fc7bf tempest-AZV2TestJSON-2079190625 tempest-AZV2TestJSON-2079190625-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.370748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee0b820-c0f7-43bc-a313-29de9f1fc7bf tempest-AZV2TestJSON-2079190625 tempest-AZV2TestJSON-2079190625-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:54.399329 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ee0b820-c0f7-43bc-a313-29de9f1fc7bf tempest-AZV2TestJSON-2079190625 tempest-AZV2TestJSON-2079190625-project] 10.222.0.32 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.196693 May 07 21:52:54.400391 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1113/2220] 10.222.0.32 () {58 vars in 1163 bytes} [Sat May 7 21:52:54 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:52:54.430674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:54.431696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:54.456052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.457792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:54.458647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.462194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:54.712629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:54.713570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:54.727607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.730799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:54.731829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.732581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:54.847927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:54.858600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce558ea0-3cbc-4712-8990-004ff5f4761b tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1323 microversion: 2.1 time: 0.434447 May 07 21:52:54.859266 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1108/2221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:54 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1323 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:54.938348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:54.939972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:54.952069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.956719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:54.957583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:54.958048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:55.122119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:55.136577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:55.143623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:55.146422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-373289cc-fc9a-49c7-a744-01cc7a3330bb tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.212803 May 07 21:52:55.159653 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1109/2222] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:54 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:55.160989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5905439a-e87d-4a33-8fbe-37ee3c010d6c req-15fc412b-552f-4358-a1f0-c5e29d714e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4261bef-6bf5-48f6-8976-9ffb930ee47e", "name": "network-vif-plugged", "status": "completed", "tag": "40b1718c-d35e-4a5e-8773-22fb9e1c85d5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:55.165349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:55.176711 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-29da0ef5-6755-4a75-9dcb-a8db5e3c240c tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1557 microversion: 2.1 time: 0.468610 May 07 21:52:55.183083 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1114/2223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:54 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1557 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:55.184781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5905439a-e87d-4a33-8fbe-37ee3c010d6c req-15fc412b-552f-4358-a1f0-c5e29d714e2b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:55.186250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5905439a-e87d-4a33-8fbe-37ee3c010d6c req-15fc412b-552f-4358-a1f0-c5e29d714e2b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:55.198009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:55.198654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:55.208523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:55.208996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:55.217306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:55.217983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:55.222377 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5905439a-e87d-4a33-8fbe-37ee3c010d6c req-15fc412b-552f-4358-a1f0-c5e29d714e2b service nova] Creating event network-vif-plugged:40b1718c-d35e-4a5e-8773-22fb9e1c85d5 for instance a4261bef-6bf5-48f6-8976-9ffb930ee47e on nch2-master-1 May 07 21:52:55.228559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5905439a-e87d-4a33-8fbe-37ee3c010d6c req-15fc412b-552f-4358-a1f0-c5e29d714e2b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077430 May 07 21:52:55.230331 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1110/2224] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:55.277188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b8a9a1d7-3acd-4500-9f1a-3ffbcb84145d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:55.279662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b8a9a1d7-3acd-4500-9f1a-3ffbcb84145d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:55.302559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8a9a1d7-3acd-4500-9f1a-3ffbcb84145d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:55.303244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8a9a1d7-3acd-4500-9f1a-3ffbcb84145d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:55.304862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8a9a1d7-3acd-4500-9f1a-3ffbcb84145d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:55.305500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8a9a1d7-3acd-4500-9f1a-3ffbcb84145d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:55.428533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:55.438375 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-128445cf-065d-4385-82c3-67001c0b79d3 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.246147 May 07 21:52:55.447918 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1115/2225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:55 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:55.453334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-141856763", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "bb51608c-2c73-49c2-bce7-76d2394358c2"}, {"uuid": "0be2ea3f-0b39-4b2d-b775-d2c4d2364465"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:55.517774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] validate_networks() for [('bb51608c-2c73-49c2-bce7-76d2394358c2', None, None, None, None, None), ('0be2ea3f-0b39-4b2d-b775-d2c4d2364465', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:52:55.576787 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b8a9a1d7-3acd-4500-9f1a-3ffbcb84145d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.344796 May 07 21:52:55.579414 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1111/2226] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:52:55 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-interface => generated 284 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:52:55.879761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:55.880671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:55.892048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:55.892780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:55.893815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:55.894561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.575437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:56.602555 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9eb96c54-9443-4d2c-9edd-2aa6b24950cc tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1473 microversion: 2.1 time: 0.728277 May 07 21:52:56.603495 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1112/2227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:55 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1473 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:56.615451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:56.616111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:56.626059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.626403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.628119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.628576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.725189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:52:56.726254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:52:56.726619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:52:56.727057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:52:56.727476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:52:56.744301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.744762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.745573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.746019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.768844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Getting quotas for project 7a05b8a866c04fe78b04ec616e62b70f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:52:56.776150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Getting quotas for user 396f4d7fe37343dcb4aeeb0839383f6f and project 7a05b8a866c04fe78b04ec616e62b70f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:52:56.790697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:52:56.793186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:52:56.845060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:56.851384 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-60ccbd81-94fd-4620-be30-fd4b018589f9 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401506 May 07 21:52:56.852736 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1116/2228] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:52:56.854915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:56.861860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:56.862686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:56.864261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:56.869842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b8683ef-5e12-42e1-af0a-ac1c5c400e6a tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.265134 May 07 21:52:56.870440 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1113/2229] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:56 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:56.885277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:56.885800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:56.890110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.890585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.894452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.894836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.899037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.899492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.900289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:56.900909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:56.957375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:56.958070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:52:56.964751 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-03ab9a05-4e27-4d6a-a4eb-dbb8f25ec6fe tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.093039 May 07 21:52:56.967335 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1114/2230] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:52:56 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7/diagnostics => generated 117 bytes in 96 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 21:52:56.978689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf3c9db0-170a-458a-9a96-bce5434806b1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:56.984894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bf3c9db0-170a-458a-9a96-bce5434806b1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:57.198697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:57.232204 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-956be1e3-791c-499c-b63d-50b040cf0746 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1318 microversion: 2.1 time: 0.378123 May 07 21:52:57.232803 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1117/2231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:56 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:57.248735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:57.250572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:57.256436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bf3c9db0-170a-458a-9a96-bce5434806b1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:57.262251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:57.263199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:57.264178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:57.266647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:57.270995 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bf3c9db0-170a-458a-9a96-bce5434806b1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1212 microversion: 2.1 time: 0.295831 May 07 21:52:57.287958 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1115/2232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:56 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1212 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:57.349983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:52:57.557221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-165a3551-ca17-40d9-a21a-4a80105ff692 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "DELETE /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 204 len: 0 microversion: 2.1 time: 0.317287 May 07 21:52:57.558979 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1118/2233] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:52:57 2022] DELETE /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:52:57.567132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:57.568673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:57.594313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:57.595115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:57.599719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:57.600229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:57.890144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:57.890968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:57.905450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:57.905911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:57.906953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:57.907569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:58.110855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:58.122642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:58.136714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:58.141252 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-132f6036-0c93-4726-b6a4-e7bbc918ff50 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1479 microversion: 2.1 time: 0.578484 May 07 21:52:58.142179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:58.143695 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1116/2234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:57 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1479 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:58.144848 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-98f260ed-d90f-4f1f-88a7-ded47828b3a6 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.259547 May 07 21:52:58.145402 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1119/2235] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:57 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:58.250590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:58.251374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:58.260939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:58.263695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:58.264652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:58.267223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:58.290546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:58.291485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:58.309719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:58.315779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:58.317061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:58.318014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:58.518388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:58.530499 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6536a473-d0ed-4f1d-8583-091e90e16148 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1216 microversion: 2.1 time: 0.244306 May 07 21:52:58.531446 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1120/2236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:58 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1216 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:59.125754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:59.135221 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b0491ee-2326-442b-94a0-5ba2a6e6f4ba tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1505 microversion: 2.1 time: 0.889562 May 07 21:52:59.146938 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1117/2237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:58 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1505 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:59.157190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:59.159318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 4deb7455-0b67-4b88-9494-f544b1b73fce] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:59.163853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:59.164082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:59.180315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.180875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.182722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.182976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.183665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.184705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.186104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.186844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.746336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:59.754441 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e3b5c0eb-e60a-49bc-a398-e005a1ffc548 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1479 microversion: 2.1 time: 0.598191 May 07 21:52:59.755079 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1118/2238] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:59 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1479 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:52:59.769795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:59.770719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:59.777708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.778400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.779512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.780136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.886341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:59.909159 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-84dd0b3c-fb95-4abd-895c-0a7a4a8076c8 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce" status: 200 len: 1506 microversion: 2.1 time: 0.759780 May 07 21:52:59.911061 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1121/2239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:59 2022] GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:52:59.928101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:52:59.929813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:52:59.936481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:59.942448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.945348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.945549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:59.947905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.952070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:52:59.960066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:52:59.961318 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d40a2308-d91b-4427-9006-fb47c38a4483 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.197135 May 07 21:52:59.961902 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1119/2240] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:52:59 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:52:59.966919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-828230cb-73ea-4dbe-84d8-dd5d2bfb2e18 req-55292f59-c1bc-4646-b00b-0e4e13dd9191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fafb82-09d3-47de-827f-770202f22005", "tag": "0cb8be1d-eb20-4313-adab-53f509d88a67"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:52:59.982991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-828230cb-73ea-4dbe-84d8-dd5d2bfb2e18 req-55292f59-c1bc-4646-b00b-0e4e13dd9191 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:52:59.983383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-828230cb-73ea-4dbe-84d8-dd5d2bfb2e18 req-55292f59-c1bc-4646-b00b-0e4e13dd9191 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:00.022574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-828230cb-73ea-4dbe-84d8-dd5d2bfb2e18 req-55292f59-c1bc-4646-b00b-0e4e13dd9191 service nova] Creating event network-changed:0cb8be1d-eb20-4313-adab-53f509d88a67 for instance 83fafb82-09d3-47de-827f-770202f22005 on nch2-master-1 May 07 21:53:00.030748 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-828230cb-73ea-4dbe-84d8-dd5d2bfb2e18 req-55292f59-c1bc-4646-b00b-0e4e13dd9191 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067600 May 07 21:53:00.031406 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1120/2241] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:00.050837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:00.051728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 4deb7455-0b67-4b88-9494-f544b1b73fce] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:00.059725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:00.060508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:00.061491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:00.061940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:00.103498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:00.109858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 4deb7455-0b67-4b88-9494-f544b1b73fce] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:53:00.113645 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2bf47fa8-b62e-4794-8c4d-e5e804919ac1 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1270 microversion: 2.1 time: 0.200364 May 07 21:53:00.122916 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1122/2242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:52:59 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:00.332960 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0d59dcbd-3eee-44b4-896d-e7ee47f60cdc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce" status: 204 len: 0 microversion: 2.1 time: 0.299930 May 07 21:53:00.334903 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1121/2243] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:00 2022] DELETE /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:53:00.343516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:00.344039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:00.352454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:00.353000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:00.356664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:00.358420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:00.413579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:53:00.597505 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-231c5000-bf08-4a72-b15e-5bbc02ca8e27 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 204 len: 0 microversion: 2.1 time: 0.258295 May 07 21:53:00.598820 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1123/2244] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:00 2022] DELETE /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:53:00.609937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:00.611243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 4deb7455-0b67-4b88-9494-f544b1b73fce] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:00.620887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:00.621666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:00.622709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:00.623364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:00.695796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-899704030", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "7bc61814-8ef0-4365-b3ea-2c20100be453"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:00.754821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] validate_networks() for [('7bc61814-8ef0-4365-b3ea-2c20100be453', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:53:01.164970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:01.166026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:01.166682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:01.167305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:01.167888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:01.179474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.180129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.182116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.182986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.203946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Getting quotas for project 4f4c556805a24040a7131d879ee91498. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:01.209419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Getting quotas for user 3e390d65f16c47ec89f5f834bccfdd8c and project 4f4c556805a24040a7131d879ee91498. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:01.223112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:53:01.226543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:53:01.296226 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0dd4b028-5bb2-4c2c-9261-e97f88be843f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833115 May 07 21:53:01.301012 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1122/2245] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:53:01.312000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:01.312838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:01.343467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.344358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.345763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.345908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.441474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc1c955ccc0c48dcbb11eba3718d7865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4642753b5d1548038be79eb12ce7b20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:01.449459 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d6ce6b1-9bd1-4387-9a83-ca8445eee32d tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 200 len: 1437 microversion: 2.1 time: 0.147179 May 07 21:53:01.459723 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1123/2246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:01 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 1437 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:01.465846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:01.466761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:01.474663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.475397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.476947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.477561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.547905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:01.556963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:01.561635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:01.569886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:01.571232 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59b78b1e-6c46-4e47-bd06-125379b6a26e tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce" status: 200 len: 1512 microversion: 2.1 time: 0.965712 May 07 21:53:01.572127 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1124/2247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:00 2022] GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce => generated 1512 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:01.572652 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-25178c8a-daf1-48f5-bfcf-69c648089145 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.109459 May 07 21:53:01.574014 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1124/2248] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:01 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:01.593449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:01.595273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac9324bb-6a6c-4d30-8aea-00949693d703 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:01.596494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac9324bb-6a6c-4d30-8aea-00949693d703 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:01.597771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:01.609510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.610844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.613274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:01.614508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:01.716852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ac9324bb-6a6c-4d30-8aea-00949693d703 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:01.723613 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac9324bb-6a6c-4d30-8aea-00949693d703 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1217 microversion: 2.1 time: 0.147760 May 07 21:53:01.724464 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1125/2249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:01 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:01.929706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:01.945729 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-910e86e1-31a3-4eb9-a4d3-0f095c87f194 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1270 microversion: 2.1 time: 0.370759 May 07 21:53:01.947110 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1125/2250] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:01 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1270 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:02.087020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9b762159-1e4e-49a2-a79a-22e9c93cd8e1 req-3b09979f-c483-4e00-8553-2a0f60c0cd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7", "name": "network-vif-deleted", "tag": "7ff85673-73cb-4149-a173-2c468116cf99"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:02.108286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9b762159-1e4e-49a2-a79a-22e9c93cd8e1 req-3b09979f-c483-4e00-8553-2a0f60c0cd1a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:02.117256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9b762159-1e4e-49a2-a79a-22e9c93cd8e1 req-3b09979f-c483-4e00-8553-2a0f60c0cd1a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:02.134479 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9b762159-1e4e-49a2-a79a-22e9c93cd8e1 req-3b09979f-c483-4e00-8553-2a0f60c0cd1a service nova] Creating event network-vif-deleted:7ff85673-73cb-4149-a173-2c468116cf99 for instance 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 on nch1-master-1 May 07 21:53:02.153591 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9b762159-1e4e-49a2-a79a-22e9c93cd8e1 req-3b09979f-c483-4e00-8553-2a0f60c0cd1a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067343 May 07 21:53:02.157654 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1126/2251] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:02.466978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:02.467716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] [instance: 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:02.491688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:02.492322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:02.493208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:02.493658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:02.521768 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] HTTP exception thrown: Instance 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 could not be found. May 07 21:53:02.531766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] Returning 404 to user: Instance 73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:02.532950 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f8b1703f-3d9a-45ab-97ff-66fe240559d9 tempest-ServerDiagnosticsNegativeTest-1377180466 tempest-ServerDiagnosticsNegativeTest-1377180466-project] 10.222.0.32 "GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7" status: 404 len: 111 microversion: 2.1 time: 0.069955 May 07 21:53:02.536863 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1126/2252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:02 2022] GET /compute/v2.1/servers/73b2c8b6-20a3-4e24-8a95-1e9d67ee0ab7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:02.588428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:02.589781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 4deb7455-0b67-4b88-9494-f544b1b73fce] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:02.599438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:02.601259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:02.621389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:02.627073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:02.628121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:02.628720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:02.630787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:02.631473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:02.636995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:02.638251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:03.017322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:03.027957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:03.029489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:03.039495 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bfe590cb-7f0c-4814-9550-809e805e93d8 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.435378 May 07 21:53:03.052107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1127/2253] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:02 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:03.066822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:03.068066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:03.077637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:03.080988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:03.081742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:03.082194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:03.235394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:03.244056 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-66925477-3974-48ee-91af-2739e6c702c2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1277 microversion: 2.1 time: 0.190439 May 07 21:53:03.244623 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1128/2254] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:03 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:03.265433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:03.267728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:03.299268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:03.300210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:03.306709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:03.307490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:03.469164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:03.484344 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0a3836fe-c1b7-4865-898b-8b60019c0fcc tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce" status: 200 len: 1512 microversion: 2.1 time: 0.899999 May 07 21:53:03.494179 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1127/2255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:02 2022] GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce => generated 1512 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:04.058530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:04.059336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:04.066280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:04.082619 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d355aa3c-e7a9-4833-bac2-035e4ec683d3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1312 microversion: 2.1 time: 0.836848 May 07 21:53:04.083254 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1129/2256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:03 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1312 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:04.085185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.085909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.086710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.087207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.228863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-54883090-3633-434e-9c46-14d60dbf8435 req-4e59cafa-7db2-41ff-90f2-35db140c190d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4deb7455-0b67-4b88-9494-f544b1b73fce", "name": "network-vif-deleted", "tag": "8bb18da3-f8df-435d-b4c9-cb0c6b3e540d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:04.245650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-54883090-3633-434e-9c46-14d60dbf8435 req-4e59cafa-7db2-41ff-90f2-35db140c190d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.246100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-54883090-3633-434e-9c46-14d60dbf8435 req-4e59cafa-7db2-41ff-90f2-35db140c190d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.271428 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-54883090-3633-434e-9c46-14d60dbf8435 req-4e59cafa-7db2-41ff-90f2-35db140c190d service nova] Creating event network-vif-deleted:8bb18da3-f8df-435d-b4c9-cb0c6b3e540d for instance 4deb7455-0b67-4b88-9494-f544b1b73fce on nch1-master-1 May 07 21:53:04.284691 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-54883090-3633-434e-9c46-14d60dbf8435 req-4e59cafa-7db2-41ff-90f2-35db140c190d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060322 May 07 21:53:04.285654 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1130/2257] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:53:04.296848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:04.298756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:04.310015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.311687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.314063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.314930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.342275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:04.379556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:04.385283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:04.389367 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a94f1392-8b10-4cfc-ad05-187e808e6d3e tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.332297 May 07 21:53:04.402431 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1128/2258] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:04 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:04.501658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:04.502442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: 4deb7455-0b67-4b88-9494-f544b1b73fce] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:04.512859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.513309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.514096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.514536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.548575 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] HTTP exception thrown: Instance 4deb7455-0b67-4b88-9494-f544b1b73fce could not be found. May 07 21:53:04.549194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Returning 404 to user: Instance 4deb7455-0b67-4b88-9494-f544b1b73fce could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:04.550063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c64018df-c7a8-45be-bb1d-6761c2b520d9 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce" status: 404 len: 111 microversion: 2.1 time: 0.052351 May 07 21:53:04.553889 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1129/2259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:04 2022] GET /compute/v2.1/servers/4deb7455-0b67-4b88-9494-f544b1b73fce => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:04.558652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:04.565336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:04.580075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.580459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.581264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.581710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.631516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:04.652568 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07e5646e-e56f-4f7e-a400-948e35bad408 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1275 microversion: 2.1 time: 0.365452 May 07 21:53:04.658041 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1131/2260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:04 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1275 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:04.703402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:04.703871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:04.704343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lazy-loading 'fault' on Instance uuid a4261bef-6bf5-48f6-8976-9ffb930ee47e {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:53:04.806641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e35b8f3a2eb4ed98800638dd51618ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae91bd9874141989a0896953655d3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:04.815893 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-123356ee-8a1e-44c0-a677-4986a92e2a39 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 200 len: 1308 microversion: 2.1 time: 0.260913 May 07 21:53:04.816729 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1130/2261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:04 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:05.103226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:05.104992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:05.130345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:05.130827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:05.131652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:05.132634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:05.409017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:05.409652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:05.427605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:05.431311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:05.432478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:05.434467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:05.827870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:05.844607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:05.846624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:05.849530 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2ac68caa-7baa-4f42-88d2-d7425501f9db tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.444649 May 07 21:53:05.854470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1131/2262] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:05 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:05.867533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:05.868668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:05.892845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:05.893702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:05.899034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:05.900518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:06.536852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:06.546727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-daab56e5-a209-4368-a35c-a5d2ac0d9e56 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 1.451298 May 07 21:53:06.558032 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1132/2263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:05 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:06.565400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:06.566572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] [instance: a4261bef-6bf5-48f6-8976-9ffb930ee47e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:06.575602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:06.576401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:06.577319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:06.577877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:06.618010 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] HTTP exception thrown: Instance a4261bef-6bf5-48f6-8976-9ffb930ee47e could not be found. May 07 21:53:06.619036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] Returning 404 to user: Instance a4261bef-6bf5-48f6-8976-9ffb930ee47e could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:06.620156 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c54bbe1-4403-4ced-9170-9549cf2e6876 tempest-MultipleCreateTestJSON-686233549 tempest-MultipleCreateTestJSON-686233549-project] 10.222.0.32 "GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e" status: 404 len: 111 microversion: 2.1 time: 0.060654 May 07 21:53:06.620991 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1133/2264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:06 2022] GET /compute/v2.1/servers/a4261bef-6bf5-48f6-8976-9ffb930ee47e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:06.739115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-013a5e85-d57f-4b03-9530-33840ff8879d req-0f0d5906-b529-4fd2-a802-f0a225712e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4261bef-6bf5-48f6-8976-9ffb930ee47e", "name": "network-vif-deleted", "tag": "40b1718c-d35e-4a5e-8773-22fb9e1c85d5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:06.759981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-013a5e85-d57f-4b03-9530-33840ff8879d req-0f0d5906-b529-4fd2-a802-f0a225712e94 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:06.760993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-013a5e85-d57f-4b03-9530-33840ff8879d req-0f0d5906-b529-4fd2-a802-f0a225712e94 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:06.790693 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-013a5e85-d57f-4b03-9530-33840ff8879d req-0f0d5906-b529-4fd2-a802-f0a225712e94 service nova] Creating event network-vif-deleted:40b1718c-d35e-4a5e-8773-22fb9e1c85d5 for instance a4261bef-6bf5-48f6-8976-9ffb930ee47e on nch2-master-1 May 07 21:53:06.812083 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-013a5e85-d57f-4b03-9530-33840ff8879d req-0f0d5906-b529-4fd2-a802-f0a225712e94 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082853 May 07 21:53:06.813644 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1134/2265] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:53:06.879396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:06.881041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:06.894475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:06.903119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:06.904278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:06.904911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:07.003854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:07.012885 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1056b63d-2004-4fc7-9d46-22163b6b0f2f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1317 microversion: 2.1 time: 1.157036 May 07 21:53:07.026069 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1132/2266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:05 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1317 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:07.086189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:07.094942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:07.099217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:07.105871 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-75345d85-e6bf-4e0b-9c9e-a556a63c7bd2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.231714 May 07 21:53:07.107875 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1135/2267] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:06 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:07.566699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:07.567792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:07.583770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:07.584235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:07.586053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:07.588672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:07.935932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:07.963027 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-107e5340-722f-4a66-9db9-91524a57a073 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.395908 May 07 21:53:07.964991 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1133/2268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:07 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:08.044592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:08.045858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:08.060370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:08.063206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:08.064216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:08.064839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:08.140591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:08.145049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:08.161517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:08.163111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:08.164337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:08.166140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:08.356323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:08.371236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:08.375210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:08.377495 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d9f87fdb-2686-4845-8d6d-500cc7caad81 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.256137 May 07 21:53:08.378086 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1134/2269] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:08 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:08.533936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ea1a513-c4c7-47b2-9fcb-ccab176f27d6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Action: 'create', calling method: .version_select at 0x7fc4225af160>, body: {"keypair": {"name": "tempest-keypair-614855448"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:08.550660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9ea1a513-c4c7-47b2-9fcb-ccab176f27d6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Getting quotas for project f75cb675742543209bcbb75d99b60e97. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:08.557156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9ea1a513-c4c7-47b2-9fcb-ccab176f27d6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Getting quotas for user 60446154374c4fac9315543687cdc0b3 and project f75cb675742543209bcbb75d99b60e97. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:08.729855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:08.737640 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7486dfe-55fc-4ecd-b5db-de5ed3e06472 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1317 microversion: 2.1 time: 0.697451 May 07 21:53:08.747865 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1136/2270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:08 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:08.917197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9ea1a513-c4c7-47b2-9fcb-ccab176f27d6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Getting quotas for project f75cb675742543209bcbb75d99b60e97. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:08.940393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9ea1a513-c4c7-47b2-9fcb-ccab176f27d6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Getting quotas for user 60446154374c4fac9315543687cdc0b3 and project f75cb675742543209bcbb75d99b60e97. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:08.989451 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ea1a513-c4c7-47b2-9fcb-ccab176f27d6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.42 time: 0.459647 May 07 21:53:08.989672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:08.991338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:08.992109 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1135/2271] 10.222.0.32 () {62 vars in 1198 bytes} [Sat May 7 21:53:08 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 07 21:53:09.009771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3b220722-126c-4785-973f-6a32e1f73ace req-8863fcf5-aadf-4052-9455-0a1ed388f417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6963278d-8040-4bd4-82fd-8f6d81720c74", "tag": "5799274a-67eb-479c-9b5c-9d5a397d1f88"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:09.010111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.013643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.017812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.018868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.042136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b220722-126c-4785-973f-6a32e1f73ace req-8863fcf5-aadf-4052-9455-0a1ed388f417 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.042698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b220722-126c-4785-973f-6a32e1f73ace req-8863fcf5-aadf-4052-9455-0a1ed388f417 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.077155 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3b220722-126c-4785-973f-6a32e1f73ace req-8863fcf5-aadf-4052-9455-0a1ed388f417 service nova] Creating event network-changed:5799274a-67eb-479c-9b5c-9d5a397d1f88 for instance 6963278d-8040-4bd4-82fd-8f6d81720c74 on nch1-master-1 May 07 21:53:09.086571 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3b220722-126c-4785-973f-6a32e1f73ace req-8863fcf5-aadf-4052-9455-0a1ed388f417 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091094 May 07 21:53:09.087761 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1136/2272] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:09.101700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-baca3a81-ae13-4acf-9796-04a606d11105 req-af73552c-482c-44eb-9258-ff76497b1961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b485f98-6005-4fd2-a4ca-72e35f397c6a", "tag": "ddb906ce-ebec-489c-aec7-92f7055d4e24"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:09.136108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-baca3a81-ae13-4acf-9796-04a606d11105 req-af73552c-482c-44eb-9258-ff76497b1961 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.141076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-baca3a81-ae13-4acf-9796-04a606d11105 req-af73552c-482c-44eb-9258-ff76497b1961 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.169906 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-baca3a81-ae13-4acf-9796-04a606d11105 req-af73552c-482c-44eb-9258-ff76497b1961 service nova] Creating event network-changed:ddb906ce-ebec-489c-aec7-92f7055d4e24 for instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a on nch2-master-1 May 07 21:53:09.186412 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-baca3a81-ae13-4acf-9796-04a606d11105 req-af73552c-482c-44eb-9258-ff76497b1961 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096287 May 07 21:53:09.188110 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1137/2273] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:09.402369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:09.403537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:09.425043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.425526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.426350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.429733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.442698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:09.450464 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c27ef156-b2f9-4620-9dc9-16fde92ec1d4 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.472448 May 07 21:53:09.454521 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1137/2274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:08 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:09.657591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:09.673372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:09.678206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:09.681790 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0818c93e-aa5c-4a9e-a84e-c69af2635131 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.284004 May 07 21:53:09.697056 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1138/2275] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:09 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:09.755985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:09.757186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:09.763970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.764431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.765230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:09.765681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:09.849043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1347505911", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:09.916390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:53:10.337746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:10.351833 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f7f9061-cdea-4274-8891-86651ca6052f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1317 microversion: 2.1 time: 0.600790 May 07 21:53:10.352433 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1139/2276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:09 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:10.467626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:10.468509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:10.477501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:10.479827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:10.482733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:10.483418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:10.508012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:10.508596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:10.509312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:10.509782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:10.510253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:10.528796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:10.529447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:10.530447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:10.531097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:10.553070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Getting quotas for project 5dbdf17ebd9e4981b3435b13defa64d6. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:10.558729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Getting quotas for user 8f0d92d56cf344f0a591c64adea147e8 and project 5dbdf17ebd9e4981b3435b13defa64d6. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:10.578213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:53:10.593728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:53:10.657209 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1b7b63b9-ad0f-4e27-92af-b1093e06b895 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045172 May 07 21:53:10.659384 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1138/2277] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:53:10.671269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-43de66bc-84f5-4035-97c7-5974bc1dd828 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:10.672212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-43de66bc-84f5-4035-97c7-5974bc1dd828 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:10.918713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-43de66bc-84f5-4035-97c7-5974bc1dd828 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:10.939909 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-43de66bc-84f5-4035-97c7-5974bc1dd828 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1222 microversion: 2.1 time: 0.274723 May 07 21:53:10.942309 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1139/2278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:10 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:10.955958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:10.959458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:10.973355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:10.977406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:10.978345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:10.979116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:11.047790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:11.057520 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fe0c69e-21d7-4cb4-a01c-784d330e076a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.593570 May 07 21:53:11.063033 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1140/2279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:10 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:11.370712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:11.372192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:11.392170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:11.392634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:11.393440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:11.393890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:11.940002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:11.950793 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-754ed351-0f8e-4b22-be7c-0d6fc3641c8f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1317 microversion: 2.1 time: 0.583786 May 07 21:53:11.951386 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1141/2280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:11 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:11.960420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1b37456c-2847-4635-ab79-ab9efbbb5ec2 req-261c54db-e707-4754-9cf4-2456df86f0ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6963278d-8040-4bd4-82fd-8f6d81720c74", "tag": "6bd3efe5-7727-41cb-974d-fb9a80d5c1a5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:11.985562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1b37456c-2847-4635-ab79-ab9efbbb5ec2 req-261c54db-e707-4754-9cf4-2456df86f0ae service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:11.986375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1b37456c-2847-4635-ab79-ab9efbbb5ec2 req-261c54db-e707-4754-9cf4-2456df86f0ae service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:12.008042 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1b37456c-2847-4635-ab79-ab9efbbb5ec2 req-261c54db-e707-4754-9cf4-2456df86f0ae service nova] Creating event network-changed:6bd3efe5-7727-41cb-974d-fb9a80d5c1a5 for instance 6963278d-8040-4bd4-82fd-8f6d81720c74 on nch1-master-1 May 07 21:53:12.012568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:12.020904 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1b37456c-2847-4635-ab79-ab9efbbb5ec2 req-261c54db-e707-4754-9cf4-2456df86f0ae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064186 May 07 21:53:12.023321 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1142/2281] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:12.026902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:12.029780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:12.030702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:12.031861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:12.035885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2f204c34-1a76-49ba-a1d8-3245eb5dfe07 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 1.091284 May 07 21:53:12.038571 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1140/2282] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:10 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:12.040897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:12.041350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:12.042146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:12.042806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:12.076105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:12.078863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:12.100049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:12.102040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:12.103594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:12.104312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:12.184522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:12.208476 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd2fb513-543d-4866-a6c5-d0e70ece4ff3 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1274 microversion: 2.1 time: 0.180911 May 07 21:53:12.212189 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1143/2283] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:12 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:12.552070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:12.566842 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-325bb83f-4448-46ce-8e29-e4e03cf318aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.494992 May 07 21:53:12.568428 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1141/2284] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:12 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:12.970069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:12.971521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:12.980035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:12.980807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:12.981877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:12.982704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.057580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:13.059270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:13.066170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:13.066812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.068124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:13.068672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.229250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:13.243112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:13.246471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:13.248273 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48a9befe-322e-44e2-931d-d3d1dd104869 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.195421 May 07 21:53:13.249564 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1142/2285] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:13 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:53:13.268308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:13.269065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:13.282720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:13.283693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.285006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:13.285703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.378255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:13.391172 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55404889-5fa4-40cc-a843-dfefb564b00f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1280 microversion: 2.1 time: 0.139976 May 07 21:53:13.391782 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1143/2286] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:13 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1280 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:13.585558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:13.586099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:13.595484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:13.597761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.598792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:13.599232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.719805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:13.733552 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-433ff2ff-259b-4b28-a81a-3b693eee5e1d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1317 microversion: 2.1 time: 0.767670 May 07 21:53:13.734467 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1144/2287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:12 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:13.738949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2c0a368d-3be5-4528-b2f2-a13fa7550442 req-4b83a07c-2aee-45ea-8c2e-f454ecfb2218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b485f98-6005-4fd2-a4ca-72e35f397c6a", "name": "network-vif-plugged", "status": "completed", "tag": "ddb906ce-ebec-489c-aec7-92f7055d4e24"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:13.756167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2c0a368d-3be5-4528-b2f2-a13fa7550442 req-4b83a07c-2aee-45ea-8c2e-f454ecfb2218 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:13.757161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2c0a368d-3be5-4528-b2f2-a13fa7550442 req-4b83a07c-2aee-45ea-8c2e-f454ecfb2218 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:13.781234 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2c0a368d-3be5-4528-b2f2-a13fa7550442 req-4b83a07c-2aee-45ea-8c2e-f454ecfb2218 service nova] Creating event network-vif-plugged:ddb906ce-ebec-489c-aec7-92f7055d4e24 for instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a on nch2-master-1 May 07 21:53:13.786349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2c0a368d-3be5-4528-b2f2-a13fa7550442 req-4b83a07c-2aee-45ea-8c2e-f454ecfb2218 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050660 May 07 21:53:13.787058 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1145/2288] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:13.991587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:14.000504 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aeeb332e-74d3-409b-baa2-4ee179b93fcf tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.419354 May 07 21:53:14.001517 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1144/2289] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:13 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:14.234591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1216236767", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "509cbb97-8d95-4377-b498-4ce6a1d5a1d9"}, {"port": "c3af0b52-e2d3-4593-a7f9-ff7d7fa37fb8", "tag": "port-1"}, {"port": "7ea348ce-dc31-4a97-a925-458a8adb95a1", "tag": "port-2"}, {"uuid": "5159d3da-3059-47f6-8ecf-b4d9b2b9d7de", "tag": "net-1"}, {"uuid": "5159d3da-3059-47f6-8ecf-b4d9b2b9d7de"}, {"uuid": "609f4b94-ee73-43b2-a5f1-920ecad898a5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "609f4b94-ee73-43b2-a5f1-920ecad898a5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f7cbb2f4-5220-49cb-8e45-26c45c23a1b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1a25a58d-c451-4444-8959-9eaa3b7e6be1", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ce511f52-3a6f-4a80-8ff5-f2f4c9553392", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1730853155"}], "key_name": "tempest-keypair-614855448", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:14.269642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:14.270789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:14.284763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:14.285271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:14.287548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:14.287686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:14.408105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:14.436006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:14.437942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:14.439537 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b1d6582-7981-4f0c-a2ca-d263988ebd47 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.175774 May 07 21:53:14.452900 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1145/2290] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:14 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:53:14.474190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] validate_networks() for [('509cbb97-8d95-4377-b498-4ce6a1d5a1d9', None, None, None, None, None), (None, None, 'c3af0b52-e2d3-4593-a7f9-ff7d7fa37fb8', None, None, None), (None, None, '7ea348ce-dc31-4a97-a925-458a8adb95a1', None, None, None), ('5159d3da-3059-47f6-8ecf-b4d9b2b9d7de', None, None, None, None, None), ('5159d3da-3059-47f6-8ecf-b4d9b2b9d7de', None, None, None, None, None), ('609f4b94-ee73-43b2-a5f1-920ecad898a5', '10.2.2.100', None, None, None, None), ('609f4b94-ee73-43b2-a5f1-920ecad898a5', '10.2.2.200', None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:53:14.664262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-633d71ef-df62-4176-a99c-8dba446b29f3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Action: 'create', calling method: .version_select at 0x7fc41c559b80>, body: {"keypair": {"name": "tempest-keypair-1518885795"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:14.720539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-633d71ef-df62-4176-a99c-8dba446b29f3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for project 0b9502da27d64dffaf0859d1f6b5663f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:14.726824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-633d71ef-df62-4176-a99c-8dba446b29f3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for user 63a6acdebf9648698ee5f3a5cac02675 and project 0b9502da27d64dffaf0859d1f6b5663f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:15.345165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-633d71ef-df62-4176-a99c-8dba446b29f3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for project 0b9502da27d64dffaf0859d1f6b5663f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:15.360109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-633d71ef-df62-4176-a99c-8dba446b29f3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for user 63a6acdebf9648698ee5f3a5cac02675 and project 0b9502da27d64dffaf0859d1f6b5663f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:15.379627 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-633d71ef-df62-4176-a99c-8dba446b29f3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.925200 May 07 21:53:15.382058 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1146/2291] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 21:53:14 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:15.392720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:15.393980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:15.402030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:15.402845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:15.404799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:15.405511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:15.664269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:15.676073 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c31a01a5-9dd3-4c26-aebd-244d0cebc936 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1322 microversion: 2.1 time: 0.292434 May 07 21:53:15.687286 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1147/2292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:15 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:15.695015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:15.695796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:15.704855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:15.705374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:15.706233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:15.708060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:15.940894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:15.958643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-53a2ca09-ee37-4b02-b926-ed7a216fa22b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1507 microversion: 2.1 time: 0.266510 May 07 21:53:15.959504 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1148/2293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:15 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:15.974958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:15.976146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:15.989834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:15.990494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:15.997553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:15.999197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:16.252965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:16.265847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67e29be2-331b-45cb-9158-ca3f746fbe58 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.304119 May 07 21:53:16.268235 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1149/2294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:15 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:16.393551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1017488007", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "50bd2f97-b40e-4599-95f3-785427235a9f"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:16.537922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] validate_networks() for [('50bd2f97-b40e-4599-95f3-785427235a9f', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:53:17.649276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:17.649980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:17.650469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:17.650972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:17.651610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:17.670332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:17.672872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:17.676012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:17.676748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:17.722008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Getting quotas for project 30dc61c4cf2b43f986262f0c112abf49. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:17.741340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Getting quotas for user f766813e116b4b8fb0cca101161cd635 and project 30dc61c4cf2b43f986262f0c112abf49. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:17.765633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:53:17.768688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:53:17.846216 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-df8154e4-8839-4272-b755-1f4f0cd3d1ee tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576133 May 07 21:53:17.847107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1150/2295] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:53:17.870617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:17.871576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:17.896851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:17.897344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:17.904072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:17.904579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.058756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:18.068418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:18.081586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:18.100440 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ad47a9d-d5a7-4ef4-a565-dc6c5be1a157 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.240298 May 07 21:53:18.101445 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1151/2296] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:17 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:18.111234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:18.112000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:18.120856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.121430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.122620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.123302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.363823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:18.381163 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-568f1670-cc8e-499f-ac7c-a8c6ef39a10c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1507 microversion: 2.1 time: 0.278080 May 07 21:53:18.394104 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1152/2297] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:18 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:18.403710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:18.404659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:18.410996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.411459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.412414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.412889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.607580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:18.615568 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de53b001-e72c-4e39-bc51-c8e0e3a00b8c tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1322 microversion: 2.1 time: 0.219228 May 07 21:53:18.617025 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1153/2298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:18 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:18.621874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a8ede5b6-1706-4205-856f-2a66ac209c6c req-54ffd166-77c3-413c-ab21-b49cde625668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf893208-e805-488d-abb0-38477b4858b2", "tag": "8aa3ddb5-af68-4e84-8882-3a527916b441"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:18.630164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a8ede5b6-1706-4205-856f-2a66ac209c6c req-54ffd166-77c3-413c-ab21-b49cde625668 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.630704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a8ede5b6-1706-4205-856f-2a66ac209c6c req-54ffd166-77c3-413c-ab21-b49cde625668 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.643849 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a8ede5b6-1706-4205-856f-2a66ac209c6c req-54ffd166-77c3-413c-ab21-b49cde625668 service nova] Creating event network-changed:8aa3ddb5-af68-4e84-8882-3a527916b441 for instance bf893208-e805-488d-abb0-38477b4858b2 on nch1-master-1 May 07 21:53:18.649869 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a8ede5b6-1706-4205-856f-2a66ac209c6c req-54ffd166-77c3-413c-ab21-b49cde625668 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031416 May 07 21:53:18.650797 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1154/2299] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:18.657530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:18.659147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:18.666205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.666797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.667735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.668189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.853809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:18.861915 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-142ad866-377e-4c4b-a34f-3e71a3a109b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.209874 May 07 21:53:18.862945 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1155/2300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:18 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:18.878941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:18.882896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:18.892030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.892763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.893930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:18.894607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:18.977791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:18.986057 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4bfa7211-1729-4f06-ab08-d8e8ce0e297b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1228 microversion: 2.1 time: 0.114511 May 07 21:53:18.986872 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1156/2301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:18 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1228 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:19.002070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:19.003810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:19.027136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.027949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.029468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.031248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.182422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:19.182876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:19.183356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:19.183797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:19.184213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:19.280952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:19.287167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.288172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.289249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.289961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.318058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:19.318583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:19.319039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:19.319459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:19.319945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:19.321916 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-695f9175-2149-426f-b5d4-dae41654de1c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "POST /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a/action" status: 202 len: 1109 microversion: 2.1 time: 0.333798 May 07 21:53:19.322604 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1157/2302] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:53:18 2022] POST /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a/action => generated 1109 bytes in 335 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 07 21:53:19.327408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:19.328298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:19.329027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.329487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.330293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.330962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.337123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.337668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.338548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.339038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.354734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Getting quotas for project f75cb675742543209bcbb75d99b60e97. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:19.360100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Getting quotas for user 60446154374c4fac9315543687cdc0b3 and project f75cb675742543209bcbb75d99b60e97. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:19.425465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:19.434218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:19.435946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:19.437386 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7d8480bb-57d3-4815-9a22-ec898d1f37aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1366 microversion: 2.57 time: 0.113571 May 07 21:53:19.438490 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1158/2303] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:19 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:19.444266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:19.445202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:19.452551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.453066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.454007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.454588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.557934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:53:19.561293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f7cbb2f4-5220-49cb-8e45-26c45c23a1b0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1a25a58d-c451-4444-8959-9eaa3b7e6be1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce511f52-3a6f-4a80-8ff5-f2f4c9553392',volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:53:19.718192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:19.725676 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b60d2ff-c174-4f83-8b66-a500ae8a5a46 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.285833 May 07 21:53:19.726536 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1159/2304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:19 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:19.731656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:19.732564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:19.740715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.741305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.742410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.743146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.933968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:19.942616 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-226a6c95-889c-4147-b490-a385dec385de tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1322 microversion: 2.1 time: 0.214552 May 07 21:53:19.943318 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1160/2305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:19 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:19.957782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:19.958505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:19.967079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.967737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:19.969048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:19.969897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.000095 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1ebd58c0-efd0-4ca5-87d0-26045a6f7efc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 5.770531 May 07 21:53:20.001139 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1146/2306] 10.222.0.32 () {62 vars in 1188 bytes} [Sat May 7 21:53:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 5772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:53:20.009901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:20.015794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:20.027501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.028244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.029235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.030490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.121925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.136189 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c9ee7897-7990-4def-b5da-2f025d1c881e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1282 microversion: 2.1 time: 0.133551 May 07 21:53:20.149145 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1147/2307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:20 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:20.161839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-071b848f-8081-40b4-afed-f2f5e84ba036 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:20.162894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-071b848f-8081-40b4-afed-f2f5e84ba036 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:20.240474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-071b848f-8081-40b4-afed-f2f5e84ba036 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.252694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-071b848f-8081-40b4-afed-f2f5e84ba036 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.254696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-071b848f-8081-40b4-afed-f2f5e84ba036 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.256187 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-071b848f-8081-40b4-afed-f2f5e84ba036 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1285 microversion: 2.42 time: 0.105343 May 07 21:53:20.257675 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1148/2308] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:20 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:20.356840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-85343b8b-eb3b-4b29-8c37-2fcbeeaac1b5 req-8292c9b5-db88-41cf-bb5e-12b1733cd380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6963278d-8040-4bd4-82fd-8f6d81720c74", "name": "network-vif-plugged", "status": "completed", "tag": "6bd3efe5-7727-41cb-974d-fb9a80d5c1a5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:20.383266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-85343b8b-eb3b-4b29-8c37-2fcbeeaac1b5 req-8292c9b5-db88-41cf-bb5e-12b1733cd380 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.384630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-85343b8b-eb3b-4b29-8c37-2fcbeeaac1b5 req-8292c9b5-db88-41cf-bb5e-12b1733cd380 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.414714 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-85343b8b-eb3b-4b29-8c37-2fcbeeaac1b5 req-8292c9b5-db88-41cf-bb5e-12b1733cd380 service nova] Creating event network-vif-plugged:6bd3efe5-7727-41cb-974d-fb9a80d5c1a5 for instance 6963278d-8040-4bd4-82fd-8f6d81720c74 on nch1-master-1 May 07 21:53:20.449791 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-85343b8b-eb3b-4b29-8c37-2fcbeeaac1b5 req-8292c9b5-db88-41cf-bb5e-12b1733cd380 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096215 May 07 21:53:20.453444 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1149/2309] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:53:20.467005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:20.467734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:20.502839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.503302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.504089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.504531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.508046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.530979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82615e23-2f65-4abf-b58c-817f225f3d3a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.579391 May 07 21:53:20.551193 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1161/2310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:19 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:20.671510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.690047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.693856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:20.695980 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-55efbe6c-1133-4b3f-b28d-4e4fabea1e69 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1372 microversion: 2.57 time: 0.234393 May 07 21:53:20.709250 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1150/2311] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:20 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:20.743845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:20.744473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:20.750584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.751133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.751844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.752287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.962645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:20.963837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:20.986348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.986818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:20.987604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:20.988047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.058351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.067005 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-50c694c4-1ddc-49a6-ac20-165c9a03a56e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.327427 May 07 21:53:21.071633 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1162/2312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:20 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:21.090049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1603822590", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1f24181a-d123-46a2-bb1f-06c929171e6c"}], "security_groups": [{"name": "tempest-securitygroup--1701031587"}], "key_name": "tempest-keypair-1518885795", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "03b8428c-d607-4323-a5b3-0814d754827a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:21.210822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.218815 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b50ba7b-3e70-4bfe-ad9e-e5f291f4f460 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1322 microversion: 2.1 time: 0.262988 May 07 21:53:21.219414 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1151/2313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:20 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:21.234535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:21.235275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:21.242679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.243317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.244448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.244903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.295718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] validate_networks() for [('1f24181a-d123-46a2-bb1f-06c929171e6c', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:53:21.380766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.389626 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6285f5d2-89b2-4d59-a08b-efc25e56d8a9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.169212 May 07 21:53:21.390212 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1152/2314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:21 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:21.394892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:21.395792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:21.403870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.404331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.405147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.405591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.478296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.487652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.489515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.490720 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f179f211-b831-40e7-9c1e-a5ca1715535a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1527 microversion: 2.42 time: 0.099539 May 07 21:53:21.491332 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1153/2315] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:21 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1527 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:21.550657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:21.551514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:21.559433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.560144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.561406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.561995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.743068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.753333 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9eaf68d8-86a6-40e4-a74d-78636a75e7aa tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.207618 May 07 21:53:21.754716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1154/2316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:21 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:21.761948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:21.762707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:21.769322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.769861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.770740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:21.771272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:21.845528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.854332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.855963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:21.857357 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5f1a0a41-4293-4bab-af47-809d21aa8023 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1372 microversion: 2.57 time: 0.101357 May 07 21:53:21.858232 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1155/2317] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:21 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:22.089893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:22.098239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:22.104592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.105180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.106096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.106828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.263629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:22.274287 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ca2c6f82-fc99-4f40-a9f0-1b264f4af412 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.188592 May 07 21:53:22.275307 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1156/2318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:22 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:22.280400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4f014336-d98e-48d5-8a6b-154c17a639c7 req-6490294d-9ec7-4fa8-83b7-258ea73fa2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04703f55-713a-4a4d-ba3f-551622d66f93", "tag": "7e3541c5-8b43-4853-87f1-12bbd6ab00a7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:22.289744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4f014336-d98e-48d5-8a6b-154c17a639c7 req-6490294d-9ec7-4fa8-83b7-258ea73fa2e6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.290278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4f014336-d98e-48d5-8a6b-154c17a639c7 req-6490294d-9ec7-4fa8-83b7-258ea73fa2e6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.301634 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4f014336-d98e-48d5-8a6b-154c17a639c7 req-6490294d-9ec7-4fa8-83b7-258ea73fa2e6 service nova] Creating event network-changed:7e3541c5-8b43-4853-87f1-12bbd6ab00a7 for instance 04703f55-713a-4a4d-ba3f-551622d66f93 on nch1-master-1 May 07 21:53:22.306867 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4f014336-d98e-48d5-8a6b-154c17a639c7 req-6490294d-9ec7-4fa8-83b7-258ea73fa2e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030149 May 07 21:53:22.307683 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1157/2319] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:22.312589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:22.313284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:22.319597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.320049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.320821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.321251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.340829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for project 0b9502da27d64dffaf0859d1f6b5663f. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:22.346762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for user 63a6acdebf9648698ee5f3a5cac02675 and project 0b9502da27d64dffaf0859d1f6b5663f. Resources: dict_keys(['metadata_items']) {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:22.361262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:22.361950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:22.362438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:22.362886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:22.363469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:22.373251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.373711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.374524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.375209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.394249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for project 0b9502da27d64dffaf0859d1f6b5663f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:22.401897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Getting quotas for user 63a6acdebf9648698ee5f3a5cac02675 and project 0b9502da27d64dffaf0859d1f6b5663f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:22.470420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:22.471222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:53:22.473407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03b8428c-d607-4323-a5b3-0814d754827a',volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:53:22.479147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d0c9ee3-acbd-4b58-af26-0b21b2dcf0bb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1322 microversion: 2.1 time: 0.170244 May 07 21:53:22.480062 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1158/2320] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:22 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:22.484950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:22.485572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:22.495587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.496063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.496868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.497315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.654455 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8424fda-dc0f-4969-b461-959e0cdbca70 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.571766 May 07 21:53:22.655261 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1163/2321] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:21 2022] POST /compute/v2.1/servers => generated 407 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:53:22.661747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:22.662943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:22.669511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.670475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.671463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.672473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.686238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:22.701769 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8570c5fc-d999-47b6-94e5-de2f7d535056 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.220250 May 07 21:53:22.711820 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1159/2322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:22 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:22.717013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4456c424-965e-435e-8fed-23ae3f291dd8 req-a861c242-5f85-4e63-9fb3-dc00f109a3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6963278d-8040-4bd4-82fd-8f6d81720c74", "name": "network-vif-plugged", "status": "completed", "tag": "5799274a-67eb-479c-9b5c-9d5a397d1f88"}, {"server_uuid": "bf893208-e805-488d-abb0-38477b4858b2", "name": "network-vif-plugged", "status": "completed", "tag": "8aa3ddb5-af68-4e84-8882-3a527916b441"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:22.728591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4456c424-965e-435e-8fed-23ae3f291dd8 req-a861c242-5f85-4e63-9fb3-dc00f109a3dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.729043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4456c424-965e-435e-8fed-23ae3f291dd8 req-a861c242-5f85-4e63-9fb3-dc00f109a3dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.749996 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4456c424-965e-435e-8fed-23ae3f291dd8 req-a861c242-5f85-4e63-9fb3-dc00f109a3dc service nova] Creating event network-vif-plugged:5799274a-67eb-479c-9b5c-9d5a397d1f88 for instance 6963278d-8040-4bd4-82fd-8f6d81720c74 on nch1-master-1 May 07 21:53:22.750807 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4456c424-965e-435e-8fed-23ae3f291dd8 req-a861c242-5f85-4e63-9fb3-dc00f109a3dc service nova] Creating event network-vif-plugged:8aa3ddb5-af68-4e84-8882-3a527916b441 for instance bf893208-e805-488d-abb0-38477b4858b2 on nch1-master-1 May 07 21:53:22.763617 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4456c424-965e-435e-8fed-23ae3f291dd8 req-a861c242-5f85-4e63-9fb3-dc00f109a3dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050294 May 07 21:53:22.767803 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1160/2323] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:22.772387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:22.785756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:22.788536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:22.790463 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95c9b2f5-a16c-4594-92e8-726ea455d1ba tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1583 microversion: 2.42 time: 0.133576 May 07 21:53:22.790751 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1164/2324] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:22 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1583 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:22.795772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-190b15d7-7b27-4dc3-8083-9de959b82256 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:22.799044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-190b15d7-7b27-4dc3-8083-9de959b82256 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:22.810969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:22.812347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:22.820750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.821956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.823033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.824091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.858996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-190b15d7-7b27-4dc3-8083-9de959b82256 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:22.868834 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-190b15d7-7b27-4dc3-8083-9de959b82256 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1122 microversion: 2.1 time: 0.099206 May 07 21:53:22.872709 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1161/2325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:22 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1122 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:22.878032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:22.878816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:22.887990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.888449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:22.889386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:22.889828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.033619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:23.047149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:23.054406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:23.058750 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7b695120-4569-4a6b-9fbe-1de3557a08aa tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1372 microversion: 2.57 time: 0.182413 May 07 21:53:23.060786 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1162/2326] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:22 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:23.090609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:23.102926 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be4fc874-7e3d-4a17-9c1f-24aef66e750a tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.302494 May 07 21:53:23.110813 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1165/2327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:22 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:23.292098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:23.292722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:23.299863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.300251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.301238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.301511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.498489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:23.499668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:23.512507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.513106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.514304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.515067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.530212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:23.538702 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be9b42cc-3ca3-4f98-9a43-c9117b2f97f1 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.250994 May 07 21:53:23.548644 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1163/2328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:23 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:23.718262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:23.719513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:23.731560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.733541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.734603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.737591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.811593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:23.823950 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f80f800a-f143-4446-b5a3-ba4af8900946 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1322 microversion: 2.1 time: 0.330922 May 07 21:53:23.825674 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1166/2329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:23 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:23.844056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:23.845017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:23.851548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.852244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:23.853227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:23.853886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.066967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.081366 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8cf41dc1-1694-4e62-8ecf-5693aedaeed3 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.367641 May 07 21:53:24.081971 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1164/2330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:23 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:24.095195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:24.095819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:24.110617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.111405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.112395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.113035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.122952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.135963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.137658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.138870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f86a2c49-d7d9-493e-b3d9-612c44957c09 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1661 microversion: 2.42 time: 0.299863 May 07 21:53:24.139995 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1167/2331] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:23 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1661 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:24.144944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:24.145864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:24.164201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.164645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.165438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.165881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.210929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.226686 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bda3ae83-82a7-434d-91df-c2af64b6e741 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1220 microversion: 2.1 time: 0.134935 May 07 21:53:24.227880 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1165/2332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:24 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:24.234386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:24.236080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:24.245886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.246569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.247630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.248505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.266487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.275508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.277331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.278867 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1bd0e695-1272-463c-a5e8-d309ea474047 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1357 microversion: 2.57 time: 0.137653 May 07 21:53:24.280054 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1168/2333] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:24 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1357 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:24.300820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:24.301624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:24.308664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.309124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.310194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.310424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.343030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:53:24.446501 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-750cb4e9-fcce-44ba-bcdc-e5398ca09682 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "DELETE /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 204 len: 0 microversion: 2.57 time: 0.146527 May 07 21:53:24.447642 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1169/2334] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:53:24 2022] DELETE /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:53:24.461417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:24.462499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:24.472518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.474283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.476300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.477189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.557618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.567312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.569437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.571515 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a197b280-74e5-4f5e-b266-379b2bcb0541 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1363 microversion: 2.57 time: 0.119744 May 07 21:53:24.572564 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1170/2335] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:24 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1363 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:24.577545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:24.578204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:24.587009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.587647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.588630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.589365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.634526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.657766 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a03b3fec-f98c-4581-9964-9bdb27bfb316 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.428616 May 07 21:53:24.659424 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1166/2336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:24 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:24.751087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:24.760223 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-931ee49e-4427-4981-b079-6ddff85ab9c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.186569 May 07 21:53:24.761007 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1171/2337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:24 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:24.841712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:24.842513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:24.849180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.849723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:24.850715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:24.851244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.056540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.066177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-759d4fb2-47a9-466c-adea-0033eaba3bb7 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1322 microversion: 2.1 time: 0.228304 May 07 21:53:25.067244 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1167/2338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:24 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:25.098648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:25.099579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:25.106321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.107073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.108466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.109441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.160613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:25.161241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:25.174147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.175213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.176235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.177188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.420566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.426981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.444076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.445648 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4430153b-07fa-403e-9bf5-776d0780c8c6 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.350559 May 07 21:53:25.445816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.447390 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1172/2339] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:25 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:25.447543 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3458c08b-24ff-45f1-82a3-2cb92276e8eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1708 microversion: 2.42 time: 0.290338 May 07 21:53:25.448346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1168/2340] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:25 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1708 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:25.457536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:25.458888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:25.466154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.466918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.467915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.468588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.546278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.553930 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-617bed29-28fe-405a-8998-dd060ebf83fd tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1238 microversion: 2.1 time: 0.104301 May 07 21:53:25.554499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1173/2341] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:25 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:25.590650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:25.591291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:25.597157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.597604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.598363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.598884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.677129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:25.678042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:25.682079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.686108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.686786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.688478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.689137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.695040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.696451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d64d1550858400a8a7804dcdb7a0110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe0f4d227c4e7d9c5c8afafd82f975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.697646 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-01c047b0-030e-4125-87d3-ab955d9bb9f2 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 200 len: 1363 microversion: 2.57 time: 0.110993 May 07 21:53:25.708288 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1169/2342] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:25 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 1363 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:25.777668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:25.778862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:25.791244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.793856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.795666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:25.797189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:25.900443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:25.911753 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6cf75a03-214c-4919-bd74-b1d85f88e06f tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1333 microversion: 2.1 time: 0.240191 May 07 21:53:25.921453 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1174/2343] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:25 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1333 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:26.083267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:26.083904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:26.102542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:26.112847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.113049 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c92c1aac-4c70-41a6-b317-81a82fb83eeb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.337356 May 07 21:53:26.113896 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1170/2344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:25 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:26.114165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.119775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.120255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.395853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:26.404055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-445723aa-e7c4-47f3-8e90-45c72ceeaf76 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1471 microversion: 2.1 time: 0.324466 May 07 21:53:26.404628 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1175/2345] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:26 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:26.468159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:26.470166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:26.480593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.481435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.482632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.483612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.678844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e10ecf8c-bd00-42b5-b45c-892e32dc91df tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:26.679451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e10ecf8c-bd00-42b5-b45c-892e32dc91df tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] [instance: 49b97b86-7853-49e9-a377-54007fb77bde] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:26.701323 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e10ecf8c-bd00-42b5-b45c-892e32dc91df tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] HTTP exception thrown: Instance 49b97b86-7853-49e9-a377-54007fb77bde could not be found. May 07 21:53:26.701942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e10ecf8c-bd00-42b5-b45c-892e32dc91df tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Returning 404 to user: Instance 49b97b86-7853-49e9-a377-54007fb77bde could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:26.704445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e10ecf8c-bd00-42b5-b45c-892e32dc91df tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/49b97b86-7853-49e9-a377-54007fb77bde/action" status: 404 len: 111 microversion: 2.1 time: 0.285495 May 07 21:53:26.732530 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1171/2346] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:53:26 2022] POST /compute/v2.1/servers/49b97b86-7853-49e9-a377-54007fb77bde/action => generated 111 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:26.753451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:26.758961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:26.784545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.784922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.791809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.793125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.794277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:26.802110 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-56e0fafc-ffe7-4d2e-ad00-e08f09fd64db tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.340057 May 07 21:53:26.812120 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1176/2347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:26 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:26.840007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:26.841777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:26.849054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.849510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.850351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.850937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.958620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:26.968846 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2ec29b8-ed40-4c8e-87cd-89f6e07b0aa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1238 microversion: 2.1 time: 0.155595 May 07 21:53:26.969796 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1177/2348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:26 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1238 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:26.976256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:26.977085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] [instance: 93763c68-763e-42ac-8855-5e7fed771529] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:26.986388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.986859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:26.988618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:26.988771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.005847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] HTTP exception thrown: Instance 93763c68-763e-42ac-8855-5e7fed771529 could not be found. May 07 21:53:27.007340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] Returning 404 to user: Instance 93763c68-763e-42ac-8855-5e7fed771529 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:27.008418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ba12097b-66da-429a-aba7-1c578ca56027 tempest-ServerShowV257Test-572012695 tempest-ServerShowV257Test-572012695-project] 10.222.0.32 "GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529" status: 404 len: 111 microversion: 2.57 time: 0.037259 May 07 21:53:27.012248 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1178/2349] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:26 2022] GET /compute/v2.1/servers/93763c68-763e-42ac-8855-5e7fed771529 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:53:27.031336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:27.032432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:27.042029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.042620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.043562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.044385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.256890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:27.264253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:27.266136 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a670eb7-18c9-4dd4-a0b5-b40f05f4179d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1668 microversion: 2.1 time: 0.255808 May 07 21:53:27.273408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:27.275338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:27.276766 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-438f5f09-fd7f-4a2f-a549-c36ea5f83ae4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1708 microversion: 2.42 time: 0.542932 May 07 21:53:27.288112 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1179/2350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:27 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1668 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:27.288112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-110743091", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:27.290285 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1172/2351] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:26 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1708 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:27.295300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:27.296227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:27.302564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.304154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.305221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.305882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.370269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:53:27.760195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:27.760650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:27.761131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:27.761546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:27.761965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:27.774376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.774972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.775850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.776372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.797769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Getting quotas for project 5dbdf17ebd9e4981b3435b13defa64d6. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:27.804450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Getting quotas for user 8f0d92d56cf344f0a591c64adea147e8 and project 5dbdf17ebd9e4981b3435b13defa64d6. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:27.818900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:53:27.822000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:53:27.830646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:27.839142 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ba591ef5-1b6b-4d93-a2f6-514d5eb4c9e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.547456 May 07 21:53:27.842888 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1173/2352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:27 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:27.845016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0088488-a280-4a19-8731-3619bcb943b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:27.847131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d0088488-a280-4a19-8731-3619bcb943b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:27.854961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0088488-a280-4a19-8731-3619bcb943b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.855736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0088488-a280-4a19-8731-3619bcb943b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.856535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0088488-a280-4a19-8731-3619bcb943b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.856985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0088488-a280-4a19-8731-3619bcb943b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.884003 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b4349d81-83e3-4803-b81b-dca9f777372a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604896 May 07 21:53:27.884947 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1180/2353] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:53:27.886017 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0088488-a280-4a19-8731-3619bcb943b3 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74/ips" status: 200 len: 179 microversion: 2.1 time: 0.044576 May 07 21:53:27.887002 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1174/2354] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 21:53:27 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74/ips => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:27.890391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:27.891221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:27.895725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bb4ce51-8a1f-4d70-a8af-e893b4e4916d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:27.896416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bb4ce51-8a1f-4d70-a8af-e893b4e4916d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:27.900872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.901554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:27.902659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:27.903285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.061932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5bb4ce51-8a1f-4d70-a8af-e893b4e4916d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:28.072789 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bb4ce51-8a1f-4d70-a8af-e893b4e4916d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1221 microversion: 2.1 time: 0.181911 May 07 21:53:28.082138 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1175/2355] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:27 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:28.082138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:28.082138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:28.082550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:28.096487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.096952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.097881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.098178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.112487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ada5251c-d4b0-4f44-90c6-4020df061648 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.226127 May 07 21:53:28.113081 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1181/2356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:27 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:28.120299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:28.120973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:28.127605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.129933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.131793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.132319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.173271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:53:28.341023 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c2e63d4-2418-4e83-976f-c40a9246fd09 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 204 len: 0 microversion: 2.1 time: 0.265745 May 07 21:53:28.345008 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1176/2357] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:28 2022] DELETE /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:53:28.349906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-86300b77-6d2b-4775-812b-3d7191ddeb19 req-18ffbb65-9a36-47d2-ac34-f37617b781d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04703f55-713a-4a4d-ba3f-551622d66f93", "name": "network-vif-plugged", "status": "completed", "tag": "7e3541c5-8b43-4853-87f1-12bbd6ab00a7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:28.361516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-86300b77-6d2b-4775-812b-3d7191ddeb19 req-18ffbb65-9a36-47d2-ac34-f37617b781d4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.362310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-86300b77-6d2b-4775-812b-3d7191ddeb19 req-18ffbb65-9a36-47d2-ac34-f37617b781d4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.367038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:28.375641 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a251518-6bbb-4b9d-b0bc-88583f718c28 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.260921 May 07 21:53:28.377146 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-86300b77-6d2b-4775-812b-3d7191ddeb19 req-18ffbb65-9a36-47d2-ac34-f37617b781d4 service nova] Creating event network-vif-plugged:7e3541c5-8b43-4853-87f1-12bbd6ab00a7 for instance 04703f55-713a-4a4d-ba3f-551622d66f93 on nch1-master-1 May 07 21:53:28.383763 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1182/2358] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:28 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:28.387157 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-86300b77-6d2b-4775-812b-3d7191ddeb19 req-18ffbb65-9a36-47d2-ac34-f37617b781d4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043324 May 07 21:53:28.388092 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1177/2359] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:28.392086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:28.392721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:28.397565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:28.398950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:28.399247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.399685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.400692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.401327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.408086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.408704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.410632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.411354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.571543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:28.581181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:28.582824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:28.584282 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-989ac1ba-91f0-4409-87ec-94ffc10b7a08 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1743 microversion: 2.42 time: 0.196422 May 07 21:53:28.585009 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1183/2360] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:28 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1743 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:28.857333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:28.857985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:28.868123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.868832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.869814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:28.870490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:28.875218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:28.887906 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-65221d4c-51d7-47f4-893f-8d70ab7e7530 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1674 microversion: 2.1 time: 0.497957 May 07 21:53:28.888799 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1178/2361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:28 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1674 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:29.073127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:29.085852 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c734143-bb59-4bd9-b0ea-908ea419aaa5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.232637 May 07 21:53:29.087042 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1184/2362] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:28 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:29.099711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:29.100969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:29.114671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.115575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.117262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.117910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.130637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:29.131686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:29.139255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.142185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.144719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.148296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.361033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:29.361677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:29.370860 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f45faef4-4eda-46d3-a126-6e9323f569cb tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1281 microversion: 2.1 time: 0.284058 May 07 21:53:29.371519 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1179/2363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:29 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1281 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:29.379173 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c17bfbc9-e99c-4688-ae64-4ddcc69a4436 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.252217 May 07 21:53:29.379762 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1185/2364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:29 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:29.406334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:29.408933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:29.420605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.421176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.422078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.423111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.609894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:29.610864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:29.622698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.625447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.626803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.627833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.777396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:29.787132 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-55501942-d24f-469a-b14c-718f25d73006 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.397254 May 07 21:53:29.793870 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1180/2365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:29 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:29.908301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:29.909667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:29.921058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.922832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.925476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:29.927769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:29.945057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:29.967279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:29.971478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:29.974834 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-abc254de-ba24-41f0-9f2a-c4bc86eefd3f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1743 microversion: 2.42 time: 0.374446 May 07 21:53:29.989721 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1186/2366] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:29 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1743 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:30.103878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:30.104494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:30.116813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.117615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.118663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.120295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.370689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:30.379540 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff0b5de4-bbf0-4816-9c9f-cb204bafb2c5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.278573 May 07 21:53:30.383093 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1187/2367] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:30 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:30.390720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e665793e-cc67-4c2b-a4a4-172c712383a8 req-4f69ab57-0908-49c7-a70c-eacb8831164f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df1b628-71b8-4dd0-893e-521f565ba1fc", "tag": "086eedec-731a-4836-8a01-603bbdb8a932"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:30.411469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e665793e-cc67-4c2b-a4a4-172c712383a8 req-4f69ab57-0908-49c7-a70c-eacb8831164f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.412840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e665793e-cc67-4c2b-a4a4-172c712383a8 req-4f69ab57-0908-49c7-a70c-eacb8831164f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.426623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e665793e-cc67-4c2b-a4a4-172c712383a8 req-4f69ab57-0908-49c7-a70c-eacb8831164f service nova] Creating event network-changed:086eedec-731a-4836-8a01-603bbdb8a932 for instance 7df1b628-71b8-4dd0-893e-521f565ba1fc on nch1-master-1 May 07 21:53:30.433500 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e665793e-cc67-4c2b-a4a4-172c712383a8 req-4f69ab57-0908-49c7-a70c-eacb8831164f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049150 May 07 21:53:30.434692 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1188/2368] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:30.443192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:30.444238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:30.452189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.454670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.455688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.459849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.586224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:30.596072 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4fa8466f-e259-4286-a23f-706e3c45e738 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1279 microversion: 2.1 time: 0.159921 May 07 21:53:30.607729 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1189/2369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:30 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1279 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:30.613485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:30.614356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:30.624234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.625134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.626183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.626966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.763620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:30.771201 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bd43127e-6b6b-44f3-99e1-295c8faad103 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1674 microversion: 2.1 time: 0.869543 May 07 21:53:30.779412 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1181/2370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:29 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1674 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:30.807466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:30.808552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:30.828972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.829449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.830254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:30.830707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:30.964702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:30.988944 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bf39b0b4-fca0-4204-beaa-4ccfc9f3e17f tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1324 microversion: 2.1 time: 0.372537 May 07 21:53:31.000715 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1190/2371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:30 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:31.007533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:31.008430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:31.023570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.027803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:31.028976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.034277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:31.334096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:31.344870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:31.347396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:31.349091 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1487eb2a-9b93-4053-860a-4965a00bd2f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1790 microversion: 2.42 time: 0.346630 May 07 21:53:31.350397 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1191/2372] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:31 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1790 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:31.398058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:31.398801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:31.407197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.408045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:31.409083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.410178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:31.531312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:31.547638 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d573474-3d91-44c7-9e93-f6e65dc117f1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.743676 May 07 21:53:31.549525 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1182/2373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:30 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:31.616411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:31.618533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:31.629529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.629927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:31.631736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.633312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:31.651233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:31.680432 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fe316745-e38a-4ce7-a3c4-01a1a21c5520 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.275069 May 07 21:53:31.681282 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1192/2374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:31 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:31.790743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:31.801954 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ab29f03-6527-4782-9c43-a4a9a8c0b56f tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1279 microversion: 2.1 time: 0.189876 May 07 21:53:31.802435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:31.803837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:31.804273 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1183/2375] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:31 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:31.819955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.820449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:31.824716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:31.825914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:32.006160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:32.007245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:32.020952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:32.023959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:32.026787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:32.027279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:32.218712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:32.232670 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47115c8a-e88c-4a7e-88a2-68f291d4a2d7 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1674 microversion: 2.1 time: 0.438300 May 07 21:53:32.239344 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1193/2376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:31 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1674 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:32.367942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:32.368592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:32.383962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:32.384420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:32.385206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:32.385641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:32.830099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:32.840052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:32.842550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:32.843850 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9386713b-060f-43de-bbc9-edccb0342bfe tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1790 microversion: 2.42 time: 0.479808 May 07 21:53:32.844653 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1194/2377] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:32 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1790 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:32.853864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:32.855378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:32.872692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:32.875535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:32.879360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:32.882169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.224792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:33.248673 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8442f8f-1825-488a-af2f-9f7307b7e187 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1520 microversion: 2.1 time: 1.246939 May 07 21:53:33.249276 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1184/2378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:32 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1520 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:33.279864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:33.283536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:33.315139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:33.315582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.316377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:33.322834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.383312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:33.401344 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-612ddd89-37a6-4583-b041-234c1c62ebb3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.552474 May 07 21:53:33.405438 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1195/2379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:32 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:33.456090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:33.457581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:33.480311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:33.481052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.482032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:33.482707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.784125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:33.792152 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dfcbf480-1537-4e8b-b102-d63fe8f3b5b5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.370551 May 07 21:53:33.792740 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1196/2380] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:33 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:33.799577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b5a0ef81-a17c-4411-867a-58ce70ce28fb req-dec4d18a-7947-4f6f-bb58-2ea76a6e82d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6963278d-8040-4bd4-82fd-8f6d81720c74", "name": "network-vif-deleted", "tag": "6bd3efe5-7727-41cb-974d-fb9a80d5c1a5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:33.810672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b5a0ef81-a17c-4411-867a-58ce70ce28fb req-dec4d18a-7947-4f6f-bb58-2ea76a6e82d7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:33.811427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b5a0ef81-a17c-4411-867a-58ce70ce28fb req-dec4d18a-7947-4f6f-bb58-2ea76a6e82d7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.825096 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b5a0ef81-a17c-4411-867a-58ce70ce28fb req-dec4d18a-7947-4f6f-bb58-2ea76a6e82d7 service nova] Creating event network-vif-deleted:6bd3efe5-7727-41cb-974d-fb9a80d5c1a5 for instance 6963278d-8040-4bd4-82fd-8f6d81720c74 on nch1-master-1 May 07 21:53:33.831053 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b5a0ef81-a17c-4411-867a-58ce70ce28fb req-dec4d18a-7947-4f6f-bb58-2ea76a6e82d7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036891 May 07 21:53:33.831870 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1197/2381] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:33.838704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:33.839740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:33.874417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:33.876480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.878560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:33.879873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:33.951964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:33.968138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd7a9531-6f54-49c5-89b5-300ebf1a1b73 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.706515 May 07 21:53:33.981516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1185/2382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:33 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:33.990270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e51460f-1098-4ed9-8c5b-d5766b2062a7 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1070183656", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "50bd2f97-b40e-4599-95f3-785427235a9f"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:33.999632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e51460f-1098-4ed9-8c5b-d5766b2062a7 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:34.000492 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e51460f-1098-4ed9-8c5b-d5766b2062a7 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017956 May 07 21:53:34.006375 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1186/2383] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:33 2022] POST /compute/v2.1/servers => generated 175 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:53:34.012295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:34.017154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:34.031979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.034521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.036026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.041486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.286045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:34.299346 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-28da1bc0-d078-4ce2-8f58-8af019e19f65 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1495 microversion: 2.1 time: 0.465031 May 07 21:53:34.311625 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1198/2384] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:33 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1495 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:34.319288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ffd61d7-05ac-4061-ba7c-ad9ea39417e6"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:34.321962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:34.328766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.329666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.331559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.332689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.700804 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4fe6c108-7adb-4151-bb8d-6fb2ae0517f5 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "POST /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387108 May 07 21:53:34.702319 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1199/2385] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 21:53:34 2022] POST /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:34.727475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-487fe510-5f3e-4f2a-8094-65d8beb6233b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:34.729042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-487fe510-5f3e-4f2a-8094-65d8beb6233b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 6aaee1d5-63de-463c-b50e-5c463583f93c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:34.742123 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-487fe510-5f3e-4f2a-8094-65d8beb6233b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] HTTP exception thrown: Instance 6aaee1d5-63de-463c-b50e-5c463583f93c could not be found. May 07 21:53:34.742803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-487fe510-5f3e-4f2a-8094-65d8beb6233b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 404 to user: Instance 6aaee1d5-63de-463c-b50e-5c463583f93c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:34.743667 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-487fe510-5f3e-4f2a-8094-65d8beb6233b tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/6aaee1d5-63de-463c-b50e-5c463583f93c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.039859 May 07 21:53:34.744221 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1200/2386] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:53:34 2022] GET /compute/v2.1/servers/6aaee1d5-63de-463c-b50e-5c463583f93c/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:34.754660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-92116509-9f4f-47f4-a298-7e070425965f req-22453ee8-401a-429e-9a95-7833e9edbf6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6963278d-8040-4bd4-82fd-8f6d81720c74", "name": "network-vif-unplugged", "status": "completed", "tag": "5799274a-67eb-479c-9b5c-9d5a397d1f88"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:34.766026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-92116509-9f4f-47f4-a298-7e070425965f req-22453ee8-401a-429e-9a95-7833e9edbf6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.766980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-92116509-9f4f-47f4-a298-7e070425965f req-22453ee8-401a-429e-9a95-7833e9edbf6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.799038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:34.816010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:34.819714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:34.827872 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0d1bc797-cb16-4e57-949a-e552f061e1df tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1837 microversion: 2.42 time: 0.819924 May 07 21:53:34.828171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-92116509-9f4f-47f4-a298-7e070425965f req-22453ee8-401a-429e-9a95-7833e9edbf6d service nova] Creating event network-vif-unplugged:5799274a-67eb-479c-9b5c-9d5a397d1f88 for instance 6963278d-8040-4bd4-82fd-8f6d81720c74 on nch1-master-1 May 07 21:53:34.830240 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1187/2387] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:34 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1837 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:34.838383 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-92116509-9f4f-47f4-a298-7e070425965f req-22453ee8-401a-429e-9a95-7833e9edbf6d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091502 May 07 21:53:34.838383 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1201/2388] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:34.844490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:34.845127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:34.846823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:34.847775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:34.858651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.859290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.860207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.861620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.862208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.862765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:34.864429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:34.866964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:35.223834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:35.232294 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5acce3ec-dcfa-48ca-80d4-0ac13493419d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.392567 May 07 21:53:35.237800 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1202/2389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:34 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:35.250833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00070d2e-2cb9-403a-82dc-d42905602673 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-80131732", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50bd2f97-b40e-4599-95f3-785427235a9f"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:35.257100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00070d2e-2cb9-403a-82dc-d42905602673 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:35.258197 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00070d2e-2cb9-403a-82dc-d42905602673 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.019219 May 07 21:53:35.271943 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1203/2390] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:35 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:53:35.278631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:35.279502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:35.288866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:35.289569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:35.290696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:35.291355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:35.652204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:35.663658 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b677c434-d005-4a65-b797-1ce59c8eb608 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.390034 May 07 21:53:35.665101 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1204/2391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:35 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:35.686403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:35.688214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:35.708779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:35.711150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:35.713633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:35.714281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:35.813332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:35.831459 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-679b1d60-e81a-4496-a6b9-4558ce6ad80a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.997532 May 07 21:53:35.835298 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1188/2392] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:34 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:35.844430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f962380-c2c9-41e6-bc0e-c187d3a311ba tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2004149310", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50bd2f97-b40e-4599-95f3-785427235a9f"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:35.847005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f962380-c2c9-41e6-bc0e-c187d3a311ba tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:35.848867 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f962380-c2c9-41e6-bc0e-c187d3a311ba tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.011939 May 07 21:53:35.858121 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1189/2393] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:35 2022] POST /compute/v2.1/servers => generated 689 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:53:35.867284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:35.868985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:35.886738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:35.889023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:35.891230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:35.893400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.049347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '396f4d7fe37343dcb4aeeb0839383f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a05b8a866c04fe78b04ec616e62b70f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:36.063589 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8663c92-f50c-4256-a06f-31d1f97b2323 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 200 len: 1297 microversion: 2.1 time: 0.395828 May 07 21:53:36.064789 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1205/2394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:35 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 1297 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:36.072033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-387b4df3-868c-4d39-ac3c-6d014dc34c75 req-2d0f1a7a-4275-4b49-98f2-2d770824e327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6963278d-8040-4bd4-82fd-8f6d81720c74", "name": "network-vif-deleted", "tag": "5799274a-67eb-479c-9b5c-9d5a397d1f88"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:36.094508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-387b4df3-868c-4d39-ac3c-6d014dc34c75 req-2d0f1a7a-4275-4b49-98f2-2d770824e327 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.095377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-387b4df3-868c-4d39-ac3c-6d014dc34c75 req-2d0f1a7a-4275-4b49-98f2-2d770824e327 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.109503 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-387b4df3-868c-4d39-ac3c-6d014dc34c75 req-2d0f1a7a-4275-4b49-98f2-2d770824e327 service nova] Creating event network-vif-deleted:5799274a-67eb-479c-9b5c-9d5a397d1f88 for instance 6963278d-8040-4bd4-82fd-8f6d81720c74 on nch1-master-1 May 07 21:53:36.117463 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-387b4df3-868c-4d39-ac3c-6d014dc34c75 req-2d0f1a7a-4275-4b49-98f2-2d770824e327 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050464 May 07 21:53:36.118316 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1206/2395] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:36.125880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b00973cb-3a80-4668-a7e9-f2713e8d8a76 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-869623592", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50bd2f97-b40e-4599-95f3-785427235a9f"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:36.127865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b00973cb-3a80-4668-a7e9-f2713e8d8a76 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:36.129008 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b00973cb-3a80-4668-a7e9-f2713e8d8a76 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.009270 May 07 21:53:36.130167 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1207/2396] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:53:36 2022] POST /compute/v2.1/servers => generated 1197 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 07 21:53:36.206620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf0e710d-1149-46f3-a841-e4a0a6d55653 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2015958336", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "50bd2f97-b40e-4599-95f3-785427235a9f"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:36.212672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bf0e710d-1149-46f3-a841-e4a0a6d55653 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:36.213764 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bf0e710d-1149-46f3-a841-e4a0a6d55653 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.015255 May 07 21:53:36.219674 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1208/2397] 10.222.0.32 () {60 vars in 1147 bytes} [Sat May 7 21:53:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 07 21:53:36.227479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d894004-f0d6-499c-ade2-17cf2d36686a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:36.228369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d894004-f0d6-499c-ade2-17cf2d36686a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 5cef3e2b-bb3e-4468-8862-9ac8159c61e1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:36.234298 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-2d894004-f0d6-499c-ade2-17cf2d36686a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] HTTP exception thrown: Instance 5cef3e2b-bb3e-4468-8862-9ac8159c61e1 could not be found. May 07 21:53:36.235208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d894004-f0d6-499c-ade2-17cf2d36686a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 404 to user: Instance 5cef3e2b-bb3e-4468-8862-9ac8159c61e1 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:36.236270 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d894004-f0d6-499c-ade2-17cf2d36686a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/5cef3e2b-bb3e-4468-8862-9ac8159c61e1/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015383 May 07 21:53:36.251283 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1209/2398] 10.222.0.32 () {58 vars in 1280 bytes} [Sat May 7 21:53:36 2022] GET /compute/v2.1/servers/5cef3e2b-bb3e-4468-8862-9ac8159c61e1/metadata/test2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:36.259777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:36.260979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:36.277732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.278429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.279449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.280071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.509078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:36.529923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:36.532016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:36.533541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb018d4b-02de-4eaa-8096-7446b173acb9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1837 microversion: 2.42 time: 0.677451 May 07 21:53:36.534891 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1190/2399] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:35 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1837 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:36.540370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:36.551600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:36.558984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.561314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.565369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.566138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.619846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:53:36.741671 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7b8a7139-d20d-43fa-8277-828b0dfc3bb9 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "DELETE /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 204 len: 0 microversion: 2.1 time: 0.204533 May 07 21:53:36.743137 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1191/2400] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:36 2022] DELETE /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:53:36.751710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:36.752856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:36.761269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:36.762585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.763378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.764648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.765863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.775567 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1b0ad9f-9d2c-4811-bd4e-cdd8a5190b92 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.522823 May 07 21:53:36.791569 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1210/2401] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:36 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:36.811446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:36.812095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:36.838670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.839182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:36.847360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:36.848085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.336370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:37.344399 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4266bec2-87af-4fdd-8d52-42e19636577c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.599163 May 07 21:53:37.351178 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1192/2402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:36 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:37.360319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:37.363205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:37.376591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.378822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.380605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.383099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.566521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:37.583702 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a14eed5c-7797-48f9-898a-af223dc7ed7a tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1526 microversion: 2.1 time: 0.782517 May 07 21:53:37.585236 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1211/2403] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:36 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1526 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:37.598292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:37.599305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:37.613249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.614068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.615516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.616953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.651503 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] HTTP exception thrown: Instance 6963278d-8040-4bd4-82fd-8f6d81720c74 could not be found. May 07 21:53:37.652615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Returning 404 to user: Instance 6963278d-8040-4bd4-82fd-8f6d81720c74 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:37.653856 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8e41deed-c406-47d5-b0f7-483b623d1b52 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 404 len: 111 microversion: 2.1 time: 0.067296 May 07 21:53:37.659336 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1212/2404] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:37 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:37.672561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:37.675127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:37.689705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.690666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.692905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.694136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.774411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:37.813868 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b753dc0-c696-4037-9620-b40000d21654 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.451993 May 07 21:53:37.814565 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1193/2405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:37 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:37.828436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:37.829338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:37.852090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.852900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:37.854882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:37.855594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:38.399040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:38.421327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:38.431399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:38.436799 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7265ea61-d567-445b-a880-760afcde76e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1837 microversion: 2.42 time: 0.775529 May 07 21:53:38.437574 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1213/2406] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:37 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1837 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:38.457444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e8371b8d-22cd-469d-9ac8-994a3f443597 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:38.460974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e8371b8d-22cd-469d-9ac8-994a3f443597 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:38.469407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8371b8d-22cd-469d-9ac8-994a3f443597 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:38.470857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8371b8d-22cd-469d-9ac8-994a3f443597 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:38.472296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8371b8d-22cd-469d-9ac8-994a3f443597 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:38.473350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8371b8d-22cd-469d-9ac8-994a3f443597 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:38.569606 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e8371b8d-22cd-469d-9ac8-994a3f443597 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116315 May 07 21:53:38.572070 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1214/2407] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:53:38 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:38.593702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:38.594464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:38.606250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:38.606718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:38.607860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:38.608555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:38.865401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:38.876107 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b131faf-dd44-4240-aece-5e938c9a6baf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.296355 May 07 21:53:38.877118 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1215/2408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:38 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:38.890375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b4aa222b-673a-41bc-a21a-fa34a7be93ab req-d09be504-987d-417f-8bad-964e2e3ebab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "c96fe3c0-1df8-4707-980e-6b6ab0d159b2"}, {"name": "network-changed", "server_uuid": "a98be0d5-4433-4cae-a301-70a6c876e235", "tag": "700c26d0-534a-4e1c-838a-15c5bd956f7a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:38.902398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b4aa222b-673a-41bc-a21a-fa34a7be93ab req-d09be504-987d-417f-8bad-964e2e3ebab9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:38.903070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b4aa222b-673a-41bc-a21a-fa34a7be93ab req-d09be504-987d-417f-8bad-964e2e3ebab9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:38.919410 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b4aa222b-673a-41bc-a21a-fa34a7be93ab req-d09be504-987d-417f-8bad-964e2e3ebab9 service nova] Creating event network-changed:c96fe3c0-1df8-4707-980e-6b6ab0d159b2 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:53:38.919410 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b4aa222b-673a-41bc-a21a-fa34a7be93ab req-d09be504-987d-417f-8bad-964e2e3ebab9 service nova] Creating event network-changed:700c26d0-534a-4e1c-838a-15c5bd956f7a for instance a98be0d5-4433-4cae-a301-70a6c876e235 on nch2-master-1 May 07 21:53:38.928309 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b4aa222b-673a-41bc-a21a-fa34a7be93ab req-d09be504-987d-417f-8bad-964e2e3ebab9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049424 May 07 21:53:38.930462 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1216/2409] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:38.967913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:38.968921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:38.978628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:38.979522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:38.981017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:38.981936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:39.098363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:39.108806 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c88e745-9b9b-4ea7-8bcd-39c08eba23c4 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 1.292884 May 07 21:53:39.111061 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1194/2410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:37 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:39.116585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:39.117211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:39.139836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lazy-loading 'services' on Instance uuid 83fafb82-09d3-47de-827f-770202f22005 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:53:39.140057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:39.140361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:39.141173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:39.141631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:39.287905 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb68ec99-a3c7-41da-96b9-a4f8a3deae91 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments/3ffd61d7-05ac-4061-ba7c-ad9ea39417e6" status: 202 len: 0 microversion: 2.1 time: 0.355907 May 07 21:53:39.290878 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1217/2411] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 21:53:38 2022] DELETE /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments/3ffd61d7-05ac-4061-ba7c-ad9ea39417e6 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:53:39.296776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:39.297502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:39.307828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:39.308443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:39.309233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:39.309728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.150630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:40.168779 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb74bb80-95c6-4603-81ff-700fec7a872e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1526 microversion: 2.1 time: 1.053620 May 07 21:53:40.172266 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1195/2412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:39 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1526 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:40.183853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:40.184784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:40.185420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:40.200651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.201121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.208016 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c3a734bf-1508-4a3e-b01c-355157235d87 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.917471 May 07 21:53:40.209209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.210315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.225773 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1218/2413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:39 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:40.232318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:40.234743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:40.256033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.257139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.258219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.258930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.614906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:40.642346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:40.647601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:40.651588 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d34abfa7-ca97-49ac-bc14-a064eeb2f51d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1858 microversion: 2.42 time: 0.473235 May 07 21:53:40.652947 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1196/2414] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:40 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1858 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:40.660709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:40.664108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:40.674098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.674938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.675925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.676826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.747446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:40.761621 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ddc61206-2ca7-4ed2-b35e-796ae95cb588 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.534552 May 07 21:53:40.763191 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1219/2415] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:40 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:40.775032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4771c69-0665-44a5-9462-d63fe09373ee tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:40.776534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4771c69-0665-44a5-9462-d63fe09373ee tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:40.794510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4771c69-0665-44a5-9462-d63fe09373ee tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.796885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4771c69-0665-44a5-9462-d63fe09373ee tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.799788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4771c69-0665-44a5-9462-d63fe09373ee tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.800781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4771c69-0665-44a5-9462-d63fe09373ee tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.890356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4771c69-0665-44a5-9462-d63fe09373ee tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119924 May 07 21:53:40.892165 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1220/2416] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:53:40 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:53:40.906725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a7852b66-b0f8-44ab-99e3-e97dc0ca9cc8 req-f5ec555f-fb15-46b6-a0f4-de7690cb7cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df1b628-71b8-4dd0-893e-521f565ba1fc", "name": "network-vif-plugged", "status": "completed", "tag": "086eedec-731a-4836-8a01-603bbdb8a932"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:40.923513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a7852b66-b0f8-44ab-99e3-e97dc0ca9cc8 req-f5ec555f-fb15-46b6-a0f4-de7690cb7cce service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:40.923977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a7852b66-b0f8-44ab-99e3-e97dc0ca9cc8 req-f5ec555f-fb15-46b6-a0f4-de7690cb7cce service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:40.939689 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a7852b66-b0f8-44ab-99e3-e97dc0ca9cc8 req-f5ec555f-fb15-46b6-a0f4-de7690cb7cce service nova] Creating event network-vif-plugged:086eedec-731a-4836-8a01-603bbdb8a932 for instance 7df1b628-71b8-4dd0-893e-521f565ba1fc on nch1-master-1 May 07 21:53:40.946102 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a7852b66-b0f8-44ab-99e3-e97dc0ca9cc8 req-f5ec555f-fb15-46b6-a0f4-de7690cb7cce service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052245 May 07 21:53:40.947156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1221/2417] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:41.117193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7aeb14aa-3740-4745-997c-2de58b4f57b0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'create', calling method: .version_select at 0x7fc41c584430>, body: {"keypair": {"name": "tempest-keypair-1447216086"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:41.158541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-7aeb14aa-3740-4745-997c-2de58b4f57b0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:41.169636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-7aeb14aa-3740-4745-997c-2de58b4f57b0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for user bdc18dc6c5214fbb9c1fa61eeb514cc9 and project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:41.196566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:41.209606 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f2d48fe3-ace7-4596-b8f2-5bb8803fe8df tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.554625 May 07 21:53:41.219992 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1197/2418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:40 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:41.234054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-82844f9d-902c-413c-a38e-b8dafbc37ea8 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:41.254030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-82844f9d-902c-413c-a38e-b8dafbc37ea8 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:41.269413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82844f9d-902c-413c-a38e-b8dafbc37ea8 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.269966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82844f9d-902c-413c-a38e-b8dafbc37ea8 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.272989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82844f9d-902c-413c-a38e-b8dafbc37ea8 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.273481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82844f9d-902c-413c-a38e-b8dafbc37ea8 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.327902 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-82844f9d-902c-413c-a38e-b8dafbc37ea8 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106410 May 07 21:53:41.328821 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1198/2419] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:53:41 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:53:41.333613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-782adae7-ce7b-40e8-ad38-0281fa32b948 req-0c20b088-e220-4449-a98a-21bffd19e9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04703f55-713a-4a4d-ba3f-551622d66f93", "name": "network-vif-deleted", "tag": "7e3541c5-8b43-4853-87f1-12bbd6ab00a7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:41.342932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-782adae7-ce7b-40e8-ad38-0281fa32b948 req-0c20b088-e220-4449-a98a-21bffd19e9ec service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.343575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-782adae7-ce7b-40e8-ad38-0281fa32b948 req-0c20b088-e220-4449-a98a-21bffd19e9ec service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.356633 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-782adae7-ce7b-40e8-ad38-0281fa32b948 req-0c20b088-e220-4449-a98a-21bffd19e9ec service nova] Creating event network-vif-deleted:7e3541c5-8b43-4853-87f1-12bbd6ab00a7 for instance 04703f55-713a-4a4d-ba3f-551622d66f93 on nch1-master-1 May 07 21:53:41.372417 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-782adae7-ce7b-40e8-ad38-0281fa32b948 req-0c20b088-e220-4449-a98a-21bffd19e9ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040688 May 07 21:53:41.389861 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1199/2420] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:41.398155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:41.399157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:41.406911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.407588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.408563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.409170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.442018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-7aeb14aa-3740-4745-997c-2de58b4f57b0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:41.448514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-7aeb14aa-3740-4745-997c-2de58b4f57b0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for user bdc18dc6c5214fbb9c1fa61eeb514cc9 and project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:41.451445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.452211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.452947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lazy-loading 'fault' on Instance uuid 04703f55-713a-4a4d-ba3f-551622d66f93 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:53:41.467632 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7aeb14aa-3740-4745-997c-2de58b4f57b0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.518631 May 07 21:53:41.474107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1222/2421] 10.222.0.32 () {62 vars in 1198 bytes} [Sat May 7 21:53:40 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 521 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 07 21:53:41.487297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:41.488247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:41.502228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.502764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.503671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.504127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.560300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f766813e116b4b8fb0cca101161cd635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dc61c4cf2b43f986262f0c112abf49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:41.575137 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd42f086-817c-4989-9291-e8ce52a68e4e tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 200 len: 1314 microversion: 2.1 time: 0.179204 May 07 21:53:41.575777 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1200/2422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:41 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:41.580551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:41.581057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:41.601220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.601686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.602494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.602992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.672610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:53:41.839694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:41.848737 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d3125b3-47fb-44fc-a878-97a60156d91a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1294 microversion: 2.1 time: 0.378895 May 07 21:53:41.849320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1223/2423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:41 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1294 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:41.854144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-616de728-c439-4bb6-98eb-bedc822c570d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 204 len: 0 microversion: 2.1 time: 0.277092 May 07 21:53:41.854745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1201/2424] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:41 2022] DELETE /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:53:41.873578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:41.874247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:41.882967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:41.883999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:41.891215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.894888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.895674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.897298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.907386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.907991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:41.910623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:41.916214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.374127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:42.407864 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9e25dc30-f3c1-47f1-b5ea-0297d44fbef8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.549221 May 07 21:53:42.411135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:42.413756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1202/2425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:41 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:42.422457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:42.423820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:42.424805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:42.426308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:42.431175 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-684d2fa8-1199-413d-b8af-770dfa43e6da tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1858 microversion: 2.42 time: 0.568149 May 07 21:53:42.431806 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1224/2426] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:41 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1858 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:42.434026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.434901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.436135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.437965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.439601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:42.440227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:42.456752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.462405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.463327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.463784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.663866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:42.677484 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f2eda0a1-f32c-440e-98d8-6ce78ddac681 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.243918 May 07 21:53:42.679090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1225/2427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:42 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:42.685492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:42.686087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] [instance: 04703f55-713a-4a4d-ba3f-551622d66f93] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:42.694799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.695525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.696630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.697318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.724486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] HTTP exception thrown: Instance 04703f55-713a-4a4d-ba3f-551622d66f93 could not be found. May 07 21:53:42.725381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] Returning 404 to user: Instance 04703f55-713a-4a4d-ba3f-551622d66f93 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:42.726239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1527e517-f660-4686-882a-67d4c2bc9b72 tempest-ServerMetadataNegativeTestJSON-1474697718 tempest-ServerMetadataNegativeTestJSON-1474697718-project] 10.222.0.32 "GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93" status: 404 len: 111 microversion: 2.1 time: 0.045887 May 07 21:53:42.727678 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1226/2428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:42 2022] GET /compute/v2.1/servers/04703f55-713a-4a4d-ba3f-551622d66f93 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:42.869135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:42.873161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:42.874165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:42.881800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fa348eed-61b3-4095-9440-b4c9f2e26cfe tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1681 microversion: 2.1 time: 0.466285 May 07 21:53:42.896809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.897399 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1203/2429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:42 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1681 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:42.898241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:42.899252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:42.899873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:43.215301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:43.223671 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-65aa5e62-42c4-4fc7-a67d-b86d62a7eaa7 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1486 microversion: 2.1 time: 0.361949 May 07 21:53:43.235175 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1227/2430] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:42 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1486 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:43.242701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-57873ac9-9563-4d9a-857f-69b1da891480 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:43.243237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-57873ac9-9563-4d9a-857f-69b1da891480 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:43.251199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57873ac9-9563-4d9a-857f-69b1da891480 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:43.251667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57873ac9-9563-4d9a-857f-69b1da891480 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:43.252480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57873ac9-9563-4d9a-857f-69b1da891480 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:43.253577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57873ac9-9563-4d9a-857f-69b1da891480 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:43.425231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:43.426237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:43.438020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:43.438488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:43.439327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:43.439780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:43.800947 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-57873ac9-9563-4d9a-857f-69b1da891480 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.563999 May 07 21:53:43.801957 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1204/2431] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 21:53:43 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc/os-interface => generated 285 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:43.806869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:43.807714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:43.826928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:43.827398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:43.828194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:43.828648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:44.071957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:44.091472 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59bcbe64-a3a2-4939-acf0-ff508ec55542 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.670115 May 07 21:53:44.091871 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1228/2432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:43 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:44.106613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:44.111339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:44.129919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:44.131319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:44.133469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:44.133930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:44.641488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:44.659339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:44.661605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:44.663869 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0f9ae90-6853-47c4-bd69-60456a80723e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.861001 May 07 21:53:44.665031 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1205/2433] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:43 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:44.672228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-df96bd34-0411-4c20-9997-d583105b7720 req-d3e2760a-b887-47bd-81ad-eb3cd684ea50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "c3af0b52-e2d3-4593-a7f9-ff7d7fa37fb8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:44.689229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-df96bd34-0411-4c20-9997-d583105b7720 req-d3e2760a-b887-47bd-81ad-eb3cd684ea50 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:44.689957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-df96bd34-0411-4c20-9997-d583105b7720 req-d3e2760a-b887-47bd-81ad-eb3cd684ea50 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:44.712509 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-df96bd34-0411-4c20-9997-d583105b7720 req-d3e2760a-b887-47bd-81ad-eb3cd684ea50 service nova] Creating event network-changed:c3af0b52-e2d3-4593-a7f9-ff7d7fa37fb8 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:53:44.719052 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-df96bd34-0411-4c20-9997-d583105b7720 req-d3e2760a-b887-47bd-81ad-eb3cd684ea50 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051199 May 07 21:53:44.722369 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1206/2434] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:44.723105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:44.736438 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bdfd10ff-9421-4cfc-99a4-82ac9e31e32d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.642107 May 07 21:53:44.745387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:44.746047 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1229/2435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:44 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:44.746676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:44.754004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:44.754467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:44.756169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:44.756945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.108902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:45.109528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:45.116471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:45.117194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.118155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:45.118786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.646211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:45.657409 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-000f53f2-46a7-4e90-b3fc-e69e0bc6f51d tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1681 microversion: 2.1 time: 0.933194 May 07 21:53:45.670647 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1207/2436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:44 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1681 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:45.683565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-42cdd6d3-73fc-4f31-a0d0-77b464c6901d req-ebbe6878-0ccb-4dc4-b1f6-34b7423b09b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98be0d5-4433-4cae-a301-70a6c876e235", "name": "network-vif-plugged", "status": "completed", "tag": "700c26d0-534a-4e1c-838a-15c5bd956f7a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:45.722651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-42cdd6d3-73fc-4f31-a0d0-77b464c6901d req-ebbe6878-0ccb-4dc4-b1f6-34b7423b09b8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:45.727853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-42cdd6d3-73fc-4f31-a0d0-77b464c6901d req-ebbe6878-0ccb-4dc4-b1f6-34b7423b09b8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.753990 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-42cdd6d3-73fc-4f31-a0d0-77b464c6901d req-ebbe6878-0ccb-4dc4-b1f6-34b7423b09b8 service nova] Creating event network-vif-plugged:700c26d0-534a-4e1c-838a-15c5bd956f7a for instance a98be0d5-4433-4cae-a301-70a6c876e235 on nch2-master-1 May 07 21:53:45.769073 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-42cdd6d3-73fc-4f31-a0d0-77b464c6901d req-ebbe6878-0ccb-4dc4-b1f6-34b7423b09b8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096485 May 07 21:53:45.770210 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1208/2437] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:45.787938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:45.790416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:45.798715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:45.799543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.800769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:45.801398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.945461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:45.956176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-06e33c81-4104-4820-aec8-cdea4de2e536 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.851025 May 07 21:53:45.966356 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1230/2438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:45 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:45.966356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:45.966356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:45.972375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:45.972943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.973839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:45.974435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:45.991278 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] HTTP exception thrown: Instance 6963278d-8040-4bd4-82fd-8f6d81720c74 could not be found. May 07 21:53:45.991953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Returning 404 to user: Instance 6963278d-8040-4bd4-82fd-8f6d81720c74 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:45.992909 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f5d2c9f-94b6-47cf-a108-b7dba085e878 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 404 len: 111 microversion: 2.1 time: 0.034599 May 07 21:53:46.007978 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1231/2439] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:45 2022] DELETE /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:46.019057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:46.020327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:46.029511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.030556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.031686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.033298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.402481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:46.426102 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2a87b74c-d0b4-448c-bfa3-d9c22d79f029 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.416655 May 07 21:53:46.428187 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1232/2440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:46 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:46.433737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:46.434642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: 6963278d-8040-4bd4-82fd-8f6d81720c74] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:46.442046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.443995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.445127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.445875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.459140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:46.469709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:46.472627 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] HTTP exception thrown: Instance 6963278d-8040-4bd4-82fd-8f6d81720c74 could not be found. May 07 21:53:46.474612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:46.479725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Returning 404 to user: Instance 6963278d-8040-4bd4-82fd-8f6d81720c74 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:46.479923 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-33051917-c6ff-4e86-839a-647a5d351e8d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.706300 May 07 21:53:46.490875 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1db7e27c-f869-49b8-a660-9a7cdcea6011 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74" status: 404 len: 111 microversion: 2.1 time: 0.051646 May 07 21:53:46.491082 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1209/2441] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:45 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:46.499966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:46.500626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:46.509131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.509767 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1233/2442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:46 2022] GET /compute/v2.1/servers/6963278d-8040-4bd4-82fd-8f6d81720c74 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:46.516980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.518037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.518584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.551237 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] HTTP exception thrown: Instance f3ba0813-ab71-47d9-8c7c-607769a67273 could not be found. May 07 21:53:46.552495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Returning 404 to user: Instance f3ba0813-ab71-47d9-8c7c-607769a67273 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:46.557220 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-812f02dc-d6bc-47b9-a83d-a786c421a06d tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 404 len: 111 microversion: 2.1 time: 0.061363 May 07 21:53:46.559051 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1210/2443] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:46 2022] DELETE /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:53:46.567601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:46.568875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] [instance: f3ba0813-ab71-47d9-8c7c-607769a67273] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:46.591109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.591862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.592840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.593400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.608402 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] HTTP exception thrown: Instance f3ba0813-ab71-47d9-8c7c-607769a67273 could not be found. May 07 21:53:46.609363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] Returning 404 to user: Instance f3ba0813-ab71-47d9-8c7c-607769a67273 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:46.610441 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03288fc3-3d89-48b8-bd97-b70d3d326b68 tempest-ServersTestMultiNic-180563375 tempest-ServersTestMultiNic-180563375-project] 10.222.0.32 "GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273" status: 404 len: 111 microversion: 2.1 time: 0.047334 May 07 21:53:46.611580 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1234/2444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:46 2022] GET /compute/v2.1/servers/f3ba0813-ab71-47d9-8c7c-607769a67273 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:46.675696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:46.676671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:46.687567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.688065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.692513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.693031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.771257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-aec22533-e94e-455d-9437-0020f730ea80 req-8f5b8e37-95ed-4329-aac2-2907ace5ff06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "7ea348ce-dc31-4a97-a925-458a8adb95a1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:46.781773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aec22533-e94e-455d-9437-0020f730ea80 req-8f5b8e37-95ed-4329-aac2-2907ace5ff06 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.782245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aec22533-e94e-455d-9437-0020f730ea80 req-8f5b8e37-95ed-4329-aac2-2907ace5ff06 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.807271 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-aec22533-e94e-455d-9437-0020f730ea80 req-8f5b8e37-95ed-4329-aac2-2907ace5ff06 service nova] Creating event network-changed:7ea348ce-dc31-4a97-a925-458a8adb95a1 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:53:46.813032 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-aec22533-e94e-455d-9437-0020f730ea80 req-8f5b8e37-95ed-4329-aac2-2907ace5ff06 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045493 May 07 21:53:46.814156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1235/2445] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:53:46.870558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:46.874753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c004505a-7a6b-4683-9f12-25e1d9158daa req-9d2ae7ed-e16d-4544-a1ef-eb260d12167b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fafb82-09d3-47de-827f-770202f22005", "name": "network-vif-deleted", "tag": "0cb8be1d-eb20-4313-adab-53f509d88a67"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:46.887245 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b3713334-a590-423e-87a6-71dbb44ed6d2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1613 microversion: 2.1 time: 0.215133 May 07 21:53:46.893199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c004505a-7a6b-4683-9f12-25e1d9158daa req-9d2ae7ed-e16d-4544-a1ef-eb260d12167b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.893946 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1211/2446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:46 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1613 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:46.894487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c004505a-7a6b-4683-9f12-25e1d9158daa req-9d2ae7ed-e16d-4544-a1ef-eb260d12167b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:46.910479 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c004505a-7a6b-4683-9f12-25e1d9158daa req-9d2ae7ed-e16d-4544-a1ef-eb260d12167b service nova] Creating event network-vif-deleted:0cb8be1d-eb20-4313-adab-53f509d88a67 for instance 83fafb82-09d3-47de-827f-770202f22005 on nch2-master-1 May 07 21:53:46.918722 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c004505a-7a6b-4683-9f12-25e1d9158daa req-9d2ae7ed-e16d-4544-a1ef-eb260d12167b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058483 May 07 21:53:46.920034 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1236/2447] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:46.977997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:46.978713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:46.999254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:46.999745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.000609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.001135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.215456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:47.216177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:47.226384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.226884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.227688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.228143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.393259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:47.408827 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3fe22624-840c-490a-93fe-905b75ab6ef7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1514 microversion: 2.1 time: 0.438439 May 07 21:53:47.409417 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1212/2448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:46 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1514 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:47.445074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:47.445959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:47.465814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.466571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.467607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.468061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.808666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:47.816089 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cc8304c3-bb4c-4ae8-ac0a-6737416d5ab1 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1486 microversion: 2.1 time: 0.604765 May 07 21:53:47.834814 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1237/2449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:47 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1486 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:47.840592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:47.841595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:47.846320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:47.860925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.861383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.862163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.862513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b59b10fb-bf8e-49f6-962e-c3c9999ee7e2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1321 microversion: 2.1 time: 0.422703 May 07 21:53:47.862662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.863847 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1213/2450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:47 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:47.906514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:47.907605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:47.920088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.920939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:47.922180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:47.922907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:48.026717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:48.038053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d343a790-c84d-41fe-b1a9-53a0a76f2dc2 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1326 microversion: 2.1 time: 0.134333 May 07 21:53:48.051609 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1214/2451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:47 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1326 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:48.063894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-731155845", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "772be29c-bb44-46ae-a3e0-b0a78574bddf"}], "security_groups": [{"name": "tempest-securitygroup--1328391406"}], "key_name": "tempest-keypair-1447216086", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:48.365841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] validate_networks() for [('772be29c-bb44-46ae-a3e0-b0a78574bddf', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:53:48.665463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:48.682746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:48.685420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:48.691658 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-648c070c-cedb-4816-9c48-acccdaa43c06 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.866454 May 07 21:53:48.692732 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1238/2452] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:47 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:48.700835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:48.704714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:48.720563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:48.721230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:48.722202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:48.722871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.299205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:49.310154 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-947603cc-13d5-44e7-8720-b1f2b5c19e67 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1520 microversion: 2.1 time: 0.613124 May 07 21:53:49.310854 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1239/2453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:48 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1520 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:49.315812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:49.316631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:49.325449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.325909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.326689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.327338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.406547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:53:49.407210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:53:49.407869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:53:49.408361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:53:49.408861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:53:49.419967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.420517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.421402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.421997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.443554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for project 93c3c71171814bb7b1018904086ad506. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:53:49.450370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for user bdc18dc6c5214fbb9c1fa61eeb514cc9 and project 93c3c71171814bb7b1018904086ad506. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:53:49.468242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:53:49.471652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:53:49.564721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aab58e44-1661-48cf-bdc9-6ff503ced147 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.511854 May 07 21:53:49.567004 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1215/2454] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:53:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:53:49.572243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0fedf6e9-2ef5-4f21-b659-7c1a369a0182 req-26dc7724-e103-4bd7-bc4a-1dd16da490c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df1b628-71b8-4dd0-893e-521f565ba1fc", "tag": "086eedec-731a-4836-8a01-603bbdb8a932"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:49.602500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0fedf6e9-2ef5-4f21-b659-7c1a369a0182 req-26dc7724-e103-4bd7-bc4a-1dd16da490c2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.603438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0fedf6e9-2ef5-4f21-b659-7c1a369a0182 req-26dc7724-e103-4bd7-bc4a-1dd16da490c2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.615579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0fedf6e9-2ef5-4f21-b659-7c1a369a0182 req-26dc7724-e103-4bd7-bc4a-1dd16da490c2 service nova] Creating event network-changed:086eedec-731a-4836-8a01-603bbdb8a932 for instance 7df1b628-71b8-4dd0-893e-521f565ba1fc on nch1-master-1 May 07 21:53:49.621044 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0fedf6e9-2ef5-4f21-b659-7c1a369a0182 req-26dc7724-e103-4bd7-bc4a-1dd16da490c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052278 May 07 21:53:49.621794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1216/2455] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:49.627017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-38cf6295-69e4-41ec-8f48-1334295b4153 req-bd29b414-826a-4a48-abf2-aee1145d1665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "5ace34e4-5209-40cb-a0ff-407d97d110dd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:49.637862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-38cf6295-69e4-41ec-8f48-1334295b4153 req-bd29b414-826a-4a48-abf2-aee1145d1665 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.638834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-38cf6295-69e4-41ec-8f48-1334295b4153 req-bd29b414-826a-4a48-abf2-aee1145d1665 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.658832 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-38cf6295-69e4-41ec-8f48-1334295b4153 req-bd29b414-826a-4a48-abf2-aee1145d1665 service nova] Creating event network-changed:5ace34e4-5209-40cb-a0ff-407d97d110dd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:53:49.664494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-38cf6295-69e4-41ec-8f48-1334295b4153 req-bd29b414-826a-4a48-abf2-aee1145d1665 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041124 May 07 21:53:49.665382 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1217/2456] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:49.671090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:49.671807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:49.678350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.678792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.679635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.680088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.715396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:49.715921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:49.716380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lazy-loading 'fault' on Instance uuid 83fafb82-09d3-47de-827f-770202f22005 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:53:49.785733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2d5596fa4984ceab3525ffc0a14d48f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62b1d2f38652407eaa85fbb15aff6307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:49.795442 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-46ecba7f-ef5f-4951-bdb1-a5617202813f tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 200 len: 1331 microversion: 2.1 time: 0.128540 May 07 21:53:49.796979 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1218/2457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:49 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:49.810801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e16a97d-5dd0-4f83-8460-7abedce8de31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:49.811732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e16a97d-5dd0-4f83-8460-7abedce8de31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:50.035218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e16a97d-5dd0-4f83-8460-7abedce8de31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.046538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e16a97d-5dd0-4f83-8460-7abedce8de31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.048540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e16a97d-5dd0-4f83-8460-7abedce8de31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.050161 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e16a97d-5dd0-4f83-8460-7abedce8de31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1281 microversion: 2.20 time: 0.251744 May 07 21:53:50.051788 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1219/2458] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:49 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:50.057137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:50.058835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:50.072834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.074307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.076471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.077226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.135663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.143732 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ca590eb-4139-4eda-b183-b484df49912a tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1470 microversion: 2.1 time: 0.831624 May 07 21:53:50.159515 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1240/2459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:49 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1470 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:50.165274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:50.166124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:50.174096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.174792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.175816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.176451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.244570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lazy-loading 'flavor' on Instance uuid a98be0d5-4433-4cae-a301-70a6c876e235 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:53:50.413832 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91b2535d-c414-49cb-8948-6412b292f497 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235/action" status: 202 len: 0 microversion: 2.1 time: 0.252709 May 07 21:53:50.414490 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1241/2460] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:53:50 2022] POST /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:53:50.426481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:50.427382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:50.444639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.455214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.457221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.457878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.695919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.705081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.706604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.708015 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee11a3f2-d739-4cf7-9574-d98db3078646 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.654639 May 07 21:53:50.709106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1220/2461] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:50 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:50.713658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8d2879ec-f794-473c-97e3-525334ba6731 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:50.714281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8d2879ec-f794-473c-97e3-525334ba6731 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:50.728059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d2879ec-f794-473c-97e3-525334ba6731 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.728510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d2879ec-f794-473c-97e3-525334ba6731 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.729501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d2879ec-f794-473c-97e3-525334ba6731 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.730057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d2879ec-f794-473c-97e3-525334ba6731 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.908324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:50.916507 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04ae068f-c383-4c2d-8f06-39950db5ed2a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1520 microversion: 2.1 time: 0.500427 May 07 21:53:50.923190 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1242/2462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:50 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1520 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:50.928352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:50.939770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:50.946596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.947471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.948469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:50.949087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:50.988579 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] HTTP exception thrown: Instance 83fafb82-09d3-47de-827f-770202f22005 could not be found. May 07 21:53:50.989564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Returning 404 to user: Instance 83fafb82-09d3-47de-827f-770202f22005 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:50.990422 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8d6d070-a219-4bd9-9fcf-5b65eb4582b6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 404 len: 111 microversion: 2.1 time: 0.065912 May 07 21:53:50.991021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1243/2463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:50 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:51.000024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd3c2808-dee8-4351-bb9c-f851f0fe351b tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '.version_select at 0x7fc42250e790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:51.046720 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd3c2808-dee8-4351-bb9c-f851f0fe351b tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610722317" status: 202 len: 0 microversion: 2.1 time: 0.049398 May 07 21:53:51.048125 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1244/2464] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610722317 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:53:51.095975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:51.097327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:51.111267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:51.111717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:51.112514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:51.112960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:51.287186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:51.295799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:51.297317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:51.298442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0156eb8a-0bed-454f-974c-4abf16b80d28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1333 microversion: 2.20 time: 0.232255 May 07 21:53:51.299036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1245/2465] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:51 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:51.351106 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8d2879ec-f794-473c-97e3-525334ba6731 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1629 microversion: 2.1 time: 0.640675 May 07 21:53:51.357521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1221/2466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:50 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1629 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:51.726672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:51.727402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:51.747823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cdad4e1f-6cf4-429f-8e39-1fe66967df94 req-752c6568-6544-4cac-aafa-8fd13885b554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "bd421caf-72a7-469a-bd36-ed429f10bc0d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:51.754155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:51.755019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:51.756641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:51.757324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:51.765722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cdad4e1f-6cf4-429f-8e39-1fe66967df94 req-752c6568-6544-4cac-aafa-8fd13885b554 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:51.766555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cdad4e1f-6cf4-429f-8e39-1fe66967df94 req-752c6568-6544-4cac-aafa-8fd13885b554 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:51.798099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cdad4e1f-6cf4-429f-8e39-1fe66967df94 req-752c6568-6544-4cac-aafa-8fd13885b554 service nova] Creating event network-changed:bd421caf-72a7-469a-bd36-ed429f10bc0d for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:53:51.807945 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cdad4e1f-6cf4-429f-8e39-1fe66967df94 req-752c6568-6544-4cac-aafa-8fd13885b554 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066143 May 07 21:53:51.810049 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1222/2467] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:53:51.940782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:51.942501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:51.955485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:51.956319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:51.958591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:51.959746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:52.422226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:52.435449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:52.437259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:52.440894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:52.444451 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00d61d7e-7e36-4c10-be2d-c8829d613c03 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.721655 May 07 21:53:52.455244 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f35cb792-6b15-49bc-8a98-90a4d3022659 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1520 microversion: 2.1 time: 0.522235 May 07 21:53:52.456079 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1223/2468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:51 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:52.464189 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1246/2469] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:51 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:52.464719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:52.465335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:52.472125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09117a3e-13fd-406f-bf6b-eee0fb6f7cfd tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:52.476068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09117a3e-13fd-406f-bf6b-eee0fb6f7cfd tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:52.482912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:52.483368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:52.484395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:52.485011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:52.485773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09117a3e-13fd-406f-bf6b-eee0fb6f7cfd tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:52.486500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09117a3e-13fd-406f-bf6b-eee0fb6f7cfd tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:52.487653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09117a3e-13fd-406f-bf6b-eee0fb6f7cfd tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:52.488404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09117a3e-13fd-406f-bf6b-eee0fb6f7cfd tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:52.650197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:52.682035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:52.685368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:52.686857 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94d3fa5d-272b-4cbf-8aa2-fbb7066b63ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1339 microversion: 2.20 time: 0.229663 May 07 21:53:52.688011 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1224/2470] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:52 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1339 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:53.306448 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09117a3e-13fd-406f-bf6b-eee0fb6f7cfd tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1612 microversion: 2.1 time: 0.840054 May 07 21:53:53.320120 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1247/2471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:52 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1612 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:53.323682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:53.324862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:53.334373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:53.334881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:53.335682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:53.336125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:53.417532 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] HTTP exception thrown: Cannot 'migrate' instance a98be0d5-4433-4cae-a301-70a6c876e235 while it is in vm_state suspended May 07 21:53:53.418602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Returning 409 to user: Cannot 'migrate' instance a98be0d5-4433-4cae-a301-70a6c876e235 while it is in vm_state suspended {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:53.420419 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c543945e-68bc-4f7e-849a-b6f457f74fc9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235/action" status: 409 len: 148 microversion: 2.1 time: 0.100677 May 07 21:53:53.432724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ec7482f-9e13-4961-980d-48aacd1f4f00 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:53.435163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ec7482f-9e13-4961-980d-48aacd1f4f00 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:53.436276 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ec7482f-9e13-4961-980d-48aacd1f4f00 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2/action" status: 400 len: 144 microversion: 2.1 time: 0.008314 May 07 21:53:53.440109 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1248/2472] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:53:53 2022] POST /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2/action => generated 144 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 07 21:53:53.442575 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1225/2473] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:53:53 2022] POST /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235/action => generated 148 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 07 21:53:53.455982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9a444018-a547-44ab-b6e5-bc1b6a56fff9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:53.457217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9a444018-a547-44ab-b6e5-bc1b6a56fff9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:53.458095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9a444018-a547-44ab-b6e5-bc1b6a56fff9 tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2/action" status: 400 len: 120 microversion: 2.1 time: 0.010021 May 07 21:53:53.459241 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1249/2474] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:53:53 2022] POST /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:53:53.470448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:53.475670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:53.483352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-215056a7-5916-4433-855a-d34ff1c2817d tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:53.485098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-215056a7-5916-4433-855a-d34ff1c2817d tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Failed to fetch instance by id 999 {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2926}} May 07 21:53:53.486103 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-215056a7-5916-4433-855a-d34ff1c2817d tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] HTTP exception thrown: Instance 999 could not be found. May 07 21:53:53.487294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-215056a7-5916-4433-855a-d34ff1c2817d tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:53.490674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:53.491543 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-215056a7-5916-4433-855a-d34ff1c2817d tempest-ServersAdminNegativeTestJSON-934627555 tempest-ServersAdminNegativeTestJSON-934627555-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.012929 May 07 21:53:53.493777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:53.495019 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1250/2475] 10.222.0.32 () {60 vars in 1178 bytes} [Sat May 7 21:53:53 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:53:53.495706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:53.498030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:53.508624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:53.509749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:53.524132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:53.525332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:53.526651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:53.527797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:53.992423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.015234 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-211e0ed1-9fa3-4f88-8509-c061f679fed9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1520 microversion: 2.1 time: 0.517518 May 07 21:53:54.017045 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1251/2476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:53 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1520 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:54.026631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:54.031382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:54.039283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.039999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.041368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.042100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.076416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:53:54.204951 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-176e8e62-350d-40af-bdcf-bf512ca70c35 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 204 len: 0 microversion: 2.1 time: 0.185428 May 07 21:53:54.205659 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1252/2477] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:54 2022] DELETE /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:53:54.220013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:54.220831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:54.231285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.231759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.232810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.233683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.435945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.448113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.450869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.454654 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-25d3b621-121e-4e95-9c31-45c35ea019e2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.989871 May 07 21:53:54.458388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1226/2478] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:53 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:54.463066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d2df36f6-df03-4c04-9a7f-66fbedd3d689 req-dd48432a-858a-4d55-b87d-6fb6a0626a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b485f98-6005-4fd2-a4ca-72e35f397c6a", "name": "network-vif-plugged", "status": "completed", "tag": "ddb906ce-ebec-489c-aec7-92f7055d4e24"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:54.483905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d2df36f6-df03-4c04-9a7f-66fbedd3d689 req-dd48432a-858a-4d55-b87d-6fb6a0626a0e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.484829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d2df36f6-df03-4c04-9a7f-66fbedd3d689 req-dd48432a-858a-4d55-b87d-6fb6a0626a0e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.502192 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d2df36f6-df03-4c04-9a7f-66fbedd3d689 req-dd48432a-858a-4d55-b87d-6fb6a0626a0e service nova] Creating event network-vif-plugged:ddb906ce-ebec-489c-aec7-92f7055d4e24 for instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a on nch2-master-1 May 07 21:53:54.513902 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d2df36f6-df03-4c04-9a7f-66fbedd3d689 req-dd48432a-858a-4d55-b87d-6fb6a0626a0e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053510 May 07 21:53:54.515738 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1227/2479] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:54.526016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:54.527573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:54.543734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.544504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.546871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.548325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.633410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.645289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.648177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.649487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3e2db814-aa2f-41dc-8a57-987843651f16 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1407 microversion: 2.20 time: 0.442423 May 07 21:53:54.651081 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1253/2480] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:54 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:54.666835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4f12426b-1458-4743-ac2c-d4df4c6ee5cd req-aadf23c6-ea74-4c88-afcb-117de2c6d88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "840ebb23-b4df-469e-b8a1-03792fff9bb1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:54.678958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f12426b-1458-4743-ac2c-d4df4c6ee5cd req-aadf23c6-ea74-4c88-afcb-117de2c6d88c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:54.679711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f12426b-1458-4743-ac2c-d4df4c6ee5cd req-aadf23c6-ea74-4c88-afcb-117de2c6d88c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:54.693136 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4f12426b-1458-4743-ac2c-d4df4c6ee5cd req-aadf23c6-ea74-4c88-afcb-117de2c6d88c service nova] Creating event network-changed:840ebb23-b4df-469e-b8a1-03792fff9bb1 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:53:54.700112 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4f12426b-1458-4743-ac2c-d4df4c6ee5cd req-aadf23c6-ea74-4c88-afcb-117de2c6d88c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037496 May 07 21:53:54.706758 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1254/2481] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:54.877851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:54.892008 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85d51c01-5671-4356-9ebc-d63f2551ca74 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1467 microversion: 2.1 time: 0.374042 May 07 21:53:54.893316 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1228/2482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:54 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1467 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:55.035296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:55.036109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:55.044030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:55.045185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:55.046307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:55.046989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:55.290067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:55.310475 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6712ba35-8a50-4dbb-b6e0-1979e205f62f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1520 microversion: 2.1 time: 0.280694 May 07 21:53:55.325348 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1255/2483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:55 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:55.483909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:55.487350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:55.549781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:55.554849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:55.558457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:55.559232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:55.679933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:55.680697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:55.715943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:55.722557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:55.724711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:55.725174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.163519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.176630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.179780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.185843 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-28278bad-ba1d-4ff4-bdc2-e0ee2542848d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1407 microversion: 2.20 time: 0.517580 May 07 21:53:56.186830 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1256/2484] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:55 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:56.196627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:56.202395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:56.218127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.218653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.219577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.220056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.463717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.491902 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8f9dc005-f863-4dc4-b54d-f6a5c14ad17d tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1467 microversion: 2.1 time: 0.301776 May 07 21:53:56.494696 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1257/2485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:56 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1467 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:56.501547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:56.506951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:56.519563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.520021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.522942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.523398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.756940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.768630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.770588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.772602 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d04d5f68-0e1a-4704-ac32-cbd8059e98f8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 1.300325 May 07 21:53:56.773782 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1229/2486] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:55 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:56.790390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:56.795979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:56.803623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.805071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.806655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.807884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.825734 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] HTTP exception thrown: Instance 83fafb82-09d3-47de-827f-770202f22005 could not be found. May 07 21:53:56.826989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Returning 404 to user: Instance 83fafb82-09d3-47de-827f-770202f22005 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:56.828043 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a1f06b0-466e-441a-bb52-b395aaad0bf6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 404 len: 111 microversion: 2.1 time: 0.053174 May 07 21:53:56.829759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1230/2487] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:53:56 2022] DELETE /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:56.839036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:56.840057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] [instance: 83fafb82-09d3-47de-827f-770202f22005] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:56.849099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.849824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.851521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:56.852628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:56.874541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] HTTP exception thrown: Instance 83fafb82-09d3-47de-827f-770202f22005 could not be found. May 07 21:53:56.875483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] Returning 404 to user: Instance 83fafb82-09d3-47de-827f-770202f22005 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:53:56.878183 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13494468-48c4-4179-9f63-75b71fc37cc6 tempest-AttachSCSIVolumeTestJSON-1730679280 tempest-AttachSCSIVolumeTestJSON-1730679280-project] 10.222.0.32 "GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005" status: 404 len: 111 microversion: 2.1 time: 0.045034 May 07 21:53:56.879524 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1231/2488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:56 2022] GET /compute/v2.1/servers/83fafb82-09d3-47de-827f-770202f22005 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:53:56.942071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:56.955265 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95b1c155-b6b3-4af2-8cde-df6755ebdd7a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1520 microversion: 2.1 time: 0.459170 May 07 21:53:56.956368 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1258/2489] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:56 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1520 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:57.215544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:57.216284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:57.228832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-769e20b0-f66e-4010-ae03-632a61b0757f req-e5cd9e41-be14-49c3-9948-2b9c867ccfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:57.231692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:57.232353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:57.235370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:57.236586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:57.263819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-769e20b0-f66e-4010-ae03-632a61b0757f req-e5cd9e41-be14-49c3-9948-2b9c867ccfc2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:57.267130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-769e20b0-f66e-4010-ae03-632a61b0757f req-e5cd9e41-be14-49c3-9948-2b9c867ccfc2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:57.325582 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-769e20b0-f66e-4010-ae03-632a61b0757f req-e5cd9e41-be14-49c3-9948-2b9c867ccfc2 service nova] Creating event network-changed:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch1-master-1 May 07 21:53:57.344317 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-769e20b0-f66e-4010-ae03-632a61b0757f req-e5cd9e41-be14-49c3-9948-2b9c867ccfc2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117204 May 07 21:53:57.345932 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1259/2490] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:53:57.516657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:57.518570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:57.536875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:57.537716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:57.538698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:57.539334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:57.904520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:57.915136 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6890828-442c-4795-8c66-84568b58508b tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1467 microversion: 2.1 time: 0.407354 May 07 21:53:57.917486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1260/2491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:57 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1467 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:57.923717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:57.924632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:57.934335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:57.935083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:57.936623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:57.937283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:58.335447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:58.347709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:58.350272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:58.351898 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-180f1a9d-cb44-4404-a079-ef246bac3204 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.433158 May 07 21:53:58.362652 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1261/2492] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:57 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:58.362652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:58.362652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:58.364736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:58.365216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:58.366134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:58.366642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:58.506461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:58.553110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:58.557660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:58.561335 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fbeb520f-1a0c-4040-8489-628bfbaf1b87 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1407 microversion: 2.20 time: 1.357354 May 07 21:53:58.562929 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1232/2493] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:57 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1407 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:53:58.676595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:58.695160 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c484d559-3c30-4c7c-8fa2-696959e1d299 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1505 microversion: 2.1 time: 0.338871 May 07 21:53:58.696165 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1262/2494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:58 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:58.711844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:58.712467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:58.730949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:58.731412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:58.732398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:58.733018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:58.934953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:58.935345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:58.946956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:58.947506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:58.948494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:58.951728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:59.108208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:59.116515 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c315ff81-14a6-4513-acaf-7f0c18ac58d1 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 200 len: 1425 microversion: 2.1 time: 0.186765 May 07 21:53:59.117093 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1263/2495] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:58 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 1425 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:53:59.381614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:59.382180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:59.395208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:59.397934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:59.399158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:59.417678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:59.673671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:53:59.686942 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d5148ac-39ed-4548-ab6a-9e9d8785ea09 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 200 len: 1505 microversion: 2.1 time: 0.978877 May 07 21:53:59.688136 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1233/2496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:53:58 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 1505 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:53:59.703301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1305f24f-a08b-4a96-b4b3-57c5ae64ddf8 req-31bc605d-3edb-47e1-ad94-2f405cab07fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98be0d5-4433-4cae-a301-70a6c876e235", "name": "network-vif-deleted", "tag": "700c26d0-534a-4e1c-838a-15c5bd956f7a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:53:59.719515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1305f24f-a08b-4a96-b4b3-57c5ae64ddf8 req-31bc605d-3edb-47e1-ad94-2f405cab07fe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:59.720173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1305f24f-a08b-4a96-b4b3-57c5ae64ddf8 req-31bc605d-3edb-47e1-ad94-2f405cab07fe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:59.737406 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1305f24f-a08b-4a96-b4b3-57c5ae64ddf8 req-31bc605d-3edb-47e1-ad94-2f405cab07fe service nova] Creating event network-vif-deleted:700c26d0-534a-4e1c-838a-15c5bd956f7a for instance a98be0d5-4433-4cae-a301-70a6c876e235 on nch2-master-1 May 07 21:53:59.745238 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1305f24f-a08b-4a96-b4b3-57c5ae64ddf8 req-31bc605d-3edb-47e1-ad94-2f405cab07fe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055302 May 07 21:53:59.746152 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1234/2497] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:53:59.752725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:53:59.753709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:53:59.761376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:59.762067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:53:59.763105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:53:59.763706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.231608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:00.242035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:00.243775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:00.245465 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64155664-cfbd-4bfa-8c78-9c4b9331abb2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.879120 May 07 21:54:00.246662 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1264/2498] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:59 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:00.251684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:00.252304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:00.258573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.259196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.260082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.260662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.283291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:00.297046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:00.298951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:00.299863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:54:00.300627 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a51ce944-4ff7-4ab9-ad41-359f6b14f8bf tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1407 microversion: 2.20 time: 0.552963 May 07 21:54:00.301551 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1235/2499] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:53:59 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:00.306929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:00.307819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: a98be0d5-4433-4cae-a301-70a6c876e235] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:00.314085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.314912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.315951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.316627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.333472 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] HTTP exception thrown: Instance a98be0d5-4433-4cae-a301-70a6c876e235 could not be found. May 07 21:54:00.334485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Returning 404 to user: Instance a98be0d5-4433-4cae-a301-70a6c876e235 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:54:00.335616 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c722fb55-fdf8-45cb-be97-3b35a9695d38 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235" status: 404 len: 111 microversion: 2.1 time: 0.032277 May 07 21:54:00.339720 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1236/2500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:00 2022] GET /compute/v2.1/servers/a98be0d5-4433-4cae-a301-70a6c876e235 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:54:00.344712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:00.345331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:00.353516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.354256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.355448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.356712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.393599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:54:00.508906 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6422c937-150e-4d4c-95d5-fa59f3024cea tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 204 len: 0 microversion: 2.1 time: 0.164571 May 07 21:54:00.510977 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1237/2501] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:54:00 2022] DELETE /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:54:00.511684 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb329e5b-7d37-46df-b027-1b516fec2010 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 204 len: 0 microversion: 2.1 time: 0.262961 May 07 21:54:00.517114 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1265/2502] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:54:00 2022] DELETE /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:54:00.535910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:00.540741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:00.557512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.558054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.562917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:00.563632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:00.638535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-337269965", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "7bc61814-8ef0-4365-b3ea-2c20100be453"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:00.729821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] validate_networks() for [('7bc61814-8ef0-4365-b3ea-2c20100be453', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:54:00.948843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:00.967804 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-637b1bb7-05da-45a7-8477-170129bf11a2 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1477 microversion: 2.1 time: 0.447323 May 07 21:54:00.969445 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1238/2503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:00 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:01.264653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:01.265266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:01.272178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:01.272630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:01.273403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:01.273843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:01.725204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:54:01.725873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:54:01.726104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:54:01.726760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:54:01.727188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:54:01.737587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:01.738347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:01.739984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:01.740842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:01.765273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Getting quotas for project 4f4c556805a24040a7131d879ee91498. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:01.781668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Getting quotas for user 3e390d65f16c47ec89f5f834bccfdd8c and project 4f4c556805a24040a7131d879ee91498. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:01.800633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:54:01.807464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:54:01.907528 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ef8bc5f-5236-4038-be04-093acced1c55 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.273372 May 07 21:54:01.912863 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1266/2504] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:54:01.921897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:01.922529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:01.936629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:01.937212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:01.938620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:01.939188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:02.282483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:02.298876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:02.301013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:02.310010 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb6b927a-5d65-42e6-af83-9d7af4ffba14 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 1.048886 May 07 21:54:02.311588 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1239/2505] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:01 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:54:02.320162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-46c7a69a-2202-4605-a04e-2955631facf2 req-1a512608-2823-4829-bebe-f03307360263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "54d4d944-47e9-4336-a070-44cbc0439ffd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:02.336284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-46c7a69a-2202-4605-a04e-2955631facf2 req-1a512608-2823-4829-bebe-f03307360263 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:02.339416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-46c7a69a-2202-4605-a04e-2955631facf2 req-1a512608-2823-4829-bebe-f03307360263 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:02.374608 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-46c7a69a-2202-4605-a04e-2955631facf2 req-1a512608-2823-4829-bebe-f03307360263 service nova] Creating event network-changed:54d4d944-47e9-4336-a070-44cbc0439ffd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:02.391243 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-46c7a69a-2202-4605-a04e-2955631facf2 req-1a512608-2823-4829-bebe-f03307360263 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077893 May 07 21:54:02.392578 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1240/2506] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:02.410006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f1282acd-1a20-4c4e-ade2-4a9360e6328b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:02.416479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f1282acd-1a20-4c4e-ade2-4a9360e6328b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:02.660139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:02.678260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:02.683342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:02.685209 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1907e7b7-b3c7-4399-8316-fdcda228bcc8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1407 microversion: 2.20 time: 0.774203 May 07 21:54:02.687445 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1267/2507] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:01 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1407 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:02.705039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:02.706090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:02.733601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:02.734947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:02.740778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:02.742552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:03.037951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f1282acd-1a20-4c4e-ade2-4a9360e6328b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:03.045690 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f1282acd-1a20-4c4e-ade2-4a9360e6328b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1217 microversion: 2.1 time: 0.649007 May 07 21:54:03.049344 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1241/2508] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:02 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1217 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:03.272836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0d92d56cf344f0a591c64adea147e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbdf17ebd9e4981b3435b13defa64d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:03.281569 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9d966ef2-67fa-4dec-801d-25869233c937 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 200 len: 1477 microversion: 2.1 time: 0.592271 May 07 21:54:03.289684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1268/2509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:02 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 1477 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:03.329123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:03.329774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:03.337299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:03.337757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:03.338601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:03.339091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:03.707380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:03.708930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:03.721358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:03.722453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:03.724309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:03.724940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:04.192662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:04.205980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:04.207589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:04.210532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-723a6881-e6c9-4f7a-80aa-866c4e9a87a8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1407 microversion: 2.20 time: 0.509066 May 07 21:54:04.227205 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1269/2510] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:03 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:04.448408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1130072869", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:04.541215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] validate_networks() for [('38ca9b6e-b205-48f9-a002-ddfee225fe39', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:54:04.900647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:04.923518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:04.925340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:04.928334 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f36a2b24-4a82-4db9-93c2-b88fba6df311 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 1.602417 May 07 21:54:04.941356 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1242/2511] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:03 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:04.949962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7bdce94f-fd35-40b9-8e93-1e744d48704c req-2de378f8-d6c2-41f2-bc14-ca88eb5e2da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf893208-e805-488d-abb0-38477b4858b2", "name": "network-vif-deleted", "tag": "8aa3ddb5-af68-4e84-8882-3a527916b441"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:04.966065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7bdce94f-fd35-40b9-8e93-1e744d48704c req-2de378f8-d6c2-41f2-bc14-ca88eb5e2da2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:04.966815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7bdce94f-fd35-40b9-8e93-1e744d48704c req-2de378f8-d6c2-41f2-bc14-ca88eb5e2da2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:04.980319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7bdce94f-fd35-40b9-8e93-1e744d48704c req-2de378f8-d6c2-41f2-bc14-ca88eb5e2da2 service nova] Creating event network-vif-deleted:8aa3ddb5-af68-4e84-8882-3a527916b441 for instance bf893208-e805-488d-abb0-38477b4858b2 on nch1-master-1 May 07 21:54:05.002295 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7bdce94f-fd35-40b9-8e93-1e744d48704c req-2de378f8-d6c2-41f2-bc14-ca88eb5e2da2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058469 May 07 21:54:05.003762 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1243/2512] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:05.010068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:05.015980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:05.037405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:05.038273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:05.039454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:05.040132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:05.392674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:05.401453 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ebd78eb2-49f0-47ca-9400-1c98a9d79133 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1275 microversion: 2.1 time: 0.395602 May 07 21:54:05.404147 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1244/2513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:05 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1275 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:05.425866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:05.427485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] [instance: bf893208-e805-488d-abb0-38477b4858b2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:05.441186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:05.444759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:05.446170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:05.447854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:05.486022 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] HTTP exception thrown: Instance bf893208-e805-488d-abb0-38477b4858b2 could not be found. May 07 21:54:05.489342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] Returning 404 to user: Instance bf893208-e805-488d-abb0-38477b4858b2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:54:05.490552 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7ee4e006-1ce8-4b4c-adcf-888327873fc5 tempest-ServersAdminNegativeTestJSON-347319588 tempest-ServersAdminNegativeTestJSON-347319588-project] 10.222.0.32 "GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2" status: 404 len: 111 microversion: 2.1 time: 0.082071 May 07 21:54:05.491366 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1245/2514] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:05 2022] GET /compute/v2.1/servers/bf893208-e805-488d-abb0-38477b4858b2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:54:05.504546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ae3784ff-c9ca-4ec3-8381-f06f55898a5d req-2cdc1a4f-104f-4488-b010-a3f049c29305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "name": "network-vif-plugged", "status": "completed", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:05.523922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ae3784ff-c9ca-4ec3-8381-f06f55898a5d req-2cdc1a4f-104f-4488-b010-a3f049c29305 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:05.524303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ae3784ff-c9ca-4ec3-8381-f06f55898a5d req-2cdc1a4f-104f-4488-b010-a3f049c29305 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:05.553914 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ae3784ff-c9ca-4ec3-8381-f06f55898a5d req-2cdc1a4f-104f-4488-b010-a3f049c29305 service nova] Creating event network-vif-plugged:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch1-master-1 May 07 21:54:05.570035 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ae3784ff-c9ca-4ec3-8381-f06f55898a5d req-2cdc1a4f-104f-4488-b010-a3f049c29305 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077191 May 07 21:54:05.571393 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1246/2515] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:05.588118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:05.592102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:05.606207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:05.609807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:05.616085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:05.617000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:06.331570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:06.350194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:06.353944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:06.361218 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-293579f1-a924-43cf-8117-4c0f77afd911 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1407 microversion: 2.20 time: 0.788332 May 07 21:54:06.362118 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1247/2516] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:05 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1407 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:06.385986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:06.397417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:06.404615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:06.405437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:06.406491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:06.407341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:06.822547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:54:06.823174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:54:06.823500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:54:06.823910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:54:06.824390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:54:06.841519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:06.841995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:06.844933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:06.848710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:06.875391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Getting quotas for project addf83b9a69e4628b1b962b7fceeb9ae. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:06.883488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Getting quotas for user 83a248d0471340df8fa0f09b0547574e and project addf83b9a69e4628b1b962b7fceeb9ae. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:06.900682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:54:06.905250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:54:06.991493 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-466af4a8-29ee-4561-b3c3-4437f3d9b79b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.762496 May 07 21:54:06.995171 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1270/2517] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:54:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:54:07.006630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-40ddabd6-3abf-44ca-a9ad-041c9d068818 req-280a153b-373a-4b92-8d9a-344788e74cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b485f98-6005-4fd2-a4ca-72e35f397c6a", "name": "network-vif-deleted", "tag": "ddb906ce-ebec-489c-aec7-92f7055d4e24"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:07.022064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-40ddabd6-3abf-44ca-a9ad-041c9d068818 req-280a153b-373a-4b92-8d9a-344788e74cdc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:07.023152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-40ddabd6-3abf-44ca-a9ad-041c9d068818 req-280a153b-373a-4b92-8d9a-344788e74cdc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:07.047474 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-40ddabd6-3abf-44ca-a9ad-041c9d068818 req-280a153b-373a-4b92-8d9a-344788e74cdc service nova] Creating event network-vif-deleted:ddb906ce-ebec-489c-aec7-92f7055d4e24 for instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a on nch2-master-1 May 07 21:54:07.064538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.065201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-40ddabd6-3abf-44ca-a9ad-041c9d068818 req-280a153b-373a-4b92-8d9a-344788e74cdc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062140 May 07 21:54:07.066593 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1271/2518] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:07.086316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.088120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.090644 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5a38de4-f438-4871-b38b-90a7ef5e75c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.726736 May 07 21:54:07.091459 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1248/2519] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:06 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:07.114091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:07.115920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0db5e562-e3dd-4491-a4d2-1a441c4da9ca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:07.116747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0db5e562-e3dd-4491-a4d2-1a441c4da9ca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:07.118973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:07.150487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:07.154423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:07.167573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:07.168673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:07.443762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.454569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0db5e562-e3dd-4491-a4d2-1a441c4da9ca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.456146 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4fbcf4a6-5d32-4acc-b8d5-1b7910fdb846 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1275 microversion: 2.1 time: 0.385871 May 07 21:54:07.469383 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1272/2520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:07 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1275 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:07.472710 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0db5e562-e3dd-4491-a4d2-1a441c4da9ca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1223 microversion: 2.1 time: 0.356334 May 07 21:54:07.473836 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1249/2521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:07 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1223 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:07.484481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:07.485118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:07.511260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:07.511708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:07.512513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:07.517640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:07.870423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.885722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.889444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:07.895577 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8c9f14cb-d8f3-45a9-b74e-a3f089f344d8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1600 microversion: 2.20 time: 0.422459 May 07 21:54:07.898149 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1273/2522] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:07 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1600 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:07.919908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a0a5c6d-7c65-46e9-b99e-cebf9a554498 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:07.920425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a0a5c6d-7c65-46e9-b99e-cebf9a554498 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:07.929769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a0a5c6d-7c65-46e9-b99e-cebf9a554498 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:07.930280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a0a5c6d-7c65-46e9-b99e-cebf9a554498 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:07.931058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a0a5c6d-7c65-46e9-b99e-cebf9a554498 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:07.945573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a0a5c6d-7c65-46e9-b99e-cebf9a554498 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:08.110978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:08.111931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:08.132295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:08.133048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:08.134227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:08.134875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:08.551454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:08.561732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:08.564142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:08.565558 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae7a11f8-ba7c-4c18-acf4-bfab5ae19daf tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.458900 May 07 21:54:08.584304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1274/2523] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:08 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:08.607226 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a0a5c6d-7c65-46e9-b99e-cebf9a554498 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.691256 May 07 21:54:08.608367 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1250/2524] 10.222.0.32 () {60 vars in 1315 bytes} [Sat May 7 21:54:07 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-interface => generated 285 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:54:08.610937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:08.611750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:08.637676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:08.640882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:08.641935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:08.642560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:08.652848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:08.661644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:08.704120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:08.706898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:08.707836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:08.709674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:09.091745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:09.115400 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-790faf2e-8ed6-456f-837a-a99a68ad69ba tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1275 microversion: 2.1 time: 0.503540 May 07 21:54:09.117764 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1251/2525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:08 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1275 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:09.379393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:09.398623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3203432b-e153-4024-bb76-c3d246214972 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.812044 May 07 21:54:09.399671 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1275/2526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:08 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:09.595261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:09.596383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:09.622387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:09.623684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:09.624891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:09.625737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:10.159753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:10.162952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:10.183949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:10.186219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:10.187916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:10.189520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:10.337821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:10.348567 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d1af5f0e-262f-474c-b1b2-97e12181434a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1281 microversion: 2.1 time: 0.217465 May 07 21:54:10.351150 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1276/2527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:10 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:10.433657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:10.434965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:10.443576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:10.444040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:10.445641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:10.446101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:10.694322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:10.704489 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86dd1823-6c8e-40f2-822f-91089cc69c45 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.285491 May 07 21:54:10.705892 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1277/2528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:10 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:10.714677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:10.725574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:10.728386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:10.730190 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-865d172f-79e2-43c2-a820-99c14d374cac tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 1.138833 May 07 21:54:10.730997 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1252/2529] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:09 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:10.735941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5190d838-99b9-4091-b9b4-2ba26f0cca49 req-bf125346-8922-4f68-b377-50c7d0a000dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:10.752531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5190d838-99b9-4091-b9b4-2ba26f0cca49 req-bf125346-8922-4f68-b377-50c7d0a000dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:10.752963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5190d838-99b9-4091-b9b4-2ba26f0cca49 req-bf125346-8922-4f68-b377-50c7d0a000dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:10.780225 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5190d838-99b9-4091-b9b4-2ba26f0cca49 req-bf125346-8922-4f68-b377-50c7d0a000dc service nova] Creating event network-changed:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch1-master-1 May 07 21:54:10.785674 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5190d838-99b9-4091-b9b4-2ba26f0cca49 req-bf125346-8922-4f68-b377-50c7d0a000dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053288 May 07 21:54:10.786895 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1253/2530] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:10.930325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1038590687", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:11.015459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:54:11.370755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:11.371981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:11.391649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.392160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:54:11.392312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:11.392628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:54:11.393171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:54:11.393540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:54:11.393966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:54:11.395255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.395877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:11.415043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.415559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:11.416261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.416725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:11.457632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:11.464901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:11.481741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:54:11.484447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:54:11.580446 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2507b17a-39e0-4a56-84d1-b22571f6b984 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873048 May 07 21:54:11.581908 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1278/2531] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:54:11.593241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d73cad6-a5bb-46ac-a47c-12b7ae032d80 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:11.594312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d73cad6-a5bb-46ac-a47c-12b7ae032d80 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:11.701079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2d73cad6-a5bb-46ac-a47c-12b7ae032d80 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:11.709532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d73cad6-a5bb-46ac-a47c-12b7ae032d80 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1217 microversion: 2.1 time: 0.120150 May 07 21:54:11.714337 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1279/2532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:11 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:11.726558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:11.727486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:11.739531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.741033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:11.742237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.745016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:11.915483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:11.929139 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-195ea94b-bd49-4fde-b7b7-c1c541763b4e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1281 microversion: 2.1 time: 0.561353 May 07 21:54:11.930524 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1254/2533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:11 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1281 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:11.935697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:11.943237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:11.951248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.952638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:11.953704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:11.954387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:12.002462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:12.011975 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a7e11370-6dea-4911-84c1-55f1708551c0 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.290163 May 07 21:54:12.022991 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1280/2534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:11 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:12.728864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:12.730238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:12.730745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:12.737928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:12.740014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:12.740883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:12.741341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:12.745829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:12.748058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:12.749615 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-18667cdd-1c46-45dc-96d2-1bc65400b256 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.817603 May 07 21:54:12.750219 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1255/2535] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:11 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:12.809050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:12.817305 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a73090d8-1173-40eb-a883-d9ede8b87494 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1269 microversion: 2.1 time: 0.092437 May 07 21:54:12.818468 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1281/2536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:12 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:12.948364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:12.949524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:12.956346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:12.956806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:12.957593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:12.958358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:13.033400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:13.034957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:13.047390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:13.049633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:13.051654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:13.053743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:13.185336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:13.222943 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6687064f-4f24-4ac4-b89f-a9441039295e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1281 microversion: 2.1 time: 0.280076 May 07 21:54:13.234890 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1256/2537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:12 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1281 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:13.297287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:13.310198 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2719cc3a-a5b3-4916-b9dd-80955bec52c6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.282649 May 07 21:54:13.311977 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1282/2538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:13 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:13.770277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:13.771857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:13.781222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:13.782825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:13.783902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:13.785086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:13.836381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:13.837671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:13.854314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:13.854895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:13.856107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:13.856602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:13.945360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:13.955010 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9b8529e0-e75f-4dc9-9c12-8220a4f6385e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1275 microversion: 2.1 time: 0.123742 May 07 21:54:13.965340 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1283/2539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:13 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:14.242497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:14.243422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:14.250574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:14.251065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:14.251859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:14.252370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:14.423679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:14.435165 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8452d23e-9a60-4e5c-a039-bbc8b99ff20c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.196995 May 07 21:54:14.435981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1284/2540] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:14 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:14.441409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:14.442394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:14.451774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:14.452539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:14.453500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:14.454167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:14.603359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:14.611803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86046620-c357-439b-8278-d41d12dda53b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.174619 May 07 21:54:14.612415 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1285/2541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:14 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:14.866428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:14.878488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:14.881182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:14.882667 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b4e99558-9dfa-4dd1-83ec-bafa2a09b40f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 1.117187 May 07 21:54:14.883480 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1257/2542] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:13 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:14.975098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:14.975951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:14.983879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:14.984327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:14.985108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:14.985560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:15.069908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:15.080073 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae88242a-b0e6-41f1-9150-2012d2dea6c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1275 microversion: 2.1 time: 0.110817 May 07 21:54:15.081119 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1286/2543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:14 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:15.313790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-79df95b2-dec0-476a-a6d2-895a29b6fbd3 req-1287840c-a262-444b-ab97-5128a8262700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb", "tag": "861cefe1-1ec7-45b2-a2a0-851f6f48c014"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:15.330493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-79df95b2-dec0-476a-a6d2-895a29b6fbd3 req-1287840c-a262-444b-ab97-5128a8262700 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:15.330985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-79df95b2-dec0-476a-a6d2-895a29b6fbd3 req-1287840c-a262-444b-ab97-5128a8262700 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:15.350699 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-79df95b2-dec0-476a-a6d2-895a29b6fbd3 req-1287840c-a262-444b-ab97-5128a8262700 service nova] Creating event network-changed:861cefe1-1ec7-45b2-a2a0-851f6f48c014 for instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb on nch2-master-1 May 07 21:54:15.356130 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-79df95b2-dec0-476a-a6d2-895a29b6fbd3 req-1287840c-a262-444b-ab97-5128a8262700 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048346 May 07 21:54:15.356899 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1258/2544] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:15.453406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:15.454192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:15.461476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:15.461883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:15.462907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:15.463336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:15.610132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:15.619623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d88734e4-bf4b-478a-8ebd-7deb32cefedd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.170347 May 07 21:54:15.620469 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1287/2545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:15 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:15.635666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:15.636819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:15.645328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:15.645942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:15.647102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:15.647672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:15.902809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:15.903651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:15.912390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:15.912943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:15.913846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:15.914385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:16.131363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:16.140868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:16.142336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:16.143565 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-984694aa-549d-4ed1-b328-dac42a9b5957 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.245444 May 07 21:54:16.144108 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1288/2546] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:15 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:16.148851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:16.149530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:16.155897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:16.156247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:16.156722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:16.157353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:16.223072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:16.231212 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12e7c5fd-6f9f-4fd4-8bca-5dcd3f04ef88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1275 microversion: 2.1 time: 0.085921 May 07 21:54:16.231790 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1289/2547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:16 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:16.437050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:16.445218 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e54e927-f459-4ad7-bb27-22e8d902463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.814974 May 07 21:54:16.445784 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1259/2548] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:15 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:16.638865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:16.639491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:16.646166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:16.646667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:16.647671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:16.648122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:16.804820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:16.813767 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94402285-496b-4d4b-a966-369850cb2d26 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.178933 May 07 21:54:16.814990 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1290/2549] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:16 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:17.163072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:17.163702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:17.170296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.170970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.171782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.172207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.250624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:17.251286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:17.258635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.259168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.259951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.260405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.324968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:17.336421 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6aca6fb-ca56-4253-955c-270733d32ba1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1275 microversion: 2.1 time: 0.089549 May 07 21:54:17.337564 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1291/2550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:17 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:17.461677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:17.462395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:17.468559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.469122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.469974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.470432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.616606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:17.624153 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-75738743-24cf-467a-bd8f-60e6c14ee1d2 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.166512 May 07 21:54:17.624740 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1292/2551] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:17 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:17.832157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:17.832815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:17.840226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.840810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.841898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:17.842279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:17.930706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:17.956027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:17.958548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:17.960574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f552b073-56bb-44a4-9990-b0f6195f170c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.801700 May 07 21:54:17.961669 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1260/2552] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:17 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:17.996214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:18.008698 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2353d86-6508-4529-a0b4-c63371dd07f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.180277 May 07 21:54:18.009892 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1293/2553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:17 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:18.357331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:18.358733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:18.371832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:18.373694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:18.376350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:18.377645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:18.455431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e67e4270-db54-42bf-9d6d-34db9bfa99e7 req-2eac3872-da23-40a7-9906-7d82b52bf54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1328c136-9d82-4506-81cd-534b3799a51d", "tag": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:18.471667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e67e4270-db54-42bf-9d6d-34db9bfa99e7 req-2eac3872-da23-40a7-9906-7d82b52bf54a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:18.473371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e67e4270-db54-42bf-9d6d-34db9bfa99e7 req-2eac3872-da23-40a7-9906-7d82b52bf54a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:18.501734 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e67e4270-db54-42bf-9d6d-34db9bfa99e7 req-2eac3872-da23-40a7-9906-7d82b52bf54a service nova] Creating event network-changed:26b45fcb-fb85-4cfb-9dc0-1b5852bae60e for instance 1328c136-9d82-4506-81cd-534b3799a51d on nch1-master-1 May 07 21:54:18.508676 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e67e4270-db54-42bf-9d6d-34db9bfa99e7 req-2eac3872-da23-40a7-9906-7d82b52bf54a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059929 May 07 21:54:18.525906 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1294/2554] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:18.642512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:18.643667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:18.653501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:18.654826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:18.655632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:18.659631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:18.787001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:18.805018 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed3e7743-a05b-4f5b-9edf-1ddb85a75864 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.454428 May 07 21:54:18.828054 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1261/2555] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:18 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:18.986316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:18.987345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:18.996161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:18.998794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:19.001907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:19.002685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:19.471350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:19.482875 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5f6d710-ec5a-4830-a882-36c233acc7a4 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.844421 May 07 21:54:19.484196 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1295/2556] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:18 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:19.499352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:19.500663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:19.513046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:19.513893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:19.514934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:19.515547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:19.898631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:19.914332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c0a72f6-0d92-47db-8ed6-6d6331e6cee8 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.426446 May 07 21:54:19.916842 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1296/2557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:19 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:19.924909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:19.925807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:19.941728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:19.943560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:19.946404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:19.947178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:20.187179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:20.204459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:20.205222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:20.215806 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e232e27-1935-4e06-a024-cc53d139e97b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 1.237009 May 07 21:54:20.216449 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1262/2558] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:18 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:54:20.507225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:20.508205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:20.521972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:20.522837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:20.524204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:20.526350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:20.865531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:20.884956 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4993e9f5-165a-4d3d-9ca2-7aa0363a8852 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.959871 May 07 21:54:20.886027 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1297/2559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:19 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:20.937762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:20.939875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:20.960710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:20.961139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:20.961999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:20.962439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:21.086847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:21.098521 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-de72102d-f5d9-4398-a7cb-64dcb06b7c77 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.600396 May 07 21:54:21.102023 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1263/2560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:20 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:21.235540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:21.236914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:21.249944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:21.250978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:21.254523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:21.254523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:21.502728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:21.548658 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0bc45197-9cdd-40ca-a9ec-d2ba6a5e786c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.615539 May 07 21:54:21.561724 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1298/2561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:20 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:21.903516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:21.905518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:21.915656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:21.920469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:21.923071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:21.923916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:22.354719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:22.365269 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59b87ece-830d-4c0b-bec5-692c899c1434 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.464865 May 07 21:54:22.367662 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1299/2562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:21 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:22.382192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:22.382877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:22.406059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:22.411730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:22.414004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:22.416093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:22.420243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:22.428073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:22.435774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:22.437076 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88ecbaa8-3a75-4814-a9b1-b6fc9039ef8f tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 1.205944 May 07 21:54:22.437647 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1264/2563] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:21 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:22.475440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d9ca1be9-a51f-4a66-a543-de110a047450 req-d7836ec1-a75f-47a6-ba0a-3499ec04c37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2", "tag": "0f31f820-4134-4910-88d6-283ed3ed34a7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:22.507815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d9ca1be9-a51f-4a66-a543-de110a047450 req-d7836ec1-a75f-47a6-ba0a-3499ec04c37e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:22.510523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d9ca1be9-a51f-4a66-a543-de110a047450 req-d7836ec1-a75f-47a6-ba0a-3499ec04c37e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:22.545302 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d9ca1be9-a51f-4a66-a543-de110a047450 req-d7836ec1-a75f-47a6-ba0a-3499ec04c37e service nova] Creating event network-changed:0f31f820-4134-4910-88d6-283ed3ed34a7 for instance dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 on nch2-master-1 May 07 21:54:22.556980 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d9ca1be9-a51f-4a66-a543-de110a047450 req-d7836ec1-a75f-47a6-ba0a-3499ec04c37e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110725 May 07 21:54:22.557358 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1265/2564] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:22.572509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:22.575612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:22.585442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:22.586172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:22.587693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:22.588394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:22.868531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:22.880991 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5a437d8-9262-4220-bbe7-ecf4c260c519 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.315343 May 07 21:54:22.881922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1266/2565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:22 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:23.050510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:23.063636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-894eb2dc-d602-45c0-95ea-09bc5fa7e4ab tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.694581 May 07 21:54:23.064255 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1300/2566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:22 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:23.383613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:23.384301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:23.400518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:23.401359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:23.402525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:23.403261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:23.457528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:23.459813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:23.467181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:23.467925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:23.468975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:23.469708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:23.761972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:23.784423 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f7896546-95df-49c2-b74c-b4e0071881d2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.405149 May 07 21:54:23.786345 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1267/2567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:23 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:23.834237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:23.848807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:23.851748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:23.853779 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a2351c0-b325-459d-8ea4-4952cb69185a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.400919 May 07 21:54:23.855040 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1301/2568] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:23 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:23.898128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:23.898937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:23.906070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:23.907131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:23.908003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:23.908848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:24.083042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:24.085848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:24.102856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:24.103327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:24.107332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:24.108550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:24.109748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:24.123280 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81918f89-fb3c-43a5-948b-d0f09df147bd tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.227310 May 07 21:54:24.124407 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1268/2569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:23 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:24.496143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:24.509998 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d1d99649-4fed-48f6-b57d-a80020a1f17e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.431790 May 07 21:54:24.522553 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1302/2570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:24 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:24.806644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:24.808350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:24.820694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:24.822037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:24.824752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:24.825618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:24.883140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:24.885601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:24.898226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:24.898698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:24.901550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:24.903359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:25.335599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:25.358854 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd61b4b1-bec1-4bb6-ada6-25a51a85b07b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.560753 May 07 21:54:25.360007 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1269/2571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:24 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:25.371381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:25.372516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:25.381471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:25.382602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:25.383700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:25.384702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:25.616494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:25.630731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:25.633374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:25.635112 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9774978d-fb79-4db3-8603-4939ace9fc63 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.765163 May 07 21:54:25.636128 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1303/2572] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:24 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:54:25.641772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:25.642984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:25.643447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:25.654878 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a9f4872-4be8-49f3-8a29-49a27e1c23cb tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.292557 May 07 21:54:25.655660 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1270/2573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:25 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:25.675962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:25.676435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:25.678959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:25.679404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:25.936530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:25.953821 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8fdf286e-ebbc-44c8-97ba-693171139317 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.315366 May 07 21:54:25.956166 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1304/2574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:25 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:26.376750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:26.377393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:26.392004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:26.392554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:26.393324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:26.393773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:26.659245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:26.659630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:26.666846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:26.670351 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fda1018-968e-4feb-bf1a-1527bc872ca2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.298335 May 07 21:54:26.682564 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1271/2575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:26 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:26.687059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:26.690288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:26.691009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:26.693089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:26.693931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:26.694580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:26.724596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:26.725062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:26.726061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:26.726666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:27.070919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:27.083845 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6a4b48b0-6e67-4a0b-9a65-f2ed249e230f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.407218 May 07 21:54:27.084560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:27.086114 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1272/2576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:26 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:27.092122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:27.092975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:27.097498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:27.100352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:27.101974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7e65bea2-0f74-4b05-bf2f-86422c170374 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.448232 May 07 21:54:27.112772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:27.115249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:27.116262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:27.116653 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1305/2577] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:26 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:54:27.119577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:27.122360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f0a3a2ef-594f-4018-8685-d880ff5302db req-12bcbda6-0357-4834-810d-32417855360b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1328c136-9d82-4506-81cd-534b3799a51d", "name": "network-vif-plugged", "status": "completed", "tag": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:27.145162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f0a3a2ef-594f-4018-8685-d880ff5302db req-12bcbda6-0357-4834-810d-32417855360b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:27.146149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f0a3a2ef-594f-4018-8685-d880ff5302db req-12bcbda6-0357-4834-810d-32417855360b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:27.167705 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f0a3a2ef-594f-4018-8685-d880ff5302db req-12bcbda6-0357-4834-810d-32417855360b service nova] Creating event network-vif-plugged:26b45fcb-fb85-4cfb-9dc0-1b5852bae60e for instance 1328c136-9d82-4506-81cd-534b3799a51d on nch1-master-1 May 07 21:54:27.179339 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f0a3a2ef-594f-4018-8685-d880ff5302db req-12bcbda6-0357-4834-810d-32417855360b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060530 May 07 21:54:27.180448 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1306/2578] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:27.606985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:27.632120 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1146788c-756a-4d51-b188-4a034e0b36cf tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.539472 May 07 21:54:27.633180 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1273/2579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:27 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:27.695178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:27.696516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:27.714848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:27.715779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:27.716639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:27.717091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:27.924279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:27.935019 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7978eeac-b421-4308-8fd8-d41f111061c6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.245594 May 07 21:54:27.945744 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1307/2580] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:27 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:28.102038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:28.103489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:28.111443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.112519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:28.113623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.114284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:28.128441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:28.130488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:28.142604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.143147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:28.144373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.145042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:28.439253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:28.460114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:28.461683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:28.463075 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-34762dc9-7428-46d2-a264-ff05581547c9 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.341402 May 07 21:54:28.475700 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1308/2581] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:28 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:54:28.563344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:28.574355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8803c709-eed0-4b4c-a944-d51e98141e90 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1323 microversion: 2.1 time: 0.476271 May 07 21:54:28.575272 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1274/2582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:28 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1323 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:28.656180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:28.657237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:28.666839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.668408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:28.669912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.670906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:28.955174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:28.956810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:28.978600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.982370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:28.984659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:28.986360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:29.218461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:29.232395 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c083cce9-d6b6-47f2-81ff-e468eb94f052 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.280290 May 07 21:54:29.233734 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1275/2583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:28 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:29.414423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:29.442951 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b72891e0-435f-430e-8396-e997609b3e49 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.792760 May 07 21:54:29.444251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1309/2584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:28 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:29.485538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:29.486348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:29.496380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:29.496916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:29.497659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:29.498233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:29.594737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:29.595906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:29.620042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:29.620810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:29.622039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:29.624763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:29.923086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:29.956538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:29.961322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:29.964555 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e1b6a80-b3d3-4f12-946e-b2d9584292c7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.485350 May 07 21:54:29.965801 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1276/2585] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:29 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:30.004037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:30.018559 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf23cfe0-140b-42ba-9e9b-07f13c4a9749 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1517 microversion: 2.1 time: 0.428535 May 07 21:54:30.020270 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1310/2586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:29 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1517 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:30.037003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:30.038366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:30.046262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.047106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.048132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.049228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.097972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lazy-loading 'flavor' on Instance uuid 1328c136-9d82-4506-81cd-534b3799a51d {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:54:30.254845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:30.256435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:30.282812 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7977f29a-5f24-489c-a84b-9a14029ec449 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action" status: 200 len: 32 microversion: 2.1 time: 0.248703 May 07 21:54:30.284197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.284840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.285067 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1277/2587] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:54:30 2022] POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:54:30.288740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.289785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.300758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:30.304601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:30.322040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.324994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.326149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.328322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.617436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:30.637174 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7900c4d9-b36b-4f27-a1a4-60bdd1cd90d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.387546 May 07 21:54:30.646497 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1311/2588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:30 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:30.659717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:30.660583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:30.667017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:30.674363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.675156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.681660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.682809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:30.688596 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-04de4adb-56b4-4486-8707-8a38815e701e tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.395866 May 07 21:54:30.700592 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1278/2589] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:30 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:30.954948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:30.966171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7befc45f-6ba3-418f-9892-871bcde81e19 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.317226 May 07 21:54:30.967675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1312/2590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:30 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:30.986387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:30.987640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:30.997993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:30.998666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:31.000415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:31.004117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:31.377249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:31.387871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:31.390459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:31.392023 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b22f0c0b-819f-4fea-853a-fe3776017e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.410841 May 07 21:54:31.403940 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1279/2591] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:30 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:31.552293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a4326f7a-f210-4687-9d8e-1378f9e22d79 req-743b3350-ebcc-4e50-aaa4-7a116e79afc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb", "name": "network-vif-plugged", "status": "completed", "tag": "861cefe1-1ec7-45b2-a2a0-851f6f48c014"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:31.577224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a4326f7a-f210-4687-9d8e-1378f9e22d79 req-743b3350-ebcc-4e50-aaa4-7a116e79afc3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:31.580435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a4326f7a-f210-4687-9d8e-1378f9e22d79 req-743b3350-ebcc-4e50-aaa4-7a116e79afc3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:31.599468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a4326f7a-f210-4687-9d8e-1378f9e22d79 req-743b3350-ebcc-4e50-aaa4-7a116e79afc3 service nova] Creating event network-vif-plugged:861cefe1-1ec7-45b2-a2a0-851f6f48c014 for instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb on nch2-master-1 May 07 21:54:31.623194 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a4326f7a-f210-4687-9d8e-1378f9e22d79 req-743b3350-ebcc-4e50-aaa4-7a116e79afc3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077246 May 07 21:54:31.624488 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1313/2592] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:31.654695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:31.655500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:31.676947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:31.694268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:31.696756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:31.701669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:31.709011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:31.710190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:31.726494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:31.733205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:31.734998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:31.737693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:32.015259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:32.026071 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b4fe9126-3610-4e65-a005-1ede661e459f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.375608 May 07 21:54:32.037262 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1280/2593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:31 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:32.037262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:32.037262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:32.047740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:32.048253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:32.049606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:32.049906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:32.248472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:32.261114 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-06f4de6d-cd13-4ae8-b420-2d0eaf2e65f4 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.557235 May 07 21:54:32.262740 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1314/2594] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:31 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:32.328330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:32.342250 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1dfde1d4-d8f5-47e3-909f-06ba63387b57 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1317 microversion: 2.1 time: 0.313679 May 07 21:54:32.342922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1281/2595] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:32 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:32.415577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:32.416458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:32.426227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:32.426841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:32.427826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:32.428278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:32.774508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:32.795144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:32.797472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:32.799071 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7385d5c7-d11c-433c-967f-694d837fd49d tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.389937 May 07 21:54:32.811836 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1315/2596] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:32 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:33.044623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:33.045881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:33.054533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.055389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.056379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.057005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.282055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:33.283280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:33.316602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.324618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.327995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.341161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.375483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:33.386132 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2d90a6f-83a5-46d5-85ef-97911072a0db tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.346354 May 07 21:54:33.388064 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1282/2597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:33 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:33.394516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:33.409983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:33.417799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.418422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.419358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.420001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.751356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:33.769674 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f399e278-356b-419e-b916-dbd0bc8394a6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1508 microversion: 2.1 time: 0.379849 May 07 21:54:33.771924 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1283/2598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:33 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:33.804187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:33.808665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:33.822609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:33.833768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.834244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.835120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.835574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.837332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4217f0bb-fcc6-412f-8e6b-f5d822ecc05c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.560194 May 07 21:54:33.840938 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1316/2599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:33 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:33.849968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:33.861857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:33.884671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.886168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:33.888253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:33.890729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.122855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:34.165314 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-86aec960-3c47-44a4-836f-ffedd05a89be tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1508 microversion: 2.1 time: 0.379658 May 07 21:54:34.172213 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1284/2600] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:33 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:34.188579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06048e29-ddc8-4f88-9c13-cafafd01d9e7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:34.196812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06048e29-ddc8-4f88-9c13-cafafd01d9e7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:34.220114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06048e29-ddc8-4f88-9c13-cafafd01d9e7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.223208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06048e29-ddc8-4f88-9c13-cafafd01d9e7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.224305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06048e29-ddc8-4f88-9c13-cafafd01d9e7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.224774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06048e29-ddc8-4f88-9c13-cafafd01d9e7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.372605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06048e29-ddc8-4f88-9c13-cafafd01d9e7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "PUT /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1080 microversion: 2.1 time: 0.185629 May 07 21:54:34.376414 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1285/2601] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 21:54:34 2022] PUT /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1080 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:34.391469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:34.392390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:34.437581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.438048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.443306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.444161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.618523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:34.653495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:34.661122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:34.664351 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88c3def8-c851-4d4b-8e20-a9b9ac0768c4 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.821915 May 07 21:54:34.682492 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1317/2602] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:33 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:34.713091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:34.713963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:34.724168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.724863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.725845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.727751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.835384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:34.855974 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05d5c878-ffc7-45f8-b5b1-b76990190615 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1506 microversion: 2.1 time: 0.467669 May 07 21:54:34.859033 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1286/2603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:34 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:34.881314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:34.884748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:34.909249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.910457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:34.914033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:34.916531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:35.229232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:35.239574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fb2e79fe-2924-4cd8-b03c-eda35e33abd5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.367505 May 07 21:54:35.240471 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1287/2604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:34 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:35.246164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:35.247130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:35.254206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:35.255019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:35.256274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:35.256891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:35.506105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:35.516252 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05c07e5b-4c23-4e00-b67a-aa65d0f4463b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1506 microversion: 2.1 time: 0.274241 May 07 21:54:35.516840 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1288/2605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:35 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:35.541504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:35.544759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:35.545507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:35.554205 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-71f104ca-20dc-4e5d-be27-f36f992ebc79 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.869775 May 07 21:54:35.554819 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1318/2606] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:34 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:35.555446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:35.556464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:35.557703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:35.558722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:35.702306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:35.702306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:35.741339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:35.743230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:35.755902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:35.756507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:35.790340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:54:35.798631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:54:35.799407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:54:35.799960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:54:35.800514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:54:35.972480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:35.993996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.005945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.026377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.028114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.121157 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3aba8460-a61a-42d5-93d6-de26b840766a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "POST /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb/action" status: 202 len: 1112 microversion: 2.1 time: 0.585134 May 07 21:54:36.122584 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1289/2607] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:54:35 2022] POST /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb/action => generated 1112 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 07 21:54:36.179077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:36.183696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:36.220583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.221599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.222613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.223886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.572857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:36.590325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:36.592400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:36.595710 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8c11511-7bae-482a-9baa-a013f4f0eaf2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.908836 May 07 21:54:36.614006 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1319/2608] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:35 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:36.631836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:36.632556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:36.654629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.658250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.659263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.659727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.706746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:36.719087 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e947f7e-bcef-4d5f-8703-00e7e3f8abba tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.571928 May 07 21:54:36.720836 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1290/2609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:36 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:36.726830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a7bdbc29-e161-4d31-a889-0d3b3558e9c4 req-c24ba43e-1692-47a7-9883-40b7435aa032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-plugged", "status": "completed", "tag": "54d4d944-47e9-4336-a070-44cbc0439ffd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:36.736874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a7bdbc29-e161-4d31-a889-0d3b3558e9c4 req-c24ba43e-1692-47a7-9883-40b7435aa032 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.738047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a7bdbc29-e161-4d31-a889-0d3b3558e9c4 req-c24ba43e-1692-47a7-9883-40b7435aa032 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.756114 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a7bdbc29-e161-4d31-a889-0d3b3558e9c4 req-c24ba43e-1692-47a7-9883-40b7435aa032 service nova] Creating event network-vif-plugged:54d4d944-47e9-4336-a070-44cbc0439ffd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:36.767577 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a7bdbc29-e161-4d31-a889-0d3b3558e9c4 req-c24ba43e-1692-47a7-9883-40b7435aa032 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044736 May 07 21:54:36.768852 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1291/2610] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:36.788262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:36.789224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:36.825027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.825027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:36.825027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:36.825027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:37.173117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:37.182572 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0371d561-12db-455b-b22d-481beafbc352 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.412385 May 07 21:54:37.194374 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1292/2611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:36 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:37.563002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:37.574712 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ffee0671-4439-4be7-b4ba-a0b13d9f4d4b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.971840 May 07 21:54:37.575361 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1320/2612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:36 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:37.628172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:37.629151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:37.640069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:37.643200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:37.644487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:37.645517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:37.746574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:37.747418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:37.762684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:37.763176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:37.766038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:37.769636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:38.045355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:38.068533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:38.070408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:38.073771 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4683a4ee-c9bd-4167-aaa8-a15c041aabb7 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.451373 May 07 21:54:38.091344 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1293/2613] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:37 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:38.179896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:38.188430 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14afa6e0-f998-4dff-9d36-0a1d4719ecda tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.446944 May 07 21:54:38.195417 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1321/2614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:37 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:38.205007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:38.205659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:38.222147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:38.222602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:38.226641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:38.229059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:38.525909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:38.545133 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b4f572d-214d-45d1-99f7-bde162c2048c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.344071 May 07 21:54:38.551746 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1294/2615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:38 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:38.595206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:38.596614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:38.606372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:38.607253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:38.608370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:38.609878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:38.612103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-939449265", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "704f8450-d63f-47c9-8f27-0e9fc81678e7"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:38.695719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] validate_networks() for [('704f8450-d63f-47c9-8f27-0e9fc81678e7', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:54:38.925875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:38.942818 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c64413f-35e1-418c-a817-3f909444552f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.355066 May 07 21:54:38.944649 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1295/2616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:38 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:38.959953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a78f99b8-86ab-441a-9e0a-635b1f346056 req-a791911b-617c-4661-8464-0bdfdf9a06c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-plugged", "status": "completed", "tag": "c3af0b52-e2d3-4593-a7f9-ff7d7fa37fb8"}, {"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-plugged", "status": "completed", "tag": "5ace34e4-5209-40cb-a0ff-407d97d110dd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:38.984138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a78f99b8-86ab-441a-9e0a-635b1f346056 req-a791911b-617c-4661-8464-0bdfdf9a06c0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:38.985142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a78f99b8-86ab-441a-9e0a-635b1f346056 req-a791911b-617c-4661-8464-0bdfdf9a06c0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.005279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a78f99b8-86ab-441a-9e0a-635b1f346056 req-a791911b-617c-4661-8464-0bdfdf9a06c0 service nova] Creating event network-vif-plugged:c3af0b52-e2d3-4593-a7f9-ff7d7fa37fb8 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:39.006644 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a78f99b8-86ab-441a-9e0a-635b1f346056 req-a791911b-617c-4661-8464-0bdfdf9a06c0 service nova] Creating event network-vif-plugged:5ace34e4-5209-40cb-a0ff-407d97d110dd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:39.022912 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a78f99b8-86ab-441a-9e0a-635b1f346056 req-a791911b-617c-4661-8464-0bdfdf9a06c0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076637 May 07 21:54:39.024195 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1296/2617] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:39.112178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:39.114513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:39.123355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.124156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.125170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.125876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.284556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:54:39.285040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:54:39.285780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:54:39.286208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:54:39.287755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:54:39.301290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.302361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.303605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.308486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.330580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Getting quotas for project 4c2ee723c6a04843b302e255a401b1e7. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:39.338316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Getting quotas for user a295663c20584408b634e99490e34883 and project 4c2ee723c6a04843b302e255a401b1e7. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:39.356341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:54:39.359347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:54:39.436221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-24820450-25c1-4510-b200-512ffd930d9e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028966 May 07 21:54:39.437188 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1322/2618] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:54:39.441573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:39.443014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:39.454503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.457551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.465030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.466080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.544204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:39.565679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:39.570632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:39.572233 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-03c84151-99bf-4c9e-9727-d88ededbfe21 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.464870 May 07 21:54:39.572925 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1297/2619] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:39 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:39.578323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-59833a62-6e09-4545-889c-bae474f25b56 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:39.579288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-59833a62-6e09-4545-889c-bae474f25b56 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:39.701680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-59833a62-6e09-4545-889c-bae474f25b56 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:39.714933 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-59833a62-6e09-4545-889c-bae474f25b56 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1223 microversion: 2.1 time: 0.140462 May 07 21:54:39.717642 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1298/2620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:39 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:39.727567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:39.727981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:39.752142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.753121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.754448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.755628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.841480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:39.858275 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-633566b9-fbc6-4de4-8f16-bac5dd0074d9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.415983 May 07 21:54:39.868272 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1323/2621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:39 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:39.964275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:39.965041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:39.980736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.981130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:39.982466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.984701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:39.987218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:39.993476 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bde492c6-9936-469e-b454-73ce23ea5159 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.274559 May 07 21:54:39.994742 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1299/2622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:39 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:40.228374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:40.236248 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6cfc87c-34a0-4fe4-a0c9-bbedf6406994 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.278193 May 07 21:54:40.238066 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1324/2623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:39 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:40.592829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:40.594215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:40.602264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:40.603263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:40.604600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:40.605402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:40.733516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:40.734142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:40.744221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:40.745036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:40.746281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:40.746698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:40.834927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:40.846533 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-80217319-a8d4-47a3-b5f4-f10ce241df66 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1275 microversion: 2.1 time: 0.116826 May 07 21:54:40.848377 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1325/2624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:40 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1275 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:40.874799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:40.875445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:40.884344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:40.885116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:40.886140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:40.887061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.102308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:41.111004 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee3cc107-995d-4f6a-9d7f-4bfaf6a912d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.240952 May 07 21:54:41.111712 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1326/2625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:40 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:41.117598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:41.119222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:41.126263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:41.127252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.128063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:41.128689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.339401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:41.358440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:41.369622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:41.373538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:41.375131 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-648096b8-6294-4ea4-a7d2-556e88e93528 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.258398 May 07 21:54:41.375131 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1327/2626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:41 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:41.377809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fd8c089-c91b-4404-a6c7-512e648431bc tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.789186 May 07 21:54:41.379109 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1300/2627] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:40 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:41.384107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-38f22d3a-3236-4785-a2eb-c08dafc1308e req-e59878ea-da8f-4c83-bef6-6f05b84d8010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-plugged", "status": "completed", "tag": "840ebb23-b4df-469e-b8a1-03792fff9bb1"}, {"server_uuid": "dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2", "name": "network-vif-plugged", "status": "completed", "tag": "0f31f820-4134-4910-88d6-283ed3ed34a7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:41.389349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:41.391554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:41.407147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:41.407350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.408339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:41.408924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-38f22d3a-3236-4785-a2eb-c08dafc1308e req-e59878ea-da8f-4c83-bef6-6f05b84d8010 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:41.409392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-38f22d3a-3236-4785-a2eb-c08dafc1308e req-e59878ea-da8f-4c83-bef6-6f05b84d8010 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.411385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.445016 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-38f22d3a-3236-4785-a2eb-c08dafc1308e req-e59878ea-da8f-4c83-bef6-6f05b84d8010 service nova] Creating event network-vif-plugged:840ebb23-b4df-469e-b8a1-03792fff9bb1 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:41.448100 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-38f22d3a-3236-4785-a2eb-c08dafc1308e req-e59878ea-da8f-4c83-bef6-6f05b84d8010 service nova] Creating event network-vif-plugged:0f31f820-4134-4910-88d6-283ed3ed34a7 for instance dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 on nch2-master-1 May 07 21:54:41.462492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-38f22d3a-3236-4785-a2eb-c08dafc1308e req-e59878ea-da8f-4c83-bef6-6f05b84d8010 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085793 May 07 21:54:41.467884 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1328/2628] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:41.890464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:41.891977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:41.899849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:41.900739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.901752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:41.902217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:41.975746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:41.985964 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4fe3b583-6255-4ece-b135-b5a57bc3473b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1281 microversion: 2.1 time: 0.102638 May 07 21:54:41.986733 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1329/2629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:41 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:42.129958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:42.130832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:42.138376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:42.138870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:42.139684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:42.140301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:42.169170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:42.184767 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ad43206-87ad-4fa4-a437-e1f08de6e4c7 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.803210 May 07 21:54:42.196423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1301/2630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:41 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:42.365227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:42.373926 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09c189bc-44e5-4c1d-b815-234589c49f53 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.248290 May 07 21:54:42.374864 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1330/2631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:42 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:42.391829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:42.393276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:42.403893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:42.404080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:42.404394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:42.404527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:42.405196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:42.405651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:42.412981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:42.413442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:42.414230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:42.414662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:42.693153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:42.712756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:42.715205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:42.719358 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be33cb57-5cb9-45a7-bb52-f1e4ec6d301c tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.319233 May 07 21:54:42.720838 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1331/2632] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:42 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:42.765672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:42.775319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0dbdd0ca-f5f5-4e95-ad0a-de587f51637a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1317 microversion: 2.1 time: 0.387393 May 07 21:54:42.777898 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1302/2633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:42 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:43.006000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:43.007195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:43.018682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.021899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.022947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.025516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.110556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:43.120171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b1d066bc-83f0-4c2c-96df-0164886d706a tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1281 microversion: 2.1 time: 0.120134 May 07 21:54:43.121376 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1332/2634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:42 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:43.205229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:43.205816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:43.217137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.217589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.218468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.218951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.398331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:43.399001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:43.408642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.409109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.409973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.411325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.663249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:43.673130 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b1f890d-8673-428b-953b-9ce048e20fb5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.284079 May 07 21:54:43.675035 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1333/2635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:43 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:43.681365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-db7e68b3-36fe-4fed-84f5-0ba2c30f78a9 req-baf60f73-ec0d-434c-89f1-31b599bf6377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-plugged", "status": "completed", "tag": "c96fe3c0-1df8-4707-980e-6b6ab0d159b2"}, {"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-plugged", "status": "completed", "tag": "bd421caf-72a7-469a-bd36-ed429f10bc0d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:43.692893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-db7e68b3-36fe-4fed-84f5-0ba2c30f78a9 req-baf60f73-ec0d-434c-89f1-31b599bf6377 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.693932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-db7e68b3-36fe-4fed-84f5-0ba2c30f78a9 req-baf60f73-ec0d-434c-89f1-31b599bf6377 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.717715 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-db7e68b3-36fe-4fed-84f5-0ba2c30f78a9 req-baf60f73-ec0d-434c-89f1-31b599bf6377 service nova] Creating event network-vif-plugged:c96fe3c0-1df8-4707-980e-6b6ab0d159b2 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:43.718722 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-db7e68b3-36fe-4fed-84f5-0ba2c30f78a9 req-baf60f73-ec0d-434c-89f1-31b599bf6377 service nova] Creating event network-vif-plugged:bd421caf-72a7-469a-bd36-ed429f10bc0d for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:43.728077 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-db7e68b3-36fe-4fed-84f5-0ba2c30f78a9 req-baf60f73-ec0d-434c-89f1-31b599bf6377 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051160 May 07 21:54:43.729072 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1334/2636] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:43.747411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:43.758109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:43.766317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:43.767274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.767948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.768929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.769541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.780236 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-33530091-fcc4-4b70-b45d-910c4d3e49f3 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.579784 May 07 21:54:43.788044 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1303/2637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:43 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:43.799656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:43.800679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:43.812818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.814151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:43.815406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:43.816099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:44.090634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:44.102110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:44.104093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:44.105588 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9db21489-79e6-4be0-be10-24ef1e81e979 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.370514 May 07 21:54:44.106713 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1335/2638] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:43 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:44.114172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:44.122175 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c615c190-3275-40ae-9413-9973ea557283 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1467 microversion: 2.1 time: 0.331977 May 07 21:54:44.123481 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1304/2639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:43 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1467 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:44.138315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:44.141289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:44.168682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:44.169142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:44.170023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:44.170736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:44.346844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f4110efa-4b91-4978-a708-192d9bb7d3e2 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:44.347471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f4110efa-4b91-4978-a708-192d9bb7d3e2 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:44.357841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4110efa-4b91-4978-a708-192d9bb7d3e2 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:44.361219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4110efa-4b91-4978-a708-192d9bb7d3e2 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:44.362300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4110efa-4b91-4978-a708-192d9bb7d3e2 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:44.362954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4110efa-4b91-4978-a708-192d9bb7d3e2 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:44.437458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:44.447998 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9a7337d6-aa32-4e9a-8be0-2df0c81077eb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1323 microversion: 2.1 time: 0.313480 May 07 21:54:44.459154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1336/2640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:44 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:44.612525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f8d5ebd3-4078-4b85-90fa-96183b992e92 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Action: 'create', calling method: .version_select at 0x7fc42260e280>, body: {"keypair": {"name": "tempest-keypair-598958658"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:44.633510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f8d5ebd3-4078-4b85-90fa-96183b992e92 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Getting quotas for project 70a2fded25c74c839c01e55a91e7f7fc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:44.645442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f8d5ebd3-4078-4b85-90fa-96183b992e92 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Getting quotas for user 58c7ff193f244ddfa887908f05a920c3 and project 70a2fded25c74c839c01e55a91e7f7fc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:44.919847 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f4110efa-4b91-4978-a708-192d9bb7d3e2 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1618 microversion: 2.1 time: 0.782864 May 07 21:54:44.920463 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1305/2641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:44 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1618 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:44.933077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:44.935519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:44.946170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:44.951850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:44.953883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:44.956661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.072013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f8d5ebd3-4078-4b85-90fa-96183b992e92 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Getting quotas for project 70a2fded25c74c839c01e55a91e7f7fc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:45.083696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f8d5ebd3-4078-4b85-90fa-96183b992e92 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Getting quotas for user 58c7ff193f244ddfa887908f05a920c3 and project 70a2fded25c74c839c01e55a91e7f7fc. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:45.119575 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f8d5ebd3-4078-4b85-90fa-96183b992e92 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.32 time: 0.511957 May 07 21:54:45.124319 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1337/2642] 10.222.0.32 () {62 vars in 1198 bytes} [Sat May 7 21:54:44 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 518 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 07 21:54:45.150425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:45.151399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:45.161342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.162198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.164744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.165470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.411104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:45.419524 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee8f9d53-e6af-406d-ae62-e921143b2e58 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.497994 May 07 21:54:45.421688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1306/2643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:44 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:45.427936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f6367db-cb0b-4642-853b-8d1bf965edc2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: .version_select at 0x7fc4224c8c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1702657824", "policies": ["affinity"]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:45.496677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3f6367db-cb0b-4642-853b-8d1bf965edc2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:45.504985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3f6367db-cb0b-4642-853b-8d1bf965edc2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:45.625556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3f6367db-cb0b-4642-853b-8d1bf965edc2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:45.655121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-3f6367db-cb0b-4642-853b-8d1bf965edc2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:45.702670 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f6367db-cb0b-4642-853b-8d1bf965edc2 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.274632 May 07 21:54:45.705499 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1307/2644] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:54:45 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:45.711867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:45.718911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:45.721895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:45.727166 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2222ed66-2225-4342-9408-1b804481c7a9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.601031 May 07 21:54:45.730422 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1338/2645] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:45 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:45.749178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.750412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2e6a3b47-4ee5-477b-a46a-341df29eb6ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:45.750961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2e6a3b47-4ee5-477b-a46a-341df29eb6ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:45.752874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.756057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.756528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.774285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6a3b47-4ee5-477b-a46a-341df29eb6ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.774686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6a3b47-4ee5-477b-a46a-341df29eb6ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.775652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6a3b47-4ee5-477b-a46a-341df29eb6ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.775944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6a3b47-4ee5-477b-a46a-341df29eb6ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.869798 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2e6a3b47-4ee5-477b-a46a-341df29eb6ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/ips" status: 200 len: 153 microversion: 2.20 time: 0.137294 May 07 21:54:45.877059 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1339/2646] 10.222.0.32 () {60 vars in 1288 bytes} [Sat May 7 21:54:45 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/ips => generated 153 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:54:45.885305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:45.885944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:45.902642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.903138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:45.903934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:45.904505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:46.281456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:46.294396 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b840bba-d357-4377-afc1-bd1ad27f3893 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1323 microversion: 2.1 time: 0.418230 May 07 21:54:46.299179 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1340/2647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:45 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:46.314439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8ef2ee5b-11f5-452c-8e7d-a7025303de73 req-401e77b5-3d42-45e6-af60-02f5b7889acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6f28fb-7fb0-4dbe-b780-f14e94c9846d", "tag": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:46.332838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8ef2ee5b-11f5-452c-8e7d-a7025303de73 req-401e77b5-3d42-45e6-af60-02f5b7889acf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:46.333683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8ef2ee5b-11f5-452c-8e7d-a7025303de73 req-401e77b5-3d42-45e6-af60-02f5b7889acf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:46.362080 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8ef2ee5b-11f5-452c-8e7d-a7025303de73 req-401e77b5-3d42-45e6-af60-02f5b7889acf service nova] Creating event network-changed:251b3c4a-3d68-4a9c-8850-df61aa0e1dc6 for instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d on nch1-master-1 May 07 21:54:46.386441 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8ef2ee5b-11f5-452c-8e7d-a7025303de73 req-401e77b5-3d42-45e6-af60-02f5b7889acf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082278 May 07 21:54:46.390353 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1341/2648] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:46.401168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5afa9a1a-ba6c-4e15-afd6-63b3f00e4d9e req-514587e9-5d04-4ba3-bb2a-05563f9c73f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-plugged", "status": "completed", "tag": "7ea348ce-dc31-4a97-a925-458a8adb95a1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:46.424423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5afa9a1a-ba6c-4e15-afd6-63b3f00e4d9e req-514587e9-5d04-4ba3-bb2a-05563f9c73f4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:46.427313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5afa9a1a-ba6c-4e15-afd6-63b3f00e4d9e req-514587e9-5d04-4ba3-bb2a-05563f9c73f4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:46.457007 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5afa9a1a-ba6c-4e15-afd6-63b3f00e4d9e req-514587e9-5d04-4ba3-bb2a-05563f9c73f4 service nova] Creating event network-vif-plugged:7ea348ce-dc31-4a97-a925-458a8adb95a1 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:46.477675 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5afa9a1a-ba6c-4e15-afd6-63b3f00e4d9e req-514587e9-5d04-4ba3-bb2a-05563f9c73f4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088535 May 07 21:54:46.478592 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1342/2649] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:46.496839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-749608160", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e5523e38-e30a-423c-9fb1-e97c60d84e68"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:46.598207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:54:46.599449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:46.614816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:46.616464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:46.629150 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-183e5c38-d746-4b0f-a194-d050589d31b8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.913105 May 07 21:54:46.631050 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1308/2650] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:45 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:46.640550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:46.641674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:46.656888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:46.660355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:46.661956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:46.663319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.226367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:47.239884 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12c314d7-a8f7-4b0c-94a8-98982e95576d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.607489 May 07 21:54:47.240895 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1309/2651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:46 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:47.246745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:47.247829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:47.259093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.259932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.261009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.261658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.329055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:54:47.329755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:54:47.330729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:54:47.331789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:54:47.332917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:54:47.380028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.381592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.382669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.383327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.410037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:47.417407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:47.433665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Going to run 2 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:54:47.436655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:54:47.452808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:47.465856 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23663aea-3665-4b0d-a252-120aedcbb5b6 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.223364 May 07 21:54:47.466659 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1310/2652] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:47 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:47.483712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:47.486065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:47.496683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.498591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.504237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.505036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.506265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=136682) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 07 21:54:47.537384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:47.544818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:47.618491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:47.641339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:47.666390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=120a21bb-a0eb-49aa-adce-3903960c1785,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:54:47.734820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:47.738145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:47.741013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:47.747941 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b9c4e964-2d46-4fb0-a858-eecda4ecded4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1323 microversion: 2.1 time: 0.279612 May 07 21:54:47.749290 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1311/2653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:47 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1323 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:47.757156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:47.758148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:47.765321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.766095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.766982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.767510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.785916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:47.791601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:47.830240 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8700eaca-97c2-4a9e-8636-d8f711e49576 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.350097 May 07 21:54:47.830894 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1343/2654] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:54:46 2022] POST /compute/v2.1/servers => generated 32 bytes in 1352 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 07 21:54:47.840000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:47.843767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:47.844633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Searching by: {'deleted': False, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:54:47.861772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.862958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.863451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:47.864274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:47.890980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:54:47.928405 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f53e8b2-a491-4fbb-b1c9-92b71bcb28fc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.092420 May 07 21:54:47.935523 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1344/2655] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:54:47 2022] GET /compute/v2.1/servers => generated 1002 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:47.941406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-020c0441-8a1b-474a-bde9-1fe399d6de42 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:47.942574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-020c0441-8a1b-474a-bde9-1fe399d6de42 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:47.997546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:48.012596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:48.014753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:48.019504 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96e848e2-a48b-4006-9ba4-a6fe657a6bde tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1879 microversion: 2.42 time: 0.267956 May 07 21:54:48.020660 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1312/2656] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:47 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1879 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:48.055945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-020c0441-8a1b-474a-bde9-1fe399d6de42 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:48.067504 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-020c0441-8a1b-474a-bde9-1fe399d6de42 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1218 microversion: 2.1 time: 0.130213 May 07 21:54:48.079696 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1345/2657] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:47 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:48.227739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:48.231198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:48.242458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:48.242959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:48.243767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:48.244471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:48.258120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:48.258790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:48.293541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:48.294034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:48.294983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:48.295435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:48.314379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lazy-loading 'flavor' on Instance uuid cc6a642e-763c-4ac9-8ef7-4985bcb86060 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:54:48.501048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:48.511245 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-73787621-6e69-496e-8ff7-60b93c9521ca tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.258176 May 07 21:54:48.523336 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1346/2658] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:48 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:48.529436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1436722672", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "78b27442-bcb9-410d-9431-ef2d20377793"}, {"port": "8265c59d-4721-4235-823a-846b00373dfe", "tag": "port-1"}, {"port": "d3eb7f9f-cad6-43cc-b93c-f50a5e95c505", "tag": "port-2"}, {"uuid": "3e9903c9-6550-4ae2-aa4f-70e03144784f", "tag": "net-1"}, {"uuid": "3e9903c9-6550-4ae2-aa4f-70e03144784f"}, {"uuid": "d3d6fbc8-cbfa-4c1a-9104-6c52ad3f84a6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d3d6fbc8-cbfa-4c1a-9104-6c52ad3f84a6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b5a9abca-fd78-4787-87fc-9e321869b37d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "30fc7619-db02-4f4d-8966-a00216d45663", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "edf0b8e8-8a9a-4d7b-95eb-46163eae5081", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--859995183"}], "key_name": "tempest-keypair-598958658", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:48.731263 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b77951ec-9f02-45af-a65c-14717d20f856 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/action" status: 202 len: 0 microversion: 2.20 time: 0.509065 May 07 21:54:48.735301 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1313/2659] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:54:48 2022] POST /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:54:48.736668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] validate_networks() for [('78b27442-bcb9-410d-9431-ef2d20377793', None, None, None, None, None), (None, None, '8265c59d-4721-4235-823a-846b00373dfe', None, None, None), (None, None, 'd3eb7f9f-cad6-43cc-b93c-f50a5e95c505', None, None, None), ('3e9903c9-6550-4ae2-aa4f-70e03144784f', None, None, None, None, None), ('3e9903c9-6550-4ae2-aa4f-70e03144784f', None, None, None, None, None), ('d3d6fbc8-cbfa-4c1a-9104-6c52ad3f84a6', '10.2.2.100', None, None, None, None), ('d3d6fbc8-cbfa-4c1a-9104-6c52ad3f84a6', '10.2.2.200', None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:54:48.745474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:48.746162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:48.771842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:48.772630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:48.773354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:48.773805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:49.152452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:49.169138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-549c600c-a0c8-44d4-be44-f5398073caf1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.429702 May 07 21:54:49.170818 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1314/2660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:48 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:49.177278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:49.177922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:49.187364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:49.188073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:49.188875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:49.189340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:49.365742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:49.375754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:49.377581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:49.378798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13bc3eb1-d595-459d-bf46-d416772e7f58 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.207903 May 07 21:54:49.380100 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1315/2661] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:49 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:49.401213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:49.402641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:49.422252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:49.422864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:49.423754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:49.424298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:49.569798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:49.577618 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8584732c-2458-4019-a571-d092e21f2cd8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1323 microversion: 2.1 time: 0.196315 May 07 21:54:49.578216 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1316/2662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:49 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:49.586976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:49.586976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:49.589525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:49.589980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:49.590749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:49.591215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:50.200842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:50.213738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:50.215653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:50.217176 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e9710b7-963a-429b-b083-f60c7f6f59d8 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2834 microversion: 2.42 time: 0.637826 May 07 21:54:50.224978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1317/2663] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:49 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2834 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:50.231019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:50.233040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:50.242394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:50.243143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:50.244396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:50.244852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:50.414192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:50.425948 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79db8e6a-ff04-4e5b-a153-d2116f5904bc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1276 microversion: 2.1 time: 0.206722 May 07 21:54:50.428457 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1318/2664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:50 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:50.437407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:50.439284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:50.450230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:50.451184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:50.452687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:50.453832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:50.774125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:50.784349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6531b73c-6e59-4c18-b5b0-1d39eb8f6ed8 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.354568 May 07 21:54:50.785794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1319/2665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:50 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:50.803608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:50.804837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:50.815175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:50.815681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:50.817911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:50.818697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.060139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:51.070450 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5dfc92a7-508c-4b13-94d8-fd4dc9b90f4a tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.281589 May 07 21:54:51.071498 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1320/2666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:50 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:51.076941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3123d2f8-6940-452d-b528-0d672ee0f3e6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:51.077452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3123d2f8-6940-452d-b528-0d672ee0f3e6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:51.086932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3123d2f8-6940-452d-b528-0d672ee0f3e6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.087378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3123d2f8-6940-452d-b528-0d672ee0f3e6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.088320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3123d2f8-6940-452d-b528-0d672ee0f3e6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.088769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3123d2f8-6940-452d-b528-0d672ee0f3e6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.282276 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3123d2f8-6940-452d-b528-0d672ee0f3e6 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.202921 May 07 21:54:51.283038 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1321/2667] 10.222.0.32 () {60 vars in 1315 bytes} [Sat May 7 21:54:51 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c/os-interface => generated 1831 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:51.292522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:51.293173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:51.303369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.304248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.305297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.305744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.678227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:51.696792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:51.699731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:51.703764 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-296aa6f2-5fed-4d75-80d9-bd9e94f70b28 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.419355 May 07 21:54:51.704481 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1322/2668] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:51 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:51.717471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:51.718992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:51.736052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.736789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.738201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.739224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.805323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:54:51.805908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:54:51.806168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:54:51.806754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:54:51.807399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:54:51.820024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.820680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.821636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:51.822384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:51.844212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Getting quotas for project 70a2fded25c74c839c01e55a91e7f7fc. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:54:51.851809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Getting quotas for user 58c7ff193f244ddfa887908f05a920c3 and project 70a2fded25c74c839c01e55a91e7f7fc. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:54:52.115383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:52.127458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:54:52.131580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b5a9abca-fd78-4787-87fc-9e321869b37d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='30fc7619-db02-4f4d-8966-a00216d45663',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edf0b8e8-8a9a-4d7b-95eb-46163eae5081',volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:54:52.138335 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-602efe59-c958-49f3-b49b-763636112d61 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1323 microversion: 2.1 time: 0.430688 May 07 21:54:52.148867 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1323/2669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:51 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1323 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:52.163156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:52.164136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:52.171059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.171699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.172792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.173574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.471767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:52.485339 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b63c28d-7020-40ea-b04d-b48f4a5f7b6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.334453 May 07 21:54:52.487629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1324/2670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:52 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:52.500699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:52.501775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:52.528740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.529558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.530693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.531376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.713032 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63e649c1-18e5-4674-9f58-d5b476f8737c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 4.188385 May 07 21:54:52.714470 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1347/2671] 10.222.0.32 () {62 vars in 1188 bytes} [Sat May 7 21:54:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 4191 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:54:52.719668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:52.725923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:52.727825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Searching by: {'deleted': False, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:54:52.740791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.741580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.745226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.755721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.815245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:54:52.865636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e275b758-bff9-40af-8d5b-b7fa43d61fd4 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.149898 May 07 21:54:52.867090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1348/2672] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:54:52 2022] GET /compute/v2.1/servers => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:52.883852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:52.884852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:52.895949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.899803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:52.904135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.909057 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0a7fb575-01e7-44b3-84fa-73fa48755524 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.419281 May 07 21:54:52.910980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.911700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.912964 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1325/2673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:52 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:52.924872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-41aa7e65-9529-4e23-808a-246d0099bc60 req-7dfbf75f-5ad4-422a-9b69-01c287f00673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6f28fb-7fb0-4dbe-b780-f14e94c9846d", "name": "network-vif-plugged", "status": "completed", "tag": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:52.946804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-41aa7e65-9529-4e23-808a-246d0099bc60 req-7dfbf75f-5ad4-422a-9b69-01c287f00673 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:52.947509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-41aa7e65-9529-4e23-808a-246d0099bc60 req-7dfbf75f-5ad4-422a-9b69-01c287f00673 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:52.981731 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-41aa7e65-9529-4e23-808a-246d0099bc60 req-7dfbf75f-5ad4-422a-9b69-01c287f00673 service nova] Creating event network-vif-plugged:251b3c4a-3d68-4a9c-8850-df61aa0e1dc6 for instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d on nch1-master-1 May 07 21:54:52.991868 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-41aa7e65-9529-4e23-808a-246d0099bc60 req-7dfbf75f-5ad4-422a-9b69-01c287f00673 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074459 May 07 21:54:52.992967 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1326/2674] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:52.998821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:52.999711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:53.010508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.011211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.012146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.012679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.198974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:53.209374 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a119f84f-669a-430f-a5f1-f363fbc87115 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.340830 May 07 21:54:53.218675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1349/2675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:52 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:53.218675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-edef4e41-e9bd-499d-996c-4f5b306e5583 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:53.218675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-edef4e41-e9bd-499d-996c-4f5b306e5583 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:53.287634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-edef4e41-e9bd-499d-996c-4f5b306e5583 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:53.298103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-edef4e41-e9bd-499d-996c-4f5b306e5583 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:53.301474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-edef4e41-e9bd-499d-996c-4f5b306e5583 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:53.302900 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-edef4e41-e9bd-499d-996c-4f5b306e5583 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1285 microversion: 2.32 time: 0.091801 May 07 21:54:53.303964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1350/2676] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:53 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:53.311121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:53.314605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:53.315656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Searching by: {'deleted': False, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:54:53.323884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.324368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.325246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.325665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.356208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:54:53.401023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:53.408914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.409645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.591740 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c9d092a7-7a8d-4bd1-9aaf-88d1dc93e446 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 1608 microversion: 2.1 time: 0.284867 May 07 21:54:53.592380 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1351/2677] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:54:53 2022] GET /compute/v2.1/servers/detail => generated 1608 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:53.603321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f615c52e-57d8-4136-a8b0-fbd4d21eccf6 req-8efc98f4-1045-497c-aeae-648e61256c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "tag": "c96fe3c0-1df8-4707-980e-6b6ab0d159b2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:53.615276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f615c52e-57d8-4136-a8b0-fbd4d21eccf6 req-8efc98f4-1045-497c-aeae-648e61256c55 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.615783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f615c52e-57d8-4136-a8b0-fbd4d21eccf6 req-8efc98f4-1045-497c-aeae-648e61256c55 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.634249 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f615c52e-57d8-4136-a8b0-fbd4d21eccf6 req-8efc98f4-1045-497c-aeae-648e61256c55 service nova] Creating event network-changed:c96fe3c0-1df8-4707-980e-6b6ab0d159b2 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:54:53.641020 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f615c52e-57d8-4136-a8b0-fbd4d21eccf6 req-8efc98f4-1045-497c-aeae-648e61256c55 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046891 May 07 21:54:53.642591 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1352/2678] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:53.651955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:53.653432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:53.661700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.662474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.663443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.664011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.841903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:53.855170 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ac295349-b3de-41e6-a559-8b11233960fc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1323 microversion: 2.1 time: 0.207967 May 07 21:54:53.856196 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1353/2679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:53 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1323 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:53.862743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:53.863777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:53.872604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.873286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:53.874429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:53.875044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.040756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.049487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b780749f-1bc4-4867-a5ed-c35ef9161bfc tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.192119 May 07 21:54:54.059435 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1354/2680] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:53 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:54.065638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9499720e-566c-4bd5-ac2a-b691bf1a969a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:54.076450 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9499720e-566c-4bd5-ac2a-b691bf1a969a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015104 May 07 21:54:54.091734 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1355/2681] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:54:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:54.100871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:54.102390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:54.109728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.110617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.112080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.112674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.117371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.130476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.132421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.133649 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8fbd2226-b8b8-4352-8395-3325c8a4dd54 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 1.139197 May 07 21:54:54.141293 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1327/2682] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:52 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:54.226286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:54.227311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:54.240458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.241171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.242172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.243035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.343907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.357651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2c83847-a1f2-4c35-89f4-ec5ac440d29a tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.264353 May 07 21:54:54.358410 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1356/2683] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:54 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:54.363680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee905889-207d-4dfa-94a7-f6692cbee96c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:54.364503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee905889-207d-4dfa-94a7-f6692cbee96c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:54.448349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee905889-207d-4dfa-94a7-f6692cbee96c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.456929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee905889-207d-4dfa-94a7-f6692cbee96c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.460283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee905889-207d-4dfa-94a7-f6692cbee96c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.461512 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee905889-207d-4dfa-94a7-f6692cbee96c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1285 microversion: 2.32 time: 0.101742 May 07 21:54:54.471680 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1357/2684] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:54 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:54.478568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:54.479598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:54.487255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.487902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.488772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.489273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.534451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:54:54.648464 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c23c49a8-da0c-48d3-bf31-1b10773d7698 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 204 len: 0 microversion: 2.1 time: 0.175056 May 07 21:54:54.649086 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1358/2685] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:54:54 2022] DELETE /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:54:54.673625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:54.674914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:54.685677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.686253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.687955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.688583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.786476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.798238 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1cee7c8c-b1f1-407a-aaf8-e316fcef8b3b tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.576283 May 07 21:54:54.808151 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1328/2686] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:54 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:54.876753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:54.881548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:54.884528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:54.897176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c9cd92ab-ca58-43d7-91fd-d7b2be9b378a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1611 microversion: 2.1 time: 0.243090 May 07 21:54:54.906720 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1359/2687] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:54 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1611 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:54.908222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.908681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:54.909503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:54.909951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.066539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:55.067479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:55.074889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.075775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.076147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.076692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.227991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.238992 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c956ccd1-5fc2-478d-a3b6-6f8b0ed392c5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.176504 May 07 21:54:55.240609 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1360/2688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:55 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:55.255997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:55.256829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:55.264723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.265188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.265992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.266447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.386434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.404905 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9f23495b-e7d2-406b-afc9-c501d33a30bc tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1323 microversion: 2.1 time: 0.534304 May 07 21:54:55.407512 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1329/2689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:54 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:55.422890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-966aef3c-0c27-479a-963c-3a9811bb24a3 req-f31165be-5f04-4274-a849-9f8dffaaf3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0010a466-c288-469b-99f3-a3db8a5efb7c", "tag": "5e8b0963-4bbd-4b02-9602-197e95f150cb"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:55.434741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-966aef3c-0c27-479a-963c-3a9811bb24a3 req-f31165be-5f04-4274-a849-9f8dffaaf3de service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.435392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-966aef3c-0c27-479a-963c-3a9811bb24a3 req-f31165be-5f04-4274-a849-9f8dffaaf3de service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.448317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-966aef3c-0c27-479a-963c-3a9811bb24a3 req-f31165be-5f04-4274-a849-9f8dffaaf3de service nova] Creating event network-changed:5e8b0963-4bbd-4b02-9602-197e95f150cb for instance 0010a466-c288-469b-99f3-a3db8a5efb7c on nch2-master-1 May 07 21:54:55.454495 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-966aef3c-0c27-479a-963c-3a9811bb24a3 req-f31165be-5f04-4274-a849-9f8dffaaf3de service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045604 May 07 21:54:55.455339 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1330/2690] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:55.460351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.462024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:55.463001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:55.469833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.470299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.471249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.471410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.471897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.473608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.475748 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5434793c-8673-428d-8f73-649441137c82 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.231292 May 07 21:54:55.478262 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1361/2691] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:55 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:55.484110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:55.485076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:55.493198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.493760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.494955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.495627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.575277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.585355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.586943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.588098 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a694fc4-0d41-4acd-ac6a-52e0bae528c9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1519 microversion: 2.32 time: 0.108574 May 07 21:54:55.588664 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1362/2692] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:55 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1519 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:55.823430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:55.824463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:55.833886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.835559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.836778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.837527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.912579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:55.924016 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-866ba99b-59f3-45bf-8a64-551b7912bcae tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.467252 May 07 21:54:55.925154 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1331/2693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:55 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:55.930036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:55.930948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:55.938632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.938946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:55.939930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:55.941189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.024659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.033678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b51483a-408f-44f2-b0c5-90a623ca3338 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.222096 May 07 21:54:56.043065 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1363/2694] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:55 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:56.257551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:56.258352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:56.265258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.265725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.267056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.267966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.280923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.295169 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f6916147-8882-4775-8847-995e58647161 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1611 microversion: 2.1 time: 0.368721 May 07 21:54:56.295750 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1332/2695] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:55 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1611 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:56.424117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.426746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:56.427624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:56.433027 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bb3549c0-3389-4dfa-bdf1-3cbb38faa661 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.179968 May 07 21:54:56.433633 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1364/2696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:56 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:56.434145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.434603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.435651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.436328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.494670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:56.495554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:56.503467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.504963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.506582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.507124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.648677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.657524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.659095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.661277 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-45e8c67b-e7c0-4623-9553-c2879cea0200 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.170298 May 07 21:54:56.661963 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1365/2697] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:56 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:56.667307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:56.667935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:56.671303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.674385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.675078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.676576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.677365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.681157 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-daa8b0eb-55f3-40a6-8c81-3a05abe844ef tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1520 microversion: 2.1 time: 0.258857 May 07 21:54:56.681753 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1333/2698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:56 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:56.698173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-242b8964-109f-4226-80f7-c5d280a36810 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'create', calling method: .version_select at 0x7fc41cf499d0>, body: {"pool": null} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:56.741402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.750492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.752005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:56.753172 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9891de0-3758-4be8-a73f-a5b619ff6db1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1575 microversion: 2.32 time: 0.090037 May 07 21:54:56.753911 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1366/2699] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:56 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1575 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:56.941562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:56.942671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:56.948980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.949284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:56.950108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:56.950625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:57.206390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:57.215159 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae14f80b-7651-49f8-8c6d-9c77dc4c9fee tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.277521 May 07 21:54:57.215760 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1367/2700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:56 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:54:57.226670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:57.227337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:57.234329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:57.234964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:57.235901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:57.236612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:57.501601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:57.513445 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0605416b-20b7-46e1-b700-2ce78936e6df tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.296469 May 07 21:54:57.514075 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1368/2701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:57 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:57.522698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:57.524824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:57.537778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:57.538298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:57.539329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:57.540019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:58.081532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63a6acdebf9648698ee5f3a5cac02675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9502da27d64dffaf0859d1f6b5663f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:58.095649 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f3afd576-f76b-4f22-8462-86e696ff0293 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 200 len: 1611 microversion: 2.1 time: 0.580484 May 07 21:54:58.099261 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1369/2702] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:57 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 1611 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:58.106690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:58.110953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:58.124767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:58.125265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:58.126886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:58.127890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:58.336460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:58.347195 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5bcbf785-e9a9-4569-bd43-0843059e2f46 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.246804 May 07 21:54:58.349208 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1370/2703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:58 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:58.355129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c49d881a-b873-40d0-9275-2e96f0ad5329 req-f70cc859-e1a0-49cf-b90d-6ff4d47f285f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120a21bb-a0eb-49aa-adce-3903960c1785", "tag": "3eec7149-cebf-4a54-bf65-c4194dd2be8d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:54:58.364076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c49d881a-b873-40d0-9275-2e96f0ad5329 req-f70cc859-e1a0-49cf-b90d-6ff4d47f285f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:58.364669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c49d881a-b873-40d0-9275-2e96f0ad5329 req-f70cc859-e1a0-49cf-b90d-6ff4d47f285f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:58.380403 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c49d881a-b873-40d0-9275-2e96f0ad5329 req-f70cc859-e1a0-49cf-b90d-6ff4d47f285f service nova] Creating event network-changed:3eec7149-cebf-4a54-bf65-c4194dd2be8d for instance 120a21bb-a0eb-49aa-adce-3903960c1785 on nch2-master-1 May 07 21:54:58.386719 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c49d881a-b873-40d0-9275-2e96f0ad5329 req-f70cc859-e1a0-49cf-b90d-6ff4d47f285f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035834 May 07 21:54:58.387833 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1371/2704] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:54:58.394147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:58.395643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:58.403110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:58.403750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:58.404962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:58.405507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:58.674152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:58.684353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:58.702444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:58.703728 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5e9df8d6-94c8-416b-a8b9-bbc062ef6d07 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.314700 May 07 21:54:58.727246 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1372/2705] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:58 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:58.734318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:58.735021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:58.763212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:58.763910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:58.768043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:58.768768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:59.153716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:59.169757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:59.175292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:59.177734 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8e0d6e5-2aad-4191-acb1-70c19fda2842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1660 microversion: 2.32 time: 0.448828 May 07 21:54:59.178223 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1373/2706] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:54:58 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1660 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:54:59.188729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:59.189389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:59.206169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:59.206657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:59.208939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:59.209148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:59.540051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:54:59.553893 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9de6d4ad-827e-4961-b83b-513fbcbf0531 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.374828 May 07 21:54:59.554489 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1374/2707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:59 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:54:59.566001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:54:59.566948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:54:59.588995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:59.589650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:54:59.590602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:54:59.591218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.076883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.104684 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-06bdc715-2679-4a2a-834b-2a0d79706f03 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.549004 May 07 21:55:00.107269 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1375/2708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:54:59 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:00.121981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:00.129532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] [instance: 7df1b628-71b8-4dd0-893e-521f565ba1fc] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:00.149884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.150379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.151324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.151772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.235992 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] HTTP exception thrown: Instance 7df1b628-71b8-4dd0-893e-521f565ba1fc could not be found. May 07 21:55:00.236675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Returning 404 to user: Instance 7df1b628-71b8-4dd0-893e-521f565ba1fc could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:55:00.237754 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6fe55f4f-2a8d-452b-8a45-97f2f630f81a tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc" status: 404 len: 111 microversion: 2.1 time: 0.128203 May 07 21:55:00.238570 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1376/2709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:00 2022] GET /compute/v2.1/servers/7df1b628-71b8-4dd0-893e-521f565ba1fc => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:55:00.255195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:00.256704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:00.268587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.269280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.270813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.271404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.579977 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-242b8964-109f-4226-80f7-c5d280a36810 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.885579 May 07 21:55:00.583030 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1334/2710] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:54:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:55:00.591518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:00.592165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:00.609979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.610752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.611771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.612993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.624563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.635555 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a60146e-dc19-4353-8db7-1a7d62965710 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.385880 May 07 21:55:00.636266 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1377/2711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:00 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:00.651533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:00.652179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:00.658402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.659116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.660659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.662199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.876692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.891165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.894013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.896069 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-32836103-3dac-4d87-a36c-2009d80dad6a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.311893 May 07 21:55:00.896978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1335/2712] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:00 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:00.905834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84fefec2-a4f9-4cf0-b5be-e25c375bc8a3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] Calling method '.version_select at 0x7fc41d752430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:00.912018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.924884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.927057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:00.928246 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-680d05b5-1670-4801-a9e1-cbee071325e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1706 microversion: 2.32 time: 0.291050 May 07 21:55:00.929191 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1378/2713] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:00 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1706 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:00.929923 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84fefec2-a4f9-4cf0-b5be-e25c375bc8a3 tempest-ServersTestBootFromVolume-513562440 tempest-ServersTestBootFromVolume-513562440-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518885795" status: 202 len: 0 microversion: 2.1 time: 0.029485 May 07 21:55:00.933486 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1336/2714] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:55:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518885795 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:55:00.937584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-db2d4934-7860-4b56-afa0-778531b8be14 req-a2059899-d393-4b27-9d9a-94fb5c2431c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df1b628-71b8-4dd0-893e-521f565ba1fc", "name": "network-vif-deleted", "tag": "086eedec-731a-4836-8a01-603bbdb8a932"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:00.943601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:00.944251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:00.947572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-db2d4934-7860-4b56-afa0-778531b8be14 req-a2059899-d393-4b27-9d9a-94fb5c2431c0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.948206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-db2d4934-7860-4b56-afa0-778531b8be14 req-a2059899-d393-4b27-9d9a-94fb5c2431c0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.952098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.952544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.953356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:00.953809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:00.962861 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-db2d4934-7860-4b56-afa0-778531b8be14 req-a2059899-d393-4b27-9d9a-94fb5c2431c0 service nova] Creating event network-vif-deleted:086eedec-731a-4836-8a01-603bbdb8a932 for instance 7df1b628-71b8-4dd0-893e-521f565ba1fc on nch1-master-1 May 07 21:55:00.970960 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-db2d4934-7860-4b56-afa0-778531b8be14 req-a2059899-d393-4b27-9d9a-94fb5c2431c0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040049 May 07 21:55:00.976080 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1379/2715] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:00.981767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-235319912", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "704f8450-d63f-47c9-8f27-0e9fc81678e7"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:01.045210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] validate_networks() for [('704f8450-d63f-47c9-8f27-0e9fc81678e7', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:55:01.138462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:01.147184 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a6441ec-48be-4bfb-b0a9-9f9426b2958b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.214164 May 07 21:55:01.147790 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1337/2716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:00 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:01.153428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:01.154318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:01.162632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:01.163416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:01.164479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:01.165125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:01.486303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:01.496406 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2276e9c-77a1-430f-b6ed-76f19eb74acf tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.347395 May 07 21:55:01.497447 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1338/2717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:01 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:01.653366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:01.655133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:01.665417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:01.666386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:01.667422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:01.668051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:01.881478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:01.892992 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-da2c8367-cd9f-442d-9939-572a3161d826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.243820 May 07 21:55:01.893929 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1339/2718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:01 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:01.899981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-14ab5c83-bab7-4e5c-a2af-08ff8039263a req-81f7bc74-5a93-454c-ab6b-e620711cea9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0010a466-c288-469b-99f3-a3db8a5efb7c", "name": "network-vif-plugged", "status": "completed", "tag": "5e8b0963-4bbd-4b02-9602-197e95f150cb"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:01.913296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-14ab5c83-bab7-4e5c-a2af-08ff8039263a req-81f7bc74-5a93-454c-ab6b-e620711cea9b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:01.913972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-14ab5c83-bab7-4e5c-a2af-08ff8039263a req-81f7bc74-5a93-454c-ab6b-e620711cea9b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:01.931824 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-14ab5c83-bab7-4e5c-a2af-08ff8039263a req-81f7bc74-5a93-454c-ab6b-e620711cea9b service nova] Creating event network-vif-plugged:5e8b0963-4bbd-4b02-9602-197e95f150cb for instance 0010a466-c288-469b-99f3-a3db8a5efb7c on nch2-master-1 May 07 21:55:01.938013 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-14ab5c83-bab7-4e5c-a2af-08ff8039263a req-81f7bc74-5a93-454c-ab6b-e620711cea9b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042257 May 07 21:55:01.939214 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1340/2719] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:01.945651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:01.964301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:01.983225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:01.983695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:01.984514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:01.984966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.175195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:55:02.175843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:55:02.176127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:55:02.176743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:55:02.177307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:55:02.192175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.197656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.199164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.203549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.245050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Getting quotas for project 4c2ee723c6a04843b302e255a401b1e7. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:02.259385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Getting quotas for user a295663c20584408b634e99490e34883 and project 4c2ee723c6a04843b302e255a401b1e7. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:02.284296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:55:02.289790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:55:02.295198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.305885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.307850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.309065 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e029048f-a4d6-4bb5-bfa5-c9489fe43e98 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.368475 May 07 21:55:02.310127 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1341/2720] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:01 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:02.315887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:02.316820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:02.324942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.325412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.326268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.326724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.364367 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bfec1c59-ef48-4193-974f-336d1f4c25fb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.385853 May 07 21:55:02.371332 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1380/2721] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:55:02.378737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:02.379740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:02.388075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.391030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.393128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.394030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.572118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.583443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.584987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.586179 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd6a3ba8-c065-408c-b7f9-7b7f15f6099f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1752 microversion: 2.32 time: 0.275090 May 07 21:55:02.586747 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1342/2722] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:02 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1752 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:02.595141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-58c01eb9-e059-4d04-baff-bd396c0abdd4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:02.595141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-58c01eb9-e059-4d04-baff-bd396c0abdd4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:02.654424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-58c01eb9-e059-4d04-baff-bd396c0abdd4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.662318 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-58c01eb9-e059-4d04-baff-bd396c0abdd4 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1223 microversion: 2.1 time: 0.074526 May 07 21:55:02.662923 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1343/2723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:02 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1223 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:02.668028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:02.668985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:02.678518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.679313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.680187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.680746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.903502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.916496 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8b522f4-47e8-43ce-bb81-f83c7f1ffd60 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.252144 May 07 21:55:02.918562 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1344/2724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:02 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:02.929441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:02.934018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:02.935153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:02.950686 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c967ee48-4a69-43ef-b5f3-10f51adeb9da tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.577770 May 07 21:55:02.951603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1381/2725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:02 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:02.963845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.964585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:02.965674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:02.967129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.136909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:03.144923 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-caeba31f-82cb-4f34-b27a-24c3fbd5bc53 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1318 microversion: 2.1 time: 0.220474 May 07 21:55:03.146435 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1345/2726] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:02 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:03.329897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:03.330628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:03.352055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.352055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.352055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.352055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.605464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:03.606803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:03.615225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.615966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.617574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.618213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.805414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:03.815411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:03.817709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:03.819066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-298cdc39-86e3-49cf-b2d6-efc91df25ac6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1786 microversion: 2.32 time: 0.217856 May 07 21:55:03.819781 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1346/2727] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:03 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1786 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:03.833023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:03.833726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:03.840471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.840931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.841805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.842256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.911349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:03.920001 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d86d6a82-129b-4605-b569-fa64a7717857 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1275 microversion: 2.1 time: 0.098110 May 07 21:55:03.920708 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1347/2728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:03 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:03.947948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:03.948509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:03.960403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.960973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:03.962814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:03.962814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.099899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:04.109271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:04.112123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:04.113570 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8d40dcac-2e17-4dc5-8ac6-37c78c492b4f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.787743 May 07 21:55:04.114818 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1382/2729] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:03 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:04.121319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:04.122324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:04.130288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.131560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.132690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.133308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.463338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:04.474951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-957a7351-1add-486e-bb6a-eac749e46ff1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1523 microversion: 2.1 time: 0.530834 May 07 21:55:04.475876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1348/2730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:03 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1523 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:04.481050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-841eade0-df5a-4ea0-84c6-e30a7598736c req-5100b0d1-0452-4c1d-87f3-9530897bdd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120a21bb-a0eb-49aa-adce-3903960c1785", "name": "network-vif-plugged", "status": "completed", "tag": "3eec7149-cebf-4a54-bf65-c4194dd2be8d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:04.489591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-841eade0-df5a-4ea0-84c6-e30a7598736c req-5100b0d1-0452-4c1d-87f3-9530897bdd91 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.490046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-841eade0-df5a-4ea0-84c6-e30a7598736c req-5100b0d1-0452-4c1d-87f3-9530897bdd91 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.502001 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-841eade0-df5a-4ea0-84c6-e30a7598736c req-5100b0d1-0452-4c1d-87f3-9530897bdd91 service nova] Creating event network-vif-plugged:3eec7149-cebf-4a54-bf65-c4194dd2be8d for instance 120a21bb-a0eb-49aa-adce-3903960c1785 on nch2-master-1 May 07 21:55:04.507449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-841eade0-df5a-4ea0-84c6-e30a7598736c req-5100b0d1-0452-4c1d-87f3-9530897bdd91 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030330 May 07 21:55:04.508391 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1349/2731] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:04.516701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:04.518135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:04.518822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:04.526033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.526573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.527722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.528172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.530885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-32fb95ba-af29-43d7-8e68-1aecd777b592 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.414190 May 07 21:55:04.545860 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1383/2732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:04 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:04.826616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:04.837267 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-afb90e7f-4001-412c-9887-3b60e596d39c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1468 microversion: 2.1 time: 0.324207 May 07 21:55:04.839119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:04.839962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:04.852930 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1350/2733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:04 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1468 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:04.861340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.864743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.865739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.866677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:04.867319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.869498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:04.881180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.881659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:04.882446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:04.882925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.120582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.128397 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c8df1d1e-5524-4b2b-95a2-7495df53ce38 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 200 len: 1318 microversion: 2.1 time: 0.274007 May 07 21:55:05.129101 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1351/2734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:04 2022] GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:05.133910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:05.134653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:05.140584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.141128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.141994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.142515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.205556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.215771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.217558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.219030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb6fcdbe-b885-421d-a484-5b8969492755 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1786 microversion: 2.32 time: 0.383966 May 07 21:55:05.220160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1384/2735] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:04 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1786 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:05.226279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:05.227111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:05.233130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.236078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.236714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.237461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.238121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.244952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f0d941b7-f396-4292-950b-6e6eb6994a2b tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1281 microversion: 2.1 time: 0.114553 May 07 21:55:05.246061 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1352/2736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:05 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:05.492205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:05.492862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:05.507831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.508302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.509129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.509584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.667792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.676473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.681645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.686460 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-def98623-6774-4ab8-8839-9aa18ed36e08 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1746 microversion: 2.20 time: 0.462354 May 07 21:55:05.693289 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1385/2737] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:05 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1746 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:05.703995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:05.704635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:05.712663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.720847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.722048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:05.723249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:05.725858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:05.739819 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d174ce75-c9e5-4df5-a81b-d980e7ae88f1 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1503 microversion: 2.1 time: 0.250320 May 07 21:55:05.752051 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1353/2738] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:05 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:05.762256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7fb51c34-544f-480e-8c40-67f754ce4d24 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'create', calling method: .version_select at 0x7fc41cf49040>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1800227856", "description": "tempest-description-2128759457"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:06.157728 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7fb51c34-544f-480e-8c40-67f754ce4d24 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.399644 May 07 21:55:06.160363 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1354/2739] 10.222.0.32 () {60 vars in 1179 bytes} [Sat May 7 21:55:05 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:06.168653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:06.169558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:06.180216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.181044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.182453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.183386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.338292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:06.347935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8b320089-72cb-4157-8cab-4301d3a691a5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.653255 May 07 21:55:06.348753 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1386/2740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:05 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:06.356145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1800227856"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:06.361484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:06.385164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.397236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.398350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.398989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.443484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:06.451780 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d4a99bf1-6ada-4245-a78d-7a360f6d7128 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 200 len: 1467 microversion: 2.1 time: 0.288826 May 07 21:55:06.454260 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1355/2741] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:06 2022] GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:06.483225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:06.484158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:06.492556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.493015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.493813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.494261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.797763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:06.817484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:06.820148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:06.827753 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6a2ebbd4-9cdb-4103-a54b-35d562735146 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1832 microversion: 2.32 time: 0.349870 May 07 21:55:06.833493 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1356/2742] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:06 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1832 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:06.847522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:06.848260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:06.860674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.861269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.862178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:06.862730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:06.997049 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.network.security_group_api [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Adding security group 6b92e61f-c0aa-4cb9-a633-31aa24ceb414 to port 26b45fcb-fb85-4cfb-9dc0-1b5852bae60e May 07 21:55:07.155274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:07.166884 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b1b5f90-1c29-43d5-84bb-90aca10ee789 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1323 microversion: 2.1 time: 0.331983 May 07 21:55:07.168088 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1357/2743] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:06 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1323 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:07.177145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:07.181443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:07.182673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Searching by: {'reservation_id': 'r-3ad9q4ya', 'deleted': False, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:55:07.197532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:07.199021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:07.200257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:07.201194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:07.356794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:55:07.444611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:07.451427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:07.451887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:07.783200 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8c8e004e-6ab5-469a-b159-98106db776f4 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?reservation_id=r-3ad9q4ya" status: 200 len: 2928 microversion: 2.1 time: 0.613907 May 07 21:55:07.783811 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1358/2744] 10.222.0.32 () {58 vars in 1196 bytes} [Sat May 7 21:55:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-3ad9q4ya => generated 2928 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:07.800136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:07.800997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:07.811181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:07.815039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:07.818662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:07.819309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.089762 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af7a8dcc-a56d-401b-9a47-8bd93b2f0aca tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action" status: 202 len: 0 microversion: 2.1 time: 1.739621 May 07 21:55:08.091074 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1387/2745] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:06 2022] POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action => generated 0 bytes in 1742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:55:08.097320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5b0e1e75-68a1-40d8-b9eb-0b9f19387b51 req-4ff101c4-080d-4a00-a89a-b1eac909be79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653f2d36-3e13-4a84-93ea-5545b4e9fd2f", "tag": "9c05653c-13d6-4294-9e31-a8863d1d2783"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:08.130386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5b0e1e75-68a1-40d8-b9eb-0b9f19387b51 req-4ff101c4-080d-4a00-a89a-b1eac909be79 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.131177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5b0e1e75-68a1-40d8-b9eb-0b9f19387b51 req-4ff101c4-080d-4a00-a89a-b1eac909be79 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.171478 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5b0e1e75-68a1-40d8-b9eb-0b9f19387b51 req-4ff101c4-080d-4a00-a89a-b1eac909be79 service nova] Creating event network-changed:9c05653c-13d6-4294-9e31-a8863d1d2783 for instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f on nch1-master-1 May 07 21:55:08.208153 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5b0e1e75-68a1-40d8-b9eb-0b9f19387b51 req-4ff101c4-080d-4a00-a89a-b1eac909be79 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115584 May 07 21:55:08.209127 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1388/2746] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:08.224470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:08.225427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:08.233268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:08.239391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.240056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.241045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.242092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.251893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:08.255390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:08.258290 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc5b55fc-a26d-4e13-8474-32caf172e845 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1741 microversion: 2.20 time: 0.473464 May 07 21:55:08.258921 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1359/2747] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:07 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1741 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:08.284342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3193d2ea-8a98-4f69-8bda-aa91f0c01944 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:08.339888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.server_groups [None req-3193d2ea-8a98-4f69-8bda-aa91f0c01944 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Querying cell 6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) for 2 instances {{(pid=136681) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 07 21:55:08.343513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3193d2ea-8a98-4f69-8bda-aa91f0c01944 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.344226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3193d2ea-8a98-4f69-8bda-aa91f0c01944 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.419703 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3193d2ea-8a98-4f69-8bda-aa91f0c01944 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/e5523e38-e30a-423c-9fb1-e97c60d84e68" status: 200 len: 266 microversion: 2.1 time: 0.144206 May 07 21:55:08.420130 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1360/2748] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:55:08 2022] GET /compute/v2.1/os-server-groups/e5523e38-e30a-423c-9fb1-e97c60d84e68 => generated 266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:08.430354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:08.431127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:08.451840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.458816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.459946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.464516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.545443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:08.554684 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-839ea8d8-cea7-4209-b9ca-20a141d4444f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1517 microversion: 2.1 time: 0.336757 May 07 21:55:08.564051 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1389/2749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:08 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:08.569954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1800227856"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:08.577217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:08.600710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.601246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:08.604514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:08.604982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:09.007177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.network.security_group_api [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Removing security group 6b92e61f-c0aa-4cb9-a633-31aa24ceb414 from port 26b45fcb-fb85-4cfb-9dc0-1b5852bae60e May 07 21:55:09.020555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:09.037248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:09.039799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:09.041596 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c61c52c3-872e-4f6d-bcab-25b8a72174f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1832 microversion: 2.32 time: 0.620350 May 07 21:55:09.042831 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1361/2750] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:08 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1832 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:09.047480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7a183a3a-1d95-4856-8e02-e19840241d32 req-6ed7f4e7-4a2b-49dd-a8fc-c548ee93c842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1328c136-9d82-4506-81cd-534b3799a51d", "tag": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:09.057784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7a183a3a-1d95-4856-8e02-e19840241d32 req-6ed7f4e7-4a2b-49dd-a8fc-c548ee93c842 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:09.058595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7a183a3a-1d95-4856-8e02-e19840241d32 req-6ed7f4e7-4a2b-49dd-a8fc-c548ee93c842 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:09.072709 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7a183a3a-1d95-4856-8e02-e19840241d32 req-6ed7f4e7-4a2b-49dd-a8fc-c548ee93c842 service nova] Creating event network-changed:26b45fcb-fb85-4cfb-9dc0-1b5852bae60e for instance 1328c136-9d82-4506-81cd-534b3799a51d on nch1-master-1 May 07 21:55:09.078996 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7a183a3a-1d95-4856-8e02-e19840241d32 req-6ed7f4e7-4a2b-49dd-a8fc-c548ee93c842 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034115 May 07 21:55:09.080178 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1362/2751] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:09.085884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:09.086989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:09.095355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:09.096160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:09.097189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:09.097874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:09.913217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:09.928318 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-98b94ad7-decb-4300-897e-251059b0fd0f tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1323 microversion: 2.1 time: 0.846706 May 07 21:55:09.938113 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1363/2752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:09 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1323 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:09.955967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14fa3dcf-a029-409b-9ee1-53ce175cc14a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:09.956593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14fa3dcf-a029-409b-9ee1-53ce175cc14a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:09.988266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa3dcf-a029-409b-9ee1-53ce175cc14a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:09.989102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa3dcf-a029-409b-9ee1-53ce175cc14a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:09.990053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa3dcf-a029-409b-9ee1-53ce175cc14a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:09.990644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa3dcf-a029-409b-9ee1-53ce175cc14a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:10.295212 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb35a09a-fe37-4ae3-a8b6-1453bd48b9b9 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action" status: 202 len: 0 microversion: 2.1 time: 1.728254 May 07 21:55:10.297420 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1390/2753] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:08 2022] POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action => generated 0 bytes in 1732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:55:10.304727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-18ec85da-fa07-4c0d-8b2a-6193f0edd869 req-cd5f0b51-5d0c-4ae4-9b14-0f57b28e84dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "name": "network-vif-plugged", "status": "completed", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:10.333325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-18ec85da-fa07-4c0d-8b2a-6193f0edd869 req-cd5f0b51-5d0c-4ae4-9b14-0f57b28e84dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:10.333791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-18ec85da-fa07-4c0d-8b2a-6193f0edd869 req-cd5f0b51-5d0c-4ae4-9b14-0f57b28e84dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:10.367268 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-18ec85da-fa07-4c0d-8b2a-6193f0edd869 req-cd5f0b51-5d0c-4ae4-9b14-0f57b28e84dc service nova] Creating event network-vif-plugged:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch1-master-1 May 07 21:55:10.382199 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-18ec85da-fa07-4c0d-8b2a-6193f0edd869 req-cd5f0b51-5d0c-4ae4-9b14-0f57b28e84dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082295 May 07 21:55:10.388356 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1391/2754] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:10.399417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:10.406705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:10.426707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:10.428377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:10.433620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:10.434244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:10.748966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:10.767418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:10.772484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:10.775442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0f445370-6707-4b21-a974-149655a6350e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1741 microversion: 2.20 time: 0.384273 May 07 21:55:10.777020 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1392/2755] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:10 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1741 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:10.793645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:10.794286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:10.824551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:10.825015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:10.825816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:10.826266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:10.843729 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14fa3dcf-a029-409b-9ee1-53ce175cc14a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1619 microversion: 2.1 time: 0.904254 May 07 21:55:10.844369 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1364/2756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:09 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1619 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:10.854533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:10.855439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:10.870657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:10.871164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:10.871946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:10.872552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:11.373355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:11.388848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:11.399064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:11.401131 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97ca453f-ce82-46fe-b766-7837975807b3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1853 microversion: 2.32 time: 0.555729 May 07 21:55:11.417388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1365/2757] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:10 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1853 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:11.423354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-902490cc-c9aa-46a0-b255-62f3a4ee1c15 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'create', calling method: .version_select at 0x7fc41ce78820>, body: {"pool": null} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:11.703687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:11.721935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5949b1f-a3f4-422f-9790-8f0cce52f697 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1523 microversion: 2.1 time: 0.943419 May 07 21:55:11.728519 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1393/2758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:10 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1523 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:11.754229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e84f40b8-c26c-4f31-b1cb-22aafd9d0653 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:11.754925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e84f40b8-c26c-4f31-b1cb-22aafd9d0653 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:11.762322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84f40b8-c26c-4f31-b1cb-22aafd9d0653 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:11.767427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84f40b8-c26c-4f31-b1cb-22aafd9d0653 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:11.768516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84f40b8-c26c-4f31-b1cb-22aafd9d0653 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:11.769052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e84f40b8-c26c-4f31-b1cb-22aafd9d0653 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:12.266700 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e84f40b8-c26c-4f31-b1cb-22aafd9d0653 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 200 len: 1618 microversion: 2.1 time: 0.536414 May 07 21:55:12.274228 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1394/2759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:11 2022] GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 1618 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:12.292488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:12.293312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:12.305503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:12.308263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:12.310585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:12.312237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:12.636010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:12.651920 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a747ff8c-6073-404a-ad06-d02dc642c9a2 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1323 microversion: 2.1 time: 0.375129 May 07 21:55:12.663906 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1395/2760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:12 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1323 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:12.671623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-06fcfcc1-592b-4875-a8c4-cc1c98eac5a3 req-8c0d0541-e413-4934-afbc-6168627f33be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "248ca656-6bff-4ce6-b67d-1c6c09ea7b42"}, {"name": "network-changed", "server_uuid": "1328c136-9d82-4506-81cd-534b3799a51d", "tag": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e"}, {"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "8265c59d-4721-4235-823a-846b00373dfe"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:12.689297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-06fcfcc1-592b-4875-a8c4-cc1c98eac5a3 req-8c0d0541-e413-4934-afbc-6168627f33be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:12.691332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-06fcfcc1-592b-4875-a8c4-cc1c98eac5a3 req-8c0d0541-e413-4934-afbc-6168627f33be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:12.719416 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-06fcfcc1-592b-4875-a8c4-cc1c98eac5a3 req-8c0d0541-e413-4934-afbc-6168627f33be service nova] Creating event network-changed:248ca656-6bff-4ce6-b67d-1c6c09ea7b42 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:55:12.720060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-06fcfcc1-592b-4875-a8c4-cc1c98eac5a3 req-8c0d0541-e413-4934-afbc-6168627f33be service nova] Creating event network-changed:26b45fcb-fb85-4cfb-9dc0-1b5852bae60e for instance 1328c136-9d82-4506-81cd-534b3799a51d on nch1-master-1 May 07 21:55:12.720480 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-06fcfcc1-592b-4875-a8c4-cc1c98eac5a3 req-8c0d0541-e413-4934-afbc-6168627f33be service nova] Creating event network-changed:8265c59d-4721-4235-823a-846b00373dfe for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:55:12.741101 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-06fcfcc1-592b-4875-a8c4-cc1c98eac5a3 req-8c0d0541-e413-4934-afbc-6168627f33be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.074544 May 07 21:55:12.742030 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1396/2761] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:12.750619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:12.751318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:12.773417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:12.773962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:12.774826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:12.777450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:13.254958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:13.271941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:13.275430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:13.276660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-33486eab-8171-4f9e-8dd1-711051c0dcff tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1741 microversion: 2.20 time: 0.533502 May 07 21:55:13.277252 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1397/2762] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:12 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1741 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:13.292305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c209ae08-bf50-4d06-a0b1-67ecf1739d45 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: .version_select at 0x7fc422623310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1687315309", "policies": ["anti-affinity"]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:13.315760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c209ae08-bf50-4d06-a0b1-67ecf1739d45 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:13.322097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c209ae08-bf50-4d06-a0b1-67ecf1739d45 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:13.413844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c209ae08-bf50-4d06-a0b1-67ecf1739d45 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:13.426044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c209ae08-bf50-4d06-a0b1-67ecf1739d45 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:13.459298 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c209ae08-bf50-4d06-a0b1-67ecf1739d45 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.176033 May 07 21:55:13.460672 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1398/2763] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:55:13 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:13.475097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:13.475898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:13.489917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:13.492183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:13.494010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:13.496160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:13.930422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:13.940555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:13.952835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:13.954355 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94cd7923-0134-4f74-98bf-87f57e42fb64 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.491587 May 07 21:55:13.955130 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1399/2764] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:13 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:13.960073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:13.963716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:13.982400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:13.983112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:13.984075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:13.984669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:14.335393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:14.385480 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d924a57e-019b-4141-94d7-67bfca52a5b9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1523 microversion: 2.1 time: 0.425499 May 07 21:55:14.388955 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1400/2765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:13 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1523 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:14.402225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-860966828", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "85c8d49e-6cb2-47b8-b704-f68fa4405bb3"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:14.555018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:55:14.966841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:55:14.967515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:55:14.967739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:55:14.968349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:55:14.968771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:55:15.007847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:15.008300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:15.010910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:15.012057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:15.067058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:15.067058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:15.078585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Going to run 2 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:55:15.082234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:55:15.150355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:15.179764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:15.270112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:15.300853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:15.345321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=a390d88e-4ae4-4700-a85a-6bc97fd8bd29,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:55:15.450013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:15.458760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:15.530906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:15.549502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:15.608461 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-abd0c0b9-7915-4e0e-9cdc-17127df06a07 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.217525 May 07 21:55:15.611238 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1401/2766] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:55:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 07 21:55:15.619982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:15.620758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:15.633566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:15.634335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:15.636152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:15.636915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.041942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:16.059564 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e712eba2-6068-4d2f-9605-3cb3f32f20fa tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1323 microversion: 2.1 time: 0.448315 May 07 21:55:16.060583 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1402/2767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:15 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:16.066390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-648b78c0-09e2-4598-9757-9cd6cdbde2e4 req-81e478d2-bc5d-4592-b83e-cd875113317d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653f2d36-3e13-4a84-93ea-5545b4e9fd2f", "name": "network-vif-plugged", "status": "completed", "tag": "9c05653c-13d6-4294-9e31-a8863d1d2783"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:16.078444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-648b78c0-09e2-4598-9757-9cd6cdbde2e4 req-81e478d2-bc5d-4592-b83e-cd875113317d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.079023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-648b78c0-09e2-4598-9757-9cd6cdbde2e4 req-81e478d2-bc5d-4592-b83e-cd875113317d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.130216 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-648b78c0-09e2-4598-9757-9cd6cdbde2e4 req-81e478d2-bc5d-4592-b83e-cd875113317d service nova] Creating event network-vif-plugged:9c05653c-13d6-4294-9e31-a8863d1d2783 for instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f on nch1-master-1 May 07 21:55:16.142687 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-648b78c0-09e2-4598-9757-9cd6cdbde2e4 req-81e478d2-bc5d-4592-b83e-cd875113317d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080940 May 07 21:55:16.145704 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1403/2768] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:16.165193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:16.167821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:16.184908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.189234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.190529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.192228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.296939 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-902490cc-c9aa-46a0-b255-62f3a4ee1c15 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.877489 May 07 21:55:16.298071 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1366/2769] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:55:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:16.305183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f803f16c-aff4-4b5d-8076-502750939ef9 req-93483ba0-b5d3-423c-8dd9-3c26aab746d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "d3eb7f9f-cad6-43cc-b93c-f50a5e95c505"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:16.342257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f803f16c-aff4-4b5d-8076-502750939ef9 req-93483ba0-b5d3-423c-8dd9-3c26aab746d8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.343155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f803f16c-aff4-4b5d-8076-502750939ef9 req-93483ba0-b5d3-423c-8dd9-3c26aab746d8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.358186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f803f16c-aff4-4b5d-8076-502750939ef9 req-93483ba0-b5d3-423c-8dd9-3c26aab746d8 service nova] Creating event network-changed:d3eb7f9f-cad6-43cc-b93c-f50a5e95c505 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:55:16.365354 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f803f16c-aff4-4b5d-8076-502750939ef9 req-93483ba0-b5d3-423c-8dd9-3c26aab746d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065494 May 07 21:55:16.367176 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1367/2770] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:16.397618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:16.407515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:16.415967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.416750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.418256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.418943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.529794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:16.549117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:16.554068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:16.555423 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3aa6904e-0c1f-47e1-8d23-d463be2b74c1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1741 microversion: 2.20 time: 0.402664 May 07 21:55:16.558034 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1404/2771] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:16 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1741 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:16.570084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:16.573593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:16.595258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.599368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:16.600388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:16.602041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.085934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:17.095957 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a99e3cc0-d2cb-4526-bb6f-6b3cd51bd1b5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1523 microversion: 2.1 time: 0.534043 May 07 21:55:17.098870 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1405/2772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:16 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:17.105044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:17.111997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:17.114105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Searching by: {'deleted': False, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:55:17.121991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.124320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.125468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.126390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.208941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:17.209327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:55:17.233886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:17.236905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:17.239097 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f04083e9-f2c7-4514-b938-80bc313e57ed tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.869164 May 07 21:55:17.240381 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1368/2773] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:16 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:17.246798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'action', calling method: .version_select at 0x7fc41f63a790>, body: {"addFloatingIp": {"address": "172.35.4.113"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:17.248956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:17.261192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.262176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.263221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.265529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.274236 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5f4b5a7-289a-4e46-a028-5e8eeee65184 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.173430 May 07 21:55:17.275820 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1406/2774] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:55:17 2022] GET /compute/v2.1/servers => generated 1662 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:17.293789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:17.294722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:17.304585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.305427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.307100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.307986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.350969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Acquired lock "refresh_cache-1328c136-9d82-4506-81cd-534b3799a51d" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:55:17.627947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:17.644954 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e10eccea-c462-49d2-9b2e-d9da9012bfba tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1323 microversion: 2.1 time: 0.367357 May 07 21:55:17.647479 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1407/2775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:17 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1323 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:17.668236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:17.669233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:17.680130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.680884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.681815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:17.682450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:17.969984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:17.979925 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd6acda0-e42f-4c1f-a9c6-cae1b50824cd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1270 microversion: 2.1 time: 0.331182 May 07 21:55:17.983304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1408/2776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:17 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1270 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:18.005851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:18.006824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:18.038334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:18.039116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:18.040192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:18.040804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:18.367807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:18.378512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:18.395477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:18.396764 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ad274ae9-824c-4e13-8ce6-99b072dee8e7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1741 microversion: 2.20 time: 0.403602 May 07 21:55:18.411048 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1409/2777] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:17 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1741 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:18.412633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:18.413604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:18.424876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:18.427375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:18.428926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:18.429391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:18.761812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:18.773099 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8009df1e-bd6e-4eed-998b-020e22744216 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1523 microversion: 2.1 time: 0.364757 May 07 21:55:18.775781 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1410/2778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:18 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:18.787935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f67d6b3f-e051-49d1-b766-e37f3b72f12f req-393fe0a6-b4f8-40ce-a81b-5b05a0c1ac1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb", "name": "network-vif-plugged", "status": "completed", "tag": "861cefe1-1ec7-45b2-a2a0-851f6f48c014"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:18.804257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f67d6b3f-e051-49d1-b766-e37f3b72f12f req-393fe0a6-b4f8-40ce-a81b-5b05a0c1ac1d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:18.804984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f67d6b3f-e051-49d1-b766-e37f3b72f12f req-393fe0a6-b4f8-40ce-a81b-5b05a0c1ac1d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:18.824730 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f67d6b3f-e051-49d1-b766-e37f3b72f12f req-393fe0a6-b4f8-40ce-a81b-5b05a0c1ac1d service nova] Creating event network-vif-plugged:861cefe1-1ec7-45b2-a2a0-851f6f48c014 for instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb on nch2-master-1 May 07 21:55:18.848692 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f67d6b3f-e051-49d1-b766-e37f3b72f12f req-393fe0a6-b4f8-40ce-a81b-5b05a0c1ac1d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071433 May 07 21:55:18.849884 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1411/2779] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:18.855266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:18.855983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:18.869732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:18.870210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:18.871285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:18.871479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:19.751511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:19.779341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:19.797067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:19.800977 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0f27446-eff6-4823-9e84-b22bf0ac0391 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.949497 May 07 21:55:19.806218 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1412/2780] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:18 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:19.820044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1257fa46-f0a3-41e1-9863-d875a1e6c6f5 req-a40fca87-ee84-4dbb-a05a-b31d93c0558a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "5642df0d-b70e-45a4-b82c-4c09755c76de"}, {"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "0aa75d6c-c396-4cf7-82ed-1655289562cd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:19.860773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1257fa46-f0a3-41e1-9863-d875a1e6c6f5 req-a40fca87-ee84-4dbb-a05a-b31d93c0558a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:19.863546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1257fa46-f0a3-41e1-9863-d875a1e6c6f5 req-a40fca87-ee84-4dbb-a05a-b31d93c0558a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:19.883045 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1257fa46-f0a3-41e1-9863-d875a1e6c6f5 req-a40fca87-ee84-4dbb-a05a-b31d93c0558a service nova] Creating event network-changed:5642df0d-b70e-45a4-b82c-4c09755c76de for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:55:19.890792 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1257fa46-f0a3-41e1-9863-d875a1e6c6f5 req-a40fca87-ee84-4dbb-a05a-b31d93c0558a service nova] Creating event network-changed:0aa75d6c-c396-4cf7-82ed-1655289562cd for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:55:19.901366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1257fa46-f0a3-41e1-9863-d875a1e6c6f5 req-a40fca87-ee84-4dbb-a05a-b31d93c0558a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089188 May 07 21:55:19.910294 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1413/2781] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:19.920682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:19.924817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:19.939450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:19.940325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:19.943092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:19.948269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:20.415339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:20.426679 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-24553ed1-dd26-4863-a8ef-db25af5cdd42 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 200 len: 1519 microversion: 2.1 time: 0.514756 May 07 21:55:20.438808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1414/2782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:19 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 1519 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:20.438808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:20.438808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:20.458840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:20.459299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:20.460087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:20.461254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:20.589317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:20.604119 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e726c6c4-0a51-436e-a3fa-5814399898cf tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1276 microversion: 2.1 time: 0.169043 May 07 21:55:20.604787 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1415/2783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:20 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:20.619487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:20.620455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:20.635693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:20.636524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:20.639413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:20.639889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:20.887121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:20.900381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:20.902449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:20.904055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ca38613-e869-48a5-9c81-8814089c3db6 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1741 microversion: 2.20 time: 0.297446 May 07 21:55:20.905304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1416/2784] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:20 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:20.913369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:20.915021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:20.929024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:20.929791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:20.931260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:20.931965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:21.227843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:21.237630 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6d97810-72e8-4b0d-9353-92d876b7635d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1523 microversion: 2.1 time: 0.330857 May 07 21:55:21.238809 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1417/2785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:20 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:21.465547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-609571395", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "9b7653d0-c69e-4364-9ed6-1c005b136d81"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:21.573066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] validate_networks() for [('9b7653d0-c69e-4364-9ed6-1c005b136d81', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:55:22.192707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Building network info cache for instance {{(pid=136681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:22.244439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:55:22.246436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:55:22.247110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:55:22.247676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:55:22.248251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:55:22.263210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:22.263914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:22.264940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:22.266346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:22.295797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:22.307212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for user 228761ebf4c0406ab0977cabe351ac76 and project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:22.329489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:55:22.334165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:55:22.461531 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52aa816d-ea2c-432e-ae12-8a521c2e8047 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211947 May 07 21:55:22.462928 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1418/2786] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:55:22.469832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'action', calling method: .version_select at 0x7fc41f63a790>, body: {"addFloatingIp": {"address": "172.35.4.22"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:22.472403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:22.482051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:22.483316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:22.484527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:22.485283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:22.585004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Acquired lock "refresh_cache-0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:55:25.256722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Building network info cache for instance {{(pid=136682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:26.624786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Updating instance_info_cache with network_info: [{"id": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6", "address": "fa:16:3e:f0:96:18", "network": {"id": "704f8450-d63f-47c9-8f27-0e9fc81678e7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2146525056-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c2ee723c6a04843b302e255a401b1e7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap251b3c4a-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:26.652160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Releasing lock "refresh_cache-0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:55:26.653687 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-abd7cc11-3280-44cc-a0cf-3e363f74a0cb tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action" status: 202 len: 0 microversion: 2.1 time: 4.189458 May 07 21:55:26.654923 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1419/2787] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:22 2022] POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action => generated 0 bytes in 4191 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:55:26.665367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:26.667355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:26.680448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:26.683623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:26.685921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:26.686739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:26.964549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:26.977383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:26.980564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:26.981821 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa4799f2-9080-418f-8e62-48dbbc0a3887 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.325740 May 07 21:55:26.982907 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1420/2788] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:26 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:26.992096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:26.994088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:27.019852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.020562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.021784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.022388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.040693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Updating instance_info_cache with network_info: [{"id": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e", "address": "fa:16:3e:de:1c:18", "network": {"id": "38ca9b6e-b205-48f9-a002-ddfee225fe39", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-602815296-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "addf83b9a69e4628b1b962b7fceeb9ae", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26b45fcb-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:27.065202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Releasing lock "refresh_cache-1328c136-9d82-4506-81cd-534b3799a51d" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:55:27.068841 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c5fb1c6-5464-431c-a7ae-0ce30ad78982 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action" status: 202 len: 0 microversion: 2.1 time: 9.827120 May 07 21:55:27.070346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1369/2789] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:17 2022] POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action => generated 0 bytes in 9829 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:55:27.077085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:27.080427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:27.089692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.091442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.092469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.094143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.240426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:27.250511 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77f649c1-4da2-4b2d-aa2a-cecb626ab53d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1318 microversion: 2.1 time: 0.266607 May 07 21:55:27.251612 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1421/2790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:26 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:27.258291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-14c3bb5d-61aa-4ea1-93f1-b37f8ffd5f11 req-648f3f6e-ee7d-4b3f-a824-56dc9c855a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "744875ea-e246-4ecb-b60f-b9c04a274fe9"}, {"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "0f85ab7f-8d9d-42b6-bed5-f5b8be554023"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:27.267575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-14c3bb5d-61aa-4ea1-93f1-b37f8ffd5f11 req-648f3f6e-ee7d-4b3f-a824-56dc9c855a13 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.268399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-14c3bb5d-61aa-4ea1-93f1-b37f8ffd5f11 req-648f3f6e-ee7d-4b3f-a824-56dc9c855a13 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.289232 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-14c3bb5d-61aa-4ea1-93f1-b37f8ffd5f11 req-648f3f6e-ee7d-4b3f-a824-56dc9c855a13 service nova] Creating event network-changed:744875ea-e246-4ecb-b60f-b9c04a274fe9 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:55:27.289815 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-14c3bb5d-61aa-4ea1-93f1-b37f8ffd5f11 req-648f3f6e-ee7d-4b3f-a824-56dc9c855a13 service nova] Creating event network-changed:0f85ab7f-8d9d-42b6-bed5-f5b8be554023 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:55:27.296000 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-14c3bb5d-61aa-4ea1-93f1-b37f8ffd5f11 req-648f3f6e-ee7d-4b3f-a824-56dc9c855a13 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042590 May 07 21:55:27.301486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1422/2791] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:27.307414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ed3cc09e-cf30-4662-8ea7-d0a54d8064e0 req-6a096b7e-61cf-4445-a439-a9913f113d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1328c136-9d82-4506-81cd-534b3799a51d", "tag": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:27.318975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ed3cc09e-cf30-4662-8ea7-d0a54d8064e0 req-6a096b7e-61cf-4445-a439-a9913f113d43 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.319712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ed3cc09e-cf30-4662-8ea7-d0a54d8064e0 req-6a096b7e-61cf-4445-a439-a9913f113d43 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.336443 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ed3cc09e-cf30-4662-8ea7-d0a54d8064e0 req-6a096b7e-61cf-4445-a439-a9913f113d43 service nova] Creating event network-changed:26b45fcb-fb85-4cfb-9dc0-1b5852bae60e for instance 1328c136-9d82-4506-81cd-534b3799a51d on nch1-master-1 May 07 21:55:27.342147 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ed3cc09e-cf30-4662-8ea7-d0a54d8064e0 req-6a096b7e-61cf-4445-a439-a9913f113d43 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038751 May 07 21:55:27.343516 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1423/2792] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:27.349746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:27.351548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:27.358898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.359600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.360635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.363342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.679238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:27.695781 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-81a017c4-b014-426e-8ac5-ff7f6677be43 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1508 microversion: 2.1 time: 0.350693 May 07 21:55:27.696593 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1424/2793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:27 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:27.701388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:27.702006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:27.708426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.709110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.710239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.712061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.826498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:27.829424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:27.839783 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-60751af1-8bd7-4fe1-9568-a22384b6afaf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1272 microversion: 2.1 time: 0.141958 May 07 21:55:27.844597 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1425/2794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:27 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:27.851413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:27.853373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:27.854856 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed4f8a58-7205-46d9-91b4-156274e5bd99 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1741 microversion: 2.20 time: 0.782889 May 07 21:55:27.856999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.22"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:27.858180 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1370/2795] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:27 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1741 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:27.872614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Action: 'action', calling method: .version_select at 0x7fc41f63ad30>, body: {"removeFloatingIp": {"address": "172.35.4.113"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:27.880242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:27.888663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.894243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.895328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:27.895865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:27.936346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Acquired lock "refresh_cache-653f2d36-3e13-4a84-93ea-5545b4e9fd2f" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:55:28.583529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:28.648475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:28.649043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:28.654074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:28.660833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:29.501295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Acquired lock "refresh_cache-1328c136-9d82-4506-81cd-534b3799a51d" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:55:30.931484 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.network.neutron [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] re-assign floating IP 172.35.4.22 from instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d May 07 21:55:31.011536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Building network info cache for instance {{(pid=136682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:31.613156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Updating instance_info_cache with network_info: [{"id": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6", "address": "fa:16:3e:f0:96:18", "network": {"id": "704f8450-d63f-47c9-8f27-0e9fc81678e7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2146525056-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c2ee723c6a04843b302e255a401b1e7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap251b3c4a-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:31.640951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Building network info cache for instance {{(pid=136682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:31.974108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Building network info cache for instance {{(pid=136681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:32.421130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Updating instance_info_cache with network_info: [{"id": "9c05653c-13d6-4294-9e31-a8863d1d2783", "address": "fa:16:3e:16:f7:35", "network": {"id": "704f8450-d63f-47c9-8f27-0e9fc81678e7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2146525056-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c2ee723c6a04843b302e255a401b1e7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9c05653c-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:32.442222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Releasing lock "refresh_cache-653f2d36-3e13-4a84-93ea-5545b4e9fd2f" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:55:32.443249 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-035e0bc8-f4c4-4716-9f24-930cf5f58389 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f/action" status: 202 len: 0 microversion: 2.1 time: 4.597125 May 07 21:55:32.444125 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1426/2796] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:27 2022] POST /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f/action => generated 0 bytes in 4599 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:55:32.450078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:32.451108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:32.459598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:32.460402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:32.461387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:32.462096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:32.657912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:32.674223 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1591550-d359-4a09-8477-8c4b36db42b3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 200 len: 1508 microversion: 2.1 time: 0.228649 May 07 21:55:32.675117 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1427/2797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:32 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:32.680416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:32.681054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:32.696545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:32.697802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:32.704148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:32.705125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:32.988574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.006440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.008339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.011610 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-932284f2-e8a0-4fc0-9380-04845fdff26b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.334850 May 07 21:55:33.014560 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1428/2798] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:32 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:33.020159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:33.021064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:33.042672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.043455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.044523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.047867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.323068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.333240 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-26ab7ea3-7f49-4350-ba16-20812fbc2245 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1318 microversion: 2.1 time: 0.317265 May 07 21:55:33.343534 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1429/2799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:33 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:33.351230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:33.352578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:33.360219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.360610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.361461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.362019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.572194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Updating instance_info_cache with network_info: [{"id": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e", "address": "fa:16:3e:de:1c:18", "network": {"id": "38ca9b6e-b205-48f9-a002-ddfee225fe39", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-602815296-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "addf83b9a69e4628b1b962b7fceeb9ae", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26b45fcb-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:33.594818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.597760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Releasing lock "refresh_cache-1328c136-9d82-4506-81cd-534b3799a51d" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:55:33.600227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14e36a1d-c4ca-44de-8217-f097b711ef59 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action" status: 202 len: 0 microversion: 2.1 time: 5.737809 May 07 21:55:33.603123 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1371/2800] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:27 2022] POST /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d/action => generated 0 bytes in 5742 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:55:33.605267 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c383250-d1d4-4fbf-9e2e-ca8fec984d13 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1314 microversion: 2.1 time: 0.260321 May 07 21:55:33.615799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1430/2801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:33 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:33.615901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c2089b54-b5cb-4c60-9e62-e413fdedd6e5 req-4896f943-c2ae-4386-a6d1-b15bceefff26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6f28fb-7fb0-4dbe-b780-f14e94c9846d", "tag": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:33.621938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:33.622562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:33.629070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c2089b54-b5cb-4c60-9e62-e413fdedd6e5 req-4896f943-c2ae-4386-a6d1-b15bceefff26 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.629657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c2089b54-b5cb-4c60-9e62-e413fdedd6e5 req-4896f943-c2ae-4386-a6d1-b15bceefff26 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.638486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.638486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.639759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.640208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.649253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c2089b54-b5cb-4c60-9e62-e413fdedd6e5 req-4896f943-c2ae-4386-a6d1-b15bceefff26 service nova] Creating event network-changed:251b3c4a-3d68-4a9c-8850-df61aa0e1dc6 for instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d on nch1-master-1 May 07 21:55:33.656526 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c2089b54-b5cb-4c60-9e62-e413fdedd6e5 req-4896f943-c2ae-4386-a6d1-b15bceefff26 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045245 May 07 21:55:33.657878 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1372/2802] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:33.665767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-fc1dd620-bbf7-497b-a8cd-605b94344075 req-5c51f93c-65e7-44b8-a900-ad647ae613eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a390d88e-4ae4-4700-a85a-6bc97fd8bd29", "tag": "e8fb4c79-a7ca-4fee-9d39-932cf793d33f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:33.675024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fc1dd620-bbf7-497b-a8cd-605b94344075 req-5c51f93c-65e7-44b8-a900-ad647ae613eb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.675675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fc1dd620-bbf7-497b-a8cd-605b94344075 req-5c51f93c-65e7-44b8-a900-ad647ae613eb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.690440 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-fc1dd620-bbf7-497b-a8cd-605b94344075 req-5c51f93c-65e7-44b8-a900-ad647ae613eb service nova] Creating event network-changed:e8fb4c79-a7ca-4fee-9d39-932cf793d33f for instance a390d88e-4ae4-4700-a85a-6bc97fd8bd29 on nch2-master-1 May 07 21:55:33.697969 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-fc1dd620-bbf7-497b-a8cd-605b94344075 req-5c51f93c-65e7-44b8-a900-ad647ae613eb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038215 May 07 21:55:33.698592 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1373/2803] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:33.705281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.22"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:33.835548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.846925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.848629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:33.850124 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85c9dc3b-dee5-4594-8536-0e2fe32fac0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1726 microversion: 2.20 time: 0.232141 May 07 21:55:33.851078 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1431/2804] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:33 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1726 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:33.856311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-69174a11-5a2a-46a5-83dc-0f8991dea7e8 req-73d61dd8-d3a6-4f54-b069-3b5092f44b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "name": "network-vif-unplugged", "status": "completed", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:33.866162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-69174a11-5a2a-46a5-83dc-0f8991dea7e8 req-73d61dd8-d3a6-4f54-b069-3b5092f44b62 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.866621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-69174a11-5a2a-46a5-83dc-0f8991dea7e8 req-73d61dd8-d3a6-4f54-b069-3b5092f44b62 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.876769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:33.881516 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-69174a11-5a2a-46a5-83dc-0f8991dea7e8 req-73d61dd8-d3a6-4f54-b069-3b5092f44b62 service nova] Creating event network-vif-unplugged:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch1-master-1 May 07 21:55:33.885547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.886247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.887178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.887911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.888127 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-69174a11-5a2a-46a5-83dc-0f8991dea7e8 req-73d61dd8-d3a6-4f54-b069-3b5092f44b62 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035309 May 07 21:55:33.888879 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1432/2805] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:33.898298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:33.899706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:33.910446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.911439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.912916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:33.913832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:33.966285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:55:34.055060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d651d75-7b83-437e-b2ce-86062e43fe12 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 204 len: 0 microversion: 2.1 time: 0.164884 May 07 21:55:34.055915 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1433/2806] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:55:33 2022] DELETE /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:55:34.060909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5ecb6736-d84b-4ab9-91b1-5310ba1b6de5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '.version_select at 0x7fc41ce01c10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:34.167566 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] HTTP exception thrown: Floating IP 172.35.4.22 is not associated with instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d. May 07 21:55:34.169612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Returning 409 to user: Floating IP 172.35.4.22 is not associated with instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:55:34.171304 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9baf12ba-d323-4001-b745-f71e4ad931d1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action" status: 409 len: 145 microversion: 2.1 time: 0.470116 May 07 21:55:34.172286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1374/2807] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:33 2022] POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action => generated 145 bytes in 473 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 21:55:34.180786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2b2b75a-84be-4091-8142-19c9f3a7774b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8544d5aa-b3ac-47bc-9200-f41820a8209c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:34.182145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e2b2b75a-84be-4091-8142-19c9f3a7774b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:34.189567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b2b75a-84be-4091-8142-19c9f3a7774b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:34.190382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b2b75a-84be-4091-8142-19c9f3a7774b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:34.191739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b2b75a-84be-4091-8142-19c9f3a7774b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:34.192498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b2b75a-84be-4091-8142-19c9f3a7774b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:34.606064 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e2b2b75a-84be-4091-8142-19c9f3a7774b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.432591 May 07 21:55:34.607009 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1375/2808] 10.222.0.32 () {62 vars in 1363 bytes} [Sat May 7 21:55:34 2022] POST /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:55:34.612357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:34.613284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:34.624097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:34.626128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:34.627135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:34.627696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.035296 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5ecb6736-d84b-4ab9-91b1-5310ba1b6de5 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/af9563f8-dceb-4fb6-8671-b1ac91f7e502" status: 202 len: 0 microversion: 2.1 time: 0.977914 May 07 21:55:35.039321 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1434/2809] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:55:34 2022] DELETE /compute/v2.1/os-floating-ips/af9563f8-dceb-4fb6-8671-b1ac91f7e502 => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:55:35.043937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2024844855", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "7bc61814-8ef0-4365-b3ea-2c20100be453"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:35.046713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:35.057735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:35.059290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:35.060465 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac0c5496-0ec3-4970-8804-e886c13dc745 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.452589 May 07 21:55:35.061040 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1376/2810] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:34 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:35.066089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.22"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:35.108059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] validate_networks() for [('7bc61814-8ef0-4365-b3ea-2c20100be453', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:55:35.371733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:35.380526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.381214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.382256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.382698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.513604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:55:35.514179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:55:35.514802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:55:35.515689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:55:35.516214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:55:35.528249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.528813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.529709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.530270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.551137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Getting quotas for project 4f4c556805a24040a7131d879ee91498. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:35.557085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Getting quotas for user 3e390d65f16c47ec89f5f834bccfdd8c and project 4f4c556805a24040a7131d879ee91498. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:35.572277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:55:35.574669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:55:35.627011 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d8346462-1fe9-40d1-8ce8-fa880ebde4eb tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588572 May 07 21:55:35.627881 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1435/2811] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:55:35.634949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:35.635845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:35.645976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.647600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.648750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.649882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.835038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:35.843919 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8027588d-e8f6-4d9e-ae7a-dfb671e07244 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1318 microversion: 2.1 time: 0.215019 May 07 21:55:35.846021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1436/2812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:35 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:35.851871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:35.852658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:35.859145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.859958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.860889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:35.861602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:35.887764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Acquired lock "refresh_cache-653f2d36-3e13-4a84-93ea-5545b4e9fd2f" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:55:36.027736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:36.037474 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5aabab3-709f-48ac-914b-798f3f32e3e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1314 microversion: 2.1 time: 0.190018 May 07 21:55:36.039128 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1437/2813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:35 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:36.046102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3d94404-7540-43b9-b01a-37a5920d486e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:36.047711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e3d94404-7540-43b9-b01a-37a5920d486e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:36.055238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3d94404-7540-43b9-b01a-37a5920d486e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.055762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3d94404-7540-43b9-b01a-37a5920d486e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.056972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3d94404-7540-43b9-b01a-37a5920d486e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.057576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3d94404-7540-43b9-b01a-37a5920d486e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.170885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3d94404-7540-43b9-b01a-37a5920d486e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/action" status: 202 len: 0 microversion: 2.20 time: 0.130377 May 07 21:55:36.175534 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1438/2814] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:55:36 2022] POST /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:55:36.180768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4034543d-414b-4147-b986-11425ef5b3c0 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '.version_select at 0x7fc41cd2b670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:36.466519 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4034543d-414b-4147-b986-11425ef5b3c0 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/6b92e61f-c0aa-4cb9-a633-31aa24ceb414" status: 202 len: 0 microversion: 2.1 time: 0.288362 May 07 21:55:36.467751 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1439/2815] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 21:55:36 2022] DELETE /compute/v2.1/os-security-groups/6b92e61f-c0aa-4cb9-a633-31aa24ceb414 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:55:36.473950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:36.475284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:36.499585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.500129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.504449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.505000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.627008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:36.635793 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-049b2ff4-51b2-41f7-97be-f14253362c0e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1270 microversion: 2.1 time: 0.166631 May 07 21:55:36.636390 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1440/2816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:36 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:36.642121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-59f5b5b3-aa55-4803-b399-c79ea7579c52 req-ea9cedad-05a7-4946-848f-515ecbff9a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6f28fb-7fb0-4dbe-b780-f14e94c9846d", "tag": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6"}, {"name": "network-changed", "server_uuid": "653f2d36-3e13-4a84-93ea-5545b4e9fd2f", "tag": "9c05653c-13d6-4294-9e31-a8863d1d2783"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:36.653360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-59f5b5b3-aa55-4803-b399-c79ea7579c52 req-ea9cedad-05a7-4946-848f-515ecbff9a65 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.654018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-59f5b5b3-aa55-4803-b399-c79ea7579c52 req-ea9cedad-05a7-4946-848f-515ecbff9a65 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.673174 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-59f5b5b3-aa55-4803-b399-c79ea7579c52 req-ea9cedad-05a7-4946-848f-515ecbff9a65 service nova] Creating event network-changed:251b3c4a-3d68-4a9c-8850-df61aa0e1dc6 for instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d on nch1-master-1 May 07 21:55:36.673537 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-59f5b5b3-aa55-4803-b399-c79ea7579c52 req-ea9cedad-05a7-4946-848f-515ecbff9a65 service nova] Creating event network-changed:9c05653c-13d6-4294-9e31-a8863d1d2783 for instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f on nch1-master-1 May 07 21:55:36.682315 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-59f5b5b3-aa55-4803-b399-c79ea7579c52 req-ea9cedad-05a7-4946-848f-515ecbff9a65 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044738 May 07 21:55:36.683495 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1441/2817] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:36.693196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-20d3732d-357e-4c40-9ca6-9f530a9ac4b3 req-4f9d2a40-870f-451e-865b-1ca1c31090bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34e6889-832e-45d3-8a1a-8c59d4ec697e", "tag": "5265c093-001b-4f7a-9877-fb1ce61028fc"}, {"name": "network-changed", "server_uuid": "1328c136-9d82-4506-81cd-534b3799a51d", "tag": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e"}, {"name": "network-changed", "server_uuid": "18b8a031-b3cd-4d2f-b349-9b08eb3a6720", "tag": "c714b978-d69a-480e-821e-03cc5b682a61"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:36.704451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-20d3732d-357e-4c40-9ca6-9f530a9ac4b3 req-4f9d2a40-870f-451e-865b-1ca1c31090bd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.705009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-20d3732d-357e-4c40-9ca6-9f530a9ac4b3 req-4f9d2a40-870f-451e-865b-1ca1c31090bd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.737870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-20d3732d-357e-4c40-9ca6-9f530a9ac4b3 req-4f9d2a40-870f-451e-865b-1ca1c31090bd service nova] Creating event network-changed:5265c093-001b-4f7a-9877-fb1ce61028fc for instance d34e6889-832e-45d3-8a1a-8c59d4ec697e on nch1-master-1 May 07 21:55:36.738751 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-20d3732d-357e-4c40-9ca6-9f530a9ac4b3 req-4f9d2a40-870f-451e-865b-1ca1c31090bd service nova] Creating event network-changed:26b45fcb-fb85-4cfb-9dc0-1b5852bae60e for instance 1328c136-9d82-4506-81cd-534b3799a51d on nch1-master-1 May 07 21:55:36.750824 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-20d3732d-357e-4c40-9ca6-9f530a9ac4b3 req-4f9d2a40-870f-451e-865b-1ca1c31090bd service nova] Creating event network-changed:c714b978-d69a-480e-821e-03cc5b682a61 for instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 on nch2-master-1 May 07 21:55:36.772745 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-20d3732d-357e-4c40-9ca6-9f530a9ac4b3 req-4f9d2a40-870f-451e-865b-1ca1c31090bd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.086320 May 07 21:55:36.773589 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1442/2818] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:36.781518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f0610ad2-6824-4dc6-a762-50cbadd393a1 req-3376bcf8-892a-47b7-b775-04d21856c147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a390d88e-4ae4-4700-a85a-6bc97fd8bd29", "name": "network-vif-plugged", "status": "completed", "tag": "e8fb4c79-a7ca-4fee-9d39-932cf793d33f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:36.794745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f0610ad2-6824-4dc6-a762-50cbadd393a1 req-3376bcf8-892a-47b7-b775-04d21856c147 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.795718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f0610ad2-6824-4dc6-a762-50cbadd393a1 req-3376bcf8-892a-47b7-b775-04d21856c147 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.826638 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f0610ad2-6824-4dc6-a762-50cbadd393a1 req-3376bcf8-892a-47b7-b775-04d21856c147 service nova] Creating event network-vif-plugged:e8fb4c79-a7ca-4fee-9d39-932cf793d33f for instance a390d88e-4ae4-4700-a85a-6bc97fd8bd29 on nch2-master-1 May 07 21:55:36.852771 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f0610ad2-6824-4dc6-a762-50cbadd393a1 req-3376bcf8-892a-47b7-b775-04d21856c147 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076388 May 07 21:55:36.854659 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1443/2819] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:36.866478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:36.871660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:36.879386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.879386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:36.880194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:36.880646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:37.851551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:37.866196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:37.868635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:37.870216 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76e408e0-4276-4400-912b-490f65b770f3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 1.015157 May 07 21:55:37.872054 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1444/2820] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:36 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:37.879359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:37.880135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:37.889487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:37.890079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:37.891598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:37.892062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:38.466262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:38.475908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:38.477418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:38.478596 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-62bb1d14-953b-4aef-b8a8-80c1066ebc31 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1754 microversion: 2.20 time: 0.604824 May 07 21:55:38.491408 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1445/2821] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:37 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1754 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:38.497562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:38.498078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:38.506809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:38.507357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:38.508205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:38.508748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:38.535598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:55:38.683954 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-189cbd20-ce12-470c-ba71-ad4c6084c291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 204 len: 0 microversion: 2.1 time: 0.191107 May 07 21:55:38.689712 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1446/2822] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:55:38 2022] DELETE /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:55:38.699401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:38.700512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:38.709119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:38.709658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:38.710616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:38.711022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:39.102662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:39.109251 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d455bb55-5f89-46dc-a69d-fb6d09c7e72f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1318 microversion: 2.1 time: 0.418314 May 07 21:55:39.118559 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1447/2823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:38 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:39.123416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:39.124055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:39.130459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:39.131026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:39.131823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:39.132273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:39.313517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Building network info cache for instance {{(pid=136681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:39.383730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:39.404269 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4dcae47b-edd4-46ad-b62f-7e52dac89a72 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1314 microversion: 2.1 time: 0.280126 May 07 21:55:39.416560 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1448/2824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:39 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:39.430531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:39.433833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:39.449793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:39.450270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:39.451221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:39.451582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:39.693787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:39.703694 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3c9d64fa-8ab5-49f4-ad7b-ce37fe36776b tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1318 microversion: 2.1 time: 0.284469 May 07 21:55:39.704639 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1449/2825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:39 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:39.718348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:39.722443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:39.729587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:39.730298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:39.731887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:39.732543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:39.939798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:39.951350 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c23abc96-6556-48d4-963e-0d6be655fb1f tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1509 microversion: 2.1 time: 0.245215 May 07 21:55:39.961083 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1450/2826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:39 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:39.961083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d94654c2-f4e9-43fb-a101-d748e7f5249d req-2c85fd88-7732-4de1-91f0-3224b6b80c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34e6889-832e-45d3-8a1a-8c59d4ec697e", "name": "network-vif-plugged", "status": "completed", "tag": "5265c093-001b-4f7a-9877-fb1ce61028fc"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:39.974817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d94654c2-f4e9-43fb-a101-d748e7f5249d req-2c85fd88-7732-4de1-91f0-3224b6b80c6e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:39.990817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d94654c2-f4e9-43fb-a101-d748e7f5249d req-2c85fd88-7732-4de1-91f0-3224b6b80c6e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.034171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d94654c2-f4e9-43fb-a101-d748e7f5249d req-2c85fd88-7732-4de1-91f0-3224b6b80c6e service nova] Creating event network-vif-plugged:5265c093-001b-4f7a-9877-fb1ce61028fc for instance d34e6889-832e-45d3-8a1a-8c59d4ec697e on nch1-master-1 May 07 21:55:40.045020 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d94654c2-f4e9-43fb-a101-d748e7f5249d req-2c85fd88-7732-4de1-91f0-3224b6b80c6e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091385 May 07 21:55:40.046862 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1451/2827] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:40.053262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:40.054079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:40.063220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.063696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.064605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.065062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.184394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Updating instance_info_cache with network_info: [{"id": "9c05653c-13d6-4294-9e31-a8863d1d2783", "address": "fa:16:3e:16:f7:35", "network": {"id": "704f8450-d63f-47c9-8f27-0e9fc81678e7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2146525056-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c2ee723c6a04843b302e255a401b1e7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9c05653c-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:40.201576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Releasing lock "refresh_cache-653f2d36-3e13-4a84-93ea-5545b4e9fd2f" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:55:40.203544 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9920c1f-235e-429c-8444-4d18583108c7 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f/action" status: 202 len: 0 microversion: 2.1 time: 5.141538 May 07 21:55:40.204347 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1377/2828] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:35 2022] POST /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f/action => generated 0 bytes in 5143 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:55:40.218747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f21b911e-8d8b-440a-a4d7-e8d688ddee76 req-cbb6a690-bb5a-4422-9b90-d4a7dccaa7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb", "name": "network-vif-deleted", "tag": "861cefe1-1ec7-45b2-a2a0-851f6f48c014"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:40.227188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f21b911e-8d8b-440a-a4d7-e8d688ddee76 req-cbb6a690-bb5a-4422-9b90-d4a7dccaa7fb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.227644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f21b911e-8d8b-440a-a4d7-e8d688ddee76 req-cbb6a690-bb5a-4422-9b90-d4a7dccaa7fb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.238800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f21b911e-8d8b-440a-a4d7-e8d688ddee76 req-cbb6a690-bb5a-4422-9b90-d4a7dccaa7fb service nova] Creating event network-vif-deleted:861cefe1-1ec7-45b2-a2a0-851f6f48c014 for instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb on nch2-master-1 May 07 21:55:40.243742 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f21b911e-8d8b-440a-a4d7-e8d688ddee76 req-cbb6a690-bb5a-4422-9b90-d4a7dccaa7fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038006 May 07 21:55:40.244352 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1378/2829] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:40.250430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:40.251358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:40.258175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.258863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.259824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.260263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.285373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:40.298744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:40.301529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:40.302730 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-762101e3-6d55-4810-a0da-a3d069fba134 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.254614 May 07 21:55:40.307049 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1452/2830] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:40 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:40.312350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:40.313133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:40.321013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.321584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.322436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.322980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.464773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:40.474614 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-146b9245-2a17-4687-9a30-2b1eb0d98de3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1467 microversion: 2.1 time: 0.165608 May 07 21:55:40.485071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1453/2831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:40 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1467 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:40.485071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:40.485071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:40.490671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.490671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.491868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.492461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.521924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:55:40.617545 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f227ba4f-78ec-4576-8436-1c02843acf35 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "DELETE /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 204 len: 0 microversion: 2.1 time: 0.140426 May 07 21:55:40.618160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1454/2832] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:55:40 2022] DELETE /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:55:40.628556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:40.630967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:40.639724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.640379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.641824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.642336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.648137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:40.666484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:40.668471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:40.670001 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-668c08b6-2e0b-4f29-afdc-fe1a1cb32fe8 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.424391 May 07 21:55:40.671627 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1379/2833] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:40 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:40.702169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:40.703410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:40.730842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.731646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:40.732456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:40.733191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:41.022679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:41.031891 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea91aabe-486c-4063-907b-c967341a411d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1314 microversion: 2.1 time: 0.411671 May 07 21:55:41.032937 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1455/2834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:40 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:41.038481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.22"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:41.039933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:41.049503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:41.049503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:41.050478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:41.050862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:41.082638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Acquired lock "refresh_cache-0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:55:41.473872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:41.481473 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f597910e-44fd-48d4-8258-03cd554e613b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 200 len: 1318 microversion: 2.1 time: 0.799345 May 07 21:55:41.482087 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1380/2835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:40 2022] GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 1318 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:41.495008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:41.495578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:41.501952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:41.502618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:41.504076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:41.504515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:41.802387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:41.811240 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ffc56182-3d61-45d2-bfab-14e611e36857 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1318 microversion: 2.1 time: 0.327722 May 07 21:55:41.812149 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1381/2836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:41 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:41.817799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:41.818500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:41.825203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:41.825769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:41.827070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:41.827680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:42.540192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83a248d0471340df8fa0f09b0547574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'addf83b9a69e4628b1b962b7fceeb9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:42.551770 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-458c2711-86b6-4cf2-a422-0592a4b6639c tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 200 len: 1509 microversion: 2.1 time: 0.738656 May 07 21:55:42.552681 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1382/2837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:41 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 1509 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:42.563546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:42.564577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:42.572212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:42.572811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:42.573688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:42.574461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:43.684494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:43.697439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:43.699243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:43.700612 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-26ca65dc-8e49-4a1f-b3fe-1bf7423150b9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 1.146800 May 07 21:55:43.711445 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1383/2838] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:42 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:43.718291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:43.719150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:43.725319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:43.725953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:43.726806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:43.727248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:44.000445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Building network info cache for instance {{(pid=136682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:44.206450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:44.225179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:44.227698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:44.229219 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-93130a6a-8861-408e-a891-4f73e423d817 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.516518 May 07 21:55:44.230364 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1384/2839] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:43 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:44.235229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:44.236125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:44.243334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:44.243934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:44.244934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:44.245402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.151773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:45.163041 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e53ee2d-d549-4528-9b24-ce5bfd7f5771 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1314 microversion: 2.1 time: 0.931247 May 07 21:55:45.167810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1385/2840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:44 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1314 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:45.175327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7e9be92e-2367-4a3b-8c70-0a5423b88bd7 req-287c7f79-8769-4103-8f84-f5e4ce3e7c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b8a031-b3cd-4d2f-b349-9b08eb3a6720", "name": "network-vif-plugged", "status": "completed", "tag": "c714b978-d69a-480e-821e-03cc5b682a61"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:45.195785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7e9be92e-2367-4a3b-8c70-0a5423b88bd7 req-287c7f79-8769-4103-8f84-f5e4ce3e7c2c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.196787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7e9be92e-2367-4a3b-8c70-0a5423b88bd7 req-287c7f79-8769-4103-8f84-f5e4ce3e7c2c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.213900 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7e9be92e-2367-4a3b-8c70-0a5423b88bd7 req-287c7f79-8769-4103-8f84-f5e4ce3e7c2c service nova] Creating event network-vif-plugged:c714b978-d69a-480e-821e-03cc5b682a61 for instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 on nch2-master-1 May 07 21:55:45.222896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7e9be92e-2367-4a3b-8c70-0a5423b88bd7 req-287c7f79-8769-4103-8f84-f5e4ce3e7c2c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052962 May 07 21:55:45.224204 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1386/2841] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:45.233894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6cf6455d-6903-4d2d-a558-72d4c4a97822 req-48f5d89f-4d02-436b-93ff-ba1f88730e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653f2d36-3e13-4a84-93ea-5545b4e9fd2f", "tag": "9c05653c-13d6-4294-9e31-a8863d1d2783"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:45.252071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6cf6455d-6903-4d2d-a558-72d4c4a97822 req-48f5d89f-4d02-436b-93ff-ba1f88730e9f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.253355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6cf6455d-6903-4d2d-a558-72d4c4a97822 req-48f5d89f-4d02-436b-93ff-ba1f88730e9f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.272290 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6cf6455d-6903-4d2d-a558-72d4c4a97822 req-48f5d89f-4d02-436b-93ff-ba1f88730e9f service nova] Creating event network-changed:9c05653c-13d6-4294-9e31-a8863d1d2783 for instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f on nch1-master-1 May 07 21:55:45.277948 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6cf6455d-6903-4d2d-a558-72d4c4a97822 req-48f5d89f-4d02-436b-93ff-ba1f88730e9f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052233 May 07 21:55:45.279009 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1387/2842] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:45.284742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:45.286800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:45.294871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.295399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.296206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.296661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.507569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Updating instance_info_cache with network_info: [{"id": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6", "address": "fa:16:3e:f0:96:18", "network": {"id": "704f8450-d63f-47c9-8f27-0e9fc81678e7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2146525056-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c2ee723c6a04843b302e255a401b1e7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap251b3c4a-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:45.529974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Releasing lock "refresh_cache-0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:55:45.532217 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6c4933fc-eca4-4fd5-9bf3-ac9315e6f96e tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action" status: 202 len: 0 microversion: 2.1 time: 4.497078 May 07 21:55:45.534162 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1456/2843] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:41 2022] POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action => generated 0 bytes in 4500 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:55:45.547567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c32cad09-0433-487e-9a20-b548e84ce2a3 req-5563530e-193a-467f-a1ab-036490f36952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e24f97-8526-41f8-906e-c99d18f445ba", "tag": "70309868-18a6-4a82-b4fb-e8df121c6f4c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:45.561904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c32cad09-0433-487e-9a20-b548e84ce2a3 req-5563530e-193a-467f-a1ab-036490f36952 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.562572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c32cad09-0433-487e-9a20-b548e84ce2a3 req-5563530e-193a-467f-a1ab-036490f36952 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.577497 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c32cad09-0433-487e-9a20-b548e84ce2a3 req-5563530e-193a-467f-a1ab-036490f36952 service nova] Creating event network-changed:70309868-18a6-4a82-b4fb-e8df121c6f4c for instance 75e24f97-8526-41f8-906e-c99d18f445ba on nch1-master-1 May 07 21:55:45.584394 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c32cad09-0433-487e-9a20-b548e84ce2a3 req-5563530e-193a-467f-a1ab-036490f36952 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047460 May 07 21:55:45.585629 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1457/2844] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:45.594328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:45.595590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:45.603318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.604011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.605160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.605788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.634050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:45.645181 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-49953d14-c071-4bb1-808a-da3f83eabb4a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 200 len: 1467 microversion: 2.1 time: 0.364581 May 07 21:55:45.648068 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1388/2845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:45 2022] GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 1467 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:45.659954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:45.660657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] [instance: 1328c136-9d82-4506-81cd-534b3799a51d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:45.667634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.668356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.669313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.669878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.695686 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] HTTP exception thrown: Instance 1328c136-9d82-4506-81cd-534b3799a51d could not be found. May 07 21:55:45.696308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] Returning 404 to user: Instance 1328c136-9d82-4506-81cd-534b3799a51d could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:55:45.697192 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ad5b794d-1fdd-46a5-8519-b943d44e9291 tempest-ServerRescueTestJSONUnderV235-1928512785 tempest-ServerRescueTestJSONUnderV235-1928512785-project] 10.222.0.32 "GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d" status: 404 len: 111 microversion: 2.1 time: 0.048050 May 07 21:55:45.701997 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1389/2846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:45 2022] GET /compute/v2.1/servers/1328c136-9d82-4506-81cd-534b3799a51d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:55:45.707968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:45.708833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:45.716417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.717109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.721947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.732271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.871476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:45.881247 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d7980c7-29c1-4022-8518-3f33a3c99d4e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1318 microversion: 2.1 time: 0.294001 May 07 21:55:45.882487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1458/2847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:45 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:45.888958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:45.889861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:45.896873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.897659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:45.898674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:45.899364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:46.064649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.077396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.079050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.080446 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-131ee483-fbcf-42e0-bda9-9ce27bfdb57b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.195230 May 07 21:55:46.081244 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1459/2848] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:45 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:46.091903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9bd0ec8-576b-462e-9245-1347480c185c tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '.version_select at 0x7fc41cb7fca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:46.142416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.154084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.155635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.157316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ea8c205-a132-4a0d-931a-b73f174f368e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.454293 May 07 21:55:46.157934 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1390/2849] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:45 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:46.163758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:46.168064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.169204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Searching by: {'reservation_id': 'r-njfvzh8q', 'deleted': False, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:55:46.177372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:46.177979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:46.178946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:46.179635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:46.281907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:55:46.330485 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9bd0ec8-576b-462e-9245-1347480c185c tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/bc6ddc69-3ad1-4ec6-ad2e-4053ffde1378" status: 200 len: 184 microversion: 2.1 time: 0.247572 May 07 21:55:46.332102 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1460/2850] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:55:46 2022] GET /compute/v2.1/os-floating-ips/bc6ddc69-3ad1-4ec6-ad2e-4053ffde1378 => generated 184 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:46.337199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:46.338261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:46.346256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:46.347615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:46.348778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:46.349764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:46.363296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.371426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:46.371891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:46.596498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:46.605329 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7709d60-fd8d-46e8-a9b8-dce91c4ece28 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1314 microversion: 2.1 time: 0.271805 May 07 21:55:46.616813 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1461/2851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:46 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:46.616813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Action: 'action', calling method: .version_select at 0x7fc41f63ad30>, body: {"removeFloatingIp": {"address": "172.35.4.22"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:46.760367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:46.776059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:46.776616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:46.777969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:46.778748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:47.106327 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ae7fb435-e90c-4593-a76c-e37d7b4ce347 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?reservation_id=r-njfvzh8q" status: 200 len: 2927 microversion: 2.1 time: 0.946779 May 07 21:55:47.119534 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1391/2852] 10.222.0.32 () {58 vars in 1196 bytes} [Sat May 7 21:55:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-njfvzh8q => generated 2927 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:47.125605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:47.126620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:47.136219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:47.137161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:47.138327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:47.138996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:47.273056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Acquired lock "refresh_cache-0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:55:47.622634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:47.639729 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3bc41af-09b0-4770-8856-2bf86b05da21 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1318 microversion: 2.1 time: 0.518887 May 07 21:55:47.642255 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1392/2853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:47 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:47.649634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:47.652060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:47.672125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:47.672812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:47.673797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:47.674344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:47.991771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:48.007059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:48.009253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:48.013949 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f770f30d-76ce-480d-b992-4c91201dcdef tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.369345 May 07 21:55:48.019251 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1393/2854] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:47 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:48.028547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc7efebc-a333-45f2-b222-617e41d00d88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:48.070434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.server_groups [None req-bc7efebc-a333-45f2-b222-617e41d00d88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Querying cell 6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) for 2 instances {{(pid=136681) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 07 21:55:48.073357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc7efebc-a333-45f2-b222-617e41d00d88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:48.076165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc7efebc-a333-45f2-b222-617e41d00d88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:48.137412 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc7efebc-a333-45f2-b222-617e41d00d88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/85c8d49e-6cb2-47b8-b704-f68fa4405bb3" status: 200 len: 271 microversion: 2.1 time: 0.112503 May 07 21:55:48.146564 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1394/2855] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:55:48 2022] GET /compute/v2.1/os-server-groups/85c8d49e-6cb2-47b8-b704-f68fa4405bb3 => generated 271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:48.153702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:48.155867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:48.174209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:48.176879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:48.178100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:48.183289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:48.744411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:48.756098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:48.768907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:48.770330 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-34afda36-ab7d-468b-992f-31874f3fb588 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.622265 May 07 21:55:48.771349 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1395/2856] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:48 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:48.778296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9becbdd0-a62d-42dc-a386-f2e2b6d2176d req-315de79b-1542-478f-b416-def7d6f2a4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}, {"server_uuid": "653f2d36-3e13-4a84-93ea-5545b4e9fd2f", "name": "network-vif-deleted", "tag": "9c05653c-13d6-4294-9e31-a8863d1d2783"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:48.812992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9becbdd0-a62d-42dc-a386-f2e2b6d2176d req-315de79b-1542-478f-b416-def7d6f2a4ed service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:48.813838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9becbdd0-a62d-42dc-a386-f2e2b6d2176d req-315de79b-1542-478f-b416-def7d6f2a4ed service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:48.835516 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9becbdd0-a62d-42dc-a386-f2e2b6d2176d req-315de79b-1542-478f-b416-def7d6f2a4ed service nova] Creating event network-changed:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch2-master-1 May 07 21:55:48.839111 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9becbdd0-a62d-42dc-a386-f2e2b6d2176d req-315de79b-1542-478f-b416-def7d6f2a4ed service nova] Creating event network-vif-deleted:9c05653c-13d6-4294-9e31-a8863d1d2783 for instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f on nch1-master-1 May 07 21:55:48.854852 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9becbdd0-a62d-42dc-a386-f2e2b6d2176d req-315de79b-1542-478f-b416-def7d6f2a4ed service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081930 May 07 21:55:48.859560 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1396/2857] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:48.866041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:48.871997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:48.891123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:48.891925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:48.892945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:48.893633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:49.166050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Building network info cache for instance {{(pid=136682) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:55:49.630428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:49.639133 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a3369a5-cab7-4342-8b17-e8d0dbfb37a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1500 microversion: 2.1 time: 0.777814 May 07 21:55:49.644003 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1397/2858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:48 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1500 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:49.653502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e2b1bf16-b840-468a-b668-a996c4eaa908 req-f1e91d4f-9874-4c7e-94c5-40a7f9912d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1328c136-9d82-4506-81cd-534b3799a51d", "name": "network-vif-deleted", "tag": "26b45fcb-fb85-4cfb-9dc0-1b5852bae60e"}, {"name": "network-changed", "server_uuid": "0d6f28fb-7fb0-4dbe-b780-f14e94c9846d", "tag": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:49.679015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e2b1bf16-b840-468a-b668-a996c4eaa908 req-f1e91d4f-9874-4c7e-94c5-40a7f9912d11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:49.680730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e2b1bf16-b840-468a-b668-a996c4eaa908 req-f1e91d4f-9874-4c7e-94c5-40a7f9912d11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:49.700998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e2b1bf16-b840-468a-b668-a996c4eaa908 req-f1e91d4f-9874-4c7e-94c5-40a7f9912d11 service nova] Creating event network-vif-deleted:26b45fcb-fb85-4cfb-9dc0-1b5852bae60e for instance 1328c136-9d82-4506-81cd-534b3799a51d on nch1-master-1 May 07 21:55:49.701788 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e2b1bf16-b840-468a-b668-a996c4eaa908 req-f1e91d4f-9874-4c7e-94c5-40a7f9912d11 service nova] Creating event network-changed:251b3c4a-3d68-4a9c-8850-df61aa0e1dc6 for instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d on nch1-master-1 May 07 21:55:49.709623 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e2b1bf16-b840-468a-b668-a996c4eaa908 req-f1e91d4f-9874-4c7e-94c5-40a7f9912d11 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064198 May 07 21:55:49.711873 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1398/2859] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:49.720664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69c1cf5c-422e-4b89-9173-d5b992fb6425 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:49.722267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-69c1cf5c-422e-4b89-9173-d5b992fb6425 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:49.729644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c1cf5c-422e-4b89-9173-d5b992fb6425 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:49.731403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c1cf5c-422e-4b89-9173-d5b992fb6425 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:49.734228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c1cf5c-422e-4b89-9173-d5b992fb6425 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:49.735838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69c1cf5c-422e-4b89-9173-d5b992fb6425 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:50.429802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Updating instance_info_cache with network_info: [{"id": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6", "address": "fa:16:3e:f0:96:18", "network": {"id": "704f8450-d63f-47c9-8f27-0e9fc81678e7", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2146525056-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4c2ee723c6a04843b302e255a401b1e7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap251b3c4a-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:55:50.458230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Releasing lock "refresh_cache-0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" {{(pid=136682) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:55:50.459539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2673385f-24fa-4258-991f-6aec537e80b8 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action" status: 202 len: 0 microversion: 2.1 time: 3.851856 May 07 21:55:50.460786 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1462/2860] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:55:46 2022] POST /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d/action => generated 0 bytes in 3853 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:55:50.470719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:50.471849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:50.484666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:50.487435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:50.508919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:50.511270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:50.962604 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-69c1cf5c-422e-4b89-9173-d5b992fb6425 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 200 len: 1618 microversion: 2.1 time: 1.248877 May 07 21:55:50.963612 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1399/2861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:49 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 1618 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:50.994005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:50.994913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:51.015017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.016861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.017959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.020696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.174911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:51.202619 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dcbeaaa3-c05c-4ce9-8a17-f8e5453d21e9 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1318 microversion: 2.1 time: 0.739952 May 07 21:55:51.203593 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1463/2862] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:50 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:51.216536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:51.218956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:51.234811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.235367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.236288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.236742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.316928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:55:51.512113 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f992f4a4-ff41-4a84-aeea-94e282557971 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 204 len: 0 microversion: 2.1 time: 0.305013 May 07 21:55:51.513931 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1464/2863] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:55:51 2022] DELETE /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:55:51.521568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:51.532373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:51.543139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.543850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.544836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.545663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.773939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:51.795088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:51.797705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:51.823026 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80d4f72a-a05e-48fd-8a86-cd78cde93c09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.857764 May 07 21:55:51.827807 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1400/2864] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:50 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:51.853777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:51.869124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:51.876161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:51.880431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.881125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.881939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.882581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.895452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:51.898144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:51.901718 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] HTTP exception thrown: Instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f could not be found. May 07 21:55:51.902337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Returning 404 to user: Instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:55:51.902876 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab418703-9af4-413e-b136-4a25b0139f5c tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.387451 May 07 21:55:51.903529 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e1c779ed-29e3-427a-8c79-1def25366402 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "DELETE /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 404 len: 111 microversion: 2.1 time: 0.073355 May 07 21:55:51.904125 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1465/2865] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:51 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:51.908690 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1401/2866] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:55:51 2022] DELETE /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:55:51.915536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c37b6ad-83db-4fe0-ab22-20b19d3a379b tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:51.916180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c37b6ad-83db-4fe0-ab22-20b19d3a379b tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:51.921266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9ec673aa-7df3-4e41-bc20-ddbb9e1f1810 req-e1b46688-8a17-499f-8317-b2470e53404c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e24f97-8526-41f8-906e-c99d18f445ba", "name": "network-vif-plugged", "status": "completed", "tag": "70309868-18a6-4a82-b4fb-e8df121c6f4c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:51.932103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c37b6ad-83db-4fe0-ab22-20b19d3a379b tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.934140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c37b6ad-83db-4fe0-ab22-20b19d3a379b tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.935164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c37b6ad-83db-4fe0-ab22-20b19d3a379b tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.937557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c37b6ad-83db-4fe0-ab22-20b19d3a379b tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.939870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9ec673aa-7df3-4e41-bc20-ddbb9e1f1810 req-e1b46688-8a17-499f-8317-b2470e53404c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:51.941899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9ec673aa-7df3-4e41-bc20-ddbb9e1f1810 req-e1b46688-8a17-499f-8317-b2470e53404c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:51.968169 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9ec673aa-7df3-4e41-bc20-ddbb9e1f1810 req-e1b46688-8a17-499f-8317-b2470e53404c service nova] Creating event network-vif-plugged:70309868-18a6-4a82-b4fb-e8df121c6f4c for instance 75e24f97-8526-41f8-906e-c99d18f445ba on nch1-master-1 May 07 21:55:51.979494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9ec673aa-7df3-4e41-bc20-ddbb9e1f1810 req-e1b46688-8a17-499f-8317-b2470e53404c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068963 May 07 21:55:51.984726 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1402/2867] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:51.996543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:51.999486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:52.020429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:52.037398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:52.038601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:52.041632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:52.242189 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c37b6ad-83db-4fe0-ab22-20b19d3a379b tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 200 len: 1618 microversion: 2.1 time: 0.336789 May 07 21:55:52.245230 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1466/2868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:51 2022] GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 1618 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:52.250886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c53378de-401e-4ed1-b7c7-7822d1daa670 req-d619d3c2-b253-41c4-9f5d-6ea86e0dffac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d6f28fb-7fb0-4dbe-b780-f14e94c9846d", "tag": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:52.273834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c53378de-401e-4ed1-b7c7-7822d1daa670 req-d619d3c2-b253-41c4-9f5d-6ea86e0dffac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:52.274303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c53378de-401e-4ed1-b7c7-7822d1daa670 req-d619d3c2-b253-41c4-9f5d-6ea86e0dffac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:52.288875 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c53378de-401e-4ed1-b7c7-7822d1daa670 req-d619d3c2-b253-41c4-9f5d-6ea86e0dffac service nova] Creating event network-changed:251b3c4a-3d68-4a9c-8850-df61aa0e1dc6 for instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d on nch1-master-1 May 07 21:55:52.296118 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c53378de-401e-4ed1-b7c7-7822d1daa670 req-d619d3c2-b253-41c4-9f5d-6ea86e0dffac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049532 May 07 21:55:52.301424 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1467/2869] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:52.307125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:52.308157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 653f2d36-3e13-4a84-93ea-5545b4e9fd2f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:52.315824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:52.317127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:52.318201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:52.318821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:52.339606 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] HTTP exception thrown: Instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f could not be found. May 07 21:55:52.340506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Returning 404 to user: Instance 653f2d36-3e13-4a84-93ea-5545b4e9fd2f could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:55:52.341522 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be9cbd5d-241d-4651-b1c2-71c290076991 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f" status: 404 len: 111 microversion: 2.1 time: 0.038769 May 07 21:55:52.342922 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1468/2870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:52 2022] GET /compute/v2.1/servers/653f2d36-3e13-4a84-93ea-5545b4e9fd2f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:55:52.348210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:52.349192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:52.356875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:52.357576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:52.358548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:52.359326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:52.361332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:52.372605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-69be8e4c-716f-4109-88f1-a0c3001399da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1506 microversion: 2.1 time: 0.385678 May 07 21:55:52.377201 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1403/2871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:51 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:52.389126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-071fd7ce-5b37-4a4a-8871-56c406050310 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '.version_select at 0x7fc41ce9b1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:52.652219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:52.665561 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa2f5c2b-fcbc-4941-ac21-847501684648 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1318 microversion: 2.1 time: 0.321343 May 07 21:55:52.666651 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1469/2872] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:52 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:52.678460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1335775562", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:52.781648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:55:53.560662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:55:53.561396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:55:53.562793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:55:53.564670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:55:53.568462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:55:53.598370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:53.599989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:53.602739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:53.603854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:53.660981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:55:53.681255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:55:53.713979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:55:53.720675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:55:53.856191 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-725a5dfc-c5d4-4e8d-9dc9-80036716190f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187385 May 07 21:55:53.858161 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1470/2873] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:55:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:55:53.866945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:53.867407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:53.877313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:53.878378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:53.880212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:53.880935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:54.331974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:54.340954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:54.350900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:54.352261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-482668af-e03e-439e-8a30-1128fef3a572 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.492777 May 07 21:55:54.353239 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1471/2874] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:53 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:54.358098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:54.368999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:54.382604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:54.383221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:54.393965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:54.399489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:55.193661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:55.219898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:55.233410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:55.235031 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2955b08c-4ea3-4db4-aee2-f075ba0d5aaf tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.880711 May 07 21:55:55.238314 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1472/2875] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:54 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:55.255727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:55.257996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:55.276801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:55.280433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:55.281767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:55.285385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:55.446199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:55.460060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7a8e6fc-3f82-452e-b253-bfa3863aa11a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1464 microversion: 2.1 time: 0.219005 May 07 21:55:55.462941 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1473/2876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:55 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1464 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:55.492834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:55.493216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:55.523654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:55.524896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:55.527166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:55.531343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.058376 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-071fd7ce-5b37-4a4a-8871-56c406050310 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/bc6ddc69-3ad1-4ec6-ad2e-4053ffde1378" status: 202 len: 0 microversion: 2.1 time: 3.679368 May 07 21:55:56.060428 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1404/2877] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:55:52 2022] DELETE /compute/v2.1/os-floating-ips/bc6ddc69-3ad1-4ec6-ad2e-4053ffde1378 => generated 0 bytes in 3682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:55:56.073638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:56.077713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:56.092605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.095825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.099186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.102205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.341601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:56.356877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59e3aaad-e31b-4588-8996-6adb8a05d715 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1509 microversion: 2.1 time: 0.887982 May 07 21:55:56.358119 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1474/2878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:55 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1509 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:56.362132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:56.365647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:56.367868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:56.373735 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-472b022d-45a8-473b-8e61-72bebc65c39e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1287 microversion: 2.1 time: 0.311178 May 07 21:55:56.378870 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1405/2879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:56 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1287 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:56.383366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.386045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.387059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.387646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.400479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-188fa626-69b3-4e24-9d26-d64dbe6eead7 req-0cf698b8-e03d-4c8a-9e7c-15f7b22b65d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b8a031-b3cd-4d2f-b349-9b08eb3a6720", "name": "network-vif-deleted", "tag": "c714b978-d69a-480e-821e-03cc5b682a61"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:56.436663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-188fa626-69b3-4e24-9d26-d64dbe6eead7 req-0cf698b8-e03d-4c8a-9e7c-15f7b22b65d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.439250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-188fa626-69b3-4e24-9d26-d64dbe6eead7 req-0cf698b8-e03d-4c8a-9e7c-15f7b22b65d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.480728 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-188fa626-69b3-4e24-9d26-d64dbe6eead7 req-0cf698b8-e03d-4c8a-9e7c-15f7b22b65d2 service nova] Creating event network-vif-deleted:c714b978-d69a-480e-821e-03cc5b682a61 for instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 on nch2-master-1 May 07 21:55:56.489675 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-188fa626-69b3-4e24-9d26-d64dbe6eead7 req-0cf698b8-e03d-4c8a-9e7c-15f7b22b65d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108668 May 07 21:55:56.490296 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1406/2880] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:55:56.510860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:56.514079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:56.532353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.533164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.537544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.539452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.602552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:55:56.793901 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb0fa9e8-2d50-4a54-a4bf-bcef86aeaa68 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 204 len: 0 microversion: 2.1 time: 0.298978 May 07 21:55:56.803357 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1407/2881] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:55:56 2022] DELETE /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:55:56.813105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:56.813854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:56.825722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:56.845184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:56.860994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.861518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.862028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:56.863494 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ff00225-d77b-4ed2-a3b6-990ec26cf257 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.504125 May 07 21:55:56.874694 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1475/2882] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:56 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:56.887728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.891462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:56.892368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:56.893756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.919797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.920547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:56.921550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:56.922006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.477383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:57.491975 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-180b5ec6-333d-496c-8664-36de12bf08f5 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1509 microversion: 2.1 time: 0.615973 May 07 21:55:57.492603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1476/2883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:56 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1509 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:57.498591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:57.499467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:57.509878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:57.522703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:57.523761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:57.525463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.525604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:57.528246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:57.532777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.538107 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e95b7c0c-50ea-4cec-85b4-3d583d6512e5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.732158 May 07 21:55:57.550403 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1408/2884] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:56 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:57.550403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:57.551424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:57.588159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:57.590322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.592014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:57.594314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.670530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:57.676792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.678235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lazy-loading 'fault' on Instance uuid 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:55:57.849892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:57.864618 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90dc1982-b9a1-4a5c-aa02-9840039d9415 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 200 len: 1304 microversion: 2.1 time: 0.362766 May 07 21:55:57.865273 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1477/2885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:57 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 1304 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:57.887886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:57.898183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:57.911405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:57.911866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.932793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:57.933181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:57.982029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:57.999149 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e536bd67-a121-48ab-8bb4-641a9a3b4604 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1526 microversion: 2.1 time: 0.458528 May 07 21:55:57.999401 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1409/2886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:57 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1526 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:58.013407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac71e8f5-80de-4eaf-86df-bd8f8121ff17 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:58.028848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac71e8f5-80de-4eaf-86df-bd8f8121ff17 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:58.051739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac71e8f5-80de-4eaf-86df-bd8f8121ff17 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:58.052458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac71e8f5-80de-4eaf-86df-bd8f8121ff17 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:58.053415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac71e8f5-80de-4eaf-86df-bd8f8121ff17 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:58.053999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac71e8f5-80de-4eaf-86df-bd8f8121ff17 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:58.226709 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac71e8f5-80de-4eaf-86df-bd8f8121ff17 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "PUT /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1081 microversion: 2.1 time: 0.225864 May 07 21:55:58.231326 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1410/2887] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 21:55:57 2022] PUT /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1081 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:58.245006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:58.252138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:58.280142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:58.281419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:58.285322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:58.285873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:58.617447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:58.637584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:58.639920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:58.641967 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f2840b73-da76-4a6e-9c58-2fc028671024 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.401009 May 07 21:55:58.643435 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1411/2888] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:58 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:58.648687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:58.649583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:58.656850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:58.658033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:58.659246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:58.659856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.026226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:59.038109 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bbd2f0b3-8ed9-4276-b0f2-f102cba3fde7 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1507 microversion: 2.1 time: 0.393247 May 07 21:55:59.041194 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1412/2889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:58 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:59.063992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:59.065236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:59.082127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.082895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.083965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.084471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.117932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:59.137910 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fd19c0ca-6cd6-4ce9-b8b6-aed01545d9a8 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 1.259274 May 07 21:55:59.140035 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1478/2890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:57 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:59.148222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:59.153311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:59.162880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.163682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.165226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.166066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.186845 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 could not be found. May 07 21:55:59.189696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:55:59.207735 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-baa343e1-4a2a-4325-b45e-4fe161d24d55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 404 len: 111 microversion: 2.1 time: 0.066058 May 07 21:55:59.211583 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1479/2891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:59 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:55:59.252011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:59.252011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:59.266717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.267706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.268647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.269030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.635304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a295663c20584408b634e99490e34883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ee723c6a04843b302e255a401b1e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:59.649931 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c868d44-2c49-4710-815e-3115e028e0c1 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 200 len: 1526 microversion: 2.1 time: 0.437044 May 07 21:55:59.650519 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1480/2892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:59 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 1526 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:55:59.666008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:55:59.670627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:55:59.684600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.685038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.685566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:59.686037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:55:59.686289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:55:59.704282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:59.707811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:55:59.714942 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1658038-8fd0-46e5-b2cb-bb7d81867bf4 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.665213 May 07 21:55:59.715635 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1413/2893] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:55:59 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:55:59.744220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1270127674", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "9b7653d0-c69e-4364-9ed6-1c005b136d81"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:55:59.880012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] validate_networks() for [('9b7653d0-c69e-4364-9ed6-1c005b136d81', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:00.313891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:00.324207 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-98f9fd88-eb5a-464c-b5c8-06257777f537 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1507 microversion: 2.1 time: 0.666877 May 07 21:56:00.328413 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1481/2894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:55:59 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1507 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:00.342656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:00.344957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:00.365312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.368261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:00.370411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.371077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:00.666162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:00.672945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:00.673943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:00.675260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:00.675885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:00.690815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.692355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:00.693691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.694382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:00.733289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:00.749155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for user 228761ebf4c0406ab0977cabe351ac76 and project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:00.767505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:00.772359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:00.833310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:00.850089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:00.851902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:00.853293 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-902d1b6e-b098-4cd1-adc9-3f8d2853f1df tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.523442 May 07 21:56:00.854381 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1482/2895] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:00 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:00.858759 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141873 May 07 21:56:00.859633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:00.860422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:00.861439 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1414/2896] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:56:00.867480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.867912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:00.868385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:00.869351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.869565 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79591f26-1cc1-431d-b81a-86f8230fd41d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002326 May 07 21:56:00.870177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:00.876458 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1415/2897] 10.222.0.32 () {56 vars in 885 bytes} [Sat May 7 21:56:00 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 07 21:56:00.882246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-932c2594-4d4a-42e4-9bbe-c21a3281469e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:00.884318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-932c2594-4d4a-42e4-9bbe-c21a3281469e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:00.894010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-932c2594-4d4a-42e4-9bbe-c21a3281469e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.894727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-932c2594-4d4a-42e4-9bbe-c21a3281469e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:00.897026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-932c2594-4d4a-42e4-9bbe-c21a3281469e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:00.897786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-932c2594-4d4a-42e4-9bbe-c21a3281469e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.027462 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-932c2594-4d4a-42e4-9bbe-c21a3281469e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "PUT /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1083 microversion: 2.1 time: 0.149424 May 07 21:56:01.032222 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1416/2898] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 21:56:00 2022] PUT /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1083 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:01.043971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f0b1c331-ac7e-4638-9527-a0a989dce291 req-776347b6-ae77-473b-9a8b-36bde801ee55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d6f28fb-7fb0-4dbe-b780-f14e94c9846d", "name": "network-vif-deleted", "tag": "251b3c4a-3d68-4a9c-8850-df61aa0e1dc6"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:01.061150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f0b1c331-ac7e-4638-9527-a0a989dce291 req-776347b6-ae77-473b-9a8b-36bde801ee55 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.061944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f0b1c331-ac7e-4638-9527-a0a989dce291 req-776347b6-ae77-473b-9a8b-36bde801ee55 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.084361 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f0b1c331-ac7e-4638-9527-a0a989dce291 req-776347b6-ae77-473b-9a8b-36bde801ee55 service nova] Creating event network-vif-deleted:251b3c4a-3d68-4a9c-8850-df61aa0e1dc6 for instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d on nch1-master-1 May 07 21:56:01.092038 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f0b1c331-ac7e-4638-9527-a0a989dce291 req-776347b6-ae77-473b-9a8b-36bde801ee55 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058356 May 07 21:56:01.093292 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1417/2899] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:01.102828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.103573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] [instance: 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:01.113270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.114085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.115222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.116023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.143962 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] HTTP exception thrown: Instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d could not be found. May 07 21:56:01.144868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] Returning 404 to user: Instance 0d6f28fb-7fb0-4dbe-b780-f14e94c9846d could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:01.147272 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3e91ba53-8750-4bc6-b14e-235d1ab6a725 tempest-FloatingIPsAssociationTestJSON-1580629389 tempest-FloatingIPsAssociationTestJSON-1580629389-project] 10.222.0.32 "GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d" status: 404 len: 111 microversion: 2.1 time: 0.051243 May 07 21:56:01.154878 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1418/2900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2.1/servers/0d6f28fb-7fb0-4dbe-b780-f14e94c9846d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:01.183977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.184953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:01.208531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.209007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.215336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.216358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.293356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:01.302009 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-35097caf-31c8-423f-8781-06c496f857c0 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.446202 May 07 21:56:01.303071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1483/2901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:00 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:01.307945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3ef6040-7c6f-426f-91ce-53513edf0748 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.308811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a3ef6040-7c6f-426f-91ce-53513edf0748 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:01.392213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a3ef6040-7c6f-426f-91ce-53513edf0748 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:01.401787 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a3ef6040-7c6f-426f-91ce-53513edf0748 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1215 microversion: 2.1 time: 0.097400 May 07 21:56:01.403420 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1484/2902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:01.405032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3ef6040-7c6f-426f-91ce-53513edf0748 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.406295 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a3ef6040-7c6f-426f-91ce-53513edf0748 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001875 May 07 21:56:01.407304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1485/2903] 10.222.0.32 () {54 vars in 1034 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) May 07 21:56:01.412791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.414213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:01.421921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.422845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.425260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.425771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.594900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:01.606197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:01.608133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:01.609688 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.453565 May 07 21:56:01.611258 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1419/2904] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:01.613897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.615172 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001894 May 07 21:56:01.616033 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1420/2905] 10.222.0.32 () {54 vars in 1040 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:01.624396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.625818 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-43637a16-1158-407e-bfbf-ed7c78e79ed3 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001707 May 07 21:56:01.626644 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1421/2906] 10.222.0.32 () {56 vars in 885 bytes} [Sat May 7 21:56:01 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 07 21:56:01.810420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:01.828380 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85c61519-4eba-4b49-a722-6b73a3d18059 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1509 microversion: 2.1 time: 0.419807 May 07 21:56:01.829166 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1486/2907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1509 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:01.844300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.844841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:01.859008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.859878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.860824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.861415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.872752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:01.873639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:01.886378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.887102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:01.888060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:01.890902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.246633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:02.266139 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-477b054a-9e73-4bab-ba68-08c0e901425e tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1509 microversion: 2.1 time: 0.425513 May 07 21:56:02.269606 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1422/2908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:02.278406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-186cc88c-76e5-4d25-a4e4-6703394ace28 req-d6115b60-092b-475e-92b4-2e7dce00e077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-plugged", "status": "completed", "tag": "5642df0d-b70e-45a4-b82c-4c09755c76de"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:02.296508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-186cc88c-76e5-4d25-a4e4-6703394ace28 req-d6115b60-092b-475e-92b4-2e7dce00e077 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.302059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-186cc88c-76e5-4d25-a4e4-6703394ace28 req-d6115b60-092b-475e-92b4-2e7dce00e077 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.331817 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-186cc88c-76e5-4d25-a4e4-6703394ace28 req-d6115b60-092b-475e-92b4-2e7dce00e077 service nova] Creating event network-vif-plugged:5642df0d-b70e-45a4-b82c-4c09755c76de for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:02.341750 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-186cc88c-76e5-4d25-a4e4-6703394ace28 req-d6115b60-092b-475e-92b4-2e7dce00e077 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070659 May 07 21:56:02.347067 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1423/2909] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:02.354703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:02.361416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:02.376955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.378363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.379365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.379541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.398348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:02.410935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:02.423067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:02.431108 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a0a344e4-5b12-4a43-aa62-6c6a836a4016 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.561179 May 07 21:56:02.433949 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1487/2910] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:01 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:56:02.457485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:02.458531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:02.460508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:02.470314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.471011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.475635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.476284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.618680 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5b2eed0-5175-43f9-aa17-e26251813c5f tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "DELETE /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 204 len: 0 microversion: 2.1 time: 0.270111 May 07 21:56:02.619769 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1424/2911] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:02 2022] DELETE /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:02.650862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:02.654216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:02.663677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.666183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.667702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.668554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.759452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:02.798934 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-755a6a9e-22d6-497b-b6e9-8f6bef67e54e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.358171 May 07 21:56:02.801146 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1488/2912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:02 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:02.810745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:02.812015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:02.813062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:02.820318 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4064bcb1-ba87-4680-aa91-302ba75a48d9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1211 microversion: 2.1 time: 0.194666 May 07 21:56:02.823459 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1425/2913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:02 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1211 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:02.834954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.835360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:02.836180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:02.836430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.837623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.838254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.849982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.851102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.853175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:02.853863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:02.893501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:02.980991 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Instance is already in deleting state, ignoring this request May 07 21:56:02.982459 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14034716-f2de-4473-87e1-23c70c18117c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "DELETE /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 204 len: 0 microversion: 2.1 time: 0.178205 May 07 21:56:02.983215 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1489/2914] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:02 2022] DELETE /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:02.993258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:02.994833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:03.003021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.003926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.005171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.006307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.215092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:03.246260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:03.246610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:03.251346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:03.254445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-20b79258-fee6-4246-a577-2bc78c1cc842 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.428281 May 07 21:56:03.258363 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1426/2915] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:02 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:03.273530 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bbfb6029-f111-4c7d-882b-39a7deb133a3 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1515 microversion: 2.1 time: 0.284551 May 07 21:56:03.275166 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1490/2916] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:02 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:03.435615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5e946668-f666-4c55-aa21-9cb9faba6149 req-e126ea96-773e-4fd7-ae3f-01658d8d2cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1", "tag": "0f996493-44aa-49b3-bebb-f6248f93ca91"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:03.446012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5e946668-f666-4c55-aa21-9cb9faba6149 req-e126ea96-773e-4fd7-ae3f-01658d8d2cf9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.447039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5e946668-f666-4c55-aa21-9cb9faba6149 req-e126ea96-773e-4fd7-ae3f-01658d8d2cf9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.452033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:03.454021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:03.462473 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5e946668-f666-4c55-aa21-9cb9faba6149 req-e126ea96-773e-4fd7-ae3f-01658d8d2cf9 service nova] Creating event network-changed:0f996493-44aa-49b3-bebb-f6248f93ca91 for instance 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 on nch1-master-1 May 07 21:56:03.464993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.465456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.466276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.469397 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5e946668-f666-4c55-aa21-9cb9faba6149 req-e126ea96-773e-4fd7-ae3f-01658d8d2cf9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209394 May 07 21:56:03.470975 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1427/2917] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:03.476827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.733714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:03.768667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:03.776533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:03.778044 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95e77f8d-5f5c-4ee6-a6dc-4dd341ecdb40 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.330272 May 07 21:56:03.781401 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1491/2918] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:03 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:03.820112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:03.820961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:03.833299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.834726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.835667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.842036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:03.843769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:03.853563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.863899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.864504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:03.865504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:03.865991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:04.032485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:04.044150 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-acb7dcec-f354-404e-a9ef-d126e08aacdb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1275 microversion: 2.1 time: 0.206350 May 07 21:56:04.048240 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1492/2919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:03 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:04.090224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:04.098690 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d202f01c-13ae-4bc2-862d-03feaabd34eb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.285203 May 07 21:56:04.104183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1428/2920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:03 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:04.277721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:04.278435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:04.292492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:04.292712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:04.293669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:04.294139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:04.294446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:04.295497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:04.307201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:04.310886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:04.312006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:04.312611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.043583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.060683 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-33ae4889-5d02-4763-bd59-a9822407abed tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1515 microversion: 2.1 time: 0.769755 May 07 21:56:05.070693 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1429/2921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:04 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1515 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:05.078305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-plugged", "status": "completed", "tag": "248ca656-6bff-4ce6-b67d-1c6c09ea7b42"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-plugged", "status": "completed", "tag": "0aa75d6c-c396-4cf7-82ed-1655289562cd"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-plugged", "status": "completed", "tag": "744875ea-e246-4ecb-b60f-b9c04a274fe9"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-plugged", "status": "completed", "tag": "8265c59d-4721-4235-823a-846b00373dfe"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-plugged", "status": "completed", "tag": "d3eb7f9f-cad6-43cc-b93c-f50a5e95c505"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:05.102742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:05.103387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.130235 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Creating event network-vif-plugged:248ca656-6bff-4ce6-b67d-1c6c09ea7b42 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:05.131062 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Creating event network-vif-plugged:0aa75d6c-c396-4cf7-82ed-1655289562cd for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:05.131881 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Creating event network-vif-plugged:744875ea-e246-4ecb-b60f-b9c04a274fe9 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:05.132755 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Creating event network-vif-plugged:8265c59d-4721-4235-823a-846b00373dfe for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:05.133575 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] Creating event network-vif-plugged:d3eb7f9f-cad6-43cc-b93c-f50a5e95c505 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:05.141536 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c943ef5e-68f3-4377-979a-333056418e25 req-3a931241-a0b1-4fc2-b4c6-a6ff37a5ec20 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.078740 May 07 21:56:05.143702 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1430/2922] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:05.150313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:05.151453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:05.162472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:05.163578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.164811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:05.165176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.251413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.265901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.268627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.271101 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ca08af1e-65ee-4bea-b292-4dd782dd03f6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.997688 May 07 21:56:05.272450 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1493/2923] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:04 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:05.429538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.453507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.456771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.458095 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a7d49f3-0059-42b0-9408-751de1a5cc4d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.312961 May 07 21:56:05.463798 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1431/2924] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:05 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:05.469525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:05.480743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:05.501663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:05.502130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.503566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:05.504022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.516309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4af27d5-051a-4e98-b3be-269a8a7b90d3 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Action: 'create', calling method: .version_select at 0x7fc41cadfaf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-448994834", "metadata": {"Type": "work"}}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:05.519362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4af27d5-051a-4e98-b3be-269a8a7b90d3 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:05.522795 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4af27d5-051a-4e98-b3be-269a8a7b90d3 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.248853 May 07 21:56:05.524056 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1494/2925] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 21:56:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:56:05.529228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:05.530095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:05.540391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:05.541323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.542667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:05.543364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:05.645960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:05.657065 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dabbe261-8997-47a6-a0af-5e044e8d2f27 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1273 microversion: 2.1 time: 0.191522 May 07 21:56:05.658535 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1432/2926] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:05 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:05.667582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86d0ce86-1579-4941-a093-5fc65d13718f tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Action: 'create', calling method: .version_select at 0x7fc41ccec550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-44862931", "metadata": {"Type": "work"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:05.671699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86d0ce86-1579-4941-a093-5fc65d13718f tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:05.672693 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-86d0ce86-1579-4941-a093-5fc65d13718f tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011139 May 07 21:56:05.673340 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1433/2927] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 21:56:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:56:05.694916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c9bd973f-6ad2-41ee-a759-2d279d715fc0 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Action: 'create', calling method: .version_select at 0x7fc41cbee0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1561575882", "metadata": {"Type": "work"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:05.696498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c9bd973f-6ad2-41ee-a759-2d279d715fc0 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:05.697460 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c9bd973f-6ad2-41ee-a759-2d279d715fc0 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017274 May 07 21:56:05.698152 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1434/2928] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 21:56:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:56:05.715810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fa405164-9cec-409f-a477-d69d296df572 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Calling method '.version_select at 0x7fc41ce78c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:05.763063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-fa405164-9cec-409f-a477-d69d296df572 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] HTTP exception thrown: Volume tempest-invalid-1366190941 could not be found. May 07 21:56:05.764040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fa405164-9cec-409f-a477-d69d296df572 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Returning 404 to user: Volume tempest-invalid-1366190941 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:05.764922 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fa405164-9cec-409f-a477-d69d296df572 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1366190941" status: 404 len: 99 microversion: 2.1 time: 0.057253 May 07 21:56:05.765486 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1435/2929] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 21:56:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1366190941 => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:56:05.782719 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a08f0bb-3f3d-43d3-9c5e-e94eec8f00d6 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004552 May 07 21:56:05.787477 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1436/2930] 10.222.0.32 () {58 vars in 1139 bytes} [Sat May 7 21:56:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 07 21:56:05.793579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56952560-343f-4bb1-bb1f-77045ffe3025 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004364 May 07 21:56:05.794436 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1437/2931] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:56:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 07 21:56:05.805145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-391c9b00-f936-489c-bd45-d4bc203b0a11 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Calling method '.version_select at 0x7fc41cc40310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:05.844843 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-391c9b00-f936-489c-bd45-d4bc203b0a11 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] HTTP exception thrown: Volume 82b78dce-9b0b-4e63-8e7f-8329df021974 could not be found. May 07 21:56:05.846049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-391c9b00-f936-489c-bd45-d4bc203b0a11 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Returning 404 to user: Volume 82b78dce-9b0b-4e63-8e7f-8329df021974 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:05.846965 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-391c9b00-f936-489c-bd45-d4bc203b0a11 tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/82b78dce-9b0b-4e63-8e7f-8329df021974" status: 404 len: 109 microversion: 2.1 time: 0.045573 May 07 21:56:05.848286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1438/2932] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 21:56:05 2022] DELETE /compute/v2.1/os-volumes/82b78dce-9b0b-4e63-8e7f-8329df021974 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:05.858553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab0f7e8f-62d6-45b4-a2bf-4e18861c44fd tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Calling method '.version_select at 0x7fc41cd488b0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:05.899200 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ab0f7e8f-62d6-45b4-a2bf-4e18861c44fd tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] HTTP exception thrown: Volume 327f174c-09c6-470a-8874-c132bd34ab51 could not be found. May 07 21:56:05.900864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab0f7e8f-62d6-45b4-a2bf-4e18861c44fd tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] Returning 404 to user: Volume 327f174c-09c6-470a-8874-c132bd34ab51 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:05.902090 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ab0f7e8f-62d6-45b4-a2bf-4e18861c44fd tempest-VolumesNegativeTest-1295458918 tempest-VolumesNegativeTest-1295458918-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/327f174c-09c6-470a-8874-c132bd34ab51" status: 404 len: 109 microversion: 2.1 time: 0.048380 May 07 21:56:05.910079 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1439/2933] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 21:56:05 2022] GET /compute/v2.1/os-volumes/327f174c-09c6-470a-8874-c132bd34ab51 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:06.087641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:06.089532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:06.100780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.101870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.103429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.104276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.208722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.227750 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-243a6616-a8ca-4750-bba4-2450b75df4e3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.701069 May 07 21:56:06.230043 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1495/2934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:05 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:06.295626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:06.297465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:06.320090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.320942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.325444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.328014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.389099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.410943 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-38866513-a754-42b9-ad3e-32ef2c3db336 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1515 microversion: 2.1 time: 0.336190 May 07 21:56:06.426738 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1440/2935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:06 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1515 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:06.483235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:06.484029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:06.508282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.516284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.517142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.517593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.849055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.863464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.875210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.876846 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51c4167b-0403-499c-89ca-8e9c8456c9d4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.397579 May 07 21:56:06.877271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.877758 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1441/2936] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:06 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:56:06.889249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:06.889892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:06.891676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.898025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:06.900195 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7f2775b-f3f2-43f0-94ab-ad0213bea8c7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.612315 May 07 21:56:06.902986 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1496/2937] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:06 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:06.911026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.911513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.912283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.912895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:06.925594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7a1ebae4-bc8a-4c0b-b0fb-a5e3df9519eb req-d6b84945-6de4-4dcc-916d-f522d7501e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e24f97-8526-41f8-906e-c99d18f445ba", "name": "network-vif-deleted", "tag": "70309868-18a6-4a82-b4fb-e8df121c6f4c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:06.946312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7a1ebae4-bc8a-4c0b-b0fb-a5e3df9519eb req-d6b84945-6de4-4dcc-916d-f522d7501e16 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:06.947118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7a1ebae4-bc8a-4c0b-b0fb-a5e3df9519eb req-d6b84945-6de4-4dcc-916d-f522d7501e16 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.001423 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7a1ebae4-bc8a-4c0b-b0fb-a5e3df9519eb req-d6b84945-6de4-4dcc-916d-f522d7501e16 service nova] Creating event network-vif-deleted:70309868-18a6-4a82-b4fb-e8df121c6f4c for instance 75e24f97-8526-41f8-906e-c99d18f445ba on nch1-master-1 May 07 21:56:07.023307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7a1ebae4-bc8a-4c0b-b0fb-a5e3df9519eb req-d6b84945-6de4-4dcc-916d-f522d7501e16 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117891 May 07 21:56:07.024463 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1497/2938] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:07.198295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3bca4ec7-0d79-4dd4-a14f-6c6cd1296291 req-e44c342f-0c8a-4660-b405-726646db5de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-plugged", "status": "completed", "tag": "0f85ab7f-8d9d-42b6-bed5-f5b8be554023"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:07.221818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3bca4ec7-0d79-4dd4-a14f-6c6cd1296291 req-e44c342f-0c8a-4660-b405-726646db5de6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.222597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3bca4ec7-0d79-4dd4-a14f-6c6cd1296291 req-e44c342f-0c8a-4660-b405-726646db5de6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.249810 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3bca4ec7-0d79-4dd4-a14f-6c6cd1296291 req-e44c342f-0c8a-4660-b405-726646db5de6 service nova] Creating event network-vif-plugged:0f85ab7f-8d9d-42b6-bed5-f5b8be554023 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:07.259500 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3bca4ec7-0d79-4dd4-a14f-6c6cd1296291 req-e44c342f-0c8a-4660-b405-726646db5de6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072866 May 07 21:56:07.262364 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1498/2939] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:07.271975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:07.273215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:07.283654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.286441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.287583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.289617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.302969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:07.313232 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b42ba531-514a-4682-b5e0-89c02d08d7a4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.434307 May 07 21:56:07.319115 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1442/2940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:06 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:07.433617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:07.434898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:07.450827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.451747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.453405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.455014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.495130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.496093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.496727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lazy-loading 'fault' on Instance uuid 75e24f97-8526-41f8-906e-c99d18f445ba {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:56:07.572130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e390d65f16c47ec89f5f834bccfdd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4c556805a24040a7131d879ee91498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:07.581405 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27b4409d-97be-4bd4-8c41-3ebfa4b0eb40 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 200 len: 1308 microversion: 2.1 time: 0.152545 May 07 21:56:07.594906 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1443/2941] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:07 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:07.707019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:07.714296 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af811176-3a74-4299-8125-451f8105d72c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.449285 May 07 21:56:07.724808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1499/2942] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:07 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:07.895620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:07.896823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:07.913417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.914296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.915352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.916257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.921612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:07.922429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:07.935206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.935719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:07.939485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:07.940228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.276379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.281598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.290424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.293650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.295047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.298805 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a61fe44-0079-4bea-a0c2-636018fba336 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.379856 May 07 21:56:08.300537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.300999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1500/2943] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:07 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:56:08.305213 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71e40514-4258-46a9-8ccb-1e217081c5b3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.411566 May 07 21:56:08.316759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1444/2944] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:07 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:08.336190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:08.336786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:08.351670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.352583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.353655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.354327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.603448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:08.604283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 75e24f97-8526-41f8-906e-c99d18f445ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:08.629032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.632603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.635019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.636587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.679367 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] HTTP exception thrown: Instance 75e24f97-8526-41f8-906e-c99d18f445ba could not be found. May 07 21:56:08.680352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Returning 404 to user: Instance 75e24f97-8526-41f8-906e-c99d18f445ba could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:08.683329 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-11ed5223-911f-4d0e-8947-f1458227a88c tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba" status: 404 len: 111 microversion: 2.1 time: 0.086540 May 07 21:56:08.684771 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1445/2945] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:08 2022] GET /compute/v2.1/servers/75e24f97-8526-41f8-906e-c99d18f445ba => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:56:08.708307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:08.709137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:08.725006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.725892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.727636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.728587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.768245 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] HTTP exception thrown: Instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb could not be found. May 07 21:56:08.768860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.770379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Returning 404 to user: Instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:08.771417 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29d685df-1c31-4a47-94f4-8872bb15e5d6 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 404 len: 111 microversion: 2.1 time: 0.082226 May 07 21:56:08.773341 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1446/2946] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:08 2022] DELETE /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:08.779737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:08.781630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:08.788398 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dea3f951-e522-48b0-a88c-2c0e25022b20 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.458122 May 07 21:56:08.792240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.792240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.793775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.795261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.805823 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1501/2947] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:08 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:08.823811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:08.827331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:08.853800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.855113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.856868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.858569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.908019 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] HTTP exception thrown: Instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb could not be found. May 07 21:56:08.910813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Returning 404 to user: Instance 9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:08.912456 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d534c32e-f9e9-4e90-9839-8ca41125b59d tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb" status: 404 len: 111 microversion: 2.1 time: 0.101428 May 07 21:56:08.915655 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1502/2948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:08 2022] GET /compute/v2.1/servers/9f1345a1-41a5-40ac-a7c4-7d6b9eb621fb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:08.931258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:08.933916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:08.951048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.951922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.954299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:08.956211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:08.973796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:08.986508 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] HTTP exception thrown: Instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a could not be found. May 07 21:56:08.987510 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c31e3eb2-9ca6-4f51-a918-672504aab6d5 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.212928 May 07 21:56:08.987962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Returning 404 to user: Instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:08.989009 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d338924d-6848-4614-bbca-b95e62576a89 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 404 len: 111 microversion: 2.1 time: 0.068200 May 07 21:56:08.990218 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1503/2949] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:08 2022] DELETE /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:56:08.990875 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1447/2950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:08 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:09.000969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:09.001896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] [instance: 3b485f98-6005-4fd2-a4ca-72e35f397c6a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:09.011645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.012761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.014039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.014623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.052433 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] HTTP exception thrown: Instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a could not be found. May 07 21:56:09.056164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] Returning 404 to user: Instance 3b485f98-6005-4fd2-a4ca-72e35f397c6a could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:09.058870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-732051b3-0559-4728-a281-c0aa6e012315 tempest-ServerDiskConfigTestJSON-1629561190 tempest-ServerDiskConfigTestJSON-1629561190-project] 10.222.0.32 "GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a" status: 404 len: 111 microversion: 2.1 time: 0.063568 May 07 21:56:09.059381 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1504/2951] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:08 2022] GET /compute/v2.1/servers/3b485f98-6005-4fd2-a4ca-72e35f397c6a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:09.076406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4f2d13b8-51d7-4926-93c2-4e555328f059 req-37e81ba7-5b26-4c6b-b705-21444e53c8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7a8b92-09df-4099-94f7-37bbd4e0fa2c", "tag": "2bd7a9c3-1135-4b92-a56c-4185babcccd8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:09.103629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4f2d13b8-51d7-4926-93c2-4e555328f059 req-37e81ba7-5b26-4c6b-b705-21444e53c8d3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.104473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4f2d13b8-51d7-4926-93c2-4e555328f059 req-37e81ba7-5b26-4c6b-b705-21444e53c8d3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.135731 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4f2d13b8-51d7-4926-93c2-4e555328f059 req-37e81ba7-5b26-4c6b-b705-21444e53c8d3 service nova] Creating event network-changed:2bd7a9c3-1135-4b92-a56c-4185babcccd8 for instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c on nch2-master-1 May 07 21:56:09.147721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4f2d13b8-51d7-4926-93c2-4e555328f059 req-37e81ba7-5b26-4c6b-b705-21444e53c8d3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081227 May 07 21:56:09.148636 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1448/2952] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:09.324060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:09.324781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:09.325270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:09.326366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:09.335966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.337725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.338829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.339443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.356451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.357161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.358810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.359689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.590049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:09.604659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:09.606902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:09.608371 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b14ac6a2-9b3a-4bc8-88d5-cc2f410b074c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.288663 May 07 21:56:09.609500 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1449/2953] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:09 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:09.616180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-8f21c228-7db8-42a9-a134-0e77c39ba528 req-057487c8-5ed4-43e4-b57d-1ebef28e8404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "name": "network-vif-plugged", "status": "completed", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:09.626580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8f21c228-7db8-42a9-a134-0e77c39ba528 req-057487c8-5ed4-43e4-b57d-1ebef28e8404 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.627099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8f21c228-7db8-42a9-a134-0e77c39ba528 req-057487c8-5ed4-43e4-b57d-1ebef28e8404 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.651640 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-8f21c228-7db8-42a9-a134-0e77c39ba528 req-057487c8-5ed4-43e4-b57d-1ebef28e8404 service nova] Creating event network-vif-plugged:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch2-master-1 May 07 21:56:09.660264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-8f21c228-7db8-42a9-a134-0e77c39ba528 req-057487c8-5ed4-43e4-b57d-1ebef28e8404 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048937 May 07 21:56:09.661306 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1450/2954] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:09.811919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:09.812630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:09.820318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.821531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:09.822923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:09.823547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:10.000457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.014959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bdb1b375-ed3a-453e-b578-1742cd0c1c9b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.207182 May 07 21:56:10.019739 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1451/2955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:09 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:10.023539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.035161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:10.036121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:10.036270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.037766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.039565 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b45902e-a7a1-480b-b31d-c27b4e1b1bb1 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1874 microversion: 2.32 time: 0.722461 May 07 21:56:10.042937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:10.043797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:10.054386 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1505/2956] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:09 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1874 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:10.055853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:10.056320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:10.240474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.251270 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4763aa77-be26-474b-8716-edf28dec7826 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.229696 May 07 21:56:10.253491 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1452/2957] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:10 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:10.629687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:10.630813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:10.638839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:10.639572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:10.640762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:10.641361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:10.943372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.953337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.955274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:10.956729 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9677bf4-5d59-46ff-9a6d-1b430d48969f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.333746 May 07 21:56:10.957882 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1506/2958] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:10 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:11.037521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:11.038298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:11.047211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.047968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.050375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.051246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.062533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:11.064926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:11.082612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.091413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.092803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.093478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.383796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:11.396584 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-682238e0-6ed4-46f1-9273-2710265604df tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.363011 May 07 21:56:11.397223 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1453/2959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:11 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:11.411455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:11.413169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:11.421546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.422336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.424529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.425243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.530222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:11.546694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:11.555074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:11.556576 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-50853900-0d31-4ba8-a0ed-6eb9472728f5 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2826 microversion: 2.32 time: 0.499075 May 07 21:56:11.560520 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1507/2960] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:11 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2826 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:11.579849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5cace0ca-a970-4dff-b426-d4d5bf63a916 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:11.581280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5cace0ca-a970-4dff-b426-d4d5bf63a916 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:11.593531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cace0ca-a970-4dff-b426-d4d5bf63a916 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.597273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cace0ca-a970-4dff-b426-d4d5bf63a916 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.598162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cace0ca-a970-4dff-b426-d4d5bf63a916 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.600414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5cace0ca-a970-4dff-b426-d4d5bf63a916 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.740543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:11.751428 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-282381c3-b728-4450-a9e9-2393b213d04b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.352207 May 07 21:56:11.760741 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1454/2961] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:11 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:11.807500 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5cace0ca-a970-4dff-b426-d4d5bf63a916 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.230549 May 07 21:56:11.808156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1508/2962] 10.222.0.32 () {60 vars in 1315 bytes} [Sat May 7 21:56:11 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec/os-interface => generated 1830 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:56:11.978613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:11.980065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:11.996395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:11.996896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:11.997722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:12.001482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:12.102682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7687104d-ee1f-4b72-bb45-47b0264c5daf req-c14909b9-2bdb-4142-8324-02b2972f7a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1", "name": "network-vif-plugged", "status": "completed", "tag": "0f996493-44aa-49b3-bebb-f6248f93ca91"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:12.118196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7687104d-ee1f-4b72-bb45-47b0264c5daf req-c14909b9-2bdb-4142-8324-02b2972f7a06 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:12.118952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7687104d-ee1f-4b72-bb45-47b0264c5daf req-c14909b9-2bdb-4142-8324-02b2972f7a06 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:12.141689 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7687104d-ee1f-4b72-bb45-47b0264c5daf req-c14909b9-2bdb-4142-8324-02b2972f7a06 service nova] Creating event network-vif-plugged:0f996493-44aa-49b3-bebb-f6248f93ca91 for instance 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 on nch1-master-1 May 07 21:56:12.157093 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7687104d-ee1f-4b72-bb45-47b0264c5daf req-c14909b9-2bdb-4142-8324-02b2972f7a06 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401755 May 07 21:56:12.159578 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1455/2963] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:12.295398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:12.307280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:12.312833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:12.316566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3f29b5e-8bc8-44bc-8ca8-c1901b466625 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.344028 May 07 21:56:12.317165 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1509/2964] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:11 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:12.415737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:12.416686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:12.431447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:12.435327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:12.436921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:12.439302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:12.770917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:12.771556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:12.788838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:12.791459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:12.794801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:12.795295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:12.825534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:12.835777 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f93b6e37-b19e-4328-aebf-3871e24de97e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.425689 May 07 21:56:12.850704 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1456/2965] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:12 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:13.334470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:13.336745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:13.337373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:13.342160 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4519c670-d8ac-4a1c-a8f8-181b7d698d6b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1317 microversion: 2.1 time: 0.577338 May 07 21:56:13.347890 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1510/2966] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:12 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:13.360916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:13.378349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:13.380358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:13.384674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:13.815433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:13.825913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:13.832597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:13.841225 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-992ce92c-c28f-4732-a91b-0a52d18abb8a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1810 microversion: 2.20 time: 0.508372 May 07 21:56:13.858984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:13.860360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:13.863912 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1457/2967] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:13 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1810 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:56:13.868791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:13.869503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:13.871085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:13.871859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:14.134882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6f2a690c-11e3-4ae9-8eab-cfd6343f4f21 req-16065401-2bdc-4ff9-abe1-60f2e8809916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "tag": "248ca656-6bff-4ce6-b67d-1c6c09ea7b42"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:14.145010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6f2a690c-11e3-4ae9-8eab-cfd6343f4f21 req-16065401-2bdc-4ff9-abe1-60f2e8809916 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:14.145744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6f2a690c-11e3-4ae9-8eab-cfd6343f4f21 req-16065401-2bdc-4ff9-abe1-60f2e8809916 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:14.150618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:14.160673 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f167dbe-9593-4ee8-9476-7ba3fcf99b62 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.306432 May 07 21:56:14.163441 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1511/2968] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:13 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:14.175888 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6f2a690c-11e3-4ae9-8eab-cfd6343f4f21 req-16065401-2bdc-4ff9-abe1-60f2e8809916 service nova] Creating event network-changed:248ca656-6bff-4ce6-b67d-1c6c09ea7b42 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:56:14.184647 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6f2a690c-11e3-4ae9-8eab-cfd6343f4f21 req-16065401-2bdc-4ff9-abe1-60f2e8809916 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052565 May 07 21:56:14.185749 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1458/2969] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:56:14.365369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:14.366481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:14.378269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:14.379418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:14.382842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:14.383613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:14.643604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:14.665113 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-01bc6f6e-4b06-4398-a26b-ae6c53c2b1c1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1466 microversion: 2.1 time: 0.293919 May 07 21:56:14.665826 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1512/2970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:14 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1466 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:14.684222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-044d2927-6a05-4bdd-8cdc-786b2637a098 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:14.684950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-044d2927-6a05-4bdd-8cdc-786b2637a098 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:14.696946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044d2927-6a05-4bdd-8cdc-786b2637a098 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:14.697404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044d2927-6a05-4bdd-8cdc-786b2637a098 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:14.698201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044d2927-6a05-4bdd-8cdc-786b2637a098 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:14.698652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044d2927-6a05-4bdd-8cdc-786b2637a098 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:14.862846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:14.863796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:14.879641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:14.880558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:14.883924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:14.884631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:15.316514 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-044d2927-6a05-4bdd-8cdc-786b2637a098 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1617 microversion: 2.1 time: 0.637602 May 07 21:56:15.321779 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1459/2971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:14 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1617 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:15.336601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:15.337471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:15.349990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:15.353294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:15.354450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:15.355818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:15.628164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:15.642755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:15.648884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:15.652654 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c612e0fc-6efd-4d0f-a3d9-a70efb4e711c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1797 microversion: 2.20 time: 0.796080 May 07 21:56:15.656579 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1513/2972] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:14 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1797 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:15.670579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f98cf89a-3568-48a9-9326-2946de38779d req-2cb26b63-bd98-47a1-945f-4f342ac5835b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7a8b92-09df-4099-94f7-37bbd4e0fa2c", "name": "network-vif-plugged", "status": "completed", "tag": "2bd7a9c3-1135-4b92-a56c-4185babcccd8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:15.696488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f98cf89a-3568-48a9-9326-2946de38779d req-2cb26b63-bd98-47a1-945f-4f342ac5835b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:15.696956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f98cf89a-3568-48a9-9326-2946de38779d req-2cb26b63-bd98-47a1-945f-4f342ac5835b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:15.728725 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f98cf89a-3568-48a9-9326-2946de38779d req-2cb26b63-bd98-47a1-945f-4f342ac5835b service nova] Creating event network-vif-plugged:2bd7a9c3-1135-4b92-a56c-4185babcccd8 for instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c on nch2-master-1 May 07 21:56:15.739652 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f98cf89a-3568-48a9-9326-2946de38779d req-2cb26b63-bd98-47a1-945f-4f342ac5835b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081022 May 07 21:56:15.741268 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1514/2973] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:15.755198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1330236635", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2"]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:15.856447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:15.974899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:15.984976 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fe810a48-b44b-46a4-af6a-aa4e8b66389d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.661764 May 07 21:56:15.991479 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1460/2974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:15 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:16.275695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:16.276408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:16.277284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:16.277978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:16.278639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:16.294833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:16.294833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:16.294833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:16.295230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:16.333925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:16.343628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:16.383249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:16.391637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:16.516267 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ad51aa70-1e1d-49da-912b-3503adeb850f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773741 May 07 21:56:16.519106 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1515/2975] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:56:16.528969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9318d23f-28dd-409f-843d-fd5d47166377 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:16.530524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9318d23f-28dd-409f-843d-fd5d47166377 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:16.722307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9318d23f-28dd-409f-843d-fd5d47166377 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:16.741781 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9318d23f-28dd-409f-843d-fd5d47166377 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1217 microversion: 2.1 time: 0.212314 May 07 21:56:16.742443 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1461/2976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:16 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:16.822453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1482306417", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "92ee54a4-6cae-41b9-99d3-263ba33ff675"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:16.900272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] validate_networks() for [('92ee54a4-6cae-41b9-99d3-263ba33ff675', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:17.007897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:17.008532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:17.018861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:17.019351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:17.020155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:17.020607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:17.558268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:17.587484 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e5380f74-43fa-47f5-8f95-6d3ed969ca35 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1315 microversion: 2.1 time: 0.580776 May 07 21:56:17.601943 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1462/2977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:17 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:17.757949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:17.758574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:17.770015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:17.770469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:17.771278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:17.771721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:17.889086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:17.890291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:17.890832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:17.891256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:17.891716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:17.907431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:17.910601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:17.919220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:17.919695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:17.979944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Getting quotas for project a017d4c58fe640c5bf85d1d055b3da11. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:17.986313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Getting quotas for user 2574be3d704f4f46942a5cfa852ff392 and project a017d4c58fe640c5bf85d1d055b3da11. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:18.008220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:18.019782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:18.020261 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc800aeb-0438-4d18-bf93-6d31ce0aef27 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1269 microversion: 2.1 time: 0.266253 May 07 21:56:18.023779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:18.032764 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1463/2978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:17 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1269 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:18.191357 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-956251d8-d2ad-487c-9019-6302b13188dd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.622214 May 07 21:56:18.193911 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1516/2979] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:56:18.207298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b722371a-1ae3-4a4d-8ea0-e4745eee57c3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:18.208336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b722371a-1ae3-4a4d-8ea0-e4745eee57c3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:18.363157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b722371a-1ae3-4a4d-8ea0-e4745eee57c3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:18.372225 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b722371a-1ae3-4a4d-8ea0-e4745eee57c3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1217 microversion: 2.1 time: 0.169408 May 07 21:56:18.373876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1464/2980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:18 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:18.608121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:18.609800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:18.622372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:18.623947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:18.625646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:18.628297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:18.925012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:18.935152 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a73baa66-e837-4590-88c0-bedabcce60fd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1501 microversion: 2.1 time: 0.331437 May 07 21:56:18.955784 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1517/2981] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:18 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1501 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:19.038622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:19.039723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:19.068756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:19.069198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:19.070026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:19.073529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:19.377534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:19.390463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:19.391375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:19.398984 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fbe7accb-46f2-4a59-8834-ffe51de9769b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1275 microversion: 2.1 time: 0.362572 May 07 21:56:19.407874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:19.408707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:19.409721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:19.411225 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1465/2982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:19 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1275 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:19.429626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:19.877522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:19.886561 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-186aa098-5e41-4d4d-935a-bb0318cee66f tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1213 microversion: 2.1 time: 0.500583 May 07 21:56:19.891537 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1518/2983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:19 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1213 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:20.425761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:20.427426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:20.454360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:20.456909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:20.457950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:20.460731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:20.577591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-19602211", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "cad67ef4-7464-41a3-89b9-99b9a8d2dcdb"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:20.669151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] validate_networks() for [('cad67ef4-7464-41a3-89b9-99b9a8d2dcdb', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:21.052022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:21.067290 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7d8ccd74-7d6d-4396-a08e-a4f8d54fe559 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1317 microversion: 2.1 time: 0.652013 May 07 21:56:21.070198 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1519/2984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:20 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:21.084509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a357f932-6e86-441e-992c-5e2d6589be9a"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:21.088602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:21.108502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:21.109517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:21.110687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:21.113760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:21.473849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:21.476370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:21.477321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:21.477903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:21.478479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:21.519117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:21.522501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:21.524355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:21.526128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:21.571225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Getting quotas for project bdb8a8a58b5b4b9b95ac9d6a782df6af. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:21.581360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Getting quotas for user 2c615ca825f6488fbdddff03a048b94b and project bdb8a8a58b5b4b9b95ac9d6a782df6af. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:21.596830 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee1af3fd-6920-4836-a710-ee9cdf0f6098 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523291 May 07 21:56:21.599207 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1520/2985] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 21:56:21 2022] POST /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:21.603377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:21.623499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:21.624297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:21.625391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:21.643820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:21.645029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:21.647005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:21.647459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:21.771115 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-425b2e1b-63f6-4275-9e8a-b62347f26406 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687605 May 07 21:56:21.772274 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1466/2986] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:56:21.797166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3e79b99a-b84c-4e4e-b922-4606ed124cef tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:21.803622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3e79b99a-b84c-4e4e-b922-4606ed124cef tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:21.935360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:21.949108 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f0af5a4-43e5-417c-804c-d6c7fd14e2cf tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1275 microversion: 2.1 time: 0.343393 May 07 21:56:21.957903 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1521/2987] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:21 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1275 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:21.977216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1f7ea35a-f039-4109-984f-fce360a20962 req-6d25a340-fa47-4d68-974f-245679e447df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "667146df-e986-4daa-bcba-4c5482efbad0", "tag": "efdbc27d-d662-4524-a972-4ae143b5530b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:22.040814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1f7ea35a-f039-4109-984f-fce360a20962 req-6d25a340-fa47-4d68-974f-245679e447df service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:22.041393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1f7ea35a-f039-4109-984f-fce360a20962 req-6d25a340-fa47-4d68-974f-245679e447df service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:22.083459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3e79b99a-b84c-4e4e-b922-4606ed124cef tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:22.093969 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3e79b99a-b84c-4e4e-b922-4606ed124cef tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1230 microversion: 2.1 time: 0.315037 May 07 21:56:22.094575 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1467/2988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:21 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1230 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:22.119098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:22.119742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:22.144988 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1f7ea35a-f039-4109-984f-fce360a20962 req-6d25a340-fa47-4d68-974f-245679e447df service nova] Creating event network-changed:efdbc27d-d662-4524-a972-4ae143b5530b for instance 667146df-e986-4daa-bcba-4c5482efbad0 on nch1-master-1 May 07 21:56:22.177184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:22.177646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:22.179141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1f7ea35a-f039-4109-984f-fce360a20962 req-6d25a340-fa47-4d68-974f-245679e447df service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218136 May 07 21:56:22.183977 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1522/2989] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:22.186574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:22.189567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:22.559927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:22.574928 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80aec6e1-b065-4223-a2a4-6e97beeeec75 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1317 microversion: 2.1 time: 0.463462 May 07 21:56:22.576070 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1468/2990] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:22 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:22.966200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:22.966986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:22.977588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:22.977994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:22.978889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:22.985128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:23.114482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:23.115923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:23.124463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:23.125211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:23.128112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:23.128856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:23.468100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:23.479414 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a21fe5cb-a09f-44d9-b8fe-1ab87d0f68f4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.517360 May 07 21:56:23.480129 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1523/2991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:22 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:23.487448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:23.488070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:23.514985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:23.514985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:23.514985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:23.514985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:23.814313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:23.827138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b369bd8-f691-4b75-a8de-f23f906ccb7d tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1234 microversion: 2.1 time: 0.719422 May 07 21:56:23.827743 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1469/2992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:23 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1234 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:23.837398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:23.838049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:23.863861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:23.874994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:23.875942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:23.876401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:24.146302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:24.155161 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b48b8891-3f3b-4864-b587-02dddf456ab6 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1317 microversion: 2.1 time: 0.326328 May 07 21:56:24.165864 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1470/2993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:23 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:24.290415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:24.303948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:24.305823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:24.307569 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-02fb034a-1c24-4871-bec9-11a350ae13eb tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2952 microversion: 2.42 time: 0.824541 May 07 21:56:24.308349 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1524/2994] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:23 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2952 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:24.346004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ced6a43a-cf28-4e1c-ac51-6cc33144134a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:24.348939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ced6a43a-cf28-4e1c-ac51-6cc33144134a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:24.360409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ced6a43a-cf28-4e1c-ac51-6cc33144134a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:24.361963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ced6a43a-cf28-4e1c-ac51-6cc33144134a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:24.363522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ced6a43a-cf28-4e1c-ac51-6cc33144134a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:24.364793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ced6a43a-cf28-4e1c-ac51-6cc33144134a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:24.503793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:24.504384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:24.514155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:24.514610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:24.525473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:24.526272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:24.651855 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ced6a43a-cf28-4e1c-ac51-6cc33144134a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.313736 May 07 21:56:24.660629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1471/2995] 10.222.0.32 () {60 vars in 1315 bytes} [Sat May 7 21:56:24 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c/os-interface => generated 1831 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:24.848844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:24.852425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:24.877221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:24.877221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:24.877221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:24.878946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:25.045904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:25.089147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb605c5e-80e5-4a9d-934d-548b3e80d742 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1288 microversion: 2.1 time: 0.247794 May 07 21:56:25.089960 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1472/2996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:24 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1288 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:25.105617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:25.129711 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0855244f-fe9a-46c6-bca6-4a2ba5d9338e tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.630120 May 07 21:56:25.130813 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1525/2997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:24 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:25.176688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:25.176688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:25.206277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:25.223377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:25.228476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:25.229600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:25.525949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:25.551590 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-18a15f19-7e45-4537-b19a-ea28618e19fb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1317 microversion: 2.1 time: 0.378695 May 07 21:56:25.552864 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1473/2998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:25 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:26.106323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:26.106989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:26.122623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.125365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.126428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.127493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.150448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:26.151544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:26.169176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.170516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.175084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.177693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.326666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:26.342313 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-642d8aaf-24ff-46bc-9573-256e23bff052 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1288 microversion: 2.1 time: 0.239805 May 07 21:56:26.342941 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1526/2999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:26 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1288 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:26.351088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:26.351599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:26.380649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.381487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.382610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.383243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.440171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:26.490626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:26.501303 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-11f94e66-538b-493f-b364-e1bc2bf0b127 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.359203 May 07 21:56:26.512040 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1474/3000] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:26 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:26.573506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:26.574195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:26.586509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.589178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.590257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.590886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.671258 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5eee3e2a-7248-4615-9f7f-0314f4f3baa5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 204 len: 0 microversion: 2.1 time: 0.326986 May 07 21:56:26.672666 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1527/3001] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:26 2022] DELETE /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:26.682325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:26.683433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:26.693147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.696622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.698689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.710320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.788258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:26.802627 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cefa1f62-fafe-4895-a04b-00bab6f0b274 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1317 microversion: 2.1 time: 0.234087 May 07 21:56:26.803708 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1475/3002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:26 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:26.813910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c9c0ef7a-1f9c-4cf0-9606-0167d9614355 req-e7b81b08-aeb7-48e1-b911-9aae7d955d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3f598bc-bd2c-4610-90f9-724d5cb1619b", "tag": "7c89cdcf-6e2d-43ca-bd9c-a9cd5b8613e4"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:26.824333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c9c0ef7a-1f9c-4cf0-9606-0167d9614355 req-e7b81b08-aeb7-48e1-b911-9aae7d955d9f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:26.825026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c9c0ef7a-1f9c-4cf0-9606-0167d9614355 req-e7b81b08-aeb7-48e1-b911-9aae7d955d9f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:26.839160 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c9c0ef7a-1f9c-4cf0-9606-0167d9614355 req-e7b81b08-aeb7-48e1-b911-9aae7d955d9f service nova] Creating event network-changed:7c89cdcf-6e2d-43ca-bd9c-a9cd5b8613e4 for instance b3f598bc-bd2c-4610-90f9-724d5cb1619b on nch2-master-1 May 07 21:56:26.846332 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c9c0ef7a-1f9c-4cf0-9606-0167d9614355 req-e7b81b08-aeb7-48e1-b911-9aae7d955d9f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040399 May 07 21:56:26.847549 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1476/3003] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:27.048038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:27.058935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09a0aa2b-c6ca-4bb6-8298-2059efb5ed7d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1553 microversion: 2.1 time: 0.381113 May 07 21:56:27.062524 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1528/3004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:26 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:27.364562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:27.365986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:27.379585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:27.382293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:27.386118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:27.386989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:27.520083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:27.521526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:27.538966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:27.542607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:27.543787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:27.544759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:27.746580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:27.757807 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e3fd0b0-f690-4f2a-af3f-a2d32edb5550 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.399506 May 07 21:56:27.758939 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1477/3005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:27 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:27.825683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:27.827875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:27.843638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:27.844101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:27.847217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:27.847844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:27.854906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:27.871290 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd033590-455a-4c8e-b331-41279d7c03d6 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.356114 May 07 21:56:27.884496 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1529/3006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:27 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:28.053953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:28.065119 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2e4e4e3-9b00-4cdc-850a-b30d5dcf4b5d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1317 microversion: 2.1 time: 0.245977 May 07 21:56:28.068157 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1478/3007] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:27 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:28.081512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:28.082191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:28.091270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:28.091742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:28.092546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:28.093000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:28.135147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-19641a84-037e-4bc3-839f-5b15fd9189a0 req-1db09d26-d64f-4876-941d-c232a93e2ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667146df-e986-4daa-bcba-4c5482efbad0", "name": "network-vif-plugged", "status": "completed", "tag": "efdbc27d-d662-4524-a972-4ae143b5530b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:28.150432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-19641a84-037e-4bc3-839f-5b15fd9189a0 req-1db09d26-d64f-4876-941d-c232a93e2ec1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:28.152716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-19641a84-037e-4bc3-839f-5b15fd9189a0 req-1db09d26-d64f-4876-941d-c232a93e2ec1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:28.180726 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-19641a84-037e-4bc3-839f-5b15fd9189a0 req-1db09d26-d64f-4876-941d-c232a93e2ec1 service nova] Creating event network-vif-plugged:efdbc27d-d662-4524-a972-4ae143b5530b for instance 667146df-e986-4daa-bcba-4c5482efbad0 on nch1-master-1 May 07 21:56:28.187292 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-19641a84-037e-4bc3-839f-5b15fd9189a0 req-1db09d26-d64f-4876-941d-c232a93e2ec1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056539 May 07 21:56:28.188330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1479/3008] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:56:28.575701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:28.593147 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04ff633d-b2dd-4f41-857a-f3ee7a87caa3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1553 microversion: 2.1 time: 0.516681 May 07 21:56:28.599754 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1530/3009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:28 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1553 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:28.777074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:28.777867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:28.786451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:28.787229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:28.788180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:28.788767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:28.889006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:28.889670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:28.899071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:28.899529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:28.905751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:28.906539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:29.125824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:29.134723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:29.137201 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-061fd5e5-48eb-4d7c-85f2-3f7d0f4fabdf tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.365200 May 07 21:56:29.138093 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1480/3010] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:28 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:29.152885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d5b55d52-3e7b-4baf-b078-03c1e1c9dc0c req-157c2fcf-4add-4749-84ac-bc1e34eef01b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76df8f5c-4c19-4bba-a009-84627accd050", "tag": "3e3a79b2-c327-437f-8e1f-c48c8ea9c228"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:29.155434 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e8bd172a-9419-430e-abd2-6f86582cffcd tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.266984 May 07 21:56:29.157302 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1531/3011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:28 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:29.162610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d5b55d52-3e7b-4baf-b078-03c1e1c9dc0c req-157c2fcf-4add-4749-84ac-bc1e34eef01b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:29.163104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d5b55d52-3e7b-4baf-b078-03c1e1c9dc0c req-157c2fcf-4add-4749-84ac-bc1e34eef01b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:29.172009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:29.172910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:29.175712 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d5b55d52-3e7b-4baf-b078-03c1e1c9dc0c req-157c2fcf-4add-4749-84ac-bc1e34eef01b service nova] Creating event network-changed:3e3a79b2-c327-437f-8e1f-c48c8ea9c228 for instance 76df8f5c-4c19-4bba-a009-84627accd050 on nch1-master-1 May 07 21:56:29.182233 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d5b55d52-3e7b-4baf-b078-03c1e1c9dc0c req-157c2fcf-4add-4749-84ac-bc1e34eef01b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033837 May 07 21:56:29.183131 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1481/3012] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:29.187399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:29.188435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:29.190992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:29.192314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:29.403800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:29.412064 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9068e0f-9849-42cd-b808-b6b98b5fc2c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1317 microversion: 2.1 time: 0.253189 May 07 21:56:29.412654 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1532/3013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:29 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:29.620115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:29.621335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:29.632754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:29.633652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:29.637309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:29.647786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:29.785124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:29.794391 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8dc923d3-d926-476e-9c58-2bc77fe89f85 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1511 microversion: 2.1 time: 0.179833 May 07 21:56:29.795712 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1533/3014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:29 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:29.816324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e03a0888-3083-4ca0-8f81-511556cdbd40 req-0e3a8157-6c60-41b0-823c-0869b0b7a7bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7a8b92-09df-4099-94f7-37bbd4e0fa2c", "name": "network-vif-deleted", "tag": "2bd7a9c3-1135-4b92-a56c-4185babcccd8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:29.826904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e03a0888-3083-4ca0-8f81-511556cdbd40 req-0e3a8157-6c60-41b0-823c-0869b0b7a7bc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:29.828121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e03a0888-3083-4ca0-8f81-511556cdbd40 req-0e3a8157-6c60-41b0-823c-0869b0b7a7bc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:29.840665 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e03a0888-3083-4ca0-8f81-511556cdbd40 req-0e3a8157-6c60-41b0-823c-0869b0b7a7bc service nova] Creating event network-vif-deleted:2bd7a9c3-1135-4b92-a56c-4185babcccd8 for instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c on nch2-master-1 May 07 21:56:29.847490 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e03a0888-3083-4ca0-8f81-511556cdbd40 req-0e3a8157-6c60-41b0-823c-0869b0b7a7bc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347917 May 07 21:56:29.848348 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1482/3015] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:30.161537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:30.162161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:30.177249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:30.178647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:30.178934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.180083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.180862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.181372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.190394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.191520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.192628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.193233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.490195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:30.504582 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-67cdf5e6-091b-4026-b449-1919b003ff49 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.328884 May 07 21:56:30.505502 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1483/3016] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:30 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:30.510356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:30.513288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:30.523660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:30.525136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.525799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.526807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.527667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.535295 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63316b8d-322c-41d6-836e-1667d0b940eb tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.378701 May 07 21:56:30.537704 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1534/3017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:30 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:30.663107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:30.670498 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f3c87ead-4d9b-4dec-b303-e567d0699793 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1466 microversion: 2.1 time: 0.163828 May 07 21:56:30.671103 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1484/3018] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:30 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:30.687658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2afeb9a4-d431-41fc-8bb8-70eb85855f9a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:30.688269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2afeb9a4-d431-41fc-8bb8-70eb85855f9a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:30.695414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2afeb9a4-d431-41fc-8bb8-70eb85855f9a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.695861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2afeb9a4-d431-41fc-8bb8-70eb85855f9a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.696623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2afeb9a4-d431-41fc-8bb8-70eb85855f9a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.697061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2afeb9a4-d431-41fc-8bb8-70eb85855f9a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.813469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:30.814737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:30.831272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.831901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.832978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.844379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.885382 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2afeb9a4-d431-41fc-8bb8-70eb85855f9a tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1617 microversion: 2.1 time: 0.201307 May 07 21:56:30.888294 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1535/3019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:30 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1617 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:30.926416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:30.927055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:30.927884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lazy-loading 'fault' on Instance uuid 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:56:30.988868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:30.998728 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e9dc2714-07c7-4f76-bd82-b72b7a80e21d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 200 len: 1305 microversion: 2.1 time: 0.189354 May 07 21:56:31.001208 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1485/3020] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:30 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 1305 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:31.030285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1008568028", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:31.087937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:31.352169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:31.352626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:31.353116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:31.353782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:31.354203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:31.364648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:31.365010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:31.365897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:31.366346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:31.383381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:31.388691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Getting quotas for user 7262be0d7db141e69bdf493bd7a5505a and project a24cf19532e0484fabd6dc4e6b66fe30. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:31.402584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:31.404927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:31.449376 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e16feca6-18f9-4212-9044-33253578df7e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.422975 May 07 21:56:31.455093 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1536/3021] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:56:31.460725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db9680b9-1818-4287-a906-224e081b130e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:31.461346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db9680b9-1818-4287-a906-224e081b130e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:31.517867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db9680b9-1818-4287-a906-224e081b130e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:31.522653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:31.523303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:31.524859 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db9680b9-1818-4287-a906-224e081b130e tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1217 microversion: 2.1 time: 0.068303 May 07 21:56:31.525737 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1486/3022] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:31 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:31.530685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:31.531185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:31.531972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:31.532422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:31.558297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:31.559998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:31.572535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:31.573062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:31.573902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:31.574720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:31.738142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:31.743941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:31.747342 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2c4d39b-6ced-4e90-a54e-2b64fd981499 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.228470 May 07 21:56:31.751286 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1537/3023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:31 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:31.754598 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-57b9284d-c92c-4175-bcd3-0743820e1324 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.203281 May 07 21:56:31.756196 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1487/3024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:31 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:32.018240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:32.019416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:32.029376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.030085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:32.035748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.036417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:32.063126 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. May 07 21:56:32.069341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:32.070290 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb7daca0-2ed3-4747-9ce8-960947af061a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 404 len: 111 microversion: 2.1 time: 0.056775 May 07 21:56:32.070949 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1538/3025] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:32 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:32.223244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:32.225019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:32.236484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.237222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:32.238498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.239743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:32.260004 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. May 07 21:56:32.260722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:32.261708 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06893572-971b-4011-82b3-682471f42982 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045290 May 07 21:56:32.262964 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1488/3026] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 21:56:32 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:32.426164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-82671581", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "9b7653d0-c69e-4364-9ed6-1c005b136d81"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:32.484555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] validate_networks() for [('9b7653d0-c69e-4364-9ed6-1c005b136d81', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:32.544078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:32.546275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:32.557489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.559364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:32.560617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.564706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:32.710888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:32.718739 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88650176-ca54-4abd-9d70-30b22ae981ad tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1277 microversion: 2.1 time: 0.180229 May 07 21:56:32.719723 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1489/3027] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:32 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:32.768564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:32.769298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:32.777943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.778820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:32.779930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:32.780545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:33.020784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:33.030567 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a798c551-828a-46d2-8f35-d979e1016217 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.266041 May 07 21:56:33.031779 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1490/3028] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:32 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:33.040759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:33.045222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:33.056234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:33.056700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:33.061424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:33.061891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:33.075346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:33.076246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:33.076733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:33.077144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:33.077565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:33.093013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:33.094706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:33.097551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:33.098439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:33.119919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:33.126573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for user 228761ebf4c0406ab0977cabe351ac76 and project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:33.145009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:33.147414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:33.208261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2380323d-d170-4a79-96d9-a306481c9414 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786826 May 07 21:56:33.212684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1539/3029] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:56:33.221435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-27764616-50b5-4187-b5b3-25f247129b71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:33.222216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-27764616-50b5-4187-b5b3-25f247129b71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:33.313508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-27764616-50b5-4187-b5b3-25f247129b71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:33.322657 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-27764616-50b5-4187-b5b3-25f247129b71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1" status: 200 len: 1213 microversion: 2.1 time: 0.106456 May 07 21:56:33.323276 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1540/3030] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:33 2022] GET /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:33.342070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2831ad3d-20b3-470e-a2d3-4668174a2b88 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:33.342955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2831ad3d-20b3-470e-a2d3-4668174a2b88 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:33.380328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2831ad3d-20b3-470e-a2d3-4668174a2b88 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:33.445210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:33.463649 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97a09b47-22d9-410d-9d21-881f2afb7375 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.429127 May 07 21:56:33.464257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1491/3031] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:33 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:33.739904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:33.741112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:33.754480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:33.758679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:33.760058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:33.763250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:34.141179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-2831ad3d-20b3-470e-a2d3-4668174a2b88 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] Instance Mapping does not exist while attempting local delete cleanup. May 07 21:56:34.149013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2831ad3d-20b3-470e-a2d3-4668174a2b88 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1" status: 204 len: 0 microversion: 2.1 time: 0.809358 May 07 21:56:34.151065 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1541/3032] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:33 2022] DELETE /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:34.160718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:34.161833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:34.180903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:34.182935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:34.185064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:34.186904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:34.306006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:34.318943 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fc807a8d-9336-4920-9d98-8a6ac22470e1 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1317 microversion: 2.1 time: 0.585510 May 07 21:56:34.320814 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1492/3033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:33 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1317 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:34.325707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8df77e96-5cfd-4bab-84da-b599ff250ec8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:34.326636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8df77e96-5cfd-4bab-84da-b599ff250ec8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:34.333850 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-8df77e96-5cfd-4bab-84da-b599ff250ec8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance c4d6ab9c-967e-4ac6-9a25-6301662fbff1 could not be found. May 07 21:56:34.334720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8df77e96-5cfd-4bab-84da-b599ff250ec8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance c4d6ab9c-967e-4ac6-9a25-6301662fbff1 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:34.335836 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8df77e96-5cfd-4bab-84da-b599ff250ec8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1" status: 404 len: 111 microversion: 2.1 time: 0.013813 May 07 21:56:34.337834 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1493/3034] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:34 2022] GET /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:34.422227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:34.432403 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7693e8b5-ae7f-4db3-ab37-65199f874ba3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.279659 May 07 21:56:34.433631 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1542/3035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:34 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:34.486913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:34.488538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:34.506331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1109863548", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "9b7653d0-c69e-4364-9ed6-1c005b136d81"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:34.513299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:34.514385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:34.515981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:34.518971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:34.600352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] validate_networks() for [('9b7653d0-c69e-4364-9ed6-1c005b136d81', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:34.791705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:34.812657 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c177b524-4737-4163-b099-6f2ada8e4503 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.335637 May 07 21:56:34.819907 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1494/3036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:34 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:35.201726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:35.202234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:35.202634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:35.203086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:35.203999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:35.220293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.221488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.222612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.240973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.273811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:35.284874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for user 228761ebf4c0406ab0977cabe351ac76 and project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:35.311763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:35.323556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:35.337096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:35.337916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:35.356019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.357304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.359205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.361822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.425995 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85e800b1-6291-46c0-9b77-4930cedcfb2f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927585 May 07 21:56:35.426896 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1543/3037] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:56:35.437815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3632400b-4835-466f-9eac-a1a4cbad1101 req-9b03fc03-8a13-4548-8ca8-e2e57220b15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a26f825-fd4b-4599-9f14-85180126af3a", "tag": "90921e85-0f48-4254-9e51-5d33766c5e62"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:35.461919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3632400b-4835-466f-9eac-a1a4cbad1101 req-9b03fc03-8a13-4548-8ca8-e2e57220b15a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.462299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3632400b-4835-466f-9eac-a1a4cbad1101 req-9b03fc03-8a13-4548-8ca8-e2e57220b15a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.479576 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3632400b-4835-466f-9eac-a1a4cbad1101 req-9b03fc03-8a13-4548-8ca8-e2e57220b15a service nova] Creating event network-changed:90921e85-0f48-4254-9e51-5d33766c5e62 for instance 5a26f825-fd4b-4599-9f14-85180126af3a on nch2-master-1 May 07 21:56:35.484958 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3632400b-4835-466f-9eac-a1a4cbad1101 req-9b03fc03-8a13-4548-8ca8-e2e57220b15a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056719 May 07 21:56:35.485572 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1544/3038] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:35.503059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4188165f-0575-4da6-8c60-4a1dd2c966cf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:35.507117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4188165f-0575-4da6-8c60-4a1dd2c966cf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:35.593507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4188165f-0575-4da6-8c60-4a1dd2c966cf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:35.612660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4188165f-0575-4da6-8c60-4a1dd2c966cf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1215 microversion: 2.1 time: 0.116179 May 07 21:56:35.613592 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1545/3039] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:35 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:35.630980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:35.631702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:35.648498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.648966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.649768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.650216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.737717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:35.748510 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e06ab387-ae5f-4a5a-9849-9cfc2c954239 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1317 microversion: 2.1 time: 0.415779 May 07 21:56:35.749117 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1495/3040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:35 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:35.843186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:35.844369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:35.863980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.864234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.865268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:35.865742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:35.933164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:35.948329 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4feba65d-4719-4ced-8106-4f21e7cfb724 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.329353 May 07 21:56:35.963410 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1546/3041] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:35 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:36.143348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:36.152304 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-705d09da-6560-4477-ad93-106e88966a56 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.319052 May 07 21:56:36.153185 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1496/3042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:35 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:36.630682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:36.631327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:36.639611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:36.640170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:36.641063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:36.641589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:36.721627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:36.731924 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59b2a3b0-bc07-4a28-8888-acad378dbfcc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1267 microversion: 2.1 time: 0.105617 May 07 21:56:36.732536 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1547/3043] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:36 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:36.771462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:36.772142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:36.779712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:36.780441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:36.781494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:36.782218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:36.960552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:36.969210 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d131483c-5239-404d-975c-c60e9c959314 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1317 microversion: 2.1 time: 0.202770 May 07 21:56:36.969807 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1497/3044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:36 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:36.980728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:36.981438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:36.988769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:36.989382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:36.990274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:36.990842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:37.168791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:37.169355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:37.176992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:37.177918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:37.179030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:37.179693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:37.180220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:37.193084 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-306965c2-edee-40b6-9595-7db0abf261ba tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.216465 May 07 21:56:37.194225 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1548/3045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:36 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:37.351259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:37.362332 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2b5a5a2a-03ba-419a-a334-ea6c86c616e3 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.197677 May 07 21:56:37.374442 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1498/3046] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:37 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:37.540795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2a612201-3034-4a8d-9f6a-8ae2539cf89c req-db2bdb6e-0c76-4d41-8fa6-8483b67e8bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f598bc-bd2c-4610-90f9-724d5cb1619b", "name": "network-vif-plugged", "status": "completed", "tag": "7c89cdcf-6e2d-43ca-bd9c-a9cd5b8613e4"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:37.548804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2a612201-3034-4a8d-9f6a-8ae2539cf89c req-db2bdb6e-0c76-4d41-8fa6-8483b67e8bf2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:37.549263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2a612201-3034-4a8d-9f6a-8ae2539cf89c req-db2bdb6e-0c76-4d41-8fa6-8483b67e8bf2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:37.561278 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2a612201-3034-4a8d-9f6a-8ae2539cf89c req-db2bdb6e-0c76-4d41-8fa6-8483b67e8bf2 service nova] Creating event network-vif-plugged:7c89cdcf-6e2d-43ca-bd9c-a9cd5b8613e4 for instance b3f598bc-bd2c-4610-90f9-724d5cb1619b on nch2-master-1 May 07 21:56:37.566962 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2a612201-3034-4a8d-9f6a-8ae2539cf89c req-db2bdb6e-0c76-4d41-8fa6-8483b67e8bf2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029743 May 07 21:56:37.567854 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1549/3047] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:56:37.750809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:37.752218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:37.761770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:37.762898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:37.764497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:37.765472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:37.986028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:37.988846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:37.989625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:37.998095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:37.998985 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-786be1f9-aa68-43e2-807b-f2d522bfc4c8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1315 microversion: 2.1 time: 0.250310 May 07 21:56:37.999588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:38.000166 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1499/3048] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:37 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:38.001092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:38.002586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:38.212378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:38.213211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:38.225087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:38.227747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:38.228744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:38.231785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:38.237967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:38.247969 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6d764fa0-2de9-48f1-a2c9-6a78bc5a36a3 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1317 microversion: 2.1 time: 0.264136 May 07 21:56:38.248565 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1550/3049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:37 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:38.380870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:38.381805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:38.388432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:38.389114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:38.390299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:38.390840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:38.495484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:38.505173 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2d3f5825-5a27-4b4e-a03e-a58ac3549a2c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1317 microversion: 2.1 time: 0.297148 May 07 21:56:38.506570 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1500/3050] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:38 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:38.646014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:38.655359 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d5fb6f1e-8d56-4f2d-a5e1-525a859d0fd9 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.279055 May 07 21:56:38.658467 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1551/3051] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:38 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:38.970096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-50431eb9-6581-4709-a288-36dcca31e6fb req-51b128f6-3429-4e68-b722-3fe53515070f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff063ae4-e930-4d7e-a587-56a10bb3d88a", "tag": "f4677fe5-047a-4e3f-947c-2db958706ccf"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:38.993276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-50431eb9-6581-4709-a288-36dcca31e6fb req-51b128f6-3429-4e68-b722-3fe53515070f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:38.993903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-50431eb9-6581-4709-a288-36dcca31e6fb req-51b128f6-3429-4e68-b722-3fe53515070f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.010065 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-50431eb9-6581-4709-a288-36dcca31e6fb req-51b128f6-3429-4e68-b722-3fe53515070f service nova] Creating event network-changed:f4677fe5-047a-4e3f-947c-2db958706ccf for instance ff063ae4-e930-4d7e-a587-56a10bb3d88a on nch1-master-1 May 07 21:56:39.019727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:39.020511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:39.030223 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-50431eb9-6581-4709-a288-36dcca31e6fb req-51b128f6-3429-4e68-b722-3fe53515070f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071991 May 07 21:56:39.034997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.035780 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1501/3052] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:39.036675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.038073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.038692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.266231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:39.267681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:39.293863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.294720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.295726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.296176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.335891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:39.343772 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7989b4ee-93b1-4f9b-827b-75f59b16b763 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1315 microversion: 2.1 time: 0.329790 May 07 21:56:39.344830 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1552/3053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:39 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:39.470247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:39.477853 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8f89e084-3e70-45dc-9d91-c6d9b6a95951 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1317 microversion: 2.1 time: 0.216129 May 07 21:56:39.478441 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1502/3054] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:39 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:39.524160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:39.524782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:39.531033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.531493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.532266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.532895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.581586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-731f2185-293d-4d40-9bf5-c76a92d82ae9 req-7ab83386-bad8-4cdb-a014-871e987e0ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76df8f5c-4c19-4bba-a009-84627accd050", "name": "network-vif-plugged", "status": "completed", "tag": "3e3a79b2-c327-437f-8e1f-c48c8ea9c228"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:39.590851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-731f2185-293d-4d40-9bf5-c76a92d82ae9 req-7ab83386-bad8-4cdb-a014-871e987e0ceb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.591304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-731f2185-293d-4d40-9bf5-c76a92d82ae9 req-7ab83386-bad8-4cdb-a014-871e987e0ceb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.602730 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-731f2185-293d-4d40-9bf5-c76a92d82ae9 req-7ab83386-bad8-4cdb-a014-871e987e0ceb service nova] Creating event network-vif-plugged:3e3a79b2-c327-437f-8e1f-c48c8ea9c228 for instance 76df8f5c-4c19-4bba-a009-84627accd050 on nch1-master-1 May 07 21:56:39.609502 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-731f2185-293d-4d40-9bf5-c76a92d82ae9 req-7ab83386-bad8-4cdb-a014-871e987e0ceb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 May 07 21:56:39.610101 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1503/3055] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:56:39.689643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:39.693364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:39.699943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.700407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.701251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.701894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.728909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:39.740132 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a4e1178-342d-4dc6-8bf0-04e8df941da0 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1507 microversion: 2.1 time: 0.219976 May 07 21:56:39.741237 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1553/3056] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:39 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:39.760143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:39.760863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:39.767698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.768382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.769600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.770105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.804148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:39.805094 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-58f8b51c-e133-4233-994d-ae227d7ca6f3 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b/os-instance-actions/req-956251d8-d2ad-487c-9019-6302b13188dd" status: 200 len: 313 microversion: 2.1 time: 0.050909 May 07 21:56:39.806064 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1554/3057] 10.222.0.32 () {58 vars in 1418 bytes} [Sat May 7 21:56:39 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b/os-instance-actions/req-956251d8-d2ad-487c-9019-6302b13188dd => generated 313 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:39.818223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-56ba4994-4ca8-4bb6-a509-483b60dd5008 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:39.819440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-56ba4994-4ca8-4bb6-a509-483b60dd5008 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:39.825828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56ba4994-4ca8-4bb6-a509-483b60dd5008 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.826440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56ba4994-4ca8-4bb6-a509-483b60dd5008 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.827403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56ba4994-4ca8-4bb6-a509-483b60dd5008 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.827867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56ba4994-4ca8-4bb6-a509-483b60dd5008 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.904373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:39.915787 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6772de70-ee1e-4017-b84e-bfa0e2150127 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.234997 May 07 21:56:39.927452 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1504/3058] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:39 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:39.932950 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-56ba4994-4ca8-4bb6-a509-483b60dd5008 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "POST /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b/action" status: 202 len: 0 microversion: 2.1 time: 0.119361 May 07 21:56:39.933939 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1555/3059] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:39 2022] POST /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:56:39.955900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:39.956574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:39.965251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.965874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:39.966709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:39.967231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:40.217943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:40.229508 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-de04934d-20c8-4f2d-8309-65dd5c2c6a24 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1509 microversion: 2.1 time: 0.290577 May 07 21:56:40.230622 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1505/3060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:39 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:40.361536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:40.362263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:40.379195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:40.380020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:40.381057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:40.381685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:40.495472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:40.496464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:40.504273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:40.505080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:40.506079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:40.506832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:40.601550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:40.624437 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-51ac84f9-7372-405c-9c7d-9bf4110b873f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1315 microversion: 2.1 time: 0.261998 May 07 21:56:40.626752 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1556/3061] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:40 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:40.938224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:40.940949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:40.955188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:40.955909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:40.957889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:40.958406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:41.055819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:41.069878 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2c0dc5b-ce74-4fb8-87ae-a13a6c1ab212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1317 microversion: 2.1 time: 0.577813 May 07 21:56:41.071386 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1506/3062] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:40 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:41.249776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:41.251767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:41.264687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:41.265299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:41.266439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:41.268495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:41.291141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:41.303040 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ca1734f-8605-414b-85d6-a7d409a41a7e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1330 microversion: 2.1 time: 0.371772 May 07 21:56:41.306478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1557/3063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:40 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1330 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:41.446215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:41.454353 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2ac1aed5-17fa-41ca-bf80-53e89e549dec tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1514 microversion: 2.1 time: 0.209779 May 07 21:56:41.456265 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1507/3064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:41 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:41.627270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-65b9851f-b738-426e-b919-1d8d768206aa req-a9c79d3f-8c45-4489-b62b-ad081e9eded2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a26f825-fd4b-4599-9f14-85180126af3a", "name": "network-vif-plugged", "status": "completed", "tag": "90921e85-0f48-4254-9e51-5d33766c5e62"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:41.639271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-65b9851f-b738-426e-b919-1d8d768206aa req-a9c79d3f-8c45-4489-b62b-ad081e9eded2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:41.640041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-65b9851f-b738-426e-b919-1d8d768206aa req-a9c79d3f-8c45-4489-b62b-ad081e9eded2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:41.643749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:41.644385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:41.651279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:41.651740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:41.652701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:41.653152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:41.656229 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-65b9851f-b738-426e-b919-1d8d768206aa req-a9c79d3f-8c45-4489-b62b-ad081e9eded2 service nova] Creating event network-vif-plugged:90921e85-0f48-4254-9e51-5d33766c5e62 for instance 5a26f825-fd4b-4599-9f14-85180126af3a on nch2-master-1 May 07 21:56:41.661923 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-65b9851f-b738-426e-b919-1d8d768206aa req-a9c79d3f-8c45-4489-b62b-ad081e9eded2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038790 May 07 21:56:41.666542 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1558/3065] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:41.869049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:41.879311 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-255585f6-a16d-45e6-9773-6df97313b4c5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1315 microversion: 2.1 time: 0.240188 May 07 21:56:41.889935 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1508/3066] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:41 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:42.088702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:42.089389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:42.096204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.096711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.097878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.098369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.256167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:42.270562 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0cd4f8e2-e87d-47ee-b332-4689ee32ed4f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1317 microversion: 2.1 time: 0.187184 May 07 21:56:42.271121 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1559/3067] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:42 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:42.322407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:42.323930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:42.332293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.333091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.334067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.334548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.474161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:42.475200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:42.481931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.482685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.483688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.484335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.504274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:42.513727 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a6e14519-d201-4be6-9a76-ef5576235ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1533 microversion: 2.1 time: 0.195359 May 07 21:56:42.514998 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1509/3068] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:42 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1533 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:42.535648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c16c0d70-17f7-40d0-b3cd-74bc8cbff5a2 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'create', calling method: .version_select at 0x7fc41caded30>, body: {"pool": "9221b764-ef06-431f-8941-796516ed7c3b"} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:42.679309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:42.689205 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1478ca4e-edde-4309-bb1e-1831bde9a246 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1507 microversion: 2.1 time: 0.219926 May 07 21:56:42.689800 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1560/3069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:42 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:42.717402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9ea3162-3a61-4604-a629-c42a7bbfd3cc tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '.version_select at 0x7fc41c443d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:42.718323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9ea3162-3a61-4604-a629-c42a7bbfd3cc tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:42.730550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9ea3162-3a61-4604-a629-c42a7bbfd3cc tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.731802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9ea3162-3a61-4604-a629-c42a7bbfd3cc tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.733787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9ea3162-3a61-4604-a629-c42a7bbfd3cc tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.734216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9ea3162-3a61-4604-a629-c42a7bbfd3cc tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.785899 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9ea3162-3a61-4604-a629-c42a7bbfd3cc tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.075551 May 07 21:56:42.786862 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1561/3070] 10.222.0.32 () {58 vars in 1295 bytes} [Sat May 7 21:56:42 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b/os-instance-actions => generated 611 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:56:42.803487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:42.804004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:42.816822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.818209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.819147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.819628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.851944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:42.951463 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-435ade2c-0845-4a24-836d-3176b6db652d tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 204 len: 0 microversion: 2.1 time: 0.156655 May 07 21:56:42.959146 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1562/3071] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:42 2022] DELETE /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:42.962339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:42.963893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:42.971074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.971467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:42.972173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:42.972623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.131744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:43.147621 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-949ae60a-9b89-4dc7-b671-3c15024a5f33 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1315 microversion: 2.1 time: 0.190385 May 07 21:56:43.151967 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1563/3072] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:42 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:43.165526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:43.166532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:43.176490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.176490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.177607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.183581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.408642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:43.420318 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-20ec743a-3abb-4160-970a-989a55732a70 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1513 microversion: 2.1 time: 0.267042 May 07 21:56:43.430525 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1564/3073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:43 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:43.430525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:43.430525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:43.434544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.435329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.436105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.436496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.617563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:43.628050 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63e201f1-7043-4642-989f-16cb7b36b034 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1467 microversion: 2.1 time: 0.205377 May 07 21:56:43.630822 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1565/3074] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:43 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1467 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:43.651625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a443a863-5d62-4551-aa4e-d74b5b9168e3 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:43.652414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a443a863-5d62-4551-aa4e-d74b5b9168e3 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:43.661410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a443a863-5d62-4551-aa4e-d74b5b9168e3 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.662101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a443a863-5d62-4551-aa4e-d74b5b9168e3 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.663523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a443a863-5d62-4551-aa4e-d74b5b9168e3 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.663950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a443a863-5d62-4551-aa4e-d74b5b9168e3 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.820980 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a443a863-5d62-4551-aa4e-d74b5b9168e3 tempest-ServersOnMultiNodesTest-1649045737 tempest-ServersOnMultiNodesTest-1649045737-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1618 microversion: 2.1 time: 0.177719 May 07 21:56:43.822492 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1566/3075] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:43 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1618 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:43.842519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:43.843083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:43.851634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.852362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.853173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:43.853673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:43.893112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:44.007647 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bfef0597-b036-40bf-a9df-70651f4bcdeb tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 204 len: 0 microversion: 2.1 time: 0.165411 May 07 21:56:44.007647 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1567/3076] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:43 2022] DELETE /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:44.015198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:44.015198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:44.023332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.023799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.024735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.025314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.134264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c16c0d70-17f7-40d0-b3cd-74bc8cbff5a2 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.604110 May 07 21:56:44.136192 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1510/3077] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:56:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:44.149525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.17"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:44.151200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:44.160881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.161370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.162356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.163137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.217305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:44.217448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Acquired lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:56:44.227110 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-446fb9c8-af47-4aa1-a393-ed382ddaa02d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1473 microversion: 2.1 time: 0.217041 May 07 21:56:44.229494 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1568/3078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:44 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1473 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:44.234188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:44.234843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:44.242116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.242539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.244363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.244826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.437575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:44.470602 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1ecf9568-4ffd-4b33-a77d-dd3f8b8be114 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1315 microversion: 2.1 time: 0.240143 May 07 21:56:44.471486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1569/3079] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:44 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:44.477658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:44.478288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:44.488467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.488925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.489764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.490214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.688316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:44.701644 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cc391354-36b1-4f4f-a491-df050af2842b tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1513 microversion: 2.1 time: 0.228967 May 07 21:56:44.713013 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1570/3080] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:44 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:44.719236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6716543b-c7ad-4361-9c06-0a41ddea9e2a req-4712f105-e70f-491c-ad4b-e3883e9de80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff063ae4-e930-4d7e-a587-56a10bb3d88a", "name": "network-vif-plugged", "status": "completed", "tag": "f4677fe5-047a-4e3f-947c-2db958706ccf"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:44.730216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6716543b-c7ad-4361-9c06-0a41ddea9e2a req-4712f105-e70f-491c-ad4b-e3883e9de80e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:44.731082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6716543b-c7ad-4361-9c06-0a41ddea9e2a req-4712f105-e70f-491c-ad4b-e3883e9de80e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:44.754077 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6716543b-c7ad-4361-9c06-0a41ddea9e2a req-4712f105-e70f-491c-ad4b-e3883e9de80e service nova] Creating event network-vif-plugged:f4677fe5-047a-4e3f-947c-2db958706ccf for instance ff063ae4-e930-4d7e-a587-56a10bb3d88a on nch1-master-1 May 07 21:56:44.761353 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6716543b-c7ad-4361-9c06-0a41ddea9e2a req-4712f105-e70f-491c-ad4b-e3883e9de80e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056858 May 07 21:56:44.762539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1571/3081] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:45.246394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:45.247509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:45.253812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:45.254273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:45.255085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:45.255705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:45.428328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:45.436743 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-81440c5c-4fd2-41da-a4b8-4d0f0565bcda tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1473 microversion: 2.1 time: 0.194553 May 07 21:56:45.443704 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1572/3082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:45 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1473 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:45.489615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:45.491039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:45.497745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:45.498166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:45.499637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:45.499879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:45.628896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Building network info cache for instance {{(pid=136681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:56:45.690247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:45.701104 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-23864b91-9962-42fb-96d1-c94cf36c6f48 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1315 microversion: 2.1 time: 0.216707 May 07 21:56:45.703478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1573/3083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:45 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:45.709204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ee2a38f7-edf2-4780-aad9-70f3b5bc0d7f req-049206b7-68e2-45e2-9c1a-8c25126fb0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76df8f5c-4c19-4bba-a009-84627accd050", "tag": "3e3a79b2-c327-437f-8e1f-c48c8ea9c228"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:45.723264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ee2a38f7-edf2-4780-aad9-70f3b5bc0d7f req-049206b7-68e2-45e2-9c1a-8c25126fb0e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:45.723969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ee2a38f7-edf2-4780-aad9-70f3b5bc0d7f req-049206b7-68e2-45e2-9c1a-8c25126fb0e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:45.740834 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ee2a38f7-edf2-4780-aad9-70f3b5bc0d7f req-049206b7-68e2-45e2-9c1a-8c25126fb0e1 service nova] Creating event network-changed:3e3a79b2-c327-437f-8e1f-c48c8ea9c228 for instance 76df8f5c-4c19-4bba-a009-84627accd050 on nch1-master-1 May 07 21:56:45.746912 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ee2a38f7-edf2-4780-aad9-70f3b5bc0d7f req-049206b7-68e2-45e2-9c1a-8c25126fb0e1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041314 May 07 21:56:45.748605 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1574/3084] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:45.754368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:45.755415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:45.767483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:45.768629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:45.770410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:45.771189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:46.452835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:46.462012 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7fb18e9d-e2ae-4d58-9857-861b3a1e81df tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1513 microversion: 2.1 time: 0.711507 May 07 21:56:46.475203 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1575/3085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:45 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1513 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:46.487907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:46.488533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:46.509626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:46.509893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:46.510540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:46.511016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:46.916482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:46.925509 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a97dda4-c30d-4806-aa91-06874b8626dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1473 microversion: 2.1 time: 0.441920 May 07 21:56:46.926405 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1576/3086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:46 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:46.939168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:46.941156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:46.952793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:46.955864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:46.967988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:46.968812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:47.136683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Updating instance_info_cache with network_info: [{"id": "3e3a79b2-c327-437f-8e1f-c48c8ea9c228", "address": "fa:16:3e:41:85:3c", "network": {"id": "cad67ef4-7464-41a3-89b9-99b9a8d2dcdb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-333244832-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bdb8a8a58b5b4b9b95ac9d6a782df6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e3a79b2-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:56:47.161236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Releasing lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:56:47.169578 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-37f99b52-681f-4050-8a1b-0babfce3aa87 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action" status: 202 len: 0 microversion: 2.1 time: 3.025447 May 07 21:56:47.171984 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1511/3087] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:44 2022] POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action => generated 0 bytes in 3029 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:56:47.183718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5d53e67a-878a-4e66-9940-3227c0bbcbb2 req-36e1d856-1a80-4875-8619-9ca0fbc1d75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a26f825-fd4b-4599-9f14-85180126af3a", "name": "network-vif-deleted", "tag": "90921e85-0f48-4254-9e51-5d33766c5e62"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:47.208402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5d53e67a-878a-4e66-9940-3227c0bbcbb2 req-36e1d856-1a80-4875-8619-9ca0fbc1d75e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:47.209290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5d53e67a-878a-4e66-9940-3227c0bbcbb2 req-36e1d856-1a80-4875-8619-9ca0fbc1d75e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:47.230037 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5d53e67a-878a-4e66-9940-3227c0bbcbb2 req-36e1d856-1a80-4875-8619-9ca0fbc1d75e service nova] Creating event network-vif-deleted:90921e85-0f48-4254-9e51-5d33766c5e62 for instance 5a26f825-fd4b-4599-9f14-85180126af3a on nch2-master-1 May 07 21:56:47.239201 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5d53e67a-878a-4e66-9940-3227c0bbcbb2 req-36e1d856-1a80-4875-8619-9ca0fbc1d75e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064144 May 07 21:56:47.242423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1512/3088] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:47.278054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ef065435-ff1c-412d-86e1-4f58dea57ecd tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'create', calling method: .version_select at 0x7fc41cc18160>, body: {"pool": "9221b764-ef06-431f-8941-796516ed7c3b"} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:47.475426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:47.486195 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-26f19d9b-c53e-48b4-b92c-7ffdc587ba7f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1502 microversion: 2.1 time: 0.553099 May 07 21:56:47.487103 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1577/3089] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:46 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1502 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:47.491938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:47.499621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:47.514699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:47.515474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:47.516761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:47.517968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:47.556076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:47.556703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:47.557337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lazy-loading 'fault' on Instance uuid b3f598bc-bd2c-4610-90f9-724d5cb1619b {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:56:47.725005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2574be3d704f4f46942a5cfa852ff392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a017d4c58fe640c5bf85d1d055b3da11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:47.737421 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e773a868-6f23-4b33-bf0d-825c0cac1e6c tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 200 len: 1307 microversion: 2.1 time: 0.248084 May 07 21:56:47.738696 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1578/3090] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:47 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:47.750709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7fd60c17-c7b2-444f-b481-1568c75d728d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:47.753402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7fd60c17-c7b2-444f-b481-1568c75d728d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:47.764978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fd60c17-c7b2-444f-b481-1568c75d728d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:47.765745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fd60c17-c7b2-444f-b481-1568c75d728d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:47.767563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fd60c17-c7b2-444f-b481-1568c75d728d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:47.773946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fd60c17-c7b2-444f-b481-1568c75d728d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:47.962078 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7fd60c17-c7b2-444f-b481-1568c75d728d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a/action" status: 202 len: 0 microversion: 2.1 time: 0.221127 May 07 21:56:47.964780 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1579/3091] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:47 2022] POST /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:56:47.975667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7910460c-5ffe-430b-88f1-99936e2a5cee req-b809130c-1ca9-45f1-ac07-3d43728c8c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3f598bc-bd2c-4610-90f9-724d5cb1619b", "name": "network-vif-deleted", "tag": "7c89cdcf-6e2d-43ca-bd9c-a9cd5b8613e4"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:47.988850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7910460c-5ffe-430b-88f1-99936e2a5cee req-b809130c-1ca9-45f1-ac07-3d43728c8c92 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:47.989799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7910460c-5ffe-430b-88f1-99936e2a5cee req-b809130c-1ca9-45f1-ac07-3d43728c8c92 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.013509 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7910460c-5ffe-430b-88f1-99936e2a5cee req-b809130c-1ca9-45f1-ac07-3d43728c8c92 service nova] Creating event network-vif-deleted:7c89cdcf-6e2d-43ca-bd9c-a9cd5b8613e4 for instance b3f598bc-bd2c-4610-90f9-724d5cb1619b on nch2-master-1 May 07 21:56:48.023130 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7910460c-5ffe-430b-88f1-99936e2a5cee req-b809130c-1ca9-45f1-ac07-3d43728c8c92 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055329 May 07 21:56:48.027307 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1580/3092] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:48.044909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:48.050412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:48.071395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.072107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.073200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.073791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.112145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.112936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.113558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lazy-loading 'fault' on Instance uuid 5a26f825-fd4b-4599-9f14-85180126af3a {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:56:48.177207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:48.188273 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e77c2c0b-fba8-4a89-b1d5-dd8640ae74dd tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 200 len: 1307 microversion: 2.1 time: 0.157478 May 07 21:56:48.191693 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1581/3093] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:48 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:48.221917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:48.222545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:48.237307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.237901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.245375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.247475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.442098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:48.450100 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3be3048a-0fdc-4d2f-a369-0c20fd0b0ba3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1487 microversion: 2.1 time: 0.257329 May 07 21:56:48.451069 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1582/3094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:48 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1487 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:48.471234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:48.471690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:48.478206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.478816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.479738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.480269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.509180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:48.607623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9450cf12-6856-45b7-98af-18c4273d9a59 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 204 len: 0 microversion: 2.1 time: 0.140648 May 07 21:56:48.609280 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1583/3095] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:48 2022] DELETE /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:48.625985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:48.627064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:48.634659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.635422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.636366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.636789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.807092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:48.821645 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb879cd2-cb69-4e51-80b7-f1bfc6923ddd tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1493 microversion: 2.1 time: 0.205352 May 07 21:56:48.822251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1584/3096] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:48 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1493 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:48.827385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:48.828015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] [instance: b3f598bc-bd2c-4610-90f9-724d5cb1619b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:48.836409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.836982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.837902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.838509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.855165 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] HTTP exception thrown: Instance b3f598bc-bd2c-4610-90f9-724d5cb1619b could not be found. May 07 21:56:48.855851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] Returning 404 to user: Instance b3f598bc-bd2c-4610-90f9-724d5cb1619b could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:48.857222 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5db057fd-7968-4ed6-8f36-bb55c1746fb4 tempest-InstanceActionsTestJSON-889233102 tempest-InstanceActionsTestJSON-889233102-project] 10.222.0.32 "GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b" status: 404 len: 111 microversion: 2.1 time: 0.033512 May 07 21:56:48.857975 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1585/3097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:48 2022] GET /compute/v2.1/servers/b3f598bc-bd2c-4610-90f9-724d5cb1619b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:48.863320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a82bc20-da9f-4d55-be89-b4eeaa251026 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:48.864093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7a82bc20-da9f-4d55-be89-b4eeaa251026 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:48.870475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a82bc20-da9f-4d55-be89-b4eeaa251026 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.871114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a82bc20-da9f-4d55-be89-b4eeaa251026 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.871971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a82bc20-da9f-4d55-be89-b4eeaa251026 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:48.872577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a82bc20-da9f-4d55-be89-b4eeaa251026 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:48.913496 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a82bc20-da9f-4d55-be89-b4eeaa251026 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments/8544d5aa-b3ac-47bc-9200-f41820a8209c" status: 200 len: 194 microversion: 2.20 time: 0.054241 May 07 21:56:48.914421 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1586/3098] 10.222.0.32 () {60 vars in 1453 bytes} [Sat May 7 21:56:48 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments/8544d5aa-b3ac-47bc-9200-f41820a8209c => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:56:48.999041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:48.999630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:49.006427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.007243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.008471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.009376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.116750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lazy-loading 'services' on Instance uuid cc6a642e-763c-4ac9-8ef7-4985bcb86060 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:56:49.131497 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ef065435-ff1c-412d-86e1-4f58dea57ecd tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.871425 May 07 21:56:49.132263 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1513/3099] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:56:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:49.144584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.246"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:49.146336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:49.164078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.164872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.165668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.166108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.201403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Acquired lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:56:49.236143 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e00d1740-2d21-49de-8368-c625e85b89f0 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments/8544d5aa-b3ac-47bc-9200-f41820a8209c" status: 202 len: 0 microversion: 2.20 time: 0.240831 May 07 21:56:49.240767 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1587/3100] 10.222.0.32 () {60 vars in 1456 bytes} [Sat May 7 21:56:48 2022] DELETE /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments/8544d5aa-b3ac-47bc-9200-f41820a8209c => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 07 21:56:49.246856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:49.247768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 5a26f825-fd4b-4599-9f14-85180126af3a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:49.255376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.256082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.257304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.258012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.275280 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance 5a26f825-fd4b-4599-9f14-85180126af3a could not be found. May 07 21:56:49.276128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance 5a26f825-fd4b-4599-9f14-85180126af3a could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:49.277193 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0da5bf5d-12ab-4768-84ca-bba8cb388500 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a" status: 404 len: 111 microversion: 2.1 time: 0.035239 May 07 21:56:49.278178 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1588/3101] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:49 2022] GET /compute/v2.1/servers/5a26f825-fd4b-4599-9f14-85180126af3a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:49.288755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e274f533-233b-4e74-8c23-ac059333b890 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:49.290287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e274f533-233b-4e74-8c23-ac059333b890 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:49.296879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e274f533-233b-4e74-8c23-ac059333b890 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.297587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e274f533-233b-4e74-8c23-ac059333b890 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.299175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e274f533-233b-4e74-8c23-ac059333b890 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.300018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e274f533-233b-4e74-8c23-ac059333b890 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.342221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e274f533-233b-4e74-8c23-ac059333b890 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059407 May 07 21:56:49.343011 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1589/3102] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:56:49 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:56:49.353071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:49.353768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:49.361300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.362201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.363175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.363957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.394298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:49.481857 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2299435e-1ed7-4409-ad45-fcff398d7512 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 204 len: 0 microversion: 2.1 time: 0.132695 May 07 21:56:49.482675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1590/3103] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:49 2022] DELETE /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:49.492725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:49.493529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:49.499721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.500487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.501502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.502027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.675390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:49.686036 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a56be869-8d9e-4bd8-bfdf-faa0e3826b65 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1472 microversion: 2.1 time: 0.197574 May 07 21:56:49.687349 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1591/3104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:49 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:49.819205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.246 (74802e0e-433b-432d-b76a-f94358b7cf74) with port 3e3a79b2-c327-437f-8e1f-c48c8ea9c228 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9221b764-ef06-431f-8941-796516ed7c3b.", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:56:49.819916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Releasing lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:56:49.820613 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.246 (74802e0e-433b-432d-b76a-f94358b7cf74) with port 3e3a79b2-c327-437f-8e1f-c48c8ea9c228 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9221b764-ef06-431f-8941-796516ed7c3b. May 07 21:56:49.820613 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-da50c0d7-cd28-451d-8c4e-24a50c613ae0'] May 07 21:56:49.821527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Returning 400 to user: Cannot associate floating IP 172.35.4.246 (74802e0e-433b-432d-b76a-f94358b7cf74) with port 3e3a79b2-c327-437f-8e1f-c48c8ea9c228 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 9221b764-ef06-431f-8941-796516ed7c3b. May 07 21:56:49.821527 ncdv-master-1 devstack@n-api.service[136681]: Neutron server returns request_ids: ['req-da50c0d7-cd28-451d-8c4e-24a50c613ae0'] {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:49.822551 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-69a4e98f-b93d-4963-bc55-7d2d3eb7d0fa tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action" status: 400 len: 381 microversion: 2.1 time: 0.683522 May 07 21:56:49.827177 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1514/3105] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:49 2022] POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action => generated 381 bytes in 686 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 07 21:56:49.832603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a950e173-f4b5-4b42-b7cd-fa64024410e2 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '.version_select at 0x7fc41c3ee310>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:49.840248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:49.840818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:49.848566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.849028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:49.850172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:49.850881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.027907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:50.041323 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29e2aa93-1232-4ea9-b894-1911082b210d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1493 microversion: 2.1 time: 0.205622 May 07 21:56:50.044527 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1515/3106] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:49 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:50.355796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66bb9bf4-5464-46ac-835e-f97ea1bbd2ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:50.357688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-66bb9bf4-5464-46ac-835e-f97ea1bbd2ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:50.365645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66bb9bf4-5464-46ac-835e-f97ea1bbd2ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.367109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66bb9bf4-5464-46ac-835e-f97ea1bbd2ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.368155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66bb9bf4-5464-46ac-835e-f97ea1bbd2ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.368797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66bb9bf4-5464-46ac-835e-f97ea1bbd2ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.402053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66bb9bf4-5464-46ac-835e-f97ea1bbd2ad tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050600 May 07 21:56:50.402903 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1516/3107] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:56:50 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:56:50.504482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:50.505259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:50.516510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.518973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.521424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.522104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.552546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:50.666149 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ef260775-ce6c-4f1e-86bc-68e08bb1325a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 204 len: 0 microversion: 2.20 time: 0.165264 May 07 21:56:50.670063 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1517/3108] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:56:50 2022] DELETE /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:56:50.677713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:50.678435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:50.686333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.686923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.687969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.688779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.849523 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a950e173-f4b5-4b42-b7cd-fa64024410e2 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/74802e0e-433b-432d-b76a-f94358b7cf74" status: 202 len: 0 microversion: 2.1 time: 1.021414 May 07 21:56:50.851229 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1592/3109] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:56:49 2022] DELETE /compute/v2.1/os-floating-ips/74802e0e-433b-432d-b76a-f94358b7cf74 => generated 0 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:56:50.856312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:50.857227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:50.865340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.865814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.866622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:50.867133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:50.895569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:50.905749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:50.908284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:50.910076 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85cf9676-189a-464e-a302-c81d4db96c7e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.237512 May 07 21:56:50.910998 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1518/3110] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:50 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:50.928499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.17"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:51.046297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:51.054543 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5462763-e5c9-4084-b3ae-02799c06cb71 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1472 microversion: 2.1 time: 0.202074 May 07 21:56:51.059060 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1593/3111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:50 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1472 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:51.069490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:51.070334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:51.076043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:51.076550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:51.077095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:51.077948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:51.078640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:51.085327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:51.085990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:51.087003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:51.087462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:51.252416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:51.261389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f91ca696-c46a-4465-8bed-53aa24a8734a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1493 microversion: 2.1 time: 0.200423 May 07 21:56:51.274746 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1594/3112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:51 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1493 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:51.441318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Acquired lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:56:51.929990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:51.930608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:51.956806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:51.957373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:51.958656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:51.961130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:52.413050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:52.422958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:52.424498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:52.429607 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9d10596d-5b75-46e8-8b8c-1f041225582f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.504059 May 07 21:56:52.432526 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1595/3113] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:51 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:56:52.448928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:52.449804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:52.451590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Building network info cache for instance {{(pid=136681) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 07 21:56:52.462033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:52.462959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:52.464614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:52.466122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:52.621933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:52.635935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-256cf978-1ef0-4780-bf89-28337574d704 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1430 microversion: 2.1 time: 0.200871 May 07 21:56:52.636545 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1596/3114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:52 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1430 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:52.663368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:52.664082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:52.693841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:52.694206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:52.695052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:52.695496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.018865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Updating instance_info_cache with network_info: [{"id": "3e3a79b2-c327-437f-8e1f-c48c8ea9c228", "address": "fa:16:3e:41:85:3c", "network": {"id": "cad67ef4-7464-41a3-89b9-99b9a8d2dcdb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-333244832-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "bdb8a8a58b5b4b9b95ac9d6a782df6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e3a79b2-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136681) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:56:54.038484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Releasing lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:56:54.039494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61544f2c-3ec1-4c84-b8af-a6203c988261 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action" status: 202 len: 0 microversion: 2.1 time: 3.117141 May 07 21:56:54.040174 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1519/3115] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:50 2022] POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action => generated 0 bytes in 3129 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 07 21:56:54.051157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ef3bc2d6-9851-4eb2-b49d-6640c7b97e4e req-b94e00d0-18be-480f-8bfe-8dbadf4b7f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76df8f5c-4c19-4bba-a009-84627accd050", "tag": "3e3a79b2-c327-437f-8e1f-c48c8ea9c228"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:54.059928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:54.067835 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9681cf23-38fc-42c9-a112-0631b3b59ed1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 200 len: 1285 microversion: 2.1 time: 1.419590 May 07 21:56:54.068410 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1597/3116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:52 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 1285 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:54.070123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ef3bc2d6-9851-4eb2-b49d-6640c7b97e4e req-b94e00d0-18be-480f-8bfe-8dbadf4b7f93 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:54.070808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ef3bc2d6-9851-4eb2-b49d-6640c7b97e4e req-b94e00d0-18be-480f-8bfe-8dbadf4b7f93 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.080795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e6d28fd6-4fd8-434f-b82b-7f747d36d470 req-27201400-2e3f-485e-bb5e-c1c6a36955d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff063ae4-e930-4d7e-a587-56a10bb3d88a", "name": "network-vif-deleted", "tag": "f4677fe5-047a-4e3f-947c-2db958706ccf"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:54.092733 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ef3bc2d6-9851-4eb2-b49d-6640c7b97e4e req-b94e00d0-18be-480f-8bfe-8dbadf4b7f93 service nova] Creating event network-changed:3e3a79b2-c327-437f-8e1f-c48c8ea9c228 for instance 76df8f5c-4c19-4bba-a009-84627accd050 on nch1-master-1 May 07 21:56:54.099261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e6d28fd6-4fd8-434f-b82b-7f747d36d470 req-27201400-2e3f-485e-bb5e-c1c6a36955d8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:54.100037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e6d28fd6-4fd8-434f-b82b-7f747d36d470 req-27201400-2e3f-485e-bb5e-c1c6a36955d8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.103285 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ef3bc2d6-9851-4eb2-b49d-6640c7b97e4e req-b94e00d0-18be-480f-8bfe-8dbadf4b7f93 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061651 May 07 21:56:54.104060 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1520/3117] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:54.111765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:54.113526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:54.121932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:54.122618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.124236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:54.124833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.134074 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e6d28fd6-4fd8-434f-b82b-7f747d36d470 req-27201400-2e3f-485e-bb5e-c1c6a36955d8 service nova] Creating event network-vif-deleted:f4677fe5-047a-4e3f-947c-2db958706ccf for instance ff063ae4-e930-4d7e-a587-56a10bb3d88a on nch1-master-1 May 07 21:56:54.144439 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e6d28fd6-4fd8-434f-b82b-7f747d36d470 req-27201400-2e3f-485e-bb5e-c1c6a36955d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072371 May 07 21:56:54.145483 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1598/3118] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:54.155826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:54.156545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:54.170543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:54.171041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.176613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:54.177325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.279554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:54.283434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:54.284538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lazy-loading 'fault' on Instance uuid 667146df-e986-4daa-bcba-4c5482efbad0 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:56:54.406910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:54.422026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:54.430175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:54.433582 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2fc18554-0ac1-4ba3-97aa-afd121d22870 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1725 microversion: 2.20 time: 0.325976 May 07 21:56:54.434440 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1521/3119] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:54 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1725 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:54.445030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12af0b8f-c0d4-4cb0-823e-9154035a4840 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '.version_select at 0x7fc41caae700>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:54.464335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:54.481762 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9002adf8-b31d-4fe1-9895-2493c2f44846 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 200 len: 1307 microversion: 2.1 time: 0.334995 May 07 21:56:54.483785 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1599/3120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:54 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 1307 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:55.088741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:55.090277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:55.104291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:55.105262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:55.107738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:55.108445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:55.139224 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance ff063ae4-e930-4d7e-a587-56a10bb3d88a could not be found. May 07 21:56:55.143547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance ff063ae4-e930-4d7e-a587-56a10bb3d88a could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:55.145851 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ac2e85f-140e-45e4-9fee-89b95a33dec2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 404 len: 111 microversion: 2.1 time: 0.064840 May 07 21:56:55.149260 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1600/3121] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:55 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:55.404625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1607698877", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "9b7653d0-c69e-4364-9ed6-1c005b136d81"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:55.513837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] validate_networks() for [('9b7653d0-c69e-4364-9ed6-1c005b136d81', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:56:55.829830 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12af0b8f-c0d4-4cb0-823e-9154035a4840 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/b0a94b86-8ce6-489b-bba6-8de3d8c045ff" status: 202 len: 0 microversion: 2.1 time: 1.393099 May 07 21:56:55.831482 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1522/3122] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:56:54 2022] DELETE /compute/v2.1/os-floating-ips/b0a94b86-8ce6-489b-bba6-8de3d8c045ff => generated 0 bytes in 1396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:56:55.836879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:55.837730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:55.863481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:55.863968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:55.865886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:55.873547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:55.965829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:55.966293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:55.966762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lazy-loading 'fault' on Instance uuid cc6a642e-763c-4ac9-8ef7-4985bcb86060 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:56:56.041372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:56.055468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:56.057271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:56.058747 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e6a8b48-8b06-4979-ba6a-bde80ac78167 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 200 len: 1371 microversion: 2.20 time: 0.226012 May 07 21:56:56.069403 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1523/3123] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:55 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:56:56.075606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:56.076363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 667146df-e986-4daa-bcba-4c5482efbad0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:56.084444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.084901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.085865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.086316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.102663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance 667146df-e986-4daa-bcba-4c5482efbad0 could not be found. May 07 21:56:56.103324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance 667146df-e986-4daa-bcba-4c5482efbad0 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:56.105247 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd9bd5c6-98a2-4d01-ace3-fb287e172010 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0" status: 404 len: 111 microversion: 2.1 time: 0.033570 May 07 21:56:56.105937 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1524/3124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:56 2022] GET /compute/v2.1/servers/667146df-e986-4daa-bcba-4c5482efbad0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:56:56.114233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96d9fe6e-01b0-4a6f-84c2-13c1f3e97033 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:56.116316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96d9fe6e-01b0-4a6f-84c2-13c1f3e97033 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:56.118586 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96d9fe6e-01b0-4a6f-84c2-13c1f3e97033 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action" status: 400 len: 142 microversion: 2.1 time: 0.010108 May 07 21:56:56.119839 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1525/3125] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:56 2022] POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action => generated 142 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:56:56.125754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:56.126496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:56.133653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.134128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.134945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.135394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.164345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:56.267417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:56:56.268444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:56:56.269079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:56:56.270047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:56:56.270615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:56:56.289434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.289896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.290725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.291217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.300602 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15b9c096-3e97-4f7e-a320-77b4cafc553f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 204 len: 0 microversion: 2.1 time: 0.178376 May 07 21:56:56.301875 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1526/3126] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:56 2022] DELETE /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:56.310325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:56.312138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:56.316111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:56.322575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for user 228761ebf4c0406ab0977cabe351ac76 and project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:56.323299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.324852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.325990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.327125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.339671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:56:56.342654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:56:56.363978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Acquired lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 07 21:56:56.408332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce77c236-37ff-436f-bbae-de632cfbde0f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008836 May 07 21:56:56.409530 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1601/3127] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:56:56.418394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-919c38f7-7a2c-4d0e-a522-82ab47fb1db2 req-2ce67c78-bd6a-44d5-8181-33a8141fbc6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "667146df-e986-4daa-bcba-4c5482efbad0", "name": "network-vif-deleted", "tag": "efdbc27d-d662-4524-a972-4ae143b5530b"}, {"server_uuid": "cc6a642e-763c-4ac9-8ef7-4985bcb86060", "name": "network-vif-deleted", "tag": "1cef223b-c375-473f-8214-891abfa6fa86"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:56.431325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-919c38f7-7a2c-4d0e-a522-82ab47fb1db2 req-2ce67c78-bd6a-44d5-8181-33a8141fbc6e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.432278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-919c38f7-7a2c-4d0e-a522-82ab47fb1db2 req-2ce67c78-bd6a-44d5-8181-33a8141fbc6e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.449495 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-919c38f7-7a2c-4d0e-a522-82ab47fb1db2 req-2ce67c78-bd6a-44d5-8181-33a8141fbc6e service nova] Creating event network-vif-deleted:efdbc27d-d662-4524-a972-4ae143b5530b for instance 667146df-e986-4daa-bcba-4c5482efbad0 on nch1-master-1 May 07 21:56:56.450443 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-919c38f7-7a2c-4d0e-a522-82ab47fb1db2 req-2ce67c78-bd6a-44d5-8181-33a8141fbc6e service nova] Creating event network-vif-deleted:1cef223b-c375-473f-8214-891abfa6fa86 for instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 on nch2-master-1 May 07 21:56:56.480378 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-919c38f7-7a2c-4d0e-a522-82ab47fb1db2 req-2ce67c78-bd6a-44d5-8181-33a8141fbc6e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069251 May 07 21:56:56.482018 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1602/3128] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:56:56.488806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:56.489516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:56.498758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.500038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.501631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.502442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.573526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Releasing lock "refresh_cache-76df8f5c-4c19-4bba-a009-84627accd050" {{(pid=136681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 07 21:56:56.574003 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] HTTP exception thrown: floating IP not found May 07 21:56:56.574903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Returning 404 to user: floating IP not found {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:56.575983 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-210917dd-c53e-4276-bd98-159663340997 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action" status: 404 len: 67 microversion: 2.1 time: 0.272839 May 07 21:56:56.581636 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1527/3129] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:56 2022] POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action => generated 67 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:56:56.587066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85957755-01a4-49ec-934d-84828fd6293e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:56.587694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-85957755-01a4-49ec-934d-84828fd6293e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:56.702904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85957755-01a4-49ec-934d-84828fd6293e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:56.714801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85957755-01a4-49ec-934d-84828fd6293e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1215 microversion: 2.1 time: 0.132035 May 07 21:56:56.716291 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1528/3130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:56 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:56.723421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06655e42-e5a1-43ad-b3ec-c391df549c9e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:56.767695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:56.781574 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e7d40ce-b26c-4419-a1f9-10e844e094de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1472 microversion: 2.1 time: 0.298282 May 07 21:56:56.785283 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1603/3131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:56 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:56.878452 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-06655e42-e5a1-43ad-b3ec-c391df549c9e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 07 21:56:56.880265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06655e42-e5a1-43ad-b3ec-c391df549c9e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:56.881862 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06655e42-e5a1-43ad-b3ec-c391df549c9e tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action" status: 404 len: 88 microversion: 2.1 time: 0.164108 May 07 21:56:56.883423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1529/3132] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:56:56 2022] POST /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050/action => generated 88 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 21:56:56.893973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:56.895099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:56.901492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.902206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.903245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:56.904547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:56.935330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:56:57.064078 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69956352-b7de-44e8-a2c7-28cacd75ecf7 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "DELETE /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 204 len: 0 microversion: 2.1 time: 0.174500 May 07 21:56:57.064693 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1604/3133] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:56:56 2022] DELETE /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:56:57.074593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:57.075628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:57.080613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:57.081486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:57.091803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.092279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.095128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.095309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.095595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.096122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.096387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.096836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.136730 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] HTTP exception thrown: Instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 could not be found. May 07 21:56:57.142543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Returning 404 to user: Instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:56:57.142543 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ffffcbb-cc18-40ec-bfc4-b53ee0e374ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 404 len: 111 microversion: 2.20 time: 0.066592 May 07 21:56:57.156736 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1605/3134] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:56:57 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:56:57.162574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c146b9d2-1d2d-461a-a856-15737e615f48 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '.version_select at 0x7fc41c3ddaf0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:57.213877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c146b9d2-1d2d-461a-a856-15737e615f48 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447216086" status: 204 len: 0 microversion: 2.20 time: 0.054359 May 07 21:56:57.219020 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1606/3135] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:56:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447216086 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:56:57.361726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:57.372842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2c731a8-fca6-468d-bc21-c401d1f23789 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1539 microversion: 2.1 time: 0.303540 May 07 21:56:57.393595 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1530/3136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:57 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1539 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:57.734131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:57.735384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:57.743194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.743653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.746938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.747407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.802452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:57.803539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:57.825617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.827207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.831195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:57.832420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:57.934211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:57.952065 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-092932f4-84e9-41ec-9aba-a5207c366c52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1267 microversion: 2.1 time: 0.222749 May 07 21:56:57.965627 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1607/3137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:57 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:58.122692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:58.133320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-574aa438-571f-40ed-9bb0-62a27a12b0c9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1472 microversion: 2.1 time: 0.336145 May 07 21:56:58.138869 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1531/3138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:57 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1472 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:58.333588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-219d1882-6ae1-4b4f-bb08-b7d93c2d07ca tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'create', calling method: .version_select at 0x7fc41d85d8b0>, body: {"keypair": {"name": "tempest-keypair-1499389669"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:56:58.354618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-219d1882-6ae1-4b4f-bb08-b7d93c2d07ca tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:58.361865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-219d1882-6ae1-4b4f-bb08-b7d93c2d07ca tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for user bdc18dc6c5214fbb9c1fa61eeb514cc9 and project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:58.401178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:58.401820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:58.414391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:58.415205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:58.416250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:58.416879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:58.629356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:58.639316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f6fbd1cd-b308-44dc-b6e9-8536be39292f tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1539 microversion: 2.1 time: 0.241968 May 07 21:56:58.640319 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1532/3139] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:58 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:58.722620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-219d1882-6ae1-4b4f-bb08-b7d93c2d07ca tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:56:58.729171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-219d1882-6ae1-4b4f-bb08-b7d93c2d07ca tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for user bdc18dc6c5214fbb9c1fa61eeb514cc9 and project 93c3c71171814bb7b1018904086ad506. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:56:58.753978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-219d1882-6ae1-4b4f-bb08-b7d93c2d07ca tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.426165 May 07 21:56:58.755614 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1608/3140] 10.222.0.32 () {62 vars in 1198 bytes} [Sat May 7 21:56:58 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 429 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 07 21:56:58.978981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:58.979816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:58.991802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:58.992457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:58.993927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:58.994764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:59.072913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:59.081993 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2ea910f9-be2b-472a-8c5c-160eaccff83c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1273 microversion: 2.1 time: 0.116279 May 07 21:56:59.092045 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1533/3141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:58 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:59.154020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:59.155176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:59.164296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:59.164960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:59.166258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:59.167599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:59.662756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:56:59.664482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:56:59.680778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:59.681759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:59.685220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:56:59.685703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:56:59.947614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:59.954217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:56:59.956804 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f387e70-6c72-44e5-828b-a253e17432fc tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1539 microversion: 2.1 time: 0.303834 May 07 21:56:59.957398 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1534/3142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:59 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:56:59.970443 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6dd20c6a-b451-4957-b8d6-df2bf65b517a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1472 microversion: 2.1 time: 0.823038 May 07 21:56:59.971071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1609/3143] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:56:59 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1472 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:00.101726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:00.102962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:00.113187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:00.114124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:00.116093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:00.117282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:00.599179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:00.612951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-258f92df-b663-42c3-8220-604ebaac8b52 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.512064 May 07 21:57:00.613641 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1535/3144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:00 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:00.757148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-079076b0-3c99-46ae-9f96-b94c2eb573d1 req-4389c3e1-01bf-4c2e-bd60-c68f8a3f5137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1", "name": "network-vif-deleted", "tag": "0f996493-44aa-49b3-bebb-f6248f93ca91"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:00.800920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-079076b0-3c99-46ae-9f96-b94c2eb573d1 req-4389c3e1-01bf-4c2e-bd60-c68f8a3f5137 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:00.802961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-079076b0-3c99-46ae-9f96-b94c2eb573d1 req-4389c3e1-01bf-4c2e-bd60-c68f8a3f5137 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:00.880626 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-079076b0-3c99-46ae-9f96-b94c2eb573d1 req-4389c3e1-01bf-4c2e-bd60-c68f8a3f5137 service nova] Creating event network-vif-deleted:0f996493-44aa-49b3-bebb-f6248f93ca91 for instance 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 on nch1-master-1 May 07 21:57:00.929040 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-079076b0-3c99-46ae-9f96-b94c2eb573d1 req-4389c3e1-01bf-4c2e-bd60-c68f8a3f5137 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179249 May 07 21:57:00.929669 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1610/3145] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:00.975254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:00.976204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:00.985810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:00.988887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:00.989635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:00.996968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:00.997312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:01.000300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:01.001023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:01.011318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:01.012319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:01.012586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:01.165720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:01.180225 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2793fcc1-727a-4a30-b0a4-441b9ac1e4d9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 200 len: 1302 microversion: 2.1 time: 0.195936 May 07 21:57:01.183737 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1611/3146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:00 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 1302 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:01.255221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c615ca825f6488fbdddff03a048b94b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:01.266380 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9772653f-7c30-4fbc-9a1e-0e99cae6749a tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 200 len: 1315 microversion: 2.1 time: 0.296641 May 07 21:57:01.269015 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1536/3147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:00 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:01.634074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:01.637993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:01.664391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:01.666637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:01.669373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:01.671258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.078185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:02.091538 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e3f9316-3597-493e-a9ba-3bd1e6c74ffc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.461442 May 07 21:57:02.092257 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1612/3148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:01 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:02.122715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1803047219", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "772be29c-bb44-46ae-a3e0-b0a78574bddf"}], "security_groups": [{"name": "tempest-securitygroup--1881085847"}], "key_name": "tempest-keypair-1499389669", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:02.207001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:02.208864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:02.228461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.229164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.230271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.230981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.249715 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 could not be found. May 07 21:57:02.250485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance 2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:02.251833 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14a3b9ed-f4b5-49be-bcc0-3daf27dfa12c tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1" status: 404 len: 111 microversion: 2.1 time: 0.054450 May 07 21:57:02.256396 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1613/3149] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:02 2022] GET /compute/v2.1/servers/2ed200e0-4fc4-4929-a2dc-0b5c7bfefec1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:02.262711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:02.263555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:02.274431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.275250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.276571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.277027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.313389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:57:02.329951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] validate_networks() for [('772be29c-bb44-46ae-a3e0-b0a78574bddf', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:57:02.482477 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-30e2e44b-1698-4bb9-8c3c-7baf31b2d41a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 204 len: 0 microversion: 2.1 time: 0.222060 May 07 21:57:02.483554 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1614/3150] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:57:02 2022] DELETE /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:02.493101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:02.494076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] [instance: 76df8f5c-4c19-4bba-a009-84627accd050] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:02.501675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.502422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.503386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.503833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.526292 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] HTTP exception thrown: Instance 76df8f5c-4c19-4bba-a009-84627accd050 could not be found. May 07 21:57:02.527842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] Returning 404 to user: Instance 76df8f5c-4c19-4bba-a009-84627accd050 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:02.529078 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1f55f7f-47db-46a7-9e1a-d5f5d724e970 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376 tempest-FloatingIPsAssociationNegativeTestJSON-1675888376-project] 10.222.0.32 "GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050" status: 404 len: 111 microversion: 2.1 time: 0.040942 May 07 21:57:02.529821 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1615/3151] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:02 2022] GET /compute/v2.1/servers/76df8f5c-4c19-4bba-a009-84627accd050 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:02.535558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:02.536292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:02.542904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.543778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.544760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.545394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.580381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:57:02.691866 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c5b1a8b-5cf9-4c61-a209-db216f26345b tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 204 len: 0 microversion: 2.1 time: 0.160035 May 07 21:57:02.693797 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1616/3152] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:57:02 2022] DELETE /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:02.704958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:02.706458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:02.713606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.714551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.715775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:02.716598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:02.979711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:02.993292 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6381a735-beab-455a-8d57-d6769c90b571 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 200 len: 1473 microversion: 2.1 time: 0.294095 May 07 21:57:02.997193 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1617/3153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:02 2022] GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 1473 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:03.009851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-38a9b26e-6e92-4990-93c9-b0f1ff504a1e req-bde0a0d7-59cb-4f84-8de4-5a7a387ff3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76df8f5c-4c19-4bba-a009-84627accd050", "name": "network-vif-deleted", "tag": "3e3a79b2-c327-437f-8e1f-c48c8ea9c228"}, {"name": "network-changed", "server_uuid": "76fb1f24-8416-4b15-b95f-ec086bc7ee8b", "tag": "0018a0ea-3b54-48b4-be4c-da78c12b4100"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:03.026305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-38a9b26e-6e92-4990-93c9-b0f1ff504a1e req-bde0a0d7-59cb-4f84-8de4-5a7a387ff3ec service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:03.027134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-38a9b26e-6e92-4990-93c9-b0f1ff504a1e req-bde0a0d7-59cb-4f84-8de4-5a7a387ff3ec service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:03.049773 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-38a9b26e-6e92-4990-93c9-b0f1ff504a1e req-bde0a0d7-59cb-4f84-8de4-5a7a387ff3ec service nova] Creating event network-vif-deleted:3e3a79b2-c327-437f-8e1f-c48c8ea9c228 for instance 76df8f5c-4c19-4bba-a009-84627accd050 on nch1-master-1 May 07 21:57:03.051544 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-38a9b26e-6e92-4990-93c9-b0f1ff504a1e req-bde0a0d7-59cb-4f84-8de4-5a7a387ff3ec service nova] Creating event network-changed:0018a0ea-3b54-48b4-be4c-da78c12b4100 for instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b on nch2-master-1 May 07 21:57:03.067342 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-38a9b26e-6e92-4990-93c9-b0f1ff504a1e req-bde0a0d7-59cb-4f84-8de4-5a7a387ff3ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.068545 May 07 21:57:03.068265 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1618/3154] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:03.111289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:03.112071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:03.119216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:03.119730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:03.120716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:03.121425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:03.234151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:57:03.234696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:57:03.235718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:57:03.236113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:57:03.236530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:57:03.247436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:03.248085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:03.249244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:03.249763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:03.271800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for project 93c3c71171814bb7b1018904086ad506. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:57:03.278916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Getting quotas for user bdc18dc6c5214fbb9c1fa61eeb514cc9 and project 93c3c71171814bb7b1018904086ad506. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:57:03.295941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:57:03.300046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:57:03.359852 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8925fbff-d3a6-4d37-85b6-992bb5ca74cb tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.249255 May 07 21:57:03.361753 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1537/3155] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:57:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:57:03.387730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-77eae4a4-73a2-44f1-ac40-1b4cfbe35fa7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:03.389596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-77eae4a4-73a2-44f1-ac40-1b4cfbe35fa7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:03.445354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:03.466643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e8d6e489-a09a-498d-b518-01157204d8c9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.360428 May 07 21:57:03.470021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1619/3156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:03 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:03.471407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-77eae4a4-73a2-44f1-ac40-1b4cfbe35fa7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:03.482479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-77eae4a4-73a2-44f1-ac40-1b4cfbe35fa7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:03.485852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-77eae4a4-73a2-44f1-ac40-1b4cfbe35fa7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:03.487889 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-77eae4a4-73a2-44f1-ac40-1b4cfbe35fa7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1282 microversion: 2.20 time: 0.109699 May 07 21:57:03.489690 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1538/3157] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:03 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:04.014511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:04.015533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:04.031222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:04.032617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:04.033519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:04.034707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:04.469109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:04.481178 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48c44b5d-722b-485d-8a29-40e05f1fb169 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 200 len: 1473 microversion: 2.1 time: 0.471442 May 07 21:57:04.481984 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1620/3158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:04 2022] GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 1473 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:04.485876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:04.486587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:04.499487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:04.500383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:04.502389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:04.504045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:04.512974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:04.514489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:04.526591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:04.528046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:04.528859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:04.529318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:04.835604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:04.853832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:04.856008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:04.862846 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12c5ac39-a725-486a-9f5a-a85b51936cee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1334 microversion: 2.20 time: 0.351567 May 07 21:57:04.863450 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1621/3159] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:04 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1334 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:05.096501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:05.107788 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-28bbbc83-d0f5-4eec-8c74-f599fb9002f4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.627496 May 07 21:57:05.121004 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1539/3160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:04 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:05.500177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:05.501457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:05.521483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:05.522094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:05.523008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:05.523539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:05.720989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:05.733146 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47a58efe-841c-4d1b-aba1-edb35c123d31 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 200 len: 1431 microversion: 2.1 time: 0.237597 May 07 21:57:05.734047 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1622/3161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:05 2022] GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 1431 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:05.737693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3b0ed166-474d-4688-b28c-6ef2d5de6372 req-cf40bc37-76fb-4b2d-974b-4f19e83e5e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a390d88e-4ae4-4700-a85a-6bc97fd8bd29", "name": "network-vif-deleted", "tag": "e8fb4c79-a7ca-4fee-9d39-932cf793d33f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:05.769620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b0ed166-474d-4688-b28c-6ef2d5de6372 req-cf40bc37-76fb-4b2d-974b-4f19e83e5e43 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:05.770081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b0ed166-474d-4688-b28c-6ef2d5de6372 req-cf40bc37-76fb-4b2d-974b-4f19e83e5e43 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:05.800610 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3b0ed166-474d-4688-b28c-6ef2d5de6372 req-cf40bc37-76fb-4b2d-974b-4f19e83e5e43 service nova] Creating event network-vif-deleted:e8fb4c79-a7ca-4fee-9d39-932cf793d33f for instance a390d88e-4ae4-4700-a85a-6bc97fd8bd29 on nch2-master-1 May 07 21:57:05.830785 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3b0ed166-474d-4688-b28c-6ef2d5de6372 req-cf40bc37-76fb-4b2d-974b-4f19e83e5e43 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102303 May 07 21:57:05.839319 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1540/3162] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:05.883282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:05.884271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:05.895620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:05.896609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:05.897561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:05.898630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:05.910232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d2023eb5-8ae5-4479-8aea-c9bc9eb19458 req-e5d24f96-f3cc-4a16-8a1f-43bcad903684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34e6889-832e-45d3-8a1a-8c59d4ec697e", "name": "network-vif-deleted", "tag": "5265c093-001b-4f7a-9877-fb1ce61028fc"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:05.937272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d2023eb5-8ae5-4479-8aea-c9bc9eb19458 req-e5d24f96-f3cc-4a16-8a1f-43bcad903684 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:05.938622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d2023eb5-8ae5-4479-8aea-c9bc9eb19458 req-e5d24f96-f3cc-4a16-8a1f-43bcad903684 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:05.968847 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d2023eb5-8ae5-4479-8aea-c9bc9eb19458 req-e5d24f96-f3cc-4a16-8a1f-43bcad903684 service nova] Creating event network-vif-deleted:5265c093-001b-4f7a-9877-fb1ce61028fc for instance d34e6889-832e-45d3-8a1a-8c59d4ec697e on nch1-master-1 May 07 21:57:05.976430 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d2023eb5-8ae5-4479-8aea-c9bc9eb19458 req-e5d24f96-f3cc-4a16-8a1f-43bcad903684 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070758 May 07 21:57:05.983873 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1541/3163] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:06.124210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:06.124838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:06.148363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.149081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:06.150064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.150741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:06.304104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:06.312690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:06.318489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:06.322948 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3aecd31c-91fd-480c-83d9-75616b31c0f9 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1340 microversion: 2.20 time: 0.443952 May 07 21:57:06.331118 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1623/3164] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:05 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1340 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:06.447337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:06.456947 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c360314-37d5-46bc-844f-e333f76cfa58 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.336874 May 07 21:57:06.457550 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1542/3165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:06 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:06.752382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:06.753764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: d34e6889-832e-45d3-8a1a-8c59d4ec697e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:06.766023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.766763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:06.767786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.774021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:06.802921 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance d34e6889-832e-45d3-8a1a-8c59d4ec697e could not be found. May 07 21:57:06.804098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance d34e6889-832e-45d3-8a1a-8c59d4ec697e could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:06.805289 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-481f91cd-bf8f-4805-b8da-08816a76be9f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e" status: 404 len: 111 microversion: 2.1 time: 0.057397 May 07 21:57:06.814641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:06.815602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: a390d88e-4ae4-4700-a85a-6bc97fd8bd29] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:06.820004 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1624/3166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:06 2022] GET /compute/v2.1/servers/d34e6889-832e-45d3-8a1a-8c59d4ec697e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:06.827444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.828124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:06.830282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.835520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:06.861567 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance a390d88e-4ae4-4700-a85a-6bc97fd8bd29 could not be found. May 07 21:57:06.862527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance a390d88e-4ae4-4700-a85a-6bc97fd8bd29 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:06.863709 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-01369fa8-36e1-4e47-a739-83ff61d2d5ff tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29" status: 404 len: 111 microversion: 2.1 time: 0.053741 May 07 21:57:06.864900 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1543/3167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:06 2022] GET /compute/v2.1/servers/a390d88e-4ae4-4700-a85a-6bc97fd8bd29 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:57:06.872766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b35df5bb-d11e-4cd2-ae14-4049f94e6042 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:06.931782 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b35df5bb-d11e-4cd2-ae14-4049f94e6042 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/85c8d49e-6cb2-47b8-b704-f68fa4405bb3" status: 204 len: 0 microversion: 2.1 time: 0.063043 May 07 21:57:06.933153 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1625/3168] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:57:06 2022] DELETE /compute/v2.1/os-server-groups/85c8d49e-6cb2-47b8-b704-f68fa4405bb3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:06.945622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:06.946593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:06.957809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.958651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:06.959699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:06.960773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.010883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:57:07.236270 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-76ba3baa-b168-47c4-9446-5ded92b7fb88 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 204 len: 0 microversion: 2.1 time: 0.297442 May 07 21:57:07.238829 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1544/3169] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:57:06 2022] DELETE /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:07.247744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:07.248299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:07.260559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.260808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.261823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.262331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.306495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:57:07.347044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:07.347755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:07.355570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.359423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.363454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.364061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.471669 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9522d1f4-4c6c-4d5f-a8ff-721283c3d003 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 204 len: 0 microversion: 2.1 time: 0.214630 May 07 21:57:07.472783 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1626/3170] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:57:07 2022] DELETE /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:07.488436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:07.490426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:07.497159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.498589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.500030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.500840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.507286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:07.519241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:07.521341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:07.523873 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-67507fe5-795c-489d-9a58-d89f6da2597b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1340 microversion: 2.20 time: 0.181492 May 07 21:57:07.536188 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1545/3171] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:07 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:07.541675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:07.542510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:07.561410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.574998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.577323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:07.578332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:07.831314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:07.842107 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ec2618b5-b339-41dc-976f-4d1d8343c31e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.362934 May 07 21:57:07.851794 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1627/3172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:07 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:08.099066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:08.110876 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e0d30b2-a99a-4349-a625-57df73352a25 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 200 len: 1473 microversion: 2.1 time: 0.571650 May 07 21:57:08.125276 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1546/3173] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:07 2022] GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 1473 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:08.543711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:08.544543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:08.563661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:08.564680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:08.566054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:08.566684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:08.868620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:08.869470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:08.888782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:08.893026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:08.897464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:08.899101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:09.112047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:09.122523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:09.130058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:09.143509 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c66e0fc2-3fa5-4564-ae7b-24199791ac67 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1408 microversion: 2.20 time: 0.596032 May 07 21:57:09.144478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1628/3174] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:08 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1408 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:09.150232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-838147db-aa2e-4ba7-ab0a-bc8875d3aa08 req-4341983c-62bd-42d9-8f7a-5b2f58a8aaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fb1f24-8416-4b15-b95f-ec086bc7ee8b", "name": "network-vif-plugged", "status": "completed", "tag": "0018a0ea-3b54-48b4-be4c-da78c12b4100"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:09.180906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-838147db-aa2e-4ba7-ab0a-bc8875d3aa08 req-4341983c-62bd-42d9-8f7a-5b2f58a8aaaa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:09.187539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-838147db-aa2e-4ba7-ab0a-bc8875d3aa08 req-4341983c-62bd-42d9-8f7a-5b2f58a8aaaa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:09.216366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-838147db-aa2e-4ba7-ab0a-bc8875d3aa08 req-4341983c-62bd-42d9-8f7a-5b2f58a8aaaa service nova] Creating event network-vif-plugged:0018a0ea-3b54-48b4-be4c-da78c12b4100 for instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b on nch2-master-1 May 07 21:57:09.229092 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-838147db-aa2e-4ba7-ab0a-bc8875d3aa08 req-4341983c-62bd-42d9-8f7a-5b2f58a8aaaa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082381 May 07 21:57:09.232460 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1629/3175] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:09.245718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:09.246668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:09.255684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:09.256469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:09.257432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:09.258314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:09.619994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:09.634447 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a9e08846-3c26-4a11-b1cb-0193ad854fe9 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 200 len: 1473 microversion: 2.1 time: 0.400583 May 07 21:57:09.639893 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1630/3176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:09 2022] GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 1473 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:09.660145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5baa9578-6ebe-4e3a-a67e-09d789cd5f08 req-54d2a60e-0421-4113-a896-5ac20965962d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83ad7d9c-5e14-44b9-a948-c9c337d99f0c", "tag": "d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:09.681853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5baa9578-6ebe-4e3a-a67e-09d789cd5f08 req-54d2a60e-0421-4113-a896-5ac20965962d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:09.682389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5baa9578-6ebe-4e3a-a67e-09d789cd5f08 req-54d2a60e-0421-4113-a896-5ac20965962d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:09.705912 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5baa9578-6ebe-4e3a-a67e-09d789cd5f08 req-54d2a60e-0421-4113-a896-5ac20965962d service nova] Creating event network-changed:d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2 for instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c on nch1-master-1 May 07 21:57:09.718392 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5baa9578-6ebe-4e3a-a67e-09d789cd5f08 req-54d2a60e-0421-4113-a896-5ac20965962d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076840 May 07 21:57:09.720004 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1631/3177] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:09.841239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:09.848782 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-de8b275e-6491-4e6d-a38c-9dc4efdb6377 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 0.984765 May 07 21:57:09.849366 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1547/3178] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:08 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:10.165945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:10.166968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:10.183536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:10.186727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:10.190575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:10.194184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:10.585164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:10.604156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:10.607700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:10.610757 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f463ad89-e5ba-402a-b5f6-24c102f2fe29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1408 microversion: 2.20 time: 0.450986 May 07 21:57:10.612458 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1632/3179] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:10 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:10.659558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:10.660759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:10.682227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:10.684065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:10.685770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:10.686558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:10.865821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:10.866455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:10.893808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:10.899550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:10.901208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:10.901909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:10.960401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:10.968964 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f8779db-60de-4759-9598-991491cc8f7d tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 200 len: 1431 microversion: 2.1 time: 0.315829 May 07 21:57:10.969788 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1548/3180] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:10 2022] GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 1431 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:11.090573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bb4a98af-559a-485f-be2f-3b5c3cb0e617 req-93ec7a5f-6412-4ffd-8313-7c8a2b7f8740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120a21bb-a0eb-49aa-adce-3903960c1785", "name": "network-vif-deleted", "tag": "3eec7149-cebf-4a54-bf65-c4194dd2be8d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:11.113020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bb4a98af-559a-485f-be2f-3b5c3cb0e617 req-93ec7a5f-6412-4ffd-8313-7c8a2b7f8740 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:11.113486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bb4a98af-559a-485f-be2f-3b5c3cb0e617 req-93ec7a5f-6412-4ffd-8313-7c8a2b7f8740 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:11.156712 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bb4a98af-559a-485f-be2f-3b5c3cb0e617 req-93ec7a5f-6412-4ffd-8313-7c8a2b7f8740 service nova] Creating event network-vif-deleted:3eec7149-cebf-4a54-bf65-c4194dd2be8d for instance 120a21bb-a0eb-49aa-adce-3903960c1785 on nch2-master-1 May 07 21:57:11.165054 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bb4a98af-559a-485f-be2f-3b5c3cb0e617 req-93ec7a5f-6412-4ffd-8313-7c8a2b7f8740 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085434 May 07 21:57:11.165801 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1549/3181] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:11.635822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:11.637713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:11.645539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:11.646306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:11.648016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:11.648652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:11.837576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:11.847769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:11.849544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:11.851586 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c331d51-2d59-4ef6-908a-359fcbabf775 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1408 microversion: 2.20 time: 0.220953 May 07 21:57:11.852314 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1550/3182] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:11 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:11.951317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:11.962396 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0acb70a6-9252-447f-98f5-827a40a88ccf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1315 microversion: 2.1 time: 1.100592 May 07 21:57:11.963573 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1633/3183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:10 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1315 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:11.992163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:11.994000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 120a21bb-a0eb-49aa-adce-3903960c1785] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:12.004088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.004816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:12.007088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.009203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:12.057518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance 120a21bb-a0eb-49aa-adce-3903960c1785 could not be found. May 07 21:57:12.058308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance 120a21bb-a0eb-49aa-adce-3903960c1785 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:12.059228 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-defb582f-3c4b-4ed7-945a-947b8f9c7cd7 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785" status: 404 len: 111 microversion: 2.1 time: 0.076543 May 07 21:57:12.059975 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1551/3184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:11 2022] GET /compute/v2.1/servers/120a21bb-a0eb-49aa-adce-3903960c1785 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:12.071472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:12.080021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:12.104894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.106024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:12.107013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.110612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:12.208618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.210758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:12.211296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lazy-loading 'fault' on Instance uuid 0010a466-c288-469b-99f3-a3db8a5efb7c {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:57:12.398864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:12.408106 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cba5fcd2-2e9e-4376-b8f5-cb55f3b74616 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 200 len: 1308 microversion: 2.1 time: 0.343095 May 07 21:57:12.410072 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1634/3185] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:12 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:12.870804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:12.872472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:12.885153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.886789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:12.887644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.888100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:12.985001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:12.985832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:12.995454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:12.999153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.000276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.002470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.204779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:13.220514 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-750ae70e-6002-4fd0-82c1-ce4e266acf8e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1502 microversion: 2.1 time: 0.243352 May 07 21:57:13.221933 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1635/3186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:12 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:13.226786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-278959ae-0256-4dcf-8efd-2bc809272afa req-df6d8be0-7314-4379-970d-38da589e748f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0010a466-c288-469b-99f3-a3db8a5efb7c", "name": "network-vif-deleted", "tag": "5e8b0963-4bbd-4b02-9602-197e95f150cb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:13.238960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-278959ae-0256-4dcf-8efd-2bc809272afa req-df6d8be0-7314-4379-970d-38da589e748f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.239296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-278959ae-0256-4dcf-8efd-2bc809272afa req-df6d8be0-7314-4379-970d-38da589e748f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.264808 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-278959ae-0256-4dcf-8efd-2bc809272afa req-df6d8be0-7314-4379-970d-38da589e748f service nova] Creating event network-vif-deleted:5e8b0963-4bbd-4b02-9602-197e95f150cb for instance 0010a466-c288-469b-99f3-a3db8a5efb7c on nch2-master-1 May 07 21:57:13.277137 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-278959ae-0256-4dcf-8efd-2bc809272afa req-df6d8be0-7314-4379-970d-38da589e748f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052047 May 07 21:57:13.278319 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1636/3187] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:13.279866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:13.288553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:13.289264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:13.301621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:13.305896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:13.307110 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dc078a08-ca8d-4127-bcb7-921f2b2ed4ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1408 microversion: 2.20 time: 0.441490 May 07 21:57:13.312119 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1552/3188] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:12 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1408 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:13.313878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.314341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.315509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.316164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.354826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lazy-loading 'flavor' on Instance uuid 76fb1f24-8416-4b15-b95f-ec086bc7ee8b {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:57:13.430706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:13.431391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: 0010a466-c288-469b-99f3-a3db8a5efb7c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:13.442323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.443144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.444091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.444820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.464813 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance 0010a466-c288-469b-99f3-a3db8a5efb7c could not be found. May 07 21:57:13.465648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance 0010a466-c288-469b-99f3-a3db8a5efb7c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:13.467489 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-83dd0919-1992-4a59-abc5-093670ad3c2f tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c" status: 404 len: 111 microversion: 2.1 time: 0.043285 May 07 21:57:13.472095 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1553/3189] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:13 2022] GET /compute/v2.1/servers/0010a466-c288-469b-99f3-a3db8a5efb7c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:13.479489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-667bee14-c05a-451e-a69b-a00ce84a3212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:13.524615 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-667bee14-c05a-451e-a69b-a00ce84a3212 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/e5523e38-e30a-423c-9fb1-e97c60d84e68" status: 204 len: 0 microversion: 2.1 time: 0.051025 May 07 21:57:13.529734 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1554/3190] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:57:13 2022] DELETE /compute/v2.1/os-server-groups/e5523e38-e30a-423c-9fb1-e97c60d84e68 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:13.536234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:13.536978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:13.546395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.548254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.549245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.550900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.605740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:57:13.789772 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ca9c1099-1b21-4650-8dfc-38ee96d33e37 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 204 len: 0 microversion: 2.1 time: 0.258255 May 07 21:57:13.791247 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1555/3191] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:57:13 2022] DELETE /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:13.807345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:13.810385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:13.813872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f469b010-9658-43d0-b171-3b559ba978d0 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b/action" status: 202 len: 0 microversion: 2.1 time: 0.533284 May 07 21:57:13.814947 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1637/3192] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:57:13 2022] POST /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:57:13.826237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:13.826469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.827426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:13.827727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.830870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.831733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.837872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.838963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:13.840062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:13.841063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:14.049283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:14.065713 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a98289cb-9e24-45cb-872e-46e4ee509f6a tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1473 microversion: 2.1 time: 0.265734 May 07 21:57:14.076287 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1556/3193] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:13 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1473 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:14.099816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:14.109016 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-787c8522-a632-42cd-a6c0-184090b170de tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.288544 May 07 21:57:14.109620 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1638/3194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:13 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:14.331425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:14.332354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:14.339540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:14.340295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:14.341342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:14.342085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:14.543540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:14.553851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:14.555706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:14.556721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ab278733-074a-4d56-a119-ac235b4c4238 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1408 microversion: 2.20 time: 0.230678 May 07 21:57:14.557829 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1557/3195] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:14 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:15.087485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:15.088169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:15.095821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:15.096307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:15.097101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:15.097717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:15.134673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:15.135646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:15.146137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:15.146622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:15.148456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:15.149311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:15.348199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:15.359176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7dbfb11-7ecc-4d4d-971a-c75ccc6aa9de tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1473 microversion: 2.1 time: 0.279459 May 07 21:57:15.362648 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1639/3196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:15 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1473 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:15.439699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:15.452297 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bafd7a9-65b2-48bc-808c-a4f2e31a1ad4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.323526 May 07 21:57:15.452901 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1558/3197] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:15 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:15.579681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:15.580384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:15.597302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:15.598212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:15.603046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:15.605625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:15.964413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-dbbb4563-0555-40e2-a291-fdc9fa4c9ae4 req-a4948f2f-bfa3-4660-8a0d-57488c714eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2", "name": "network-vif-deleted", "tag": "0f31f820-4134-4910-88d6-283ed3ed34a7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:15.975895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:15.982020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dbbb4563-0555-40e2-a291-fdc9fa4c9ae4 req-a4948f2f-bfa3-4660-8a0d-57488c714eb1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:15.983459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dbbb4563-0555-40e2-a291-fdc9fa4c9ae4 req-a4948f2f-bfa3-4660-8a0d-57488c714eb1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:15.999744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:16.013928 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-dbbb4563-0555-40e2-a291-fdc9fa4c9ae4 req-a4948f2f-bfa3-4660-8a0d-57488c714eb1 service nova] Creating event network-vif-deleted:0f31f820-4134-4910-88d6-283ed3ed34a7 for instance dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 on nch2-master-1 May 07 21:57:16.027628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:16.030944 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-dbbb4563-0555-40e2-a291-fdc9fa4c9ae4 req-a4948f2f-bfa3-4660-8a0d-57488c714eb1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068841 May 07 21:57:16.031364 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9b8031e3-36cd-4678-846c-19a51992f748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1408 microversion: 2.20 time: 0.459210 May 07 21:57:16.039712 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1559/3198] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:57:16.048829 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1640/3199] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:15 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:16.079700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cdd9baeb-d0b1-4da9-be67-4bf6e66f6188 req-9df76644-f1f0-42e6-aeb1-fcb78b474d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ad7d9c-5e14-44b9-a948-c9c337d99f0c", "name": "network-vif-plugged", "status": "completed", "tag": "d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:16.103208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cdd9baeb-d0b1-4da9-be67-4bf6e66f6188 req-9df76644-f1f0-42e6-aeb1-fcb78b474d39 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:16.103670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cdd9baeb-d0b1-4da9-be67-4bf6e66f6188 req-9df76644-f1f0-42e6-aeb1-fcb78b474d39 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:16.118648 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cdd9baeb-d0b1-4da9-be67-4bf6e66f6188 req-9df76644-f1f0-42e6-aeb1-fcb78b474d39 service nova] Creating event network-vif-plugged:d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2 for instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c on nch1-master-1 May 07 21:57:16.124621 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cdd9baeb-d0b1-4da9-be67-4bf6e66f6188 req-9df76644-f1f0-42e6-aeb1-fcb78b474d39 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068347 May 07 21:57:16.125703 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1560/3200] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:16.379069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:16.380347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:16.389958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:16.390428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:16.391781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:16.399313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:16.487387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:16.488106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:16.488818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lazy-loading 'fault' on Instance uuid dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:57:16.498567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:16.502751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:16.538474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:16.540191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:16.543696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:16.545188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:16.576074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7262be0d7db141e69bdf493bd7a5505a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24cf19532e0484fabd6dc4e6b66fe30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:16.597528 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6800ae94-9bb6-4507-b77d-52fba2d69028 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 200 len: 1307 microversion: 2.1 time: 0.221908 May 07 21:57:16.598788 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1641/3201] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:16 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:16.759994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:16.768618 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0d23cafe-8460-43e9-95c5-d3ec39539ee5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.301165 May 07 21:57:16.769229 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1561/3202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:16 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:17.053042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:17.054024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:17.061038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:17.061703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:17.063330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:17.064012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:17.229441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:17.239462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:17.241117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:17.242349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-481a0987-8405-441b-a0e1-a359835ed166 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1408 microversion: 2.20 time: 0.193729 May 07 21:57:17.242964 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1562/3203] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:17 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:17.394711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-208093031", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0314247d-f2ef-47ce-b469-f48290a43446"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:17.458182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] validate_networks() for [('0314247d-f2ef-47ce-b469-f48290a43446', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:57:17.617023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:17.617655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] [instance: dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:17.628434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:17.628434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:17.628943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:17.629748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:17.653560 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] HTTP exception thrown: Instance dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 could not be found. May 07 21:57:17.654171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] Returning 404 to user: Instance dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:17.655389 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c44eea3-3905-4bc5-a3e2-724293281440 tempest-ServersOnMultiNodesTest-809606106 tempest-ServersOnMultiNodesTest-809606106-project] 10.222.0.32 "GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2" status: 404 len: 111 microversion: 2.1 time: 0.043179 May 07 21:57:17.660846 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1563/3204] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:17 2022] GET /compute/v2.1/servers/dc809cd6-ffa7-49b3-ad2c-9bd7a75f8db2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:17.791231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:17.792118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:17.803019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:17.804302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:17.805401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:17.806492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:17.990898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:17.998370 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-541472fb-dd08-455b-b7f0-7ebdc78f4571 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.213647 May 07 21:57:18.002225 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1564/3205] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:17 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:18.030247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:57:18.031049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:57:18.031639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:57:18.032109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:57:18.032737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:57:18.048736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:18.049622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:18.050717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:18.051378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:18.089823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Getting quotas for project 5b718fc4c73641a28b46218d8905b4bb. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:57:18.096289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Getting quotas for user 4053e69846a7440f8d7978a5a4b7eec5 and project 5b718fc4c73641a28b46218d8905b4bb. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:57:18.113260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:57:18.115754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:57:18.169567 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95f5178c-2c4c-4cd7-976e-020f1638ad16 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149406 May 07 21:57:18.170656 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1642/3206] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:57:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:57:18.181797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6310de05-47db-4d7a-a73e-42b66e0978f8 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:18.182468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6310de05-47db-4d7a-a73e-42b66e0978f8 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:18.261107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:18.261990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:18.272255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:18.272724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:18.273516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:18.294990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:18.363989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6310de05-47db-4d7a-a73e-42b66e0978f8 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:18.373538 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6310de05-47db-4d7a-a73e-42b66e0978f8 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1224 microversion: 2.1 time: 0.195435 May 07 21:57:18.376409 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1565/3207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:18 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1224 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:18.562330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:18.575530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:18.581820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:18.587570 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fde3b4e1-5fcc-4020-abd1-5729f364d06c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1601 microversion: 2.20 time: 0.326314 May 07 21:57:18.590499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1643/3208] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:18 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1601 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:18.606956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db5cdec7-9023-4042-bb01-8f97ab9b1eb5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:18.608134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db5cdec7-9023-4042-bb01-8f97ab9b1eb5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:18.615397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db5cdec7-9023-4042-bb01-8f97ab9b1eb5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:18.616023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db5cdec7-9023-4042-bb01-8f97ab9b1eb5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:18.617353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db5cdec7-9023-4042-bb01-8f97ab9b1eb5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:18.620319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db5cdec7-9023-4042-bb01-8f97ab9b1eb5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:18.751407 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db5cdec7-9023-4042-bb01-8f97ab9b1eb5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.148725 May 07 21:57:18.752386 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1566/3209] 10.222.0.32 () {60 vars in 1315 bytes} [Sat May 7 21:57:18 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:57:19.018417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:19.020219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:19.028956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:19.028956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:19.033142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:19.033860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:19.394425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:19.395445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:19.404963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:19.405694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:19.407544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:19.408537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:19.478663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:19.489098 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-227b4b70-8882-466d-bd6b-22cf923751c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.475195 May 07 21:57:19.498414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:19.507460 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1644/3210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:19 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:19.508836 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3ea8f5a-40db-435f-b13e-8a61f7ff7d5d tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1276 microversion: 2.1 time: 0.119636 May 07 21:57:19.512234 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1567/3211] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:19 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:20.513880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:20.515144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:20.527280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:20.529106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:20.530924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:20.531905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:20.537993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:20.538725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:20.548538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:20.549263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:20.550277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:20.550726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:20.700276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:20.710006 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-01eb1801-71d5-4ad4-a9c7-70c4cf496029 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1282 microversion: 2.1 time: 0.184829 May 07 21:57:20.710999 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1568/3212] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:20 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:20.945052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:20.957026 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ebf1b4b-aef1-4da4-84df-31ebea5d8f30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.447199 May 07 21:57:20.958869 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1645/3213] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:20 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:21.212687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d98442b9-8f54-4688-88b3-04ff695bbc02 req-41b099a4-ab42-4c58-beb4-564af200b134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83ad7d9c-5e14-44b9-a948-c9c337d99f0c", "tag": "d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:21.227412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d98442b9-8f54-4688-88b3-04ff695bbc02 req-41b099a4-ab42-4c58-beb4-564af200b134 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:21.228188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d98442b9-8f54-4688-88b3-04ff695bbc02 req-41b099a4-ab42-4c58-beb4-564af200b134 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:21.252990 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d98442b9-8f54-4688-88b3-04ff695bbc02 req-41b099a4-ab42-4c58-beb4-564af200b134 service nova] Creating event network-changed:d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2 for instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c on nch1-master-1 May 07 21:57:21.261716 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d98442b9-8f54-4688-88b3-04ff695bbc02 req-41b099a4-ab42-4c58-beb4-564af200b134 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052615 May 07 21:57:21.267108 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1569/3214] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:21.731061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:21.732785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:21.743348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:21.744455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:21.745493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:21.746086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:21.986442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:21.988413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:22.009747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:22.010918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:22.011903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:22.012507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:22.260567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:22.261015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:22.270383 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-453ac0f0-1069-453e-8776-6729ce40d1b0 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1324 microversion: 2.1 time: 0.545327 May 07 21:57:22.272177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71baa7de-a655-4891-b765-c6656e41a1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.298697 May 07 21:57:22.272978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1570/3215] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:21 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:22.273592 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1646/3216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:21 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:23.269359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1449340450", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:23.286499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1e4fd081-d6c8-41dd-bc7e-359fdcf7b5b7 req-52f4222a-69c9-431b-96f7-128f932e00b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "331e63b1-72db-4cd8-a68a-a173625c95ed", "tag": "b6ed2886-eb68-4188-9b66-6eff9f2cf22e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:23.304908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1e4fd081-d6c8-41dd-bc7e-359fdcf7b5b7 req-52f4222a-69c9-431b-96f7-128f932e00b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:23.306933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1e4fd081-d6c8-41dd-bc7e-359fdcf7b5b7 req-52f4222a-69c9-431b-96f7-128f932e00b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:23.332672 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1e4fd081-d6c8-41dd-bc7e-359fdcf7b5b7 req-52f4222a-69c9-431b-96f7-128f932e00b7 service nova] Creating event network-changed:b6ed2886-eb68-4188-9b66-6eff9f2cf22e for instance 331e63b1-72db-4cd8-a68a-a173625c95ed on nch1-master-1 May 07 21:57:23.345248 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1e4fd081-d6c8-41dd-bc7e-359fdcf7b5b7 req-52f4222a-69c9-431b-96f7-128f932e00b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064739 May 07 21:57:23.346477 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1647/3217] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:23.357703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:23.358719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:23.364883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:57:23.366721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:23.367762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:23.368753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:23.369342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:23.623523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:23.635951 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8b76e424-d242-427a-a6b8-3b4df9386658 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1324 microversion: 2.1 time: 0.284333 May 07 21:57:23.636854 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1648/3218] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:23 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:23.644508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:23.645881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:23.654446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:23.655188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:23.656189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:23.656873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:23.664969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:57:23.665640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:57:23.666283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:57:23.667146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:57:23.667748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:57:23.684750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:23.685531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:23.686706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:23.688776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:23.712600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Getting quotas for project f62f599384054f23bddfbc3b3d1abf3d. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:57:23.719885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Getting quotas for user e412ac7281b34df69be98088aec5fd99 and project f62f599384054f23bddfbc3b3d1abf3d. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:57:23.737715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:57:23.740693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:57:23.799413 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac2d4845-660a-401b-ad2a-d6526a382506 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768975 May 07 21:57:23.800087 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1571/3219] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:57:23.811264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3dd210bc-3d97-4791-a460-86663d171452 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:23.813401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3dd210bc-3d97-4791-a460-86663d171452 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:23.878492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:23.889337 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15128a6b-6e57-4292-867c-4a82c3e99ee8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.251043 May 07 21:57:23.890023 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1649/3220] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:23 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:23.907417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3dd210bc-3d97-4791-a460-86663d171452 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:23.919481 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3dd210bc-3d97-4791-a460-86663d171452 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1214 microversion: 2.1 time: 0.113105 May 07 21:57:23.920497 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1572/3221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:23 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:24.653780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:24.654404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:24.673712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:24.675416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:24.677413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:24.677887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:24.907362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:24.908762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:24.917519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:24.918198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:24.919228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:24.919856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:24.951004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:24.970102 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2049e361-0022-406d-be73-dfec8c7ddb47 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1324 microversion: 2.1 time: 0.316125 May 07 21:57:24.971458 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1650/3222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:24 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:24.989045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:24.991753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:25.008119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:25.008889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:25.010551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:25.013168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:25.168789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:25.181721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5c8c456-f1c0-48c1-a96e-f1a1d532e8b3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.278606 May 07 21:57:25.182604 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1573/3223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:24 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:25.466087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:25.476390 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-66f76bb4-44c8-410d-aad9-487268819331 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1274 microversion: 2.1 time: 0.501946 May 07 21:57:25.477232 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1651/3224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:24 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1274 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:26.000812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:26.002315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:26.027314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:26.028946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:26.032244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:26.033184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:26.199978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:26.201356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:26.211321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:26.211775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:26.215897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:26.216579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:26.361822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:26.374986 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c7f96ac3-eb2f-40e3-89b7-9ff70dd083aa tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1324 microversion: 2.1 time: 0.387778 May 07 21:57:26.377284 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1574/3225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:25 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:26.448234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:26.460123 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f54ddcba-6a2c-4811-aed3-28c0fa06baed tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.263933 May 07 21:57:26.461492 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1652/3226] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:26 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:26.494834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:26.495951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:26.517922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:26.518240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:26.519422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:26.519877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:27.127060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:27.135663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1210e49a-1cd1-4d69-baa3-3f3651a2d573 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1314 microversion: 2.1 time: 0.644695 May 07 21:57:27.136483 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1575/3227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:26 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:27.393670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:27.394442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:27.402497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:27.403236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:27.404436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:27.406703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:27.477442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:27.478067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:27.494691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:27.495172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:27.495955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:27.496397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:27.668138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:27.678716 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a8a153e-f3b8-4492-816e-008b872bc10c tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1324 microversion: 2.1 time: 0.289330 May 07 21:57:27.687599 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1653/3228] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:27 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:27.816082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:27.833297 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6ae44ea7-1946-4066-a8ee-39ea315c32a8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.359645 May 07 21:57:27.834129 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1576/3229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:27 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:28.032359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-120212eb-85e8-4cd5-a037-53f6cc349f67 req-56fbb31c-56b7-4c8a-bec6-b7ae42aed3dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6108279-03de-4499-9a59-7c1f4fbd291b", "tag": "3d52f5e6-5121-45cb-8de5-2a3d994fa234"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:28.073059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-120212eb-85e8-4cd5-a037-53f6cc349f67 req-56fbb31c-56b7-4c8a-bec6-b7ae42aed3dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.083130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-120212eb-85e8-4cd5-a037-53f6cc349f67 req-56fbb31c-56b7-4c8a-bec6-b7ae42aed3dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:28.106708 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-120212eb-85e8-4cd5-a037-53f6cc349f67 req-56fbb31c-56b7-4c8a-bec6-b7ae42aed3dc service nova] Creating event network-changed:3d52f5e6-5121-45cb-8de5-2a3d994fa234 for instance c6108279-03de-4499-9a59-7c1f4fbd291b on nch2-master-1 May 07 21:57:28.116296 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-120212eb-85e8-4cd5-a037-53f6cc349f67 req-56fbb31c-56b7-4c8a-bec6-b7ae42aed3dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091251 May 07 21:57:28.123552 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1654/3230] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:28.153835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-970c3baa-100a-4f74-bf18-0398a0aa58da req-4933f472-6131-4e3a-a3e1-039599b69070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331e63b1-72db-4cd8-a68a-a173625c95ed", "name": "network-vif-plugged", "status": "completed", "tag": "b6ed2886-eb68-4188-9b66-6eff9f2cf22e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:28.154532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:28.155528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:28.165594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.166641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:28.168225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.169067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:28.174850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-970c3baa-100a-4f74-bf18-0398a0aa58da req-4933f472-6131-4e3a-a3e1-039599b69070 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.179409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-970c3baa-100a-4f74-bf18-0398a0aa58da req-4933f472-6131-4e3a-a3e1-039599b69070 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:28.211523 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-970c3baa-100a-4f74-bf18-0398a0aa58da req-4933f472-6131-4e3a-a3e1-039599b69070 service nova] Creating event network-vif-plugged:b6ed2886-eb68-4188-9b66-6eff9f2cf22e for instance 331e63b1-72db-4cd8-a68a-a173625c95ed on nch1-master-1 May 07 21:57:28.217256 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-970c3baa-100a-4f74-bf18-0398a0aa58da req-4933f472-6131-4e3a-a3e1-039599b69070 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067869 May 07 21:57:28.218522 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1577/3231] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:28.504689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:28.512573 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f18b5049-8226-4b2e-90ee-ddca2ba6b64b tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1314 microversion: 2.1 time: 0.362876 May 07 21:57:28.528170 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1655/3232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:28 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:28.696684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:28.697431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:28.704380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.704838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:28.705650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.706096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:28.850558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:28.851891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:28.857850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:28.872000 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a543e7bd-f148-4475-97fb-68a5efb8b7ac tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1324 microversion: 2.1 time: 0.179519 May 07 21:57:28.878191 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1578/3233] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:28 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:28.879163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.879929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:28.881172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:28.881773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:29.042726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:29.051385 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7456a54e-8ca7-41a2-a986-dac06fb15156 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.205075 May 07 21:57:29.051975 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1656/3234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:28 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:29.532323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:29.533935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:29.543807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:29.545074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:29.546578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:29.547360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:29.889434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:29.895809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:29.897101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:29.902957 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2beee4aa-e8f1-4d7a-add2-708d9b2503aa tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1314 microversion: 2.1 time: 0.375001 May 07 21:57:29.904039 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1579/3235] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:29 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:29.922649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:29.924534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:29.925829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:29.926368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.070719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:30.071776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:30.082431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.082833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.083684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.084362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.098960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:30.108201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d0ddc367-f24c-4ab6-9cfa-8bb6441526b6 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1520 microversion: 2.1 time: 0.219254 May 07 21:57:30.121390 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1657/3236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:29 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:30.128604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:30.129372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:30.136149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.136801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.137676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.138214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.173081 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] HTTP exception thrown: Action 999 not found May 07 21:57:30.173808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Returning 404 to user: Action 999 not found {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:30.174883 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc634454-5d29-4699-9efe-343477c80bbf tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.051671 May 07 21:57:30.175460 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1658/3237] 10.222.0.32 () {58 vars in 1307 bytes} [Sat May 7 21:57:30 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed/os-instance-actions/999 => generated 66 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 07 21:57:30.187345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-892f10f6-9d31-4364-962d-ee56e74c911e tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '.version_select at 0x7fc41c2e6c10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:30.188633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-892f10f6-9d31-4364-962d-ee56e74c911e tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 9e6248bd-4e2c-478b-b79a-618c5e90262c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:30.195843 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-892f10f6-9d31-4364-962d-ee56e74c911e tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] HTTP exception thrown: Instance 9e6248bd-4e2c-478b-b79a-618c5e90262c could not be found. May 07 21:57:30.196762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-892f10f6-9d31-4364-962d-ee56e74c911e tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Returning 404 to user: Instance 9e6248bd-4e2c-478b-b79a-618c5e90262c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:30.197785 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-892f10f6-9d31-4364-962d-ee56e74c911e tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/9e6248bd-4e2c-478b-b79a-618c5e90262c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.016105 May 07 21:57:30.198376 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1659/3238] 10.222.0.32 () {58 vars in 1295 bytes} [Sat May 7 21:57:30 2022] GET /compute/v2.1/servers/9e6248bd-4e2c-478b-b79a-618c5e90262c/os-instance-actions => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:57:30.211358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:30.212146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:30.221018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.221610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.222559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.223164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.254999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:57:30.373146 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95861aae-7bbd-4656-9869-8a852c13bb6f tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "DELETE /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 204 len: 0 microversion: 2.1 time: 0.165961 May 07 21:57:30.374894 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1660/3239] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:57:30 2022] DELETE /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 21:57:30.376508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:30.383524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:30.384220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:30.387805 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9242224d-a7d4-4fac-b651-85c90de4fe84 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.321711 May 07 21:57:30.388420 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1580/3240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:30 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:30.392250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.393070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.394037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.394635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.582327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:30.592027 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09ff6304-5b21-46fb-9e3b-77efd97d13c7 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1526 microversion: 2.1 time: 0.213883 May 07 21:57:30.603598 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1661/3241] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:30 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1526 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:30.922260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:30.923659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:30.931766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.932491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:30.933472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:30.934074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:31.097214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:31.105527 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3818ec4c-3b47-47b5-8494-6937a84b9806 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1314 microversion: 2.1 time: 0.187826 May 07 21:57:31.106360 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1581/3242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:30 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:31.407021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:31.407539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:31.415380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:31.415380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:31.416307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:31.416681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:31.583886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:31.598020 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-556e3f47-c5b8-428c-82ff-034d9537ec95 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.196032 May 07 21:57:31.599867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1662/3243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:31 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:31.616331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:31.617247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:31.624336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:31.625151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:31.626114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:31.626848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:31.812255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:31.824765 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e23924a9-3aa2-46e7-b5a9-ce34402a38e3 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1526 microversion: 2.1 time: 0.216501 May 07 21:57:31.825375 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1582/3244] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:31 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1526 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:32.122597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:32.123257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:32.133722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.135581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.137141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.137598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.362583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:32.372680 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69261947-ab7d-4edb-972d-548175c53551 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1314 microversion: 2.1 time: 0.253915 May 07 21:57:32.373296 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1663/3245] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:32 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:32.621575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:32.634083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6dbc3b59-ed0c-4675-a651-001696f69df4 req-bdf0f4bb-8cce-49ff-8eea-12bcd401a10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "331e63b1-72db-4cd8-a68a-a173625c95ed", "name": "network-vif-deleted", "tag": "b6ed2886-eb68-4188-9b66-6eff9f2cf22e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:32.640068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:32.672696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6dbc3b59-ed0c-4675-a651-001696f69df4 req-bdf0f4bb-8cce-49ff-8eea-12bcd401a10c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.673440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.674479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.675887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6dbc3b59-ed0c-4675-a651-001696f69df4 req-bdf0f4bb-8cce-49ff-8eea-12bcd401a10c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.676138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.676661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.709616 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6dbc3b59-ed0c-4675-a651-001696f69df4 req-bdf0f4bb-8cce-49ff-8eea-12bcd401a10c service nova] Creating event network-vif-deleted:b6ed2886-eb68-4188-9b66-6eff9f2cf22e for instance 331e63b1-72db-4cd8-a68a-a173625c95ed on nch1-master-1 May 07 21:57:32.721421 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6dbc3b59-ed0c-4675-a651-001696f69df4 req-bdf0f4bb-8cce-49ff-8eea-12bcd401a10c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091864 May 07 21:57:32.726842 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1664/3246] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:32.866403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:32.871136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:32.896701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.897547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.901795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.902610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.903142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:32.914213 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d7ea73fa-6efd-44be-a619-3891927200b2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.298545 May 07 21:57:32.916340 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1583/3247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:32 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:32.955655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:32.956065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:32.956516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lazy-loading 'fault' on Instance uuid 331e63b1-72db-4cd8-a68a-a173625c95ed {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:57:33.001805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4053e69846a7440f8d7978a5a4b7eec5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b718fc4c73641a28b46218d8905b4bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:33.010037 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-762fea8e-bfbe-4211-af8f-c9ad36c7207a tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 200 len: 1314 microversion: 2.1 time: 0.166064 May 07 21:57:33.010944 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1665/3248] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:32 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:33.389802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:33.390587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:33.396713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:33.397250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:33.398238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:33.398864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:33.597538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:33.609677 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ebc9a2c-2575-4f32-9aab-8f7d48a914a4 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1314 microversion: 2.1 time: 0.223855 May 07 21:57:33.610677 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1584/3249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:33 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:33.807090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ded083f4-5b5b-4879-bf34-cc3c38e9de08 req-c2e4ba49-cdfc-4648-a8ba-fddf7a1efb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6108279-03de-4499-9a59-7c1f4fbd291b", "name": "network-vif-plugged", "status": "completed", "tag": "3d52f5e6-5121-45cb-8de5-2a3d994fa234"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:33.822439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ded083f4-5b5b-4879-bf34-cc3c38e9de08 req-c2e4ba49-cdfc-4648-a8ba-fddf7a1efb59 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:33.824578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ded083f4-5b5b-4879-bf34-cc3c38e9de08 req-c2e4ba49-cdfc-4648-a8ba-fddf7a1efb59 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:33.841888 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ded083f4-5b5b-4879-bf34-cc3c38e9de08 req-c2e4ba49-cdfc-4648-a8ba-fddf7a1efb59 service nova] Creating event network-vif-plugged:3d52f5e6-5121-45cb-8de5-2a3d994fa234 for instance c6108279-03de-4499-9a59-7c1f4fbd291b on nch2-master-1 May 07 21:57:33.849241 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ded083f4-5b5b-4879-bf34-cc3c38e9de08 req-c2e4ba49-cdfc-4648-a8ba-fddf7a1efb59 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046788 May 07 21:57:33.851011 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1666/3250] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:33.933935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:33.935759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:33.961470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:33.962366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:33.963279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:33.963735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:34.028393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:34.029487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] [instance: 331e63b1-72db-4cd8-a68a-a173625c95ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:34.037098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:34.037932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:34.039174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:34.039852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:34.065599 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] HTTP exception thrown: Instance 331e63b1-72db-4cd8-a68a-a173625c95ed could not be found. May 07 21:57:34.066597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] Returning 404 to user: Instance 331e63b1-72db-4cd8-a68a-a173625c95ed could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:34.067510 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fbf11fea-136c-4f42-84f5-0857f8b31294 tempest-InstanceActionsNegativeTestJSON-1302305112 tempest-InstanceActionsNegativeTestJSON-1302305112-project] 10.222.0.32 "GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed" status: 404 len: 111 microversion: 2.1 time: 0.043588 May 07 21:57:34.068405 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1667/3251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:34 2022] GET /compute/v2.1/servers/331e63b1-72db-4cd8-a68a-a173625c95ed => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:34.238376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:34.246896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5237a12c-f945-46d1-ab50-fb5ba6f5be23 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.317110 May 07 21:57:34.248171 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1585/3252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:33 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:34.630068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:34.630955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:34.641493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:34.642502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:34.643952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:34.644689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:34.940273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:34.952407 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-177ac900-587c-44b1-8691-c3f796cf2eba tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1314 microversion: 2.1 time: 0.327751 May 07 21:57:34.954304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1668/3253] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:34 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:35.266722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:35.270899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:35.287599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:35.288494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:35.289512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:35.290125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:35.538289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:35.546002 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd758ab4-4779-44b4-943a-d723e8e19e9c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.284400 May 07 21:57:35.546704 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1586/3254] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:35 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:35.971657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:35.972996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:35.982021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:35.982952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:35.984673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:35.985625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:36.248379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:36.264678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2dad4229-cfe2-46d1-b40a-2bfe953004c1 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1463 microversion: 2.1 time: 0.297768 May 07 21:57:36.273246 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1669/3255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:35 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1463 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:36.567544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:36.568389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:36.583220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:36.583690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:36.584651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:36.585149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:36.769965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9515f78f-3d18-4ba6-8764-cabc3cc782ed tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Calling method '.version_select at 0x7fc41cade160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:36.785809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9515f78f-3d18-4ba6-8764-cabc3cc782ed tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:36.786552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9515f78f-3d18-4ba6-8764-cabc3cc782ed tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:36.841642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9515f78f-3d18-4ba6-8764-cabc3cc782ed tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:36.849455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9515f78f-3d18-4ba6-8764-cabc3cc782ed tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:36.884177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9515f78f-3d18-4ba6-8764-cabc3cc782ed tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/f62f599384054f23bddfbc3b3d1abf3d?start=2022-05-06T21%3A57%3A36.282939&end=2022-05-08T21%3A57%3A36.282939" status: 200 len: 695 microversion: 2.1 time: 0.596062 May 07 21:57:36.897433 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1587/3256] 10.222.0.32 () {58 vars in 1411 bytes} [Sat May 7 21:57:36 2022] GET /compute/v2.1/os-simple-tenant-usage/f62f599384054f23bddfbc3b3d1abf3d?start=2022-05-06T21%3A57%3A36.282939&end=2022-05-08T21%3A57%3A36.282939 => generated 695 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:36.910090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-578eea66-e10e-4407-9b22-38498e6a5c29 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '.version_select at 0x7fc41c371670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:36.924727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-578eea66-e10e-4407-9b22-38498e6a5c29 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:36.925296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-578eea66-e10e-4407-9b22-38498e6a5c29 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:36.938758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-578eea66-e10e-4407-9b22-38498e6a5c29 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:36.939664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-578eea66-e10e-4407-9b22-38498e6a5c29 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:36.946250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:36.956674 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-578eea66-e10e-4407-9b22-38498e6a5c29 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/f62f599384054f23bddfbc3b3d1abf3d?start=2022-05-06T21%3A57%3A36.282939&end=2022-05-08T21%3A57%3A36.282939" status: 200 len: 647 microversion: 2.1 time: 0.057668 May 07 21:57:36.957615 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1588/3257] 10.222.0.32 () {58 vars in 1411 bytes} [Sat May 7 21:57:36 2022] GET /compute/v2.1/os-simple-tenant-usage/f62f599384054f23bddfbc3b3d1abf3d?start=2022-05-06T21%3A57%3A36.282939&end=2022-05-08T21%3A57%3A36.282939 => generated 647 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:36.962758 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5fe7a2c-186a-4045-b015-c2633dccfafc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.402349 May 07 21:57:36.963438 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1670/3258] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:36 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:36.977182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-df301b83-c227-47cd-a91d-11f6f01fd360 tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Calling method '.version_select at 0x7fc41c34c940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:36.992242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df301b83-c227-47cd-a91d-11f6f01fd360 tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:36.993244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df301b83-c227-47cd-a91d-11f6f01fd360 tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:37.021393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df301b83-c227-47cd-a91d-11f6f01fd360 tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:37.022062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df301b83-c227-47cd-a91d-11f6f01fd360 tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:37.243540 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-df301b83-c227-47cd-a91d-11f6f01fd360 tempest-TenantUsagesTestJSON-1846008641 tempest-TenantUsagesTestJSON-1846008641-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-06T21%3A57%3A36.282939&end=2022-05-08T21%3A57%3A36.282939&detailed=1" status: 200 len: 43795 microversion: 2.1 time: 0.259181 May 07 21:57:37.243540 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1671/3259] 10.222.0.32 () {58 vars in 1334 bytes} [Sat May 7 21:57:36 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-06T21%3A57%3A36.282939&end=2022-05-08T21%3A57%3A36.282939&detailed=1 => generated 43795 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:57:37.283734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:37.284595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:37.292131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:37.292813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:37.293839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:37.294791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:37.329751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:57:37.480634 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be6debd1-6c80-4ea7-a4a0-aa762a559183 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 204 len: 0 microversion: 2.1 time: 0.201180 May 07 21:57:37.482970 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1589/3260] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:57:37 2022] DELETE /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:57:37.494640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:37.496725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:37.507331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:37.508277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:37.509244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:37.509882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:37.985050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:37.986533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:37.995503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:37.996203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:37.997191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:37.997789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:38.057931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:38.084878 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-27a020d6-0794-4847-a2b3-9ca59f0231af tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1469 microversion: 2.1 time: 0.595549 May 07 21:57:38.088295 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1672/3261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:37 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1469 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:38.291678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:38.308517 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1333ff9a-b359-4e80-a794-032a30219531 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.329191 May 07 21:57:38.310182 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1590/3262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:37 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:39.127799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:39.128643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:39.141770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:39.142329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:39.144805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:39.144805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:39.339389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-672546953", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "361022fc-f38d-42f7-9311-cff7b49086c1"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:39.434924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] validate_networks() for [('361022fc-f38d-42f7-9311-cff7b49086c1', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:57:39.550789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:39.568922 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d3d0f2b-f07a-4fc7-9f07-f4749508e7eb tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1469 microversion: 2.1 time: 0.454399 May 07 21:57:39.583329 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1673/3263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:39 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:39.591684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:39.592612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:39.604612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:39.605088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:39.606272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:39.606729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:39.875552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:39.888637 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-df8dcfb5-3f98-459d-a7b4-5ddc8de734fc tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1508 microversion: 2.1 time: 0.302520 May 07 21:57:39.900202 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1674/3264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:39 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:40.589246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:40.589955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:40.599417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:40.603303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:40.604388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:40.607855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:40.741565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e412ac7281b34df69be98088aec5fd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62f599384054f23bddfbc3b3d1abf3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:40.757870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee260c0b-43fc-4852-899d-f0aebee976ac tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 200 len: 1427 microversion: 2.1 time: 0.174755 May 07 21:57:40.759664 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1675/3265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:40 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 1427 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:40.801904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-522fd3b7-edb8-4a68-a613-60b8e3cd1b28 req-6946dd11-2638-45f9-adff-26d5ceb92344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6108279-03de-4499-9a59-7c1f4fbd291b", "name": "network-vif-deleted", "tag": "3d52f5e6-5121-45cb-8de5-2a3d994fa234"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:40.833561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-522fd3b7-edb8-4a68-a613-60b8e3cd1b28 req-6946dd11-2638-45f9-adff-26d5ceb92344 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:40.834431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-522fd3b7-edb8-4a68-a613-60b8e3cd1b28 req-6946dd11-2638-45f9-adff-26d5ceb92344 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:40.887802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-522fd3b7-edb8-4a68-a613-60b8e3cd1b28 req-6946dd11-2638-45f9-adff-26d5ceb92344 service nova] Creating event network-vif-deleted:3d52f5e6-5121-45cb-8de5-2a3d994fa234 for instance c6108279-03de-4499-9a59-7c1f4fbd291b on nch2-master-1 May 07 21:57:40.907262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:57:40.908323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:57:40.908968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:57:40.909725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:57:40.910163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:57:40.914680 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-522fd3b7-edb8-4a68-a613-60b8e3cd1b28 req-6946dd11-2638-45f9-adff-26d5ceb92344 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112598 May 07 21:57:40.918817 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1676/3266] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:57:40.940487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:40.943450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:40.944365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:40.944966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:40.949847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:40.951420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:40.973071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:40.974112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:40.975407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:40.976103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:40.998552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Getting quotas for project 1a49ba5398834c43baabd7435e85d81b. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:57:41.006378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Getting quotas for user a8cd93dbf4db4d899a3c6148183be9f2 and project 1a49ba5398834c43baabd7435e85d81b. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:57:41.021447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Going to run 3 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:57:41.024174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:57:41.096008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=43947906-2565-4321-a6b4-84db6b89c14c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:57:41.182023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=a5e8392e-b439-457c-a474-09be8541f2d6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:57:41.291376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:41.302104 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dce353a5-0c7a-4fc4-b470-c0576a43bd17 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1529 microversion: 2.1 time: 0.380918 May 07 21:57:41.318802 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1677/3267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:40 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1529 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:41.357659 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cfe743d4-6616-4f6b-847e-e1415dc2077a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.238191 May 07 21:57:41.358516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1591/3268] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:57:41.371010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:41.378350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:41.379453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:57:41.416893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:41.418119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:41.419190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:41.419833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:41.449842 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88d883d2-5217-4235-87ce-96b32f0bc2e1 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.083850 May 07 21:57:41.451665 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1678/3269] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:57:41 2022] GET /compute/v2.1/servers => generated 1015 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:41.467787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-60bfe96e-0e8d-4f49-bdf2-852f9583e8c5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:41.469252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-60bfe96e-0e8d-4f49-bdf2-852f9583e8c5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:41.649253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-60bfe96e-0e8d-4f49-bdf2-852f9583e8c5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:41.659572 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-60bfe96e-0e8d-4f49-bdf2-852f9583e8c5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1222 microversion: 2.1 time: 0.197150 May 07 21:57:41.660562 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1592/3270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:41 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:41.689703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:41.690692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:41.699574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:41.700454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:41.701569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:41.702398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:41.776996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:41.777981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] [instance: c6108279-03de-4499-9a59-7c1f4fbd291b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:41.789052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:41.791522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:41.792829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:41.794008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:41.817225 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] HTTP exception thrown: Instance c6108279-03de-4499-9a59-7c1f4fbd291b could not be found. May 07 21:57:41.818051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] Returning 404 to user: Instance c6108279-03de-4499-9a59-7c1f4fbd291b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:57:41.819197 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6890e129-9976-4aa9-be48-e69bd21116a2 tempest-TenantUsagesTestJSON-1731718360 tempest-TenantUsagesTestJSON-1731718360-project] 10.222.0.32 "GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b" status: 404 len: 111 microversion: 2.1 time: 0.046283 May 07 21:57:41.820274 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1593/3271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:41 2022] GET /compute/v2.1/servers/c6108279-03de-4499-9a59-7c1f4fbd291b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:57:41.977908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:42.007792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:42.009327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:42.010600 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0990a994-d688-44b2-ae51-6f0e0fa5cab0 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2944 microversion: 2.32 time: 0.326817 May 07 21:57:42.018619 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1679/3272] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:41 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2944 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:42.053283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8997eaf-3824-4faa-a0e7-90386ae15127 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:42.054071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c8997eaf-3824-4faa-a0e7-90386ae15127 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:42.062808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8997eaf-3824-4faa-a0e7-90386ae15127 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:42.064645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8997eaf-3824-4faa-a0e7-90386ae15127 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:42.065777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8997eaf-3824-4faa-a0e7-90386ae15127 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:42.066241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8997eaf-3824-4faa-a0e7-90386ae15127 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:42.288084 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c8997eaf-3824-4faa-a0e7-90386ae15127 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.239494 May 07 21:57:42.297230 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1680/3273] 10.222.0.32 () {60 vars in 1315 bytes} [Sat May 7 21:57:42 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec/os-interface => generated 1830 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:57:42.338457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:42.339772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:42.348185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:42.349263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:42.362116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] Calling method '.version_select at 0x7fc41c3539d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:42.363209 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:57:42.363209 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 21:57:42.364633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:42.365351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:42.366327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:42.367131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:42.399163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:42.399606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:42.415847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:42.416479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:42.445861 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89a4d8cb-d755-435c-b16c-fe8a010b842d tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1573740632-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.464025 May 07 21:57:42.448433 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1594/3274] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:57:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:57:42.610367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:42.628224 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91f20a6b-3512-40ba-af6c-236c83df177c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.294665 May 07 21:57:42.637274 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1681/3275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:42 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:42.687456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0892e9c4-c891-4ed8-b78e-fc9391d07e75 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:42.689095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0892e9c4-c891-4ed8-b78e-fc9391d07e75 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:42.785910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0892e9c4-c891-4ed8-b78e-fc9391d07e75 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:42.800121 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0892e9c4-c891-4ed8-b78e-fc9391d07e75 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1222 microversion: 2.1 time: 0.118258 May 07 21:57:42.802719 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1595/3276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:42 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:43.655459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:43.657388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:43.684608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:43.685367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:43.689026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:43.693134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:43.819828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:43.821152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:43.829688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:43.851738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:43.855141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:43.855725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:44.264408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:44.267159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:44.285020 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ad9ffb3-95db-43df-ba27-328e0370a3d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.625912 May 07 21:57:44.303758 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12a9835a-8c70-4802-ad63-3c8f0e4ac5e4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1274 microversion: 2.1 time: 0.488279 May 07 21:57:44.307792 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1596/3277] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:43 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1274 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:44.309964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1682/3278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:43 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:45.323624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:45.325844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:45.328579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:45.331189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:45.352917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:45.353725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:45.365863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:45.366700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:45.372421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:45.373528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:45.379468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:45.380410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:45.599543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:45.612152 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-11c8433c-6bd7-443c-8b5e-eb78e9a21642 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1280 microversion: 2.1 time: 0.292919 May 07 21:57:45.626136 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1597/3279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:45 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1280 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:45.699183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:45.707144 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cbb769f1-bb30-4bf2-b583-8d92fe7a09aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.402023 May 07 21:57:45.710715 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1683/3280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:45 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:46.028650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e1d3e7e0-b540-420b-ab35-08b2513c929a req-083c4982-d8f0-4c2b-88db-9158f0316287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fb1f24-8416-4b15-b95f-ec086bc7ee8b", "name": "network-vif-plugged", "status": "completed", "tag": "0018a0ea-3b54-48b4-be4c-da78c12b4100"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:46.055481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e1d3e7e0-b540-420b-ab35-08b2513c929a req-083c4982-d8f0-4c2b-88db-9158f0316287 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:46.057168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e1d3e7e0-b540-420b-ab35-08b2513c929a req-083c4982-d8f0-4c2b-88db-9158f0316287 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:46.104381 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e1d3e7e0-b540-420b-ab35-08b2513c929a req-083c4982-d8f0-4c2b-88db-9158f0316287 service nova] Creating event network-vif-plugged:0018a0ea-3b54-48b4-be4c-da78c12b4100 for instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b on nch2-master-1 May 07 21:57:46.124203 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e1d3e7e0-b540-420b-ab35-08b2513c929a req-083c4982-d8f0-4c2b-88db-9158f0316287 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096002 May 07 21:57:46.124203 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1598/3281] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:46.632851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:46.633758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:46.666500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:46.668258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:46.670510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:46.674458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:46.733936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:46.734671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:46.745017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:46.746228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:46.747984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:46.749096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:47.380287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:47.390903 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7e68fd44-1f96-41ae-ac51-faf9052d0147 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.662022 May 07 21:57:47.393402 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1599/3282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:46 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:47.794591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-204229ee-84be-4f36-af26-0560aa8cf17d tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:47.808489 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-204229ee-84be-4f36-af26-0560aa8cf17d tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.208133 May 07 21:57:47.812832 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1600/3283] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:57:47.823490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e557ded2-ccac-43a8-b46e-763dba70ce13 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:47.849405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:47.851805 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e557ded2-ccac-43a8-b46e-763dba70ce13 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.031851 May 07 21:57:47.852902 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1601/3284] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:57:47 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:47.869802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dacf31d7-9347-4092-8f93-991a23290bc2 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1322 microversion: 2.1 time: 1.241159 May 07 21:57:47.873371 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1684/3285] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:46 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1322 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:47.878943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8740fd30-6bfc-4d90-9a38-c3e5b998b55a tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:47.892563 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8740fd30-6bfc-4d90-9a38-c3e5b998b55a tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025073 May 07 21:57:47.900424 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1602/3286] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:47.907078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b350fb4-632b-48da-a6cd-fc2527e23ccd tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:47.918937 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b350fb4-632b-48da-a6cd-fc2527e23ccd tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017549 May 07 21:57:47.932548 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1685/3287] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:47.949459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46f27c88-9959-41e2-86c4-1097f8bc3b19 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:47.989153 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-46f27c88-9959-41e2-86c4-1097f8bc3b19 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.049334 May 07 21:57:47.991406 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1603/3288] 10.222.0.32 () {58 vars in 1164 bytes} [Sat May 7 21:57:47 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:48.004424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0017bb7a-acfb-45ff-9c60-28b08e849cf2 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.027065 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0017bb7a-acfb-45ff-9c60-28b08e849cf2 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016508 May 07 21:57:48.028505 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1686/3289] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:48.040402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf6ab561-2342-49b0-9957-70f86de77611 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.064634 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bf6ab561-2342-49b0-9957-70f86de77611 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.027889 May 07 21:57:48.065883 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1604/3290] 10.222.0.32 () {58 vars in 1168 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:48.082441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0386f998-f7f5-4422-a5b3-0a743f04c533 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.101469 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0386f998-f7f5-4422-a5b3-0a743f04c533 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.025961 May 07 21:57:48.102910 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1687/3291] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:48.117043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd8a8b07-bdf4-4c25-a98b-3fbef14c532a tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.129591 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd8a8b07-bdf4-4c25-a98b-3fbef14c532a tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018497 May 07 21:57:48.132089 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1605/3292] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:48.143091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f39b6a15-209c-441f-b953-3c4c4957e667 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.219399 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f39b6a15-209c-441f-b953-3c4c4957e667 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.080781 May 07 21:57:48.233935 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1688/3293] 10.222.0.32 () {58 vars in 1166 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:48.234285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c99502f5-5018-4c7c-945d-db3d73ab9a29 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.249239 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c99502f5-5018-4c7c-945d-db3d73ab9a29 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018984 May 07 21:57:48.250983 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1606/3294] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:48.262534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6fa66777-9c99-4480-a8bd-d4c05200a676 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.300201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6fa66777-9c99-4480-a8bd-d4c05200a676 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038178 May 07 21:57:48.300970 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1689/3295] 10.222.0.32 () {58 vars in 1143 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:48.316450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e580fcb6-69fb-48ac-9216-15fd097ba055 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.339396 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e580fcb6-69fb-48ac-9216-15fd097ba055 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027809 May 07 21:57:48.340257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1607/3296] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:57:48.354953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-16f504c5-30d6-491a-8ddf-89d72747a3cf tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.393908 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-16f504c5-30d6-491a-8ddf-89d72747a3cf tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.045609 May 07 21:57:48.404582 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1690/3297] 10.222.0.32 () {58 vars in 1147 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:48.411928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.412766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:48.416201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b9736e8-8fb3-41c6-a1c6-c89514569367 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.421585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:48.422254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:48.423374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:48.425194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:48.445315 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b9736e8-8fb3-41c6-a1c6-c89514569367 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.042265 May 07 21:57:48.460389 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1608/3298] 10.222.0.32 () {58 vars in 1139 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:48.465259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-337f9678-32a8-402b-95d3-84c2121de740 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.477365 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-337f9678-32a8-402b-95d3-84c2121de740 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015563 May 07 21:57:48.485516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1609/3299] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:48.503931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fdb57103-f956-4b12-ad70-8fa3ed6aa523 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.589376 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fdb57103-f956-4b12-ad70-8fa3ed6aa523 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.091653 May 07 21:57:48.589975 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1610/3300] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:48.614312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-33d217f6-2c4f-498f-8dc2-86d886e2f39e tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.662121 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-33d217f6-2c4f-498f-8dc2-86d886e2f39e tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061151 May 07 21:57:48.663104 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1611/3301] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:48.678803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee8538cc-5c19-469b-a031-46a7de7bc255 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.690062 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee8538cc-5c19-469b-a031-46a7de7bc255 tempest-FlavorsV2TestJSON-963826644 tempest-FlavorsV2TestJSON-963826644-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016227 May 07 21:57:48.691613 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1612/3302] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:57:48.890914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:48.891549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:48.902594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:48.912487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:48.916194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:48.919554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:49.121454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:49.129986 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d50db4a3-b437-41f8-adb4-b0885ae7645f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.724212 May 07 21:57:49.147588 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1691/3303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:49.159164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5931ea4d-800d-4deb-ab72-e1589a6bc2f3 req-15b292cf-087c-4ea0-8f6d-6ab38a90287d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47cb701-ee25-43b2-9e1f-f5157564391c", "tag": "0bb8a966-61f0-4a95-bc07-6f7d9a13e2ba"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:49.209398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5931ea4d-800d-4deb-ab72-e1589a6bc2f3 req-15b292cf-087c-4ea0-8f6d-6ab38a90287d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:49.212099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5931ea4d-800d-4deb-ab72-e1589a6bc2f3 req-15b292cf-087c-4ea0-8f6d-6ab38a90287d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:49.247951 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5931ea4d-800d-4deb-ab72-e1589a6bc2f3 req-15b292cf-087c-4ea0-8f6d-6ab38a90287d service nova] Creating event network-changed:0bb8a966-61f0-4a95-bc07-6f7d9a13e2ba for instance c47cb701-ee25-43b2-9e1f-f5157564391c on nch1-master-1 May 07 21:57:49.259671 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5931ea4d-800d-4deb-ab72-e1589a6bc2f3 req-15b292cf-087c-4ea0-8f6d-6ab38a90287d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110432 May 07 21:57:49.265766 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1692/3304] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:49.562118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:49.603200 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d20552e-76e9-4d7e-9140-7b88bf89fbcb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1322 microversion: 2.1 time: 0.717155 May 07 21:57:49.606818 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1613/3305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:48 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:57:50.168112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:50.169508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:50.188659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:50.193168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:50.194377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:50.195136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:50.622085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:50.622816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:50.639456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:50.644858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:50.646292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:50.646981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:51.249608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:51.263630 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ffc7a7a6-7ffd-4cb2-bacb-4dc35f084f79 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 1.115152 May 07 21:57:51.265284 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1693/3306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:50 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:51.279576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-60d244d1-9bd9-474e-b479-27463e57301a req-813c5495-d94d-4849-ad72-f6b5ded8c94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5e8392e-b439-457c-a474-09be8541f2d6", "tag": "7c9e5f06-93e1-4633-9ae3-7e2cb99e2558"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:51.290299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-60d244d1-9bd9-474e-b479-27463e57301a req-813c5495-d94d-4849-ad72-f6b5ded8c94c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:51.291031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-60d244d1-9bd9-474e-b479-27463e57301a req-813c5495-d94d-4849-ad72-f6b5ded8c94c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:51.303799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:51.308475 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-60d244d1-9bd9-474e-b479-27463e57301a req-813c5495-d94d-4849-ad72-f6b5ded8c94c service nova] Creating event network-changed:7c9e5f06-93e1-4633-9ae3-7e2cb99e2558 for instance a5e8392e-b439-457c-a474-09be8541f2d6 on nch2-master-1 May 07 21:57:51.313577 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-60d244d1-9bd9-474e-b479-27463e57301a req-813c5495-d94d-4849-ad72-f6b5ded8c94c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045870 May 07 21:57:51.314391 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1694/3307] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:51.317541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e674e9cb-50c6-4a5b-a73f-5a641ca770ee tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1322 microversion: 2.1 time: 0.700856 May 07 21:57:51.319580 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1614/3308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:50 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:51.392866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9496d447-0aa5-4b31-90d2-ab9dc7fa881e req-f0f2a285-8d57-4d40-8c3d-764d8e720a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43947906-2565-4321-a6b4-84db6b89c14c", "tag": "54042997-611b-42f5-81e6-26872474a903"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:51.428440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9496d447-0aa5-4b31-90d2-ab9dc7fa881e req-f0f2a285-8d57-4d40-8c3d-764d8e720a7f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:51.431503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9496d447-0aa5-4b31-90d2-ab9dc7fa881e req-f0f2a285-8d57-4d40-8c3d-764d8e720a7f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:51.446571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66ea4880-3e72-48f0-ac8a-fbeeb67a22e3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:51.447364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-66ea4880-3e72-48f0-ac8a-fbeeb67a22e3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:51.463065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ea4880-3e72-48f0-ac8a-fbeeb67a22e3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:51.472869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ea4880-3e72-48f0-ac8a-fbeeb67a22e3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:51.476896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ea4880-3e72-48f0-ac8a-fbeeb67a22e3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:51.478909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ea4880-3e72-48f0-ac8a-fbeeb67a22e3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:51.494013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9496d447-0aa5-4b31-90d2-ab9dc7fa881e req-f0f2a285-8d57-4d40-8c3d-764d8e720a7f service nova] Creating event network-changed:54042997-611b-42f5-81e6-26872474a903 for instance 43947906-2565-4321-a6b4-84db6b89c14c on nch1-master-1 May 07 21:57:51.504868 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9496d447-0aa5-4b31-90d2-ab9dc7fa881e req-f0f2a285-8d57-4d40-8c3d-764d8e720a7f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117804 May 07 21:57:51.514434 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1695/3309] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:51.527815 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66ea4880-3e72-48f0-ac8a-fbeeb67a22e3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/ips" status: 200 len: 152 microversion: 2.20 time: 0.085848 May 07 21:57:51.528432 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1615/3310] 10.222.0.32 () {60 vars in 1288 bytes} [Sat May 7 21:57:51 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/ips => generated 152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:57:52.285013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:52.286340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:52.306789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:52.307314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:52.308135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:52.308775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:52.334389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:52.335057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:52.348276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:52.348686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:52.349495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:52.349945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:53.081181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:53.108160 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b0a60bb5-b985-4db4-b7c7-ed7c1ce6d9f0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1322 microversion: 2.1 time: 0.777525 May 07 21:57:53.111450 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1616/3311] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:52 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:53.503475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:53.513220 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8d6ccb0-11bc-4f9c-b62f-f699837396d1 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 1.235851 May 07 21:57:53.513829 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1696/3312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:52 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:54.127548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:54.128173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:54.138210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:54.142041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:54.143087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:54.143689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:54.342473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:54.344609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:54.356584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:54.357294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:54.361105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:54.361798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:54.684463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:54.692790 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ef4bc332-bda8-459f-b881-8f8aabee7ea8 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1322 microversion: 2.1 time: 0.570216 May 07 21:57:54.694265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lazy-loading 'flavor' on Instance uuid 83ad7d9c-5e14-44b9-a948-c9c337d99f0c {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:57:54.697750 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1617/3313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:54 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:54.711415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:54.712281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:54.724589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:54.725247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:54.726428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:54.727051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:55.144933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:55.152432 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6182fe2-c95f-4a28-8528-f428bff7dac5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.453182 May 07 21:57:55.168023 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1618/3314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:54 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:55.261514 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c1e1cdcc-c813-4549-8551-ae095da1e632 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/action" status: 202 len: 0 microversion: 2.20 time: 0.922084 May 07 21:57:55.266018 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1697/3315] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:57:54 2022] POST /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/action => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 07 21:57:55.273193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:55.274304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:55.286740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:55.287364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:55.290763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:55.291250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:55.719316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:55.735286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:55.761901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:55.762370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:55.763203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:55.763828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:55.768962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:55.778347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:55.787537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:55.789096 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b3d6fae4-4805-4a60-8fec-44a1d12fa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.521601 May 07 21:57:55.803160 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1619/3316] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:55 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:56.175245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:56.177375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:56.192296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:56.194668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:56.199047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:56.199724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:56.389406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:56.401092 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7eb513d-7e9b-4a0c-8645-338d7c4d7dd6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1322 microversion: 2.1 time: 0.692186 May 07 21:57:56.401711 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1698/3317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:55 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1322 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:56.485370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:56.497257 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-185ac3f6-d962-4598-8f2b-1aee4d096458 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.327143 May 07 21:57:56.499950 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1620/3318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:56 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:56.511202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d2cbf195-3b5d-4ad9-adaf-d035b1bb99ea req-da9be544-7522-43d1-a141-7784b465ea97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cb701-ee25-43b2-9e1f-f5157564391c", "name": "network-vif-plugged", "status": "completed", "tag": "0bb8a966-61f0-4a95-bc07-6f7d9a13e2ba"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:57:56.527213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d2cbf195-3b5d-4ad9-adaf-d035b1bb99ea req-da9be544-7522-43d1-a141-7784b465ea97 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:56.529145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d2cbf195-3b5d-4ad9-adaf-d035b1bb99ea req-da9be544-7522-43d1-a141-7784b465ea97 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:56.555899 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d2cbf195-3b5d-4ad9-adaf-d035b1bb99ea req-da9be544-7522-43d1-a141-7784b465ea97 service nova] Creating event network-vif-plugged:0bb8a966-61f0-4a95-bc07-6f7d9a13e2ba for instance c47cb701-ee25-43b2-9e1f-f5157564391c on nch1-master-1 May 07 21:57:56.568326 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d2cbf195-3b5d-4ad9-adaf-d035b1bb99ea req-da9be544-7522-43d1-a141-7784b465ea97 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060061 May 07 21:57:56.569722 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1699/3319] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:57:56.812655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:56.813589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:56.827553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:56.829244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:56.831373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:56.832055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:57.170160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:57.182748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:57.189133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:57.196261 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-870c6962-450c-4e7c-89d9-8adbc224be3f tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.388727 May 07 21:57:57.198974 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1621/3320] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:56 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:57.422025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:57.422732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:57.440424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:57.441114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:57.442131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:57.445834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:57.515055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:57.515993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:57.527447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:57.531707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:57.534619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:57.535312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:57.837447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:57.846460 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b2dd208b-c2f1-4625-9917-1f2d13adbd83 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.335226 May 07 21:57:57.850793 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1622/3321] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:57 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:58.025078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:58.036802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f41ca190-568b-4515-aee4-e3835cdf6b44 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1322 microversion: 2.1 time: 0.618223 May 07 21:57:58.048443 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1700/3322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:57 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:58.217970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:58.219331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:58.231347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:58.233658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:58.234892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:58.235502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:58.878607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:58.879277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:58.928621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:58.928814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:58.929610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:58.930051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:59.161181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:59.182261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:59.184097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:59.185682 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7025f2e2-0405-44f9-aa04-7921e8e3e4f1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.973630 May 07 21:57:59.187552 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1623/3323] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:57:58 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:57:59.206344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:59.207383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:59.229705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:59.230303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:59.232096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:59.235389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:59.466335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:59.478425 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-709d8884-13dd-4593-8fb7-316ff0436c76 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.614997 May 07 21:57:59.489470 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1701/3324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:58 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:59.618133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:57:59.627827 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-df7eb3bd-4104-4ef4-bb8c-999f73fbed9f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 200 len: 1515 microversion: 2.1 time: 0.438139 May 07 21:57:59.628841 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1624/3325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:59 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 1515 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:57:59.647928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:57:59.648561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:57:59.666331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:59.667677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:57:59.669459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:57:59.674639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:00.208252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:00.209148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:00.223267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:00.224107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:00.225176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:00.226262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:00.424735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:00.435775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:00.437769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:00.439209 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e28d36cc-a590-4885-b947-e558165807b2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.235022 May 07 21:58:00.440801 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1625/3326] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:00 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:00.497971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:00.499966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:00.516582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:00.518614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:00.522760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:00.523495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:00.735252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:00.744926 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29ea64c7-4666-4299-9460-776b7e9a0f0e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.252510 May 07 21:58:00.747032 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1626/3327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:00 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:00.752647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c1f100b2-6194-43a6-a1f8-ad46c03110a1 req-c29a72d0-282f-400f-b370-0977aadd62d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43947906-2565-4321-a6b4-84db6b89c14c", "name": "network-vif-plugged", "status": "completed", "tag": "54042997-611b-42f5-81e6-26872474a903"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:00.762113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c1f100b2-6194-43a6-a1f8-ad46c03110a1 req-c29a72d0-282f-400f-b370-0977aadd62d5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:00.762910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c1f100b2-6194-43a6-a1f8-ad46c03110a1 req-c29a72d0-282f-400f-b370-0977aadd62d5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:00.783965 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c1f100b2-6194-43a6-a1f8-ad46c03110a1 req-c29a72d0-282f-400f-b370-0977aadd62d5 service nova] Creating event network-vif-plugged:54042997-611b-42f5-81e6-26872474a903 for instance 43947906-2565-4321-a6b4-84db6b89c14c on nch1-master-1 May 07 21:58:00.790725 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c1f100b2-6194-43a6-a1f8-ad46c03110a1 req-c29a72d0-282f-400f-b370-0977aadd62d5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041483 May 07 21:58:00.792464 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1627/3328] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:00.906311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:00.921330 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ef3a1ba-378f-4856-8ac3-95ae650501f6 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 200 len: 1322 microversion: 2.1 time: 1.277291 May 07 21:58:00.922585 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1702/3329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:57:59 2022] GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 1322 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:01.459600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:01.460310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:01.470368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:01.471039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:01.471881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:01.472331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:01.668503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:01.713665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:01.724973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:01.728941 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fed43ac9-7397-4425-8a65-64c612090105 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.271916 May 07 21:58:01.742958 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1628/3330] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:01 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:01.762472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:01.763383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:01.783241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:01.784448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:01.788456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:01.789148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:01.940864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:01.941472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:01.951126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:01.951599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:01.957338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:01.957859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:02.143872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:02.158920 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44af1010-8a47-4a03-842f-2865b23aab7c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.400897 May 07 21:58:02.160265 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1703/3331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:01 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:02.206597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:02.226619 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7b143bc6-c099-45b8-b765-9ce1c62ff6c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 200 len: 1322 microversion: 2.1 time: 0.290896 May 07 21:58:02.228257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1629/3332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:01 2022] GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:02.751843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:02.752805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:02.762482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:02.764139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:02.767490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:02.769879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:02.910183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a52093a8-9f3f-4e3d-a586-78623acca1bb req-c280e657-995c-4bc6-a34a-1ba1ec93a81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e8392e-b439-457c-a474-09be8541f2d6", "name": "network-vif-plugged", "status": "completed", "tag": "7c9e5f06-93e1-4633-9ae3-7e2cb99e2558"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:02.944943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a52093a8-9f3f-4e3d-a586-78623acca1bb req-c280e657-995c-4bc6-a34a-1ba1ec93a81a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:02.945444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a52093a8-9f3f-4e3d-a586-78623acca1bb req-c280e657-995c-4bc6-a34a-1ba1ec93a81a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:02.971510 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a52093a8-9f3f-4e3d-a586-78623acca1bb req-c280e657-995c-4bc6-a34a-1ba1ec93a81a service nova] Creating event network-vif-plugged:7c9e5f06-93e1-4633-9ae3-7e2cb99e2558 for instance a5e8392e-b439-457c-a474-09be8541f2d6 on nch2-master-1 May 07 21:58:03.000020 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a52093a8-9f3f-4e3d-a586-78623acca1bb req-c280e657-995c-4bc6-a34a-1ba1ec93a81a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077363 May 07 21:58:03.005822 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1630/3333] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:03.180618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:03.181665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:03.208050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:03.208437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:03.211753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:03.212209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:03.322813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:03.340708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:03.344984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:03.349709 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af506cfb-0cc7-4a80-8b22-b6c01629447e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.604009 May 07 21:58:03.353107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1704/3334] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:02 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:03.362288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:03.364911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:03.384408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:03.386090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:03.387207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:03.388091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:03.532695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:03.545649 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5fcbd4f4-c8c1-47a4-a396-27718cbbb3c2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1524 microversion: 2.1 time: 0.370251 May 07 21:58:03.548029 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1631/3335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:03 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1524 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:03.711403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:03.726249 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57c5559d-e9aa-47aa-a37f-b744a3bf661f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 200 len: 1322 microversion: 2.1 time: 0.371860 May 07 21:58:03.741037 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1705/3336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:03 2022] GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:04.371548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:04.372699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:04.382510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:04.384780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:04.386120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:04.386855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:04.583037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:04.585510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:04.617543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:04.618396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:04.619752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:04.620405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:04.875744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:04.886101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:04.890651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:04.892770 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31205fa7-5113-4d97-b072-52aee73862b5 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.527002 May 07 21:58:04.896032 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1632/3337] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:04 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:04.931088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:04.932527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:04.942006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:04.943094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:04.944184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:04.944921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.246926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:05.254883 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae060828-2d79-4f18-98a9-8214b5c7217e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1506 microversion: 2.1 time: 0.693063 May 07 21:58:05.259107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1706/3338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:04 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:58:05.277371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:05.299338 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05af8958-321e-482e-a7cb-7f637cb3f0a7 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 200 len: 1514 microversion: 2.1 time: 0.398884 May 07 21:58:05.300574 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1633/3339] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:04 2022] GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 1514 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:05.320397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:05.321380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:05.330011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.337126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.338153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.340210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.710890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:05.720144 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2583814e-5ab6-433e-811d-863131dd2056 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c" status: 200 len: 1515 microversion: 2.1 time: 0.405265 May 07 21:58:05.720943 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1707/3340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:05 2022] GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:05.739865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:05.741083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:05.749547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.750243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.751110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.751622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.784041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:58:05.913861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:05.915006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:05.932008 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4e9dd8d-090d-4bc8-8445-353b0258c5c4 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c" status: 204 len: 0 microversion: 2.1 time: 0.191626 May 07 21:58:05.933129 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1634/3341] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:58:05 2022] DELETE /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:05.945406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.946753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.950391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.951207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.954469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:05.961588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:05.971867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.979373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:05.980229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:05.980682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:06.204259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:06.221379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:06.222964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:06.224161 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-54bb199e-8ba4-4f89-8438-99401ad8616b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1746 microversion: 2.20 time: 0.315135 May 07 21:58:06.224723 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1708/3342] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:05 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1746 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:06.276169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:06.277097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:06.285381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:06.286123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:06.287382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:06.288245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:06.289629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:06.304054 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23088273-7cd1-4afa-83e8-a221c28027b5 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c" status: 200 len: 1521 microversion: 2.1 time: 0.360155 May 07 21:58:06.306025 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1635/3343] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:05 2022] GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:06.666642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:06.685996 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1dc6146-44c1-4134-9d21-f25c6ea0b283 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1506 microversion: 2.1 time: 0.414744 May 07 21:58:06.687688 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1709/3344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:06 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:58:07.254244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:07.256820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:07.278713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:07.280558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:07.285842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:07.286683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:07.357398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e11afe1-ac47-411a-a775-5ad66b883ee6 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Action: 'create', calling method: .version_select at 0x7fc41c35d940>, body: {"pool": null} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:07.606357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:07.624502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:07.627007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:07.631541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2f29912b-ac98-4270-8240-6a441ff45d29 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1746 microversion: 2.20 time: 0.388099 May 07 21:58:07.634636 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1710/3345] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:07 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1746 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:07.645775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:07.647516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:07.656360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:07.657224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:07.658239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:07.659226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:07.940165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:07.955141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d531caee-1933-415d-bc27-3d06dd562799 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c" status: 200 len: 1521 microversion: 2.1 time: 0.318958 May 07 21:58:07.957096 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1711/3346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:07 2022] GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:07.962442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:07.963357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:07.987850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:07.988628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:07.989622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:07.990234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:08.288557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:08.302188 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3148b6d7-21bf-4898-8d37-ef23418e7b03 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 200 len: 1449 microversion: 2.1 time: 0.342743 May 07 21:58:08.315246 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1712/3347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:07 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 1449 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:08.340413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1c62d256-d1aa-4ccc-854b-0d0747c0ee9e req-3d20416b-cf5a-44d6-9124-e2ab27d8b7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fb1f24-8416-4b15-b95f-ec086bc7ee8b", "name": "network-vif-unplugged", "status": "completed", "tag": "0018a0ea-3b54-48b4-be4c-da78c12b4100"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:08.362645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1c62d256-d1aa-4ccc-854b-0d0747c0ee9e req-3d20416b-cf5a-44d6-9124-e2ab27d8b7b5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:08.363803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1c62d256-d1aa-4ccc-854b-0d0747c0ee9e req-3d20416b-cf5a-44d6-9124-e2ab27d8b7b5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:08.388075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.compute.server_external_events [req-1c62d256-d1aa-4ccc-854b-0d0747c0ee9e req-3d20416b-cf5a-44d6-9124-e2ab27d8b7b5 service nova] Unable to find a host for instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b. Dropping event network-vif-unplugged {{(pid=136682) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 07 21:58:08.398625 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1c62d256-d1aa-4ccc-854b-0d0747c0ee9e req-3d20416b-cf5a-44d6-9124-e2ab27d8b7b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080027 May 07 21:58:08.399768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1713/3348] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 07 21:58:08.412260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:08.414233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:08.430165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:08.431672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:08.434159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:08.434876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:08.503132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:58:08.520712 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Working on deleting snapshot db31fc59-6333-4457-982b-6734a6cec1d7 from shelved instance... May 07 21:58:09.867858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Doing local delete in cell 6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=136682) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 07 21:58:09.869527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:09.871001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:09.871662 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 07 21:58:09.876198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] deallocate_for_instance() {{(pid=136682) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 07 21:58:10.756351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Updating instance_info_cache with network_info: [] {{(pid=136682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 21:58:11.118539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a10fe80-c106-450b-b876-8d44af716a6e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 204 len: 0 microversion: 2.1 time: 2.713668 May 07 21:58:11.120600 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1714/3349] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:58:08 2022] DELETE /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 0 bytes in 2720 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:11.131664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-82eb0d5e-1c35-4271-b2c0-75ac8a323041 req-5c9980b1-dace-4869-a751-b8e829436de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43947906-2565-4321-a6b4-84db6b89c14c", "name": "network-vif-deleted", "tag": "54042997-611b-42f5-81e6-26872474a903"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:11.142629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-82eb0d5e-1c35-4271-b2c0-75ac8a323041 req-5c9980b1-dace-4869-a751-b8e829436de3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.143601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-82eb0d5e-1c35-4271-b2c0-75ac8a323041 req-5c9980b1-dace-4869-a751-b8e829436de3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.164090 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-82eb0d5e-1c35-4271-b2c0-75ac8a323041 req-5c9980b1-dace-4869-a751-b8e829436de3 service nova] Creating event network-vif-deleted:54042997-611b-42f5-81e6-26872474a903 for instance 43947906-2565-4321-a6b4-84db6b89c14c on nch1-master-1 May 07 21:58:11.172406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-82eb0d5e-1c35-4271-b2c0-75ac8a323041 req-5c9980b1-dace-4869-a751-b8e829436de3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046818 May 07 21:58:11.173926 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1715/3350] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:11.180364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:11.181311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:11.197089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.197894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.199011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.199646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.464952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:11.478814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:11.482927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:11.487487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-58e4c7c4-e829-450c-ac09-c592d44b2722 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.312081 May 07 21:58:11.489021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1716/3351] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:11 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:11.498438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:11.499251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:11.506567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.507286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.508299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.508850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.526555 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] HTTP exception thrown: Instance 43947906-2565-4321-a6b4-84db6b89c14c could not be found. May 07 21:58:11.527399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 404 to user: Instance 43947906-2565-4321-a6b4-84db6b89c14c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:11.528366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd847d01-4f1c-49c4-b625-8e42ebe9d9b3 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c" status: 404 len: 111 microversion: 2.1 time: 0.035722 May 07 21:58:11.529310 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1717/3352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:11 2022] GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:11.536485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:11.537256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:11.545063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.546394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.547456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.548029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.569453 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b could not be found. May 07 21:58:11.570352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:11.571226 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9234a27-fcc1-456a-8c64-5c9fd42204b9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 404 len: 111 microversion: 2.1 time: 0.041081 May 07 21:58:11.574954 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1718/3353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:11 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:11.596507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:11.600281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:11.601264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:11.612641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.613146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.614535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:11.615200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:11.800884 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c511739-d80d-44c2-9edf-3cbe2f58cadc tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.227550 May 07 21:58:11.801742 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1719/3354] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:58:11 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:58:11.831135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1736125444", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "9b7653d0-c69e-4364-9ed6-1c005b136d81"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:11.925472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] validate_networks() for [('9b7653d0-c69e-4364-9ed6-1c005b136d81', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:58:11.986337 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e11afe1-ac47-411a-a775-5ad66b883ee6 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 4.795788 May 07 21:58:11.992648 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1636/3355] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:58:07 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 4798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:11.993523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e03af6a1-c382-4b20-8f83-66142a72b501 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:11.995073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e03af6a1-c382-4b20-8f83-66142a72b501 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:12.000064 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e03af6a1-c382-4b20-8f83-66142a72b501 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.011870 May 07 21:58:12.000888 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1637/3356] 10.222.0.32 () {58 vars in 1181 bytes} [Sat May 7 21:58:11 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:58:12.010924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85014e8d-cd22-4e56-891a-69eb108e9704 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Calling method '.version_select at 0x7fc41c350c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:12.611321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:58:12.611321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:58:12.611974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:58:12.613994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:58:12.613994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:58:12.637964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:12.638428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:12.640119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:12.640569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:12.670499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:12.681236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for user 228761ebf4c0406ab0977cabe351ac76 and project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:12.697329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:58:12.699731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:58:12.771050 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-819d229c-70a2-467b-a5d7-8ad1b6e85602 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955955 May 07 21:58:12.772111 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1720/3357] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:58:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:58:12.792392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:12.803836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:12.805857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:12.842738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:12.843254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:12.844110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:12.844556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:12.881426 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85014e8d-cd22-4e56-891a-69eb108e9704 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/53f67c17-d381-46dd-bca2-0f5b2570ca0f" status: 200 len: 140 microversion: 2.1 time: 0.879264 May 07 21:58:12.882074 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1638/3358] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:58:12 2022] GET /compute/v2.1/os-floating-ips/53f67c17-d381-46dd-bca2-0f5b2570ca0f => generated 140 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:12.891813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bd0015a4-9c59-412e-8457-3a4b03e22c52 req-326521f7-250d-4705-9f3f-ae220e2cb399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ad7d9c-5e14-44b9-a948-c9c337d99f0c", "name": "network-vif-plugged", "status": "completed", "tag": "d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:12.924213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bd0015a4-9c59-412e-8457-3a4b03e22c52 req-326521f7-250d-4705-9f3f-ae220e2cb399 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:12.924766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bd0015a4-9c59-412e-8457-3a4b03e22c52 req-326521f7-250d-4705-9f3f-ae220e2cb399 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:12.950458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:58:12.965545 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bd0015a4-9c59-412e-8457-3a4b03e22c52 req-326521f7-250d-4705-9f3f-ae220e2cb399 service nova] Creating event network-vif-plugged:d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2 for instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c on nch1-master-1 May 07 21:58:12.985427 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bd0015a4-9c59-412e-8457-3a4b03e22c52 req-326521f7-250d-4705-9f3f-ae220e2cb399 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101808 May 07 21:58:12.986075 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1639/3359] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:13.015427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.018710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:13.038200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:13.038659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:13.044216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:13.045000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:13.072528 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12ef77b1-7f62-4ae0-a53a-d0edd0427d54 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.294851 May 07 21:58:13.073993 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1721/3360] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:58:12 2022] GET /compute/v2.1/servers => generated 681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:13.087074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90786d80-ad57-49fb-9b9f-0b2facd3ff05 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.088125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-90786d80-ad57-49fb-9b9f-0b2facd3ff05 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:13.385759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-90786d80-ad57-49fb-9b9f-0b2facd3ff05 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:13.393713 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90786d80-ad57-49fb-9b9f-0b2facd3ff05 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1215 microversion: 2.1 time: 0.317384 May 07 21:58:13.399613 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1722/3361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:13 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:13.421884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d81d1906-62bd-4fbf-991f-69ecf4ae2fae tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Calling method '.version_select at 0x7fc41c429670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.502089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:13.517840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:13.519800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:13.521980 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5625d43a-9bd4-4f11-b3e3-1952e77c2945 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.534260 May 07 21:58:13.522729 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1640/3362] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:12 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:13.554179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.568786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:13.570870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.servers [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Removing options 'limit' from query {{(pid=136681) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 07 21:58:13.572058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:13.580181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:13.581092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:13.595125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:13.597745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:13.667947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:58:13.752928 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c1edd06f-f202-4d76-a710-6f2d0ec1184e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.228619 May 07 21:58:13.753752 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1641/3363] 10.222.0.32 () {58 vars in 1143 bytes} [Sat May 7 21:58:13 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:13.764069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2c3d7140-dd94-4df1-87c0-8a557a16c430 req-3da88949-0f11-4651-874c-e2f6be0de5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fb1f24-8416-4b15-b95f-ec086bc7ee8b", "name": "network-vif-deleted", "tag": "0018a0ea-3b54-48b4-be4c-da78c12b4100"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:13.776010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2c3d7140-dd94-4df1-87c0-8a557a16c430 req-3da88949-0f11-4651-874c-e2f6be0de5b8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:13.776775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2c3d7140-dd94-4df1-87c0-8a557a16c430 req-3da88949-0f11-4651-874c-e2f6be0de5b8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:13.793194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.server_external_events [req-2c3d7140-dd94-4df1-87c0-8a557a16c430 req-3da88949-0f11-4651-874c-e2f6be0de5b8 service nova] Unable to find a host for instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b. Dropping event network-vif-deleted {{(pid=136681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 07 21:58:13.794594 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2c3d7140-dd94-4df1-87c0-8a557a16c430 req-3da88949-0f11-4651-874c-e2f6be0de5b8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039717 May 07 21:58:13.796385 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1642/3364] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 07 21:58:13.801750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-086b76cb-32de-497c-8337-b0680618b65f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.803390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-086b76cb-32de-497c-8337-b0680618b65f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:13.804567 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-086b76cb-32de-497c-8337-b0680618b65f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.007015 May 07 21:58:13.807421 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1643/3365] 10.222.0.32 () {58 vars in 1141 bytes} [Sat May 7 21:58:13 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:58:13.819305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6448c42a-1e36-4295-a63a-607859b51aef tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.820788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6448c42a-1e36-4295-a63a-607859b51aef tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:13.821768 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6448c42a-1e36-4295-a63a-607859b51aef tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.008309 May 07 21:58:13.823124 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1644/3366] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:58:13 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:58:13.833249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e66747d-81e6-4739-b154-86c231862942 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.843273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e66747d-81e6-4739-b154-86c231862942 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:13.844172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e66747d-81e6-4739-b154-86c231862942 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:13.855473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.servers [None req-8e66747d-81e6-4739-b154-86c231862942 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Flavor 'non_existing_flavor' could not be found {{(pid=136681) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 07 21:58:13.857215 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e66747d-81e6-4739-b154-86c231862942 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.029219 May 07 21:58:13.858844 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1645/3367] 10.222.0.32 () {58 vars in 1177 bytes} [Sat May 7 21:58:13 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:58:13.871908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:13.875882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:13.876804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:13.883107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:13.883888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:13.884848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:13.885483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:14.012716 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d81d1906-62bd-4fbf-991f-69ecf4ae2fae tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips" status: 200 len: 143 microversion: 2.1 time: 0.610389 May 07 21:58:14.014696 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1723/3368] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 21:58:13 2022] GET /compute/v2.1/os-floating-ips => generated 143 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:14.031528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b467d400-1811-4019-bc43-242afed378b2 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Calling method '.version_select at 0x7fc42271e280>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:14.132324 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee24f73a-fa8f-460b-9c5c-aed474af0200 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.265458 May 07 21:58:14.132923 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1646/3369] 10.222.0.32 () {58 vars in 1173 bytes} [Sat May 7 21:58:13 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:58:14.145361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:14.152581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:14.153606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:14.161725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:14.162592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:14.174196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:14.174689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:14.579227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-41b96a2c-946e-477c-b204-a10bea20070e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.437584 May 07 21:58:14.580393 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1647/3370] 10.222.0.32 () {58 vars in 1183 bytes} [Sat May 7 21:58:14 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:58:14.586700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:14.587720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:14.594476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:14.595020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:14.595815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:14.596305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:14.691925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:14.705256 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-26ad088e-9c94-4db4-b6af-178b6bfc4c98 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1267 microversion: 2.1 time: 0.123579 May 07 21:58:14.707095 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1648/3371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:14 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:14.714581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:14.715460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:14.725273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:14.726020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:14.727729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:14.728504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:15.067907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:15.077999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:15.079989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:15.082830 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3e6ef03-0f42-4e04-a95c-5ca075b03ff1 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.373911 May 07 21:58:15.083716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1649/3372] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:14 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:15.102763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:15.112233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:15.112233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:15.117139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:15.120524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:15.120524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:15.120524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:15.219532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:58:15.338416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:15.347737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:15.348433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:15.974954 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-70990455-ac87-4706-9332-24127f99eed0 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.888707 May 07 21:58:15.997847 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1650/3373] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 21:58:15 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:16.008867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:16.009677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:16.017863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.018550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.019964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.020563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.325688 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b467d400-1811-4019-bc43-242afed378b2 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/53f67c17-d381-46dd-bca2-0f5b2570ca0f" status: 202 len: 0 microversion: 2.1 time: 2.301824 May 07 21:58:16.326286 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1724/3374] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:58:14 2022] DELETE /compute/v2.1/os-floating-ips/53f67c17-d381-46dd-bca2-0f5b2570ca0f => generated 0 bytes in 2303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:58:16.332785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-38eed59a-3cc3-41e7-988d-3b0b2df2382c tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:16.340598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-38eed59a-3cc3-41e7-988d-3b0b2df2382c tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:16.341821 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-38eed59a-3cc3-41e7-988d-3b0b2df2382c tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014303 May 07 21:58:16.343234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:16.349799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1725/3375] 10.222.0.32 () {58 vars in 1177 bytes} [Sat May 7 21:58:16 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 21:58:16.355104 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-39cd6e81-39a0-4d67-9ebf-d78e5ef226bb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 0.354649 May 07 21:58:16.361980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:16.362970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:16.367938 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1651/3376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:15 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:16.370614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.382140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5612a078-0838-4680-916b-aff2039400fd tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Action: 'create', calling method: .version_select at 0x7fc41c350e50>, body: {"pool": null} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:16.383104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.384189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.384875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.662505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:16.678986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:16.685378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:16.688272 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2e6c08a7-e211-4d60-9025-1064cdc01571 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.343929 May 07 21:58:16.701948 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1726/3377] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:16 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:16.712002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:16.715566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:16.722386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Searching by: {'deleted': False, 'project_id': '1a49ba5398834c43baabd7435e85d81b'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 21:58:16.732091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.732647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.735087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.735550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.791495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 21:58:16.859691 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3da6692f-9f6d-41dd-99b6-8fadffb05e6f tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.158614 May 07 21:58:16.861989 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1727/3378] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 21:58:16 2022] GET /compute/v2.1/servers => generated 681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:16.878629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:16.881466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:16.898860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.899317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.900131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.900581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.935041 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] HTTP exception thrown: Instance 43947906-2565-4321-a6b4-84db6b89c14c could not be found. May 07 21:58:16.935559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 404 to user: Instance 43947906-2565-4321-a6b4-84db6b89c14c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:16.936451 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-18b798c0-c460-42ba-b488-d59570c1a8e9 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c" status: 404 len: 111 microversion: 2.1 time: 0.063602 May 07 21:58:16.943460 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1728/3379] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:58:16 2022] DELETE /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:16.948279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:16.948791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:16.974872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.975345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:16.976160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:16.976608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.039404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:58:17.206803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e035d76-2fc2-4d40-94a8-aea6f5476f88 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 204 len: 0 microversion: 2.1 time: 0.261960 May 07 21:58:17.207467 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1729/3380] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:58:16 2022] DELETE /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:17.227356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:17.227978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:17.244950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.245420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.246235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.246685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.303001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:58:17.472677 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-01d16643-5aa2-4950-b82d-845f2a3b0c0a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 204 len: 0 microversion: 2.1 time: 0.259015 May 07 21:58:17.474297 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1730/3381] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:58:17 2022] DELETE /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:17.487155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:17.488204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:17.495991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.496777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.497746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.498405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.696087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:17.714668 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f74dcb94-db0d-42e9-8bfa-0ede7c8cb3a5 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 0.235912 May 07 21:58:17.726148 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1731/3382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:17 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:17.741779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:17.742891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: 43947906-2565-4321-a6b4-84db6b89c14c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:17.751555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.753037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.755561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.756421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.773264 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] HTTP exception thrown: Instance 43947906-2565-4321-a6b4-84db6b89c14c could not be found. May 07 21:58:17.774197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 404 to user: Instance 43947906-2565-4321-a6b4-84db6b89c14c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:17.775294 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-761e42b2-b9bd-414e-819f-e6a3a4ce3e8e tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c" status: 404 len: 111 microversion: 2.1 time: 0.047764 May 07 21:58:17.776064 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1732/3383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:17 2022] GET /compute/v2.1/servers/43947906-2565-4321-a6b4-84db6b89c14c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:17.780964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:17.781980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:17.788384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.789033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:17.791978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:17.792634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:18.162469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:18.181570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:18.187415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:18.190365 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b9ef0d5-e661-4a08-b429-a9f44e262c6d tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.412274 May 07 21:58:18.193188 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1733/3384] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:17 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:18.219796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:18.220467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:18.237201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:18.237672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:18.238489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:18.238980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:18.670211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:18.680073 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5df30310-814b-45c9-89a2-73d2c489a1fb tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 200 len: 1520 microversion: 2.1 time: 0.485738 May 07 21:58:18.680677 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1734/3385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:18 2022] GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 1520 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:18.693686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-24da0f31-3c6e-4246-879a-28233239d800 req-8e75655c-5300-4a75-9a9e-4f2c5fe3c2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f949ce-22d7-44fa-a1f2-d579d5bd9d12", "tag": "bb2fe61d-de4d-4309-8907-7aa8991753d3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:18.714424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-24da0f31-3c6e-4246-879a-28233239d800 req-8e75655c-5300-4a75-9a9e-4f2c5fe3c2f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:18.714920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-24da0f31-3c6e-4246-879a-28233239d800 req-8e75655c-5300-4a75-9a9e-4f2c5fe3c2f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:18.736081 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-24da0f31-3c6e-4246-879a-28233239d800 req-8e75655c-5300-4a75-9a9e-4f2c5fe3c2f7 service nova] Creating event network-changed:bb2fe61d-de4d-4309-8907-7aa8991753d3 for instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 on nch2-master-1 May 07 21:58:18.747188 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-24da0f31-3c6e-4246-879a-28233239d800 req-8e75655c-5300-4a75-9a9e-4f2c5fe3c2f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065224 May 07 21:58:18.747817 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1735/3386] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:18.762120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:18.763352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:18.781129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:18.781570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:18.782366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:18.782828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:19.363371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:19.374986 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d1f5c0ea-b635-44ac-b47c-a396bb426e39 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 0.625867 May 07 21:58:19.378342 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1736/3387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:18 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:19.393966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:19.395128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:19.402305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:19.404003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:19.407810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:19.408508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:20.510032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:20.529577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:20.537052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:20.539344 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a65fa590-e6e6-44b9-8089-0825974f1a09 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 1.156946 May 07 21:58:20.540429 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1737/3388] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:19 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:20.561718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:20.562718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:20.574444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:20.575480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:20.578733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:20.579485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:20.701527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cd93dbf4db4d899a3c6148183be9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a49ba5398834c43baabd7435e85d81b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:20.714113 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e0abf64-4466-40f8-8847-4da3e56c208a tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 200 len: 1478 microversion: 2.1 time: 0.171362 May 07 21:58:20.714742 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1738/3389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:20 2022] GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 1478 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:20.725920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:20.726706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:20.746190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:20.746673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:20.747516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:20.747972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:21.058216 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5612a078-0838-4680-916b-aff2039400fd tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.688424 May 07 21:58:21.059169 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1652/3390] 10.222.0.32 () {60 vars in 1169 bytes} [Sat May 7 21:58:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:21.065674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e960c641-2f02-4610-8145-32a99dae5bce req-29d64cea-2589-4815-9c07-34e912e95af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5e8392e-b439-457c-a474-09be8541f2d6", "name": "network-vif-deleted", "tag": "7c9e5f06-93e1-4633-9ae3-7e2cb99e2558"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:21.114615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e960c641-2f02-4610-8145-32a99dae5bce req-29d64cea-2589-4815-9c07-34e912e95af6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:21.118204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e960c641-2f02-4610-8145-32a99dae5bce req-29d64cea-2589-4815-9c07-34e912e95af6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:21.150227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:21.159110 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-149fdad9-b533-4f4e-9151-329ce18ac041 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 0.442546 May 07 21:58:21.161704 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1739/3391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:20 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:21.177676 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e960c641-2f02-4610-8145-32a99dae5bce req-29d64cea-2589-4815-9c07-34e912e95af6 service nova] Creating event network-vif-deleted:7c9e5f06-93e1-4633-9ae3-7e2cb99e2558 for instance a5e8392e-b439-457c-a474-09be8541f2d6 on nch2-master-1 May 07 21:58:21.184073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-fa9d88be-f9ce-4c9f-ae78-a3cc54c423d4 req-becb48c0-115f-45f5-9c87-65e2047e12f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47cb701-ee25-43b2-9e1f-f5157564391c", "name": "network-vif-deleted", "tag": "0bb8a966-61f0-4a95-bc07-6f7d9a13e2ba"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:21.200123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fa9d88be-f9ce-4c9f-ae78-a3cc54c423d4 req-becb48c0-115f-45f5-9c87-65e2047e12f6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:21.200934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fa9d88be-f9ce-4c9f-ae78-a3cc54c423d4 req-becb48c0-115f-45f5-9c87-65e2047e12f6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:21.201343 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e960c641-2f02-4610-8145-32a99dae5bce req-29d64cea-2589-4815-9c07-34e912e95af6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140920 May 07 21:58:21.214499 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1653/3392] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:21.225514 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-fa9d88be-f9ce-4c9f-ae78-a3cc54c423d4 req-becb48c0-115f-45f5-9c87-65e2047e12f6 service nova] Creating event network-vif-deleted:0bb8a966-61f0-4a95-bc07-6f7d9a13e2ba for instance c47cb701-ee25-43b2-9e1f-f5157564391c on nch1-master-1 May 07 21:58:21.242673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c7e424b9-6040-4237-84d3-3ddc982002ad tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Calling method '.version_select at 0x7fc41c350160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:21.248497 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-fa9d88be-f9ce-4c9f-ae78-a3cc54c423d4 req-becb48c0-115f-45f5-9c87-65e2047e12f6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073536 May 07 21:58:21.249459 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1740/3393] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:21.560947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:21.561819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:21.574899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:21.575651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:21.579811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:21.580486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:21.874902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:21.883109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:21.884646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:21.885906 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fe576909-56ea-47e0-946c-d809d6d4567b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.329822 May 07 21:58:21.886435 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1741/3394] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:21 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:21.922657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:21.923329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: a5e8392e-b439-457c-a474-09be8541f2d6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:21.943997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:21.944786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:21.945587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:21.946038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:21.980127 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] HTTP exception thrown: Instance a5e8392e-b439-457c-a474-09be8541f2d6 could not be found. May 07 21:58:21.980985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 404 to user: Instance a5e8392e-b439-457c-a474-09be8541f2d6 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:21.982023 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d7cbbffb-dfac-43f9-853c-2031e9e50865 tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6" status: 404 len: 111 microversion: 2.1 time: 0.073398 May 07 21:58:21.983171 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1742/3395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:21 2022] GET /compute/v2.1/servers/a5e8392e-b439-457c-a474-09be8541f2d6 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:21.991089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:22.000908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] [instance: c47cb701-ee25-43b2-9e1f-f5157564391c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:22.007587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:22.008271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:22.009263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:22.010125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:22.034668 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] HTTP exception thrown: Instance c47cb701-ee25-43b2-9e1f-f5157564391c could not be found. May 07 21:58:22.045698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] Returning 404 to user: Instance c47cb701-ee25-43b2-9e1f-f5157564391c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:22.047892 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fd4827c3-3453-4ec4-85d2-8877617d68fe tempest-ListServersNegativeTestJSON-109486253 tempest-ListServersNegativeTestJSON-109486253-project] 10.222.0.32 "GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c" status: 404 len: 111 microversion: 2.1 time: 0.060606 May 07 21:58:22.050594 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1743/3396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:21 2022] GET /compute/v2.1/servers/c47cb701-ee25-43b2-9e1f-f5157564391c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:22.178837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:22.179615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:22.191106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:22.194164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:22.195325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:22.195933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:22.588807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:22.597128 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d5f5f3a-75b3-4866-b44e-4cee18c65480 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 0.422565 May 07 21:58:22.603267 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1744/3397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:22 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:58:22.904406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:22.908233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:22.927641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:22.929433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:22.933098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:22.933873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:23.224917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:23.244813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:23.248086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:23.253428 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-695458bb-6a24-4b67-81d1-86607fc2dd69 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.351367 May 07 21:58:23.273928 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1745/3398] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:22 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:23.618256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:23.619154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:23.633331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:23.640085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:23.646448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:23.650813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:23.884106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:23.894317 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47d3f709-1cc3-439a-b7fc-c8ae9ca534f8 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 0.281274 May 07 21:58:23.909505 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1746/3399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:23 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:23.965126 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c7e424b9-6040-4237-84d3-3ddc982002ad tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/4f3a48d4-6824-4759-b7b8-5ddac6590a87" status: 202 len: 0 microversion: 2.1 time: 2.749205 May 07 21:58:23.966277 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1654/3400] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:58:21 2022] DELETE /compute/v2.1/os-floating-ips/4f3a48d4-6824-4759-b7b8-5ddac6590a87 => generated 0 bytes in 2751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:58:23.975777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eeb64ae2-a05f-4b2b-b780-2cd18c4c8536 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Calling method '.version_select at 0x7fc41cb47ca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:24.051803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-eeb64ae2-a05f-4b2b-b780-2cd18c4c8536 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4f3a48d4-6824-4759-b7b8-5ddac6590a87 could not be found", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:58:24.052783 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-eeb64ae2-a05f-4b2b-b780-2cd18c4c8536 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] HTTP exception thrown: Floating IP not found for ID 4f3a48d4-6824-4759-b7b8-5ddac6590a87 May 07 21:58:24.054322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eeb64ae2-a05f-4b2b-b780-2cd18c4c8536 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Returning 404 to user: Floating IP not found for ID 4f3a48d4-6824-4759-b7b8-5ddac6590a87 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:24.055414 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eeb64ae2-a05f-4b2b-b780-2cd18c4c8536 tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/4f3a48d4-6824-4759-b7b8-5ddac6590a87" status: 404 len: 111 microversion: 2.1 time: 0.084476 May 07 21:58:24.056539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1747/3401] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:58:23 2022] GET /compute/v2.1/os-floating-ips/4f3a48d4-6824-4759-b7b8-5ddac6590a87 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:24.065781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69ed49b4-4f0b-4e12-a4d4-9ea51fda59ba tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Calling method '.version_select at 0x7fc41c39f280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:24.133855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG neutronclient.v2_0.client [None req-69ed49b4-4f0b-4e12-a4d4-9ea51fda59ba tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4f3a48d4-6824-4759-b7b8-5ddac6590a87 could not be found", "detail": ""}} {{(pid=136681) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:58:24.134842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-69ed49b4-4f0b-4e12-a4d4-9ea51fda59ba tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] HTTP exception thrown: Floating IP not found for ID 4f3a48d4-6824-4759-b7b8-5ddac6590a87 May 07 21:58:24.135930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-69ed49b4-4f0b-4e12-a4d4-9ea51fda59ba tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] Returning 404 to user: Floating IP not found for ID 4f3a48d4-6824-4759-b7b8-5ddac6590a87 {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:24.137568 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-69ed49b4-4f0b-4e12-a4d4-9ea51fda59ba tempest-FloatingIPsTestJSON-334170503 tempest-FloatingIPsTestJSON-334170503-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/4f3a48d4-6824-4759-b7b8-5ddac6590a87" status: 404 len: 111 microversion: 2.1 time: 0.076890 May 07 21:58:24.138598 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1655/3402] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:58:24 2022] DELETE /compute/v2.1/os-floating-ips/4f3a48d4-6824-4759-b7b8-5ddac6590a87 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:58:24.278122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:24.280130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:24.293425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:24.294181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:24.296663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:24.300415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:24.839744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:24.853812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:24.857268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:24.861767 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f52423f-0075-4b32-925e-c107c9cd9ca3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.585082 May 07 21:58:24.863722 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1748/3403] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:24 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:24.918348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:24.919579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:24.948505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:24.952770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:24.953847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:24.960179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:25.882131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:25.884280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:25.898036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:25.901317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:25.902852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:25.905183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:26.019667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:26.035325 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4806261e-501b-44f0-8dae-14afca4971eb tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 1.116225 May 07 21:58:26.036232 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1656/3404] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:24 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:26.224224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:26.232359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:26.239896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:26.242780 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-989f6c93-6924-4fbd-9863-7021f7d167fe tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.365075 May 07 21:58:26.244958 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1749/3405] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:25 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:26.527190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f036b9d6-bd63-4d1c-ba0b-c0b1e3ea7e2e req-ae2e7d3b-c18a-4ae3-b38c-ba1170c480fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f949ce-22d7-44fa-a1f2-d579d5bd9d12", "name": "network-vif-plugged", "status": "completed", "tag": "bb2fe61d-de4d-4309-8907-7aa8991753d3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:26.540732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f036b9d6-bd63-4d1c-ba0b-c0b1e3ea7e2e req-ae2e7d3b-c18a-4ae3-b38c-ba1170c480fe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:26.548370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f036b9d6-bd63-4d1c-ba0b-c0b1e3ea7e2e req-ae2e7d3b-c18a-4ae3-b38c-ba1170c480fe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:26.566704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f036b9d6-bd63-4d1c-ba0b-c0b1e3ea7e2e req-ae2e7d3b-c18a-4ae3-b38c-ba1170c480fe service nova] Creating event network-vif-plugged:bb2fe61d-de4d-4309-8907-7aa8991753d3 for instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 on nch2-master-1 May 07 21:58:26.582148 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f036b9d6-bd63-4d1c-ba0b-c0b1e3ea7e2e req-ae2e7d3b-c18a-4ae3-b38c-ba1170c480fe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058751 May 07 21:58:26.583242 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1657/3406] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:27.085536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:27.085536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:27.085536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:27.085536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:27.085536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:27.085536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:27.297446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:27.298147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:27.308433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:27.309117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:27.310073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:27.311579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:27.538514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:27.553734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:27.555497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:27.556897 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2b1c74eb-6bc7-42e4-8f86-a8bb0ebc4fb7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.265883 May 07 21:58:27.577440 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1658/3407] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:27 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:27.812239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:27.834443 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-302dd85c-7b50-42e7-a799-00b829215612 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1315 microversion: 2.1 time: 0.784654 May 07 21:58:27.838533 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1750/3408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:27 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:28.585516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:28.586142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:28.595757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:28.596213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:28.597002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:28.597443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:28.861481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:28.862290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:28.895856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:28.896311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:28.897174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:28.897635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:29.074393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:29.091866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:29.098513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:29.101378 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7602efbb-b394-4b6a-83cf-ff5c4e941bcc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1741 microversion: 2.20 time: 0.520011 May 07 21:58:29.114876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1659/3409] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:28 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1741 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:29.142947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:29.150885 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-671f14b5-4ac9-47a6-9ae8-747baabaec1d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1502 microversion: 2.1 time: 0.299896 May 07 21:58:29.163482 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1751/3410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:28 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:29.173429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d6e1923c-75c1-4045-8010-533fd233daf4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:29.183372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6e1923c-75c1-4045-8010-533fd233daf4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:29.186557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6e1923c-75c1-4045-8010-533fd233daf4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:29.292598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d6e1923c-75c1-4045-8010-533fd233daf4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Going to try to stop instance {{(pid=136681) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 21:58:29.376281 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d6e1923c-75c1-4045-8010-533fd233daf4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12/action" status: 202 len: 0 microversion: 2.1 time: 0.210331 May 07 21:58:29.380978 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1660/3411] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:58:29 2022] POST /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 21:58:29.388450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:29.389813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:29.397642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:29.398054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:29.398877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:29.399507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:29.778549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:29.798582 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5bf90104-149e-4887-8970-efcd2d6446aa tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.416024 May 07 21:58:29.801357 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1752/3412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:29 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:30.088879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91627c8a-25e2-4a9f-8daa-1655d6733977 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Action: 'create', calling method: .version_select at 0x7fc41c286280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-35129810", "policies": ["affinity"]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:30.156972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-91627c8a-25e2-4a9f-8daa-1655d6733977 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:30.173396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-91627c8a-25e2-4a9f-8daa-1655d6733977 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:30.258071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-91627c8a-25e2-4a9f-8daa-1655d6733977 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:30.265782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-91627c8a-25e2-4a9f-8daa-1655d6733977 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:30.286345 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91627c8a-25e2-4a9f-8daa-1655d6733977 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.727792 May 07 21:58:30.287346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1661/3413] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:58:29 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:30.297332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:30.298403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:30.306661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.307604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:30.308707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.309952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:30.444805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:30.445533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:30.461311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.462589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:30.465577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.468352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:30.532046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:58:30.558587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:30.570188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:30.572871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:30.574098 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3cb6e711-510e-4d45-b62a-e3424e4a5b66 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1723 microversion: 2.20 time: 0.285651 May 07 21:58:30.574669 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1662/3414] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:30 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:30.590878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec2f4fc9-ca5f-4194-b12c-44f3f509c279 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Action: 'create', calling method: .version_select at 0x7fc41c39f820>, body: {"server_group": {"name": "tempest-server-group-253319113", "policies": ["affinity"]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:30.626330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ec2f4fc9-ca5f-4194-b12c-44f3f509c279 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:30.634262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ec2f4fc9-ca5f-4194-b12c-44f3f509c279 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:30.678030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e0f27af7-aacc-4c0b-9316-edbc12c1109b tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 204 len: 0 microversion: 2.42 time: 0.761021 May 07 21:58:30.679124 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1753/3415] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:58:29 2022] DELETE /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 0 bytes in 763 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:58:30.697963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:30.699173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:30.725239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.726266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:30.727802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.728741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:30.734587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ec2f4fc9-ca5f-4194-b12c-44f3f509c279 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:30.753675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ec2f4fc9-ca5f-4194-b12c-44f3f509c279 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:30.808154 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec2f4fc9-ca5f-4194-b12c-44f3f509c279 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.224920 May 07 21:58:30.809580 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1663/3416] 10.222.0.32 () {60 vars in 1172 bytes} [Sat May 7 21:58:30 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:30.826085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:30.834877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:30.862169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.863010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:30.868296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:30.871883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:31.508842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:31.528008 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9cddfb3-f2ae-4c46-bd1b-1822ce345033 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.709996 May 07 21:58:31.529424 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1664/3417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:30 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:31.541948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-90ac6de9-8f16-4b82-8843-558afb56e391 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Action: 'create', calling method: .version_select at 0x7fc41c39f8b0>, body: {"server_group": {"name": "tempest-server-group-253319113", "policies": ["affinity"]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:31.557328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:31.576304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-90ac6de9-8f16-4b82-8843-558afb56e391 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:31.582953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-90ac6de9-8f16-4b82-8843-558afb56e391 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:31.601723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:31.614940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:31.621442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-214560e0-06ff-46c7-b040-125a9b5bd669 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2958 microversion: 2.42 time: 0.937367 May 07 21:58:31.627642 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1754/3418] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:30 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2958 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:31.645529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:31.646456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:31.671608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:31.673660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:31.675805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:31.677147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:31.708412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-90ac6de9-8f16-4b82-8843-558afb56e391 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:31.726335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-90ac6de9-8f16-4b82-8843-558afb56e391 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:31.751406 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-90ac6de9-8f16-4b82-8843-558afb56e391 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.219594 May 07 21:58:31.752078 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1665/3419] 10.222.0.32 () {60 vars in 1172 bytes} [Sat May 7 21:58:31 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:31.768140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-082a949e-80a3-458f-8ae0-dedf51a6f339 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:31.826400 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-082a949e-80a3-458f-8ae0-dedf51a6f339 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/7b8c7811-b7b5-458f-bb92-39920b80f9bd" status: 204 len: 0 microversion: 2.1 time: 0.064687 May 07 21:58:31.832659 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1666/3420] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:58:31 2022] DELETE /compute/v2.1/os-server-groups/7b8c7811-b7b5-458f-bb92-39920b80f9bd => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:31.840927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5d18e9e-751e-4554-b5c7-bf3927345f46 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:31.869196 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5d18e9e-751e-4554-b5c7-bf3927345f46 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.034436 May 07 21:58:31.870126 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1667/3421] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:58:31 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:31.885782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ecdb6ccc-88a1-49d8-97e3-1852d2b36163 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:31.943513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ecdb6ccc-88a1-49d8-97e3-1852d2b36163 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/2dd1b609-5adf-4599-ac25-4ef7efc394f4" status: 204 len: 0 microversion: 2.1 time: 0.063360 May 07 21:58:31.944935 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1668/3422] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:58:31 2022] DELETE /compute/v2.1/os-server-groups/2dd1b609-5adf-4599-ac25-4ef7efc394f4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:31.959797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-652903b1-e297-45ae-8f0c-dc6ee84fde1e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:31.971779 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-652903b1-e297-45ae-8f0c-dc6ee84fde1e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.017071 May 07 21:58:31.973111 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1669/3423] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:58:31 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:32.013311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be9a2c34-5d30-405f-b237-27837a0a24ef tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Action: 'create', calling method: .version_select at 0x7fc41c39f160>, body: {"server_group": {"name": "tempest-server-group-867396621", "policies": ["affinity"]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:32.035349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-be9a2c34-5d30-405f-b237-27837a0a24ef tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:32.041820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-be9a2c34-5d30-405f-b237-27837a0a24ef tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:32.130838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-be9a2c34-5d30-405f-b237-27837a0a24ef tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:32.142649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-be9a2c34-5d30-405f-b237-27837a0a24ef tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:32.163753 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be9a2c34-5d30-405f-b237-27837a0a24ef tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.175024 May 07 21:58:32.164662 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1670/3424] 10.222.0.32 () {60 vars in 1172 bytes} [Sat May 7 21:58:31 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:32.174244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-caeed861-4105-42ab-b902-82284bc9b2fd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:32.207859 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-caeed861-4105-42ab-b902-82284bc9b2fd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/fa2d57fa-5298-4d1d-a132-16f706774785" status: 204 len: 0 microversion: 2.1 time: 0.037335 May 07 21:58:32.209342 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1671/3425] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:58:32 2022] DELETE /compute/v2.1/os-server-groups/fa2d57fa-5298-4d1d-a132-16f706774785 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:32.223304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ed0b4f1-66f0-44d1-8f91-68239734b4c9 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:32.235130 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ed0b4f1-66f0-44d1-8f91-68239734b4c9 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.015876 May 07 21:58:32.243840 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1672/3426] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:58:32 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:32.250654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:32.253397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f0c6a88-10bd-405e-b9d3-8ab7e58f1522 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Action: 'create', calling method: .version_select at 0x7fc41c39f160>, body: {"server_group": {"name": "tempest-server-group-1321269643", "policies": ["anti-affinity"]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:32.262631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:32.267597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:32.269077 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c42447d-2e46-4bfc-92f8-c7cd1f4902fa tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1723 microversion: 2.20 time: 0.635725 May 07 21:58:32.274567 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1755/3427] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:31 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1723 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:32.298458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1f0c6a88-10bd-405e-b9d3-8ab7e58f1522 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:32.308038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1f0c6a88-10bd-405e-b9d3-8ab7e58f1522 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:32.378892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1f0c6a88-10bd-405e-b9d3-8ab7e58f1522 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:32.387382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1f0c6a88-10bd-405e-b9d3-8ab7e58f1522 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_groups'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:32.412518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1f0c6a88-10bd-405e-b9d3-8ab7e58f1522 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.164660 May 07 21:58:32.415514 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1673/3428] 10.222.0.32 () {60 vars in 1172 bytes} [Sat May 7 21:58:32 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:32.425858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5291009-86d7-4566-8bc4-36f03efbdb55 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:32.468847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5291009-86d7-4566-8bc4-36f03efbdb55 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/459062e5-4fee-4e36-b834-09b3cc752c54" status: 204 len: 0 microversion: 2.1 time: 0.046633 May 07 21:58:32.469459 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1756/3429] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:58:32 2022] DELETE /compute/v2.1/os-server-groups/459062e5-4fee-4e36-b834-09b3cc752c54 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:32.480303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-62623fc6-0e21-4217-9a43-c04221064d7e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:32.491332 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-62623fc6-0e21-4217-9a43-c04221064d7e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.017013 May 07 21:58:32.498838 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1674/3430] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:58:32 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:32.565215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:32.565973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:32.568791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e33ab1a2-9edf-4171-9a1b-cdfec4fcb5c0 req-f07d9f4f-5720-43a5-9627-44e144fef138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ad7d9c-5e14-44b9-a948-c9c337d99f0c", "name": "network-vif-unplugged", "status": "completed", "tag": "d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:32.580537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:32.580537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:32.581673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:32.585391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e33ab1a2-9edf-4171-9a1b-cdfec4fcb5c0 req-f07d9f4f-5720-43a5-9627-44e144fef138 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:32.585858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e33ab1a2-9edf-4171-9a1b-cdfec4fcb5c0 req-f07d9f4f-5720-43a5-9627-44e144fef138 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:32.588551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:32.612497 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e33ab1a2-9edf-4171-9a1b-cdfec4fcb5c0 req-f07d9f4f-5720-43a5-9627-44e144fef138 service nova] Creating event network-vif-unplugged:d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2 for instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c on nch1-master-1 May 07 21:58:32.624618 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e33ab1a2-9edf-4171-9a1b-cdfec4fcb5c0 req-f07d9f4f-5720-43a5-9627-44e144fef138 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067930 May 07 21:58:32.626210 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1757/3431] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:32.640437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1182163315", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "ea633534-0feb-4e60-9130-eeaaa8f8c568"}]}, "os:scheduler_hints": {"group": "7f6b7f6c-02cc-4e3d-aefd-951070d3a0c9"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:32.713910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] validate_networks() for [('ea633534-0feb-4e60-9130-eeaaa8f8c568', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:58:32.828871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:32.840072 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-118c571c-0c95-4367-a233-910fc04e4d3e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.283222 May 07 21:58:32.846811 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1675/3432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:32 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:32.846811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:32.847419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:32.856142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:32.856749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:32.858214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:32.859059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:33.277406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:33.289645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:33.291709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:33.293688 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66cf27cb-6768-4388-8548-89c903c135f2 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2958 microversion: 2.42 time: 0.450682 May 07 21:58:33.294395 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1676/3433] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:32 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2958 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:33.300224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:33.301019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:33.320419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:33.321063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:33.322237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:33.322824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:33.501910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:33.514856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:33.518283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:33.519852 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e2cfaafc-c79c-4faf-8d2f-1fbb2ee0ce0a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1723 microversion: 2.20 time: 0.223696 May 07 21:58:33.522887 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1677/3434] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:33 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:33.862198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:33.863099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:33.871904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:33.872563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:33.874142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:33.874752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:34.175722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:58:34.176282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:58:34.177026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:58:34.177690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:58:34.178577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:58:34.215148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:34.221734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:34.224338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:34.225066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:34.274402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:34.281320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:34.301481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:34.311350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:58:34.314886 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b477fce-ed25-477a-905e-472f50e14e30 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.455770 May 07 21:58:34.318377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:58:34.319026 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1678/3435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:33 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:58:34.335374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:34.344469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:34.365034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:34.366877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:34.368526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:34.370734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:34.453295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:34.465013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:34.565259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:58:34.581932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Getting quotas for user 5c25a60580f5449fad5d3b5eb79b7041 and project 8b773c5686d64d8a8d701f1d4ac3a925. Resources: {'server_group_members'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:58:34.653331 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-390458ee-6522-4d6f-b8ba-c1d545234404 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.017104 May 07 21:58:34.660958 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1758/3436] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:58:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:58:34.670430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:34.676195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:34.694753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:34.695566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:34.698044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:34.699334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:35.104629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:35.116270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:35.122169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:35.124631 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e03eda21-255c-4414-b747-f24c456bb558 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1666 microversion: 2.20 time: 0.462384 May 07 21:58:35.126195 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1759/3437] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:34 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1666 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:35.138174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f9c187bb-5a67-45a0-b669-de66a7b57736 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:35.139224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f9c187bb-5a67-45a0-b669-de66a7b57736 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:35.264590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f9c187bb-5a67-45a0-b669-de66a7b57736 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:35.283194 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f9c187bb-5a67-45a0-b669-de66a7b57736 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1213 microversion: 2.1 time: 0.155626 May 07 21:58:35.296749 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1760/3438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:35 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:35.302268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60973b61-af20-4ee8-b499-74febc2c2f0b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10f3d102-b557-432f-b1e2-75334003ed87"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:35.303762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-60973b61-af20-4ee8-b499-74febc2c2f0b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:35.310224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60973b61-af20-4ee8-b499-74febc2c2f0b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:35.311690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60973b61-af20-4ee8-b499-74febc2c2f0b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:35.312749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60973b61-af20-4ee8-b499-74febc2c2f0b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:35.313443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60973b61-af20-4ee8-b499-74febc2c2f0b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:35.777696 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-60973b61-af20-4ee8-b499-74febc2c2f0b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.479390 May 07 21:58:35.778981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1761/3439] 10.222.0.32 () {62 vars in 1363 bytes} [Sat May 7 21:58:35 2022] POST /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-volume_attachments => generated 188 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 21:58:35.798801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:35.808955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:35.823227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:35.825949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:35.830697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:35.831613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:36.061863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:36.076750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:36.082985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:36.084691 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e7af9a1-bdea-4851-b112-787716f01998 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2958 microversion: 2.42 time: 1.759250 May 07 21:58:36.087196 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1679/3440] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:34 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2958 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:36.097468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c6171366-343a-4bf2-8e6c-d87963c9b631 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:36.099530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c6171366-343a-4bf2-8e6c-d87963c9b631 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:36.112524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6171366-343a-4bf2-8e6c-d87963c9b631 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:36.117009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6171366-343a-4bf2-8e6c-d87963c9b631 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:36.117973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6171366-343a-4bf2-8e6c-d87963c9b631 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:36.118542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6171366-343a-4bf2-8e6c-d87963c9b631 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:36.665600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c6171366-343a-4bf2-8e6c-d87963c9b631 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-volume_attachments/10f3d102-b557-432f-b1e2-75334003ed87" status: 202 len: 0 microversion: 2.20 time: 0.576854 May 07 21:58:36.667983 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1680/3441] 10.222.0.32 () {60 vars in 1456 bytes} [Sat May 7 21:58:36 2022] DELETE /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-volume_attachments/10f3d102-b557-432f-b1e2-75334003ed87 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:36.678491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:36.680202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:36.687601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:36.688376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:36.690035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:36.690708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:36.816376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:36.825039 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f26f2add-c96c-4d57-90c7-703f530f9c81 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 1.044606 May 07 21:58:36.837195 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1762/3442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:35 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:36.843666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:36.844603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c5f9930-855e-40ba-950b-3b05d2179748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:36.845269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c5f9930-855e-40ba-950b-3b05d2179748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:36.861032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c5f9930-855e-40ba-950b-3b05d2179748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:36.861749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c5f9930-855e-40ba-950b-3b05d2179748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:36.862305 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-42b404d4-7c63-469d-b01f-f066a4193299 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1283 microversion: 2.1 time: 0.190382 May 07 21:58:36.863149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c5f9930-855e-40ba-950b-3b05d2179748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:36.863820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c5f9930-855e-40ba-950b-3b05d2179748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:36.869245 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1681/3443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:36 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1283 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:36.978286 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c5f9930-855e-40ba-950b-3b05d2179748 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "POST /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/action" status: 202 len: 0 microversion: 2.20 time: 0.139647 May 07 21:58:36.983412 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1763/3444] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 21:58:36 2022] POST /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:37.004271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:37.005897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:37.015524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.016237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:37.017540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.018198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:37.105722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:37.106208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:37.115645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.118729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:37.120869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.126710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:37.669529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:37.678218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:37.679788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:37.691365 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8bc19dfc-b7c0-4f79-931e-912ebfcaa33a tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1674 microversion: 2.20 time: 0.696031 May 07 21:58:37.692288 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1682/3445] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:36 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1674 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:37.850697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:37.851647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:37.860457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.861324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:37.862314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.866205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:37.866413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:37.881650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:37.893727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:37.896783 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3522cdc7-f316-4401-8f9d-e245201730ed tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2937 microversion: 2.42 time: 0.793633 May 07 21:58:37.902712 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1764/3446] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:37 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2937 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:37.913339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:37.914355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:37.928466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.931800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:37.933093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:37.943313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:38.075726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:38.089853 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14d482da-450a-40bb-a1ed-76940037b58f tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1271 microversion: 2.1 time: 0.185295 May 07 21:58:38.090835 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1765/3447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:37 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:38.716879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:38.720760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:38.721607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:38.730151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:38.730908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:38.733466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:38.734200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:38.738315 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-225f9298-d20c-423a-9f81-7636c43a0833 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.897818 May 07 21:58:38.746163 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1683/3448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:37 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:38.922196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:38.922924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:38.939743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:38.940232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:38.947656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:38.948548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:39.506666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:39.533217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:39.536244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:39.541907 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8a25b91-3320-4db7-b4cf-e9615198ffae tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2916 microversion: 2.42 time: 0.624312 May 07 21:58:39.543127 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1684/3449] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:38 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2916 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:39.561239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:39.562076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:39.595440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:39.595977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:39.597385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:39.597833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:39.618267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:39.627239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:39.636740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:39.643786 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e901196e-16d5-4550-b571-314bb413533e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1674 microversion: 2.20 time: 0.935573 May 07 21:58:39.670861 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1766/3450] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:38 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1674 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:39.691111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-43eff615-b325-4cff-9381-5817296b0d5f req-d61ca379-e3c0-4aa9-9284-e5d0fae7a58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-unplugged", "status": "completed", "tag": "54d4d944-47e9-4336-a070-44cbc0439ffd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:39.704898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-43eff615-b325-4cff-9381-5817296b0d5f req-d61ca379-e3c0-4aa9-9284-e5d0fae7a58e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:39.705555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-43eff615-b325-4cff-9381-5817296b0d5f req-d61ca379-e3c0-4aa9-9284-e5d0fae7a58e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:39.726867 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-43eff615-b325-4cff-9381-5817296b0d5f req-d61ca379-e3c0-4aa9-9284-e5d0fae7a58e service nova] Creating event network-vif-unplugged:54d4d944-47e9-4336-a070-44cbc0439ffd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:39.746792 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-43eff615-b325-4cff-9381-5817296b0d5f req-d61ca379-e3c0-4aa9-9284-e5d0fae7a58e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074582 May 07 21:58:39.754203 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1767/3451] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:39.770685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:39.772222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:39.785973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:39.787485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:39.789168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:39.789813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:39.987516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:40.001497 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12362297-a483-472d-806e-02249cd689ff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.455273 May 07 21:58:40.002117 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1685/3452] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:39 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:40.469060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:40.477387 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b91f8283-55d2-46c1-b5e0-6a3bef9bb33f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.717522 May 07 21:58:40.484693 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1768/3453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:39 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:58:40.544614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-659ed33d-cafa-4850-a35f-b4170762eab9 req-ea53e25f-92cc-45cc-8272-d578d5793a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-deleted", "tag": "c96fe3c0-1df8-4707-980e-6b6ab0d159b2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:40.567065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-659ed33d-cafa-4850-a35f-b4170762eab9 req-ea53e25f-92cc-45cc-8272-d578d5793a09 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:40.567975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-659ed33d-cafa-4850-a35f-b4170762eab9 req-ea53e25f-92cc-45cc-8272-d578d5793a09 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:40.572087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:40.572857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:40.589013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:40.589770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:40.590864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:40.591577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:40.598915 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-659ed33d-cafa-4850-a35f-b4170762eab9 req-ea53e25f-92cc-45cc-8272-d578d5793a09 service nova] Creating event network-vif-deleted:c96fe3c0-1df8-4707-980e-6b6ab0d159b2 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:40.612605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-659ed33d-cafa-4850-a35f-b4170762eab9 req-ea53e25f-92cc-45cc-8272-d578d5793a09 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071807 May 07 21:58:40.614883 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1686/3454] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:40.693632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:40.694665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:40.703845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:40.704542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:40.705659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:40.706256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:41.239255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:41.253569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:41.255703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:41.258495 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-16476470-ef19-49ba-94a5-cba6e3c69ca4 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 0.573555 May 07 21:58:41.272347 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1687/3455] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:40 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:41.279070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:41.280602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:41.296544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:41.297008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:41.297814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:41.299722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:41.887726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:41.901501 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ad285c9-b7b0-482d-b2e6-2c1a89fe2036 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.627646 May 07 21:58:41.902107 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1688/3456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:41 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:41.911502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:41.911502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:41.929787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:41.930262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:41.932136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:41.934955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:42.108578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:42.120465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:42.129143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:42.133195 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5d135490-3b96-438e-b493-d4aa50852b6e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2869 microversion: 2.42 time: 1.565222 May 07 21:58:42.134527 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1769/3457] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:40 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2869 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:42.140403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4a2c62fb-725e-408c-bc3d-4d217bf22572 req-53704f5c-9c37-4fff-a1ab-f654a76b2a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-unplugged", "status": "completed", "tag": "5ace34e4-5209-40cb-a0ff-407d97d110dd"}, {"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-unplugged", "status": "completed", "tag": "840ebb23-b4df-469e-b8a1-03792fff9bb1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:42.150509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4a2c62fb-725e-408c-bc3d-4d217bf22572 req-53704f5c-9c37-4fff-a1ab-f654a76b2a6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:42.151346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4a2c62fb-725e-408c-bc3d-4d217bf22572 req-53704f5c-9c37-4fff-a1ab-f654a76b2a6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:42.167667 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4a2c62fb-725e-408c-bc3d-4d217bf22572 req-53704f5c-9c37-4fff-a1ab-f654a76b2a6d service nova] Creating event network-vif-unplugged:5ace34e4-5209-40cb-a0ff-407d97d110dd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:42.168436 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4a2c62fb-725e-408c-bc3d-4d217bf22572 req-53704f5c-9c37-4fff-a1ab-f654a76b2a6d service nova] Creating event network-vif-unplugged:840ebb23-b4df-469e-b8a1-03792fff9bb1 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:42.174346 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4a2c62fb-725e-408c-bc3d-4d217bf22572 req-53704f5c-9c37-4fff-a1ab-f654a76b2a6d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.038177 May 07 21:58:42.175169 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1770/3458] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:42.279190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:42.279920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:42.298116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:42.298878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:42.300228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:42.301197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:42.376122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:42.390449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b4beb8c-e934-499a-b300-88674de6c214 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.487268 May 07 21:58:42.400753 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1689/3459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:41 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:42.759963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d81839dd-2054-43d2-b793-fb67ad46eabf req-13afa021-b521-4ec5-b521-ad5ff11f4c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-deleted", "tag": "bd421caf-72a7-469a-bd36-ed429f10bc0d"}, {"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-deleted", "tag": "5ace34e4-5209-40cb-a0ff-407d97d110dd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:42.782617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:42.785059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d81839dd-2054-43d2-b793-fb67ad46eabf req-13afa021-b521-4ec5-b521-ad5ff11f4c0d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:42.786072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d81839dd-2054-43d2-b793-fb67ad46eabf req-13afa021-b521-4ec5-b521-ad5ff11f4c0d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:42.796075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:42.797898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:42.801481 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5432c56c-044a-456a-9953-cbcf8d5fa858 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 0.527670 May 07 21:58:42.804777 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d81839dd-2054-43d2-b793-fb67ad46eabf req-13afa021-b521-4ec5-b521-ad5ff11f4c0d service nova] Creating event network-vif-deleted:bd421caf-72a7-469a-bd36-ed429f10bc0d for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:42.805678 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1771/3460] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:42 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:42.815927 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d81839dd-2054-43d2-b793-fb67ad46eabf req-13afa021-b521-4ec5-b521-ad5ff11f4c0d service nova] Creating event network-vif-deleted:5ace34e4-5209-40cb-a0ff-407d97d110dd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:42.823590 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d81839dd-2054-43d2-b793-fb67ad46eabf req-13afa021-b521-4ec5-b521-ad5ff11f4c0d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075396 May 07 21:58:42.825217 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1690/3461] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:42.919533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:42.921026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:42.934035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:42.934804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:42.936345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:42.943565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:43.156118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:43.156840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:43.170486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:43.170979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:43.171954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:43.172412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:43.508069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:43.517926 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf392209-820b-453a-b5a8-98701e077eda tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.602864 May 07 21:58:43.518525 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1772/3462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:42 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:43.533989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:43.535329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:43.548164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:43.550403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:43.553590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:43.554347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:44.335207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:44.356064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:44.367656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:44.370748 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-55b4b571-1189-4637-affe-5a9a43fdec4a tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2258 microversion: 2.42 time: 1.220541 May 07 21:58:44.389269 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1691/3463] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:43 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2258 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:44.404260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:44.410673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:44.436391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:44.438549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:44.442356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:44.443711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:44.716103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:44.741438 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-36b092f0-7429-499f-a972-6393003c6253 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 1.203969 May 07 21:58:44.751382 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1773/3464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:43 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:44.757922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:44.758991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:44.770340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:44.772471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:44.773554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:44.776006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:45.587351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:45.603534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:45.608806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:45.611598 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9fa61bd-fb08-45df-adb4-5375c9730332 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 1.218554 May 07 21:58:45.615257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1692/3465] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:44 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:45.664368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f11bde1a-86bb-4377-87a4-34698482d2ae req-71048fe5-c376-4655-b351-ece1ac498287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-deleted", "tag": "840ebb23-b4df-469e-b8a1-03792fff9bb1"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:45.705680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f11bde1a-86bb-4377-87a4-34698482d2ae req-71048fe5-c376-4655-b351-ece1ac498287 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:45.707526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f11bde1a-86bb-4377-87a4-34698482d2ae req-71048fe5-c376-4655-b351-ece1ac498287 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:45.736279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f11bde1a-86bb-4377-87a4-34698482d2ae req-71048fe5-c376-4655-b351-ece1ac498287 service nova] Creating event network-vif-deleted:840ebb23-b4df-469e-b8a1-03792fff9bb1 for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:45.749998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f11bde1a-86bb-4377-87a4-34698482d2ae req-71048fe5-c376-4655-b351-ece1ac498287 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132165 May 07 21:58:45.761142 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1693/3466] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:45.780932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:45.783225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:45.807560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:45.808548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:45.812359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:45.815483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:46.069225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:46.099229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:46.103880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:46.113150 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee98c88d-8ba9-4b72-be01-b24b75f4e1e0 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 2029 microversion: 2.42 time: 0.345901 May 07 21:58:46.147923 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1694/3467] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:45 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 2029 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:46.203541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:46.211468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:46.269065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:46.271630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:46.273261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:46.287609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:46.743649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:46.752992 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c923d30-affd-4e85-b583-acb57f98c5dd tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 2.009022 May 07 21:58:46.753636 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1774/3468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:44 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 2010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:46.762844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-22002376-f9e2-46c1-ab3b-bff8d8bfb8c0 req-b33c0bbc-c74a-4e7c-bae6-f585d32299eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fbc518-9d2b-4fb9-a281-c926bba6230b", "tag": "315c86cf-24f5-40e0-a4b9-4de7e8201af2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:46.781499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-22002376-f9e2-46c1-ab3b-bff8d8bfb8c0 req-b33c0bbc-c74a-4e7c-bae6-f585d32299eb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:46.781958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-22002376-f9e2-46c1-ab3b-bff8d8bfb8c0 req-b33c0bbc-c74a-4e7c-bae6-f585d32299eb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:46.825651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-22002376-f9e2-46c1-ab3b-bff8d8bfb8c0 req-b33c0bbc-c74a-4e7c-bae6-f585d32299eb service nova] Creating event network-changed:315c86cf-24f5-40e0-a4b9-4de7e8201af2 for instance 91fbc518-9d2b-4fb9-a281-c926bba6230b on nch1-master-1 May 07 21:58:46.843232 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-22002376-f9e2-46c1-ab3b-bff8d8bfb8c0 req-b33c0bbc-c74a-4e7c-bae6-f585d32299eb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088251 May 07 21:58:46.843858 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1775/3469] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:46.866264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:46.867296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:46.898719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:46.900583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:46.901832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:46.907074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:47.200149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:47.228955 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b1aadfe-4bfd-4de9-97e7-646c9b28eb09 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 1.067284 May 07 21:58:47.232922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1695/3470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:46 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:47.252353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:47.253407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:47.271776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:47.275380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:47.277044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:47.281549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:47.382649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:47.383490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:47.384304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lazy-loading 'fault' on Instance uuid 7bc2b763-2769-4c0e-9bf3-9ee54868505c {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:58:47.727048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:47.740803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:47.744403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60446154374c4fac9315543687cdc0b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75cb675742543209bcbb75d99b60e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:47.745647 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1990911b-f236-49d0-9635-29dd87139055 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 200 len: 1371 microversion: 2.42 time: 0.510946 May 07 21:58:47.746280 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1696/3471] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:47 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 1371 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:47.778228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:47.779553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:47.807515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:47.807976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:47.808771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:47.814627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:48.353452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:48.381067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:48.392070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:48.393362 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-359509f0-fe62-45cd-8991-8e0a56db1863 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 1.548146 May 07 21:58:48.397654 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1776/3472] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:46 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:48.415945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e4334be1-40f0-4eb4-81fd-65db5568ff41 req-51c89721-8496-4835-9748-85a8f3547565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bc2b763-2769-4c0e-9bf3-9ee54868505c", "name": "network-vif-deleted", "tag": "54d4d944-47e9-4336-a070-44cbc0439ffd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:48.453100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e4334be1-40f0-4eb4-81fd-65db5568ff41 req-51c89721-8496-4835-9748-85a8f3547565 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:48.456842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e4334be1-40f0-4eb4-81fd-65db5568ff41 req-51c89721-8496-4835-9748-85a8f3547565 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:48.495442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e4334be1-40f0-4eb4-81fd-65db5568ff41 req-51c89721-8496-4835-9748-85a8f3547565 service nova] Creating event network-vif-deleted:54d4d944-47e9-4336-a070-44cbc0439ffd for instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c on nch2-master-1 May 07 21:58:48.509159 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e4334be1-40f0-4eb4-81fd-65db5568ff41 req-51c89721-8496-4835-9748-85a8f3547565 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105972 May 07 21:58:48.512606 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1777/3473] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:48.524342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:48.525600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:48.534076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:48.534819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:48.536379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:48.537070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:48.636742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:48.647573 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3229adb0-841a-49a6-854b-41b6a5251344 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.876620 May 07 21:58:48.648926 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1697/3474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:47 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:48.775394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:48.776842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:48.787315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:48.790187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:48.791741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:48.796213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:48.833537 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] HTTP exception thrown: Instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c could not be found. May 07 21:58:48.834674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Returning 404 to user: Instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:58:48.836832 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79d6f808-d311-4c25-bbd5-d8e5e02cac22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 404 len: 111 microversion: 2.42 time: 0.073212 May 07 21:58:48.842741 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1698/3475] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:48 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:58:48.850029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4227c79f-c25c-4cba-85b3-b26205aba15e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '.version_select at 0x7fc41c350af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:48.898892 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4227c79f-c25c-4cba-85b3-b26205aba15e tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614855448" status: 204 len: 0 microversion: 2.42 time: 0.053372 May 07 21:58:48.907503 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1699/3476] 10.222.0.32 () {60 vars in 1258 bytes} [Sat May 7 21:58:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614855448 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:58:49.239778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:49.259696 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-415b815f-0ece-4872-aef6-78132b07e05a tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.740764 May 07 21:58:49.261333 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1778/3477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:48 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:49.418099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:49.418704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:49.442188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:49.442659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:49.454742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:49.455696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:49.669996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:49.672871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:49.680632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:49.681536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:49.683228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:49.684434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:49.835681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:49.848576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:49.850147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:49.852375 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aab5b3bb-115f-4dfe-8076-eebb1dc276ab tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 0.439253 May 07 21:58:49.854516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1700/3478] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:49 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:50.279422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:50.280975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:50.295938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:50.296841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:50.298897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:50.301289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:50.593485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:50.606034 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93544b76-f0e4-474a-a3b6-f0ed6ac5ee2b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.942753 May 07 21:58:50.607817 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1779/3479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:49 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:50.775017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:50.790981 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bde15209-4300-4248-af34-d61a1c52f76d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.515355 May 07 21:58:50.791956 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1701/3480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:50 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:50.873896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:50.875321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:50.898600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:50.900641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:50.904653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:50.907601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:51.625138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:51.626041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:51.640989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:51.641615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:51.653700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:51.654602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:52.152001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:52.159412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:52.175205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:52.176190 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f82cbacd-868c-48bc-8c6f-158b6c3764a0 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.555164 May 07 21:58:52.180422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:52.181734 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1702/3481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:51 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:52.194408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:52.195854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:52.196352 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9f8c574-57a9-43b2-a5c5-fc2a8c7d8801 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 1.313341 May 07 21:58:52.208730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:52.210798 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1780/3482] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:50 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:52.211667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:52.212832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:52.213707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:52.622844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:52.631288 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd8424e0-a086-4008-a302-67e72f209675 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 0.448150 May 07 21:58:52.636370 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1703/3483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:52 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:53.198009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:53.198620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:53.216827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:53.217413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:53.223929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:53.231674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:53.233155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:53.234043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:53.235389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:53.240247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:53.241109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:53.246616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:53.762303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:53.771814 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a37fd0d-9eac-403b-837e-14ba362ea07b tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.577961 May 07 21:58:53.772998 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1781/3484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:53 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:58:53.801081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:53.802014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:53.814862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:53.815777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:53.816859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:53.817480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:54.346472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:54.367360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:54.380162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:54.385361 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f066ac8d-059b-4900-9b3b-cf1806c2338c tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 1.173412 May 07 21:58:54.386090 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1704/3485] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:53 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:54.796474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:54.797372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:54.810871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:54.820454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:54.821426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:54.823763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:55.081729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:55.094716 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d1466072-b3fb-4862-839e-ef11ad017a38 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1512 microversion: 2.1 time: 1.310038 May 07 21:58:55.105142 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1782/3486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:53 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1512 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:55.175036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:55.194354 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-993f93cc-408e-4f52-91d0-f16db3b1cd86 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.398802 May 07 21:58:55.214854 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1705/3487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:54 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:55.221636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b75c5957-3139-4e35-a892-d3f0c12aaa28 req-60c1c94f-e631-48ff-8c08-d4f5122732d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fbc518-9d2b-4fb9-a281-c926bba6230b", "name": "network-vif-plugged", "status": "completed", "tag": "315c86cf-24f5-40e0-a4b9-4de7e8201af2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:58:55.241158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b75c5957-3139-4e35-a892-d3f0c12aaa28 req-60c1c94f-e631-48ff-8c08-d4f5122732d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:55.241629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b75c5957-3139-4e35-a892-d3f0c12aaa28 req-60c1c94f-e631-48ff-8c08-d4f5122732d2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:55.287925 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b75c5957-3139-4e35-a892-d3f0c12aaa28 req-60c1c94f-e631-48ff-8c08-d4f5122732d2 service nova] Creating event network-vif-plugged:315c86cf-24f5-40e0-a4b9-4de7e8201af2 for instance 91fbc518-9d2b-4fb9-a281-c926bba6230b on nch1-master-1 May 07 21:58:55.323534 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b75c5957-3139-4e35-a892-d3f0c12aaa28 req-60c1c94f-e631-48ff-8c08-d4f5122732d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111654 May 07 21:58:55.331434 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1783/3488] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:58:55.405303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:55.406625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:55.428202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:55.429572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:55.434439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:55.435759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:56.057141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:56.070206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:56.072275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:56.073056 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fe29986-191e-4654-a932-740c958d9aee tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 0.672338 May 07 21:58:56.096300 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1706/3489] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:55 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:58:56.125039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:56.125775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:56.142817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:56.143347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:56.144496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:56.145138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:56.225353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:56.226293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:56.238064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:56.238851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:56.239829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:56.246997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:56.908250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:56.925656 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c04237d-fa43-47c3-92d3-84f16feaf9c4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1313 microversion: 2.1 time: 0.704173 May 07 21:58:56.926807 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1707/3490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:56 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:58:57.095043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:57.096551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:57.115835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:57.119142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:57.126670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:57.127268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:57.286511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:57.316636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8095739c-9f67-43bc-a4eb-438899e4d78f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1489 microversion: 2.1 time: 1.194638 May 07 21:58:57.323598 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1784/3491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:56 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1489 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:57.351492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:57.351954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:57.395491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:57.398384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:57.400728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:57.401906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:57.507655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:58:57.703288 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-730ea7cf-61a6-4370-9019-11edcba95e3b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 204 len: 0 microversion: 2.1 time: 0.364980 May 07 21:58:57.704049 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1785/3492] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:58:57 2022] DELETE /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:57.712801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:57.713515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:57.752940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:57.765374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:57.772984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:57.773448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:58.246320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:58.260213 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0eb1f00b-1158-466b-8700-9b49b10386be tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1495 microversion: 2.1 time: 0.551601 May 07 21:58:58.261179 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1786/3493] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:57 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1495 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:58.282810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:58.283735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:58.294105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:58.295844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:58.296842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:58.297448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:58.301841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:58.311662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:58.318610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:58.324662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6c310eec-9bd5-4917-b3e4-013b9b91e969 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 1.234446 May 07 21:58:58.325882 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1708/3494] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:57 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:58:58.786662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:58.800574 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a104b20c-308b-49ab-9630-c108baddbd81 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1498 microversion: 2.1 time: 0.538246 May 07 21:58:58.801367 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1787/3495] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:58 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1498 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:58.817702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31a382ea-03e9-4145-9770-7bbb7ffe9fc4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:58.844899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.server_groups [None req-31a382ea-03e9-4145-9770-7bbb7ffe9fc4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Querying cell 6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) for 1 instances {{(pid=136681) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 07 21:58:58.845746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31a382ea-03e9-4145-9770-7bbb7ffe9fc4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:58.846201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31a382ea-03e9-4145-9770-7bbb7ffe9fc4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:58.891982 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31a382ea-03e9-4145-9770-7bbb7ffe9fc4 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/7f6b7f6c-02cc-4e3d-aefd-951070d3a0c9" status: 200 len: 220 microversion: 2.1 time: 0.078356 May 07 21:58:58.892590 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1709/3496] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:58:58 2022] GET /compute/v2.1/os-server-groups/7f6b7f6c-02cc-4e3d-aefd-951070d3a0c9 => generated 220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:58:58.902624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:58.903164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:58.922515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:58.927695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:58.928748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:58.929366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:58.975717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:58:59.170324 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9dbd324d-7614-4175-afb6-3c92cb46a286 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 204 len: 0 microversion: 2.1 time: 0.270844 May 07 21:58:59.171884 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1788/3497] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:58:58 2022] DELETE /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:58:59.181723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:59.182403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:59.194670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:59.195192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:59.208143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:59.209094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:59.280958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:59.281962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:59.291452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:59.292198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:59.293282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:59.293939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:59.734011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:58:59.744968 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48204c83-04f5-40ba-9901-ea5e5cfc2493 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1504 microversion: 2.1 time: 0.567585 May 07 21:58:59.745564 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1710/3498] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:59 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1504 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:58:59.769653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:58:59.772276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:58:59.787526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:59.788158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:59.789003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:58:59.789431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:58:59.996963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:00.008649 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c3a8ddd-155c-4f3e-8139-3b2db6148178 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1495 microversion: 2.1 time: 0.732611 May 07 21:59:00.011963 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1789/3499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:58:59 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1495 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:00.771219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:00.772475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:00.783766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:00.784623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:00.786601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:00.787469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:00.877947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:00.893605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:00.895123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:00.896319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bae6c669-64d7-4dcc-a762-1d51167bbc41 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 1.136603 May 07 21:59:00.896894 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1711/3500] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:58:59 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:01.030950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:01.031555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:01.041272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:01.044888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:01.045719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:01.049110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:01.257502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c25a60580f5449fad5d3b5eb79b7041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b773c5686d64d8a8d701f1d4ac3a925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:01.271464 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab1f7dce-d39a-49ed-a5d4-89de82208a00 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 200 len: 1504 microversion: 2.1 time: 0.504982 May 07 21:59:01.272450 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1790/3501] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:00 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:01.423437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8076f9b-210d-4acc-8298-6f6c6f3dab0a tempest-FloatingIPDetailsNegativeTestJSON-300686107 tempest-FloatingIPDetailsNegativeTestJSON-300686107-project] Calling method '.version_select at 0x7fc41ce163a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:01.544969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG neutronclient.v2_0.client [None req-c8076f9b-210d-4acc-8298-6f6c6f3dab0a tempest-FloatingIPDetailsNegativeTestJSON-300686107 tempest-FloatingIPDetailsNegativeTestJSON-300686107-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 4f8a8b2f-c4f1-45e3-bf99-3f877e68773f could not be found", "detail": ""}} {{(pid=136682) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 07 21:59:01.546282 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-c8076f9b-210d-4acc-8298-6f6c6f3dab0a tempest-FloatingIPDetailsNegativeTestJSON-300686107 tempest-FloatingIPDetailsNegativeTestJSON-300686107-project] HTTP exception thrown: Floating IP not found for ID 4f8a8b2f-c4f1-45e3-bf99-3f877e68773f May 07 21:59:01.547172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8076f9b-210d-4acc-8298-6f6c6f3dab0a tempest-FloatingIPDetailsNegativeTestJSON-300686107 tempest-FloatingIPDetailsNegativeTestJSON-300686107-project] Returning 404 to user: Floating IP not found for ID 4f8a8b2f-c4f1-45e3-bf99-3f877e68773f {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:01.550390 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c8076f9b-210d-4acc-8298-6f6c6f3dab0a tempest-FloatingIPDetailsNegativeTestJSON-300686107 tempest-FloatingIPDetailsNegativeTestJSON-300686107-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/4f8a8b2f-c4f1-45e3-bf99-3f877e68773f" status: 404 len: 111 microversion: 2.1 time: 0.275314 May 07 21:59:01.553590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1791/3502] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:59:01 2022] GET /compute/v2.1/os-floating-ips/4f8a8b2f-c4f1-45e3-bf99-3f877e68773f => generated 111 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:01.563009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-18d046e2-7b0b-44b5-b239-a06352f5cc3c req-81c7c698-601c-4b63-85d5-b0cfcab273d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fbc518-9d2b-4fb9-a281-c926bba6230b", "name": "network-vif-deleted", "tag": "315c86cf-24f5-40e0-a4b9-4de7e8201af2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:01.586467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-18d046e2-7b0b-44b5-b239-a06352f5cc3c req-81c7c698-601c-4b63-85d5-b0cfcab273d0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:01.587370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-18d046e2-7b0b-44b5-b239-a06352f5cc3c req-81c7c698-601c-4b63-85d5-b0cfcab273d0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:01.608751 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-18d046e2-7b0b-44b5-b239-a06352f5cc3c req-81c7c698-601c-4b63-85d5-b0cfcab273d0 service nova] Creating event network-vif-deleted:315c86cf-24f5-40e0-a4b9-4de7e8201af2 for instance 91fbc518-9d2b-4fb9-a281-c926bba6230b on nch1-master-1 May 07 21:59:01.617391 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-18d046e2-7b0b-44b5-b239-a06352f5cc3c req-81c7c698-601c-4b63-85d5-b0cfcab273d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059703 May 07 21:59:01.618337 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1792/3503] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:01.668713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:01.680753 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56688a89-9d96-4650-812e-2b345466a423 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1495 microversion: 2.1 time: 0.656410 May 07 21:59:01.682143 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1712/3504] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:01 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1495 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:01.947882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-28ad7ed8-4dda-4fd3-a12c-2ba431c3856c req-45a42278-8b59-4a63-9a58-42842f21110a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f949ce-22d7-44fa-a1f2-d579d5bd9d12", "name": "network-vif-deleted", "tag": "bb2fe61d-de4d-4309-8907-7aa8991753d3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:01.955798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:01.963294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:01.996699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:01.999460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.002611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.006950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.025521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-28ad7ed8-4dda-4fd3-a12c-2ba431c3856c req-45a42278-8b59-4a63-9a58-42842f21110a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.027622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-28ad7ed8-4dda-4fd3-a12c-2ba431c3856c req-45a42278-8b59-4a63-9a58-42842f21110a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.101704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-28ad7ed8-4dda-4fd3-a12c-2ba431c3856c req-45a42278-8b59-4a63-9a58-42842f21110a service nova] Creating event network-vif-deleted:bb2fe61d-de4d-4309-8907-7aa8991753d3 for instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 on nch2-master-1 May 07 21:59:02.117602 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-28ad7ed8-4dda-4fd3-a12c-2ba431c3856c req-45a42278-8b59-4a63-9a58-42842f21110a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190818 May 07 21:59:02.119814 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1713/3505] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:02.295257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.296173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:02.317202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.320608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.323035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.325968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.367817 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] HTTP exception thrown: Instance 91fbc518-9d2b-4fb9-a281-c926bba6230b could not be found. May 07 21:59:02.368434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Returning 404 to user: Instance 91fbc518-9d2b-4fb9-a281-c926bba6230b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.376864 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-02c9d769-d95e-4392-acaa-6ea0468c5847 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 404 len: 111 microversion: 2.1 time: 0.089804 May 07 21:59:02.380867 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1714/3506] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:02 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:59:02.392839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f26ce90f-efab-49c6-96be-92b38f656570 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.440682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.server_groups [None req-f26ce90f-efab-49c6-96be-92b38f656570 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Querying cell 6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) for 1 instances {{(pid=136681) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 07 21:59:02.442228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f26ce90f-efab-49c6-96be-92b38f656570 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.442891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f26ce90f-efab-49c6-96be-92b38f656570 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.464076 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f26ce90f-efab-49c6-96be-92b38f656570 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.076169 May 07 21:59:02.465315 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1715/3507] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:59:02 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:02.480920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e5712313-386b-4d6c-bda1-e7391138b134 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.515008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.server_groups [None req-e5712313-386b-4d6c-bda1-e7391138b134 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Querying cell 6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) for 1 instances {{(pid=136681) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 07 21:59:02.516086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5712313-386b-4d6c-bda1-e7391138b134 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.518186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5712313-386b-4d6c-bda1-e7391138b134 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.540144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e5712313-386b-4d6c-bda1-e7391138b134 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/7f6b7f6c-02cc-4e3d-aefd-951070d3a0c9" status: 200 len: 182 microversion: 2.1 time: 0.067332 May 07 21:59:02.540744 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1716/3508] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 21:59:02 2022] GET /compute/v2.1/os-server-groups/7f6b7f6c-02cc-4e3d-aefd-951070d3a0c9 => generated 182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:02.558408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.571113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:02.579163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.579643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.580460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.580917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.595165 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] HTTP exception thrown: Instance 91fbc518-9d2b-4fb9-a281-c926bba6230b could not be found. May 07 21:59:02.595800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Returning 404 to user: Instance 91fbc518-9d2b-4fb9-a281-c926bba6230b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.596666 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e92f1ae-1ff3-40af-b880-fc8b529c5b41 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 404 len: 111 microversion: 2.1 time: 0.046278 May 07 21:59:02.600539 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1717/3509] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:02 2022] DELETE /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:02.607021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.607660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] [instance: 91fbc518-9d2b-4fb9-a281-c926bba6230b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:02.614679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.615345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.616281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.616941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.650227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] HTTP exception thrown: Instance 91fbc518-9d2b-4fb9-a281-c926bba6230b could not be found. May 07 21:59:02.650762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Returning 404 to user: Instance 91fbc518-9d2b-4fb9-a281-c926bba6230b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.651663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7b44a169-ee6b-4c49-95f1-9a91d5fa9cff tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b" status: 404 len: 111 microversion: 2.1 time: 0.048577 May 07 21:59:02.655181 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1718/3510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:02 2022] GET /compute/v2.1/servers/91fbc518-9d2b-4fb9-a281-c926bba6230b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:02.661364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7e247b3-8ad3-485e-8985-0321da6bec56 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.673207 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b7e247b3-8ad3-485e-8985-0321da6bec56 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] HTTP exception thrown: Instance group 459062e5-4fee-4e36-b834-09b3cc752c54 could not be found. May 07 21:59:02.673960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7e247b3-8ad3-485e-8985-0321da6bec56 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Returning 404 to user: Instance group 459062e5-4fee-4e36-b834-09b3cc752c54 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.675097 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7e247b3-8ad3-485e-8985-0321da6bec56 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/459062e5-4fee-4e36-b834-09b3cc752c54" status: 404 len: 117 microversion: 2.1 time: 0.018146 May 07 21:59:02.678868 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1719/3511] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:59:02 2022] DELETE /compute/v2.1/os-server-groups/459062e5-4fee-4e36-b834-09b3cc752c54 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:02.684293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32878f74-58e3-4e99-8f12-fdf6f5278e2e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.697663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-32878f74-58e3-4e99-8f12-fdf6f5278e2e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] HTTP exception thrown: Instance group fa2d57fa-5298-4d1d-a132-16f706774785 could not be found. May 07 21:59:02.698628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32878f74-58e3-4e99-8f12-fdf6f5278e2e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Returning 404 to user: Instance group fa2d57fa-5298-4d1d-a132-16f706774785 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.699718 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-32878f74-58e3-4e99-8f12-fdf6f5278e2e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/fa2d57fa-5298-4d1d-a132-16f706774785" status: 404 len: 117 microversion: 2.1 time: 0.019492 May 07 21:59:02.703664 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1720/3512] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:59:02 2022] DELETE /compute/v2.1/os-server-groups/fa2d57fa-5298-4d1d-a132-16f706774785 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:02.708396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.709262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:02.715388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.715855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.716691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.717144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.753339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.753559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.754192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lazy-loading 'fault' on Instance uuid c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:59:02.853925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:02.861704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3101e92c-9950-4f9d-93f1-b9ddfad34f1b tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 200 len: 1305 microversion: 2.1 time: 0.158894 May 07 21:59:02.862611 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1721/3513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:02 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 1305 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:02.867582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-191c9915-187b-4573-bf31-2466b251ea64 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.874810 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-191c9915-187b-4573-bf31-2466b251ea64 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] HTTP exception thrown: Instance group 2dd1b609-5adf-4599-ac25-4ef7efc394f4 could not be found. May 07 21:59:02.874810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-191c9915-187b-4573-bf31-2466b251ea64 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Returning 404 to user: Instance group 2dd1b609-5adf-4599-ac25-4ef7efc394f4 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.875359 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-191c9915-187b-4573-bf31-2466b251ea64 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/2dd1b609-5adf-4599-ac25-4ef7efc394f4" status: 404 len: 117 microversion: 2.1 time: 0.011712 May 07 21:59:02.875910 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1722/3514] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:59:02 2022] DELETE /compute/v2.1/os-server-groups/2dd1b609-5adf-4599-ac25-4ef7efc394f4 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:02.880634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.881135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:02.888124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.888589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.889389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.889839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.921893 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] HTTP exception thrown: Instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c could not be found. May 07 21:59:02.922529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Returning 404 to user: Instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.923434 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e438d51-ef5e-4ddb-8d98-67a84d866e79 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 404 len: 111 microversion: 2.42 time: 0.046487 May 07 21:59:02.924023 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1723/3515] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:59:02 2022] DELETE /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:59:02.931895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0964f931-b863-424f-ac58-de2254c8fb82 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.940152 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-0964f931-b863-424f-ac58-de2254c8fb82 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] HTTP exception thrown: Instance group 7b8c7811-b7b5-458f-bb92-39920b80f9bd could not be found. May 07 21:59:02.940974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0964f931-b863-424f-ac58-de2254c8fb82 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Returning 404 to user: Instance group 7b8c7811-b7b5-458f-bb92-39920b80f9bd could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.942150 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0964f931-b863-424f-ac58-de2254c8fb82 tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/7b8c7811-b7b5-458f-bb92-39920b80f9bd" status: 404 len: 117 microversion: 2.1 time: 0.014027 May 07 21:59:02.943166 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1724/3516] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:59:02 2022] DELETE /compute/v2.1/os-server-groups/7b8c7811-b7b5-458f-bb92-39920b80f9bd => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:02.945201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:02.949275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:02.950432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] [instance: 7bc2b763-2769-4c0e-9bf3-9ee54868505c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:02.960102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.960814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.961773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:02.962407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:02.970713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:02.979020 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] HTTP exception thrown: Instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c could not be found. May 07 21:59:02.980176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] Returning 404 to user: Instance 7bc2b763-2769-4c0e-9bf3-9ee54868505c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:02.981395 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5dadb89e-dfe3-479d-a42d-8b2da2c2fe22 tempest-TaggedBootDevicesTest_v242-1845920429 tempest-TaggedBootDevicesTest_v242-1845920429-project] 10.222.0.32 "GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c" status: 404 len: 111 microversion: 2.42 time: 0.036955 May 07 21:59:02.983551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:02.986007 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1725/3517] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:02 2022] GET /compute/v2.1/servers/7bc2b763-2769-4c0e-9bf3-9ee54868505c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:59:02.989097 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b23831bf-f17e-446d-8c1e-f5b2d9dbf500 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 1.073589 May 07 21:59:02.990814 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1793/3518] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:01 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:59:03.005818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b778c209-5c9b-43ac-bff3-2f1f7a02cb3e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:03.049936 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b778c209-5c9b-43ac-bff3-2f1f7a02cb3e tempest-ServerGroupTestJSON-1010104360 tempest-ServerGroupTestJSON-1010104360-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/7f6b7f6c-02cc-4e3d-aefd-951070d3a0c9" status: 204 len: 0 microversion: 2.1 time: 0.062527 May 07 21:59:03.050909 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1726/3519] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 21:59:02 2022] DELETE /compute/v2.1/os-server-groups/7f6b7f6c-02cc-4e3d-aefd-951070d3a0c9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:59:03.885097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:03.885757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:03.894934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:03.901071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:03.905886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:03.912146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:03.969405 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 could not be found. May 07 21:59:03.976245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:03.983257 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55c03ebe-f1fb-43f0-8e11-7b8710017d94 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 404 len: 111 microversion: 2.1 time: 0.103052 May 07 21:59:03.987329 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1794/3520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:03 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:04.009257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:04.009776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:04.036390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:04.037350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:04.041597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:04.042075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:04.172224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-512938754", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "9b7653d0-c69e-4364-9ed6-1c005b136d81"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:04.246334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] validate_networks() for [('9b7653d0-c69e-4364-9ed6-1c005b136d81', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:59:04.473531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:04.483018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:04.484901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:04.486371 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f33af94-ce75-4f6a-b1ca-da281e040fc2 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 0.481502 May 07 21:59:04.494841 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1727/3521] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:04 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:05.034639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-fe1bf3e3-edaa-4403-95b5-5c40b71297d3 req-73ab5704-0c82-4b38-bb61-edf9f43c55a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ad7d9c-5e14-44b9-a948-c9c337d99f0c", "name": "network-vif-plugged", "status": "completed", "tag": "d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:05.053341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fe1bf3e3-edaa-4403-95b5-5c40b71297d3 req-73ab5704-0c82-4b38-bb61-edf9f43c55a3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:05.054064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fe1bf3e3-edaa-4403-95b5-5c40b71297d3 req-73ab5704-0c82-4b38-bb61-edf9f43c55a3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:05.089005 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-fe1bf3e3-edaa-4403-95b5-5c40b71297d3 req-73ab5704-0c82-4b38-bb61-edf9f43c55a3 service nova] Creating event network-vif-plugged:d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2 for instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c on nch1-master-1 May 07 21:59:05.101178 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-fe1bf3e3-edaa-4403-95b5-5c40b71297d3 req-73ab5704-0c82-4b38-bb61-edf9f43c55a3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070426 May 07 21:59:05.105614 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1728/3522] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:05.514142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:05.515372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:05.541082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:05.544797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:05.549998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:05.550620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:06.093842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:06.104647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:06.107268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:06.109482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-227086dd-933a-4241-9849-fbaff4afe3bd tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 0.601353 May 07 21:59:06.111255 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1729/3523] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:05 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:59:06.423094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:59:06.424361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:59:06.424924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:59:06.425423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:59:06.425911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:59:06.442400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:06.443170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:06.444520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:06.445135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:06.475490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:59:06.484145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Getting quotas for user 228761ebf4c0406ab0977cabe351ac76 and project 85587313eff94af59406aca0c1a96a02. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:59:06.515002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:59:06.518095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:59:06.587027 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-539b1c33-9efb-401f-adbe-6e2444179943 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.419466 May 07 21:59:06.587713 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1795/3524] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:59:06.598551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cf79977c-1f5f-412f-b2c6-9e627e7a358e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:06.599479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cf79977c-1f5f-412f-b2c6-9e627e7a358e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:06.754667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cf79977c-1f5f-412f-b2c6-9e627e7a358e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:06.764053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cf79977c-1f5f-412f-b2c6-9e627e7a358e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1214 microversion: 2.1 time: 0.170148 May 07 21:59:06.766152 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1730/3525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:06 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:07.132066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:07.133516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:07.150646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:07.151640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:07.155152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:07.157059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:07.714582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:07.737076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:07.747909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:07.751510 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1ec996a1-db28-4a6e-b350-10c51732364e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1732 microversion: 2.20 time: 0.623909 May 07 21:59:07.754698 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1796/3526] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:07 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1732 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:59:07.784377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:07.785318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:07.804042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:07.805482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:07.808005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:07.809485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:08.075067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:08.091904 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4846b792-2dbc-4e91-82c1-fd5cf6b061a2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1210 microversion: 2.1 time: 0.312054 May 07 21:59:08.094868 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1731/3527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:07 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1210 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:08.770369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:08.771130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:08.784520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:08.784982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:08.785792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:08.786246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:09.120591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:09.129150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:09.177291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:09.178114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:09.181754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:09.183216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:09.360803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:09.372791 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1785e71a-7dc1-4c13-b69d-93efbe107aa7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1272 microversion: 2.1 time: 0.267039 May 07 21:59:09.373558 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1732/3528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:09 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:09.598408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:09.612472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:09.614300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:09.619448 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3afe5971-60d3-4aa7-8e0b-de73c0189382 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1719 microversion: 2.20 time: 0.851442 May 07 21:59:09.635502 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1797/3529] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:08 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1719 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:10.389881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:10.390523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:10.400475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:10.401362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:10.402615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:10.403538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:10.509423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:10.519395 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a8b524bc-f3f3-42e4-94dd-07ba1dca3d71 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1272 microversion: 2.1 time: 0.133669 May 07 21:59:10.519999 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1733/3530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:10 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:11.536495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:11.537786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:11.550171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:11.552402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:11.553407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:11.556908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:12.621278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:12.632459 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b9d0a37-0bea-472d-900a-b70f862fd192 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1314 microversion: 2.1 time: 1.100029 May 07 21:59:12.634074 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1798/3531] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:11 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:12.852727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2b1170af-7ee5-4b97-bc85-ee663f8b4780 req-66cc412d-71b7-4301-bacd-036696eb8c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16037dee-704d-447b-9523-4b2728e5d647", "tag": "36a9af4d-8e33-4f5e-81b0-dfddd8e4aada"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:12.882406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2b1170af-7ee5-4b97-bc85-ee663f8b4780 req-66cc412d-71b7-4301-bacd-036696eb8c98 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:12.883147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2b1170af-7ee5-4b97-bc85-ee663f8b4780 req-66cc412d-71b7-4301-bacd-036696eb8c98 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:12.915656 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2b1170af-7ee5-4b97-bc85-ee663f8b4780 req-66cc412d-71b7-4301-bacd-036696eb8c98 service nova] Creating event network-changed:36a9af4d-8e33-4f5e-81b0-dfddd8e4aada for instance 16037dee-704d-447b-9523-4b2728e5d647 on nch2-master-1 May 07 21:59:12.927653 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2b1170af-7ee5-4b97-bc85-ee663f8b4780 req-66cc412d-71b7-4301-bacd-036696eb8c98 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080939 May 07 21:59:12.928811 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1734/3532] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:13.650781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:13.651345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:13.659072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:13.659612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:13.660361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:13.660817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:14.063353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:14.084696 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc847da7-03e2-4bb3-9c67-517f7e930e1f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1314 microversion: 2.1 time: 0.437461 May 07 21:59:14.101816 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1799/3533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:13 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:15.118686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:15.119426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:15.136567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:15.137042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:15.138396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:15.138874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:15.249086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1708245504", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "e8aaa5c2-40bf-4cf0-abeb-ec5b479a8448"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:15.323917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] validate_networks() for [('e8aaa5c2-40bf-4cf0-abeb-ec5b479a8448', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:59:15.566170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:15.583025 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b94610b3-c0b7-4218-a8c1-6ee666bb6463 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1314 microversion: 2.1 time: 0.464252 May 07 21:59:15.584198 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1800/3534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:15 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:16.241141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:59:16.241728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:59:16.242242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:59:16.242664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:59:16.243436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:59:16.252826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:16.253459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:16.254253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:16.254699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:16.279751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Getting quotas for project 1426f0d5b4ef478d91cfb1856c943052. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:59:16.286989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Getting quotas for user 6e9a3cda211245a18608ae0a25468113 and project 1426f0d5b4ef478d91cfb1856c943052. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:59:16.305534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:59:16.308176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:59:16.380781 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-34e1fdd3-9da8-4ec7-b808-6556456db846 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473012 May 07 21:59:16.386393 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1735/3535] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:59:16.393309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3955a92-9c93-43bf-b2a1-9818693e032d tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:16.393988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e3955a92-9c93-43bf-b2a1-9818693e032d tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:16.584245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e3955a92-9c93-43bf-b2a1-9818693e032d tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:16.596400 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3955a92-9c93-43bf-b2a1-9818693e032d tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1228 microversion: 2.1 time: 0.208441 May 07 21:59:16.597137 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1801/3536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:16 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1228 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:16.606890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:16.606890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:16.614888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:16.615358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:16.616153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:16.616606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:16.777981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:16.788193 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd171a74-45fd-45dd-91d8-6be621d599e2 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1314 microversion: 2.1 time: 0.190944 May 07 21:59:16.790257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1736/3537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:16 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:17.615698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:17.617165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:17.650330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:17.656004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:17.656895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:17.657349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:17.749204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f57bfbf-184c-41bc-8052-56fc86dcfbb3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c350940>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:17.815983 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1f57bfbf-184c-41bc-8052-56fc86dcfbb3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/6547f23a-a39f-4460-8494-684f9a6b66aa" status: 200 len: 662 microversion: 2.1 time: 0.071201 May 07 21:59:17.823080 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1737/3538] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:17 2022] GET /compute/v2.1/images/6547f23a-a39f-4460-8494-684f9a6b66aa => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:17.833779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:17.834486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:17.843192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:17.843717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:17.844597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:17.845041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:17.909389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:17.924987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c980e1a-9192-4a48-baa9-53635b959e93 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1288 microversion: 2.1 time: 0.314312 May 07 21:59:17.942482 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1802/3539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:17 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1288 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:17.960985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fd27dbc2-780d-4802-a188-229f6f1ea4c9 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d479ee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:18.064858 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fd27dbc2-780d-4802-a188-229f6f1ea4c9 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/6547f23a-a39f-4460-8494-684f9a6b66aa" status: 200 len: 662 microversion: 2.1 time: 0.120199 May 07 21:59:18.065470 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1803/3540] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:17 2022] GET /compute/v2.1/images/6547f23a-a39f-4460-8494-684f9a6b66aa => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:18.203576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:18.214352 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ccbc0098-7d36-4fb6-875f-f874e39e4901 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1314 microversion: 2.1 time: 0.390040 May 07 21:59:18.215193 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1738/3541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:17 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:18.943587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:18.945278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:18.964584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:18.965334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:18.966441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:18.967270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:19.073433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:19.084263 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-022550d0-0c3d-4b3b-b198-b4f35b242422 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1286 microversion: 2.1 time: 0.146281 May 07 21:59:19.085487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1804/3542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:18 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:19.233602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:19.234284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:19.243577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:19.244205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:19.245342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:19.245948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:19.494782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-689909d5-4f69-48af-8ab9-5dcde3762a9f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d0e5af0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:19.582359 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-689909d5-4f69-48af-8ab9-5dcde3762a9f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/27a99201-de89-474f-8d04-3b599ba212d2" status: 200 len: 661 microversion: 2.1 time: 0.097637 May 07 21:59:19.582978 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1805/3543] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:19 2022] GET /compute/v2.1/images/27a99201-de89-474f-8d04-3b599ba212d2 => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:19.595236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-400d85f9-9b15-4dd6-bba8-663d443fd9eb tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cf0aca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:19.651915 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-400d85f9-9b15-4dd6-bba8-663d443fd9eb tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/27a99201-de89-474f-8d04-3b599ba212d2" status: 200 len: 661 microversion: 2.1 time: 0.060293 May 07 21:59:19.653184 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1806/3544] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:19 2022] GET /compute/v2.1/images/27a99201-de89-474f-8d04-3b599ba212d2 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:59:19.754555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:19.762264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3728b918-e93f-4d3d-9758-448e95d441bf tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1314 microversion: 2.1 time: 0.534290 May 07 21:59:19.766848 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1739/3545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:19 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:20.101821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:20.102519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:20.111762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:20.112227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:20.113382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:20.113849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:20.645172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-dec7f852-59c0-4d76-85b3-6dfe2c277873 req-5a21efeb-ce70-4946-8fd9-3e8a8877382e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16037dee-704d-447b-9523-4b2728e5d647", "name": "network-vif-plugged", "status": "completed", "tag": "36a9af4d-8e33-4f5e-81b0-dfddd8e4aada"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:20.662839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dec7f852-59c0-4d76-85b3-6dfe2c277873 req-5a21efeb-ce70-4946-8fd9-3e8a8877382e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:20.663737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dec7f852-59c0-4d76-85b3-6dfe2c277873 req-5a21efeb-ce70-4946-8fd9-3e8a8877382e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:20.685542 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-dec7f852-59c0-4d76-85b3-6dfe2c277873 req-5a21efeb-ce70-4946-8fd9-3e8a8877382e service nova] Creating event network-vif-plugged:36a9af4d-8e33-4f5e-81b0-dfddd8e4aada for instance 16037dee-704d-447b-9523-4b2728e5d647 on nch2-master-1 May 07 21:59:20.699733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:20.720553 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-dec7f852-59c0-4d76-85b3-6dfe2c277873 req-5a21efeb-ce70-4946-8fd9-3e8a8877382e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080195 May 07 21:59:20.721363 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-659b210b-807c-4b60-804c-1d6f3323418b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1328 microversion: 2.1 time: 0.623566 May 07 21:59:20.722904 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1807/3546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:20 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1328 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:20.723380 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1740/3547] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:20.782626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:20.783730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:20.797981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:20.798638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:20.799762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:20.800719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:21.133698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ea6081b-0bc4-4904-9184-d4733cac4165 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d454af0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:21.200602 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ea6081b-0bc4-4904-9184-d4733cac4165 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/67f03483-e421-4171-b320-97965d840a86" status: 200 len: 662 microversion: 2.1 time: 0.070088 May 07 21:59:21.208340 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1808/3548] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:21 2022] GET /compute/v2.1/images/67f03483-e421-4171-b320-97965d840a86 => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:21.219837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1789e056-2822-4cfc-b24d-7b69d1c94776 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d2c6a60>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:21.300271 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1789e056-2822-4cfc-b24d-7b69d1c94776 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/67f03483-e421-4171-b320-97965d840a86" status: 200 len: 662 microversion: 2.1 time: 0.090330 May 07 21:59:21.303490 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1809/3549] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:21 2022] GET /compute/v2.1/images/67f03483-e421-4171-b320-97965d840a86 => generated 662 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:21.315152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:21.320370 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd131460-4a62-47c1-b60d-e9685f7b8e46 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1314 microversion: 2.1 time: 0.543993 May 07 21:59:21.325353 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1741/3550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:20 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:21.393836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-533cbeb8-2e7c-45be-bef1-9b4571e9e49e req-97f25776-71fb-420f-a33e-fdc7a9e5b8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe14da73-2fb3-48b0-8ac2-34f544c2ee96", "tag": "29e5531f-d2b8-49c4-8efa-543c9739ee88"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:21.394213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1040761926", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:21.404571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-533cbeb8-2e7c-45be-bef1-9b4571e9e49e req-97f25776-71fb-420f-a33e-fdc7a9e5b8df service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:21.405587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-533cbeb8-2e7c-45be-bef1-9b4571e9e49e req-97f25776-71fb-420f-a33e-fdc7a9e5b8df service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:21.421026 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-533cbeb8-2e7c-45be-bef1-9b4571e9e49e req-97f25776-71fb-420f-a33e-fdc7a9e5b8df service nova] Creating event network-changed:29e5531f-d2b8-49c4-8efa-543c9739ee88 for instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 on nch1-master-1 May 07 21:59:21.429820 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-533cbeb8-2e7c-45be-bef1-9b4571e9e49e req-97f25776-71fb-420f-a33e-fdc7a9e5b8df service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043931 May 07 21:59:21.431963 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1810/3551] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:21.475646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:59:21.741855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:21.742616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:21.750215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:21.750675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:21.751484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:21.751927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:22.159379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:59:22.159903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:59:22.160276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:59:22.161485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:59:22.161909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:59:22.179756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:22.180454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:22.181559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:22.182204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:22.222843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:22.227070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Getting quotas for project 4f25e7e4b2ae4a278467bc1a4fc5fa46. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:59:22.235162 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-041497a4-fd72-41a0-ba57-078320ce3ec3 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1328 microversion: 2.1 time: 0.494956 May 07 21:59:22.236356 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1811/3552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:21 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1328 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:22.242399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Getting quotas for user df0de8764373461eaad7ac7b5f3eba3d and project 4f25e7e4b2ae4a278467bc1a4fc5fa46. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:59:22.271228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:59:22.279813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:59:22.337273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:22.338179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:22.345422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:22.346105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:22.347079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:22.352102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:22.420019 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1516434e-151d-4b6d-b81d-b403b8871715 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030263 May 07 21:59:22.428319 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1742/3553] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 21:59:22.514286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1748043791", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:22.683730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:59:22.885596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:22.893332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-088cf5b8-3464-4514-8b53-973c9268a731 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1500 microversion: 2.1 time: 0.559928 May 07 21:59:22.893921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1812/3554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:22 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1500 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:22.912337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:22.913176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:22.930443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:22.930932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:22.931900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:22.932345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:22.967787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lazy-loading 'flavor' on Instance uuid 16037dee-704d-447b-9523-4b2728e5d647 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:59:23.149234 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5697c2e-716e-4d94-9e0b-2c80960d8871 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "POST /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647/action" status: 202 len: 0 microversion: 2.1 time: 0.240594 May 07 21:59:23.157732 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1813/3555] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:59:22 2022] POST /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 21:59:23.167508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:23.174650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:23.189791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:23.193320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:23.195647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:23.197358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:23.279569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:59:23.282928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:59:23.284021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:59:23.285130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:59:23.286191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:59:23.316610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:23.322655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:23.323939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:23.326298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:23.384448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Getting quotas for project 4f25e7e4b2ae4a278467bc1a4fc5fa46. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:59:23.404621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Getting quotas for user df0de8764373461eaad7ac7b5f3eba3d and project 4f25e7e4b2ae4a278467bc1a4fc5fa46. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:59:23.456362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:59:23.459218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:59:23.560618 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a4c866f2-06d4-48b1-95cb-53e4dfe41b2c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049323 May 07 21:59:23.578136 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1743/3556] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 21:59:23.596054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:23.596703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:23.611267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:23.614004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:23.615434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:23.616061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:24.046735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:24.068927 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d4a00d6c-8a60-4970-8c96-4b4c5fa5456f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1328 microversion: 2.1 time: 0.489228 May 07 21:59:24.082654 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1744/3557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:23 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1328 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:24.099931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-55559014-0688-47b8-90ac-1c44683d314a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:24.100934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-55559014-0688-47b8-90ac-1c44683d314a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:24.258823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:24.272618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55559014-0688-47b8-90ac-1c44683d314a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:24.287961 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f2d5b044-a9cd-4090-bbb1-96d119abbe07 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1508 microversion: 2.1 time: 1.124610 May 07 21:59:24.290250 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1814/3558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:23 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1508 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:24.305790 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-55559014-0688-47b8-90ac-1c44683d314a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1218 microversion: 2.1 time: 0.211219 May 07 21:59:24.309144 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1745/3559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:24 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1218 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:25.101462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:25.102174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:25.124859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.125998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.131765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.132495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.314996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:25.320177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:25.338743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.340263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.341437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.342104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.452733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:25.466764 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-78e73227-d43f-4840-a26b-9695fecaf897 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1328 microversion: 2.1 time: 0.371050 May 07 21:59:25.469009 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1815/3560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:25 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1328 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:25.478108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:25.479072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:25.494795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.494795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.495402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.495956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.660588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:25.672371 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4739b29c-65cc-46b7-94ed-f37b04c76abe tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1276 microversion: 2.1 time: 0.201289 May 07 21:59:25.673607 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1816/3561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:25 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:25.822976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:25.841939 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-532d0fc8-9da3-47ce-8599-00e75b01b827 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1491 microversion: 2.1 time: 0.536043 May 07 21:59:25.844058 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1746/3562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:25 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1491 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:25.860746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:25.861523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:25.867941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.868740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.869787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:25.870458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:25.901129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:59:26.034890 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ccfab138-e275-496d-869a-fda7230adb8f tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 204 len: 0 microversion: 2.1 time: 0.178317 May 07 21:59:26.037873 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1817/3563] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:25 2022] DELETE /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:59:26.047932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:26.048681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:26.057883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:26.058943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:26.060098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:26.060714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:26.500178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:26.500904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:26.520110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:26.520578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:26.524360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:26.528847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:26.551075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:26.579513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-288f8ccb-a684-4c1e-9023-b15bdebeb9c7 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1497 microversion: 2.1 time: 0.530891 May 07 21:59:26.582071 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1747/3564] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:26 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1497 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:26.692926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:26.693902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:26.714481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:26.715936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:26.717124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:26.718377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:26.857817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:26.870801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-326f7ba8-c0a3-46c8-8610-f44dfc85163e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1276 microversion: 2.1 time: 0.182979 May 07 21:59:26.872789 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1748/3565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:26 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:27.082651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:27.102964 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-42799304-5642-4109-9326-a33b9fc9a24b tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1328 microversion: 2.1 time: 0.618010 May 07 21:59:27.104090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1818/3566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:26 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1328 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:27.600692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:27.602403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:27.614990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:27.616375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:27.631296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:27.635104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:27.889117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:27.889736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:27.908828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:27.909577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:27.910558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:27.911214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:28.027271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:28.041815 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-64eb0b7a-fa0c-441a-a46b-da4dc48c70c3 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1497 microversion: 2.1 time: 0.445822 May 07 21:59:28.042705 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1749/3567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:27 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1497 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:28.122478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:28.123409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:28.133060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:28.133847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:28.134655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:28.135337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:28.466010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:28.474938 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ba9af850-9662-498b-9553-565b4d60eaf0 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1328 microversion: 2.1 time: 0.357661 May 07 21:59:28.477589 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1750/3568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:28 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1328 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:28.484469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-62b0fab6-6ffd-40e8-9328-1c7aabe03eec req-3e4dc73e-3775-4c66-99ae-d4aa616820ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe14da73-2fb3-48b0-8ac2-34f544c2ee96", "name": "network-vif-plugged", "status": "completed", "tag": "29e5531f-d2b8-49c4-8efa-543c9739ee88"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:28.496096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-62b0fab6-6ffd-40e8-9328-1c7aabe03eec req-3e4dc73e-3775-4c66-99ae-d4aa616820ab service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:28.497609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-62b0fab6-6ffd-40e8-9328-1c7aabe03eec req-3e4dc73e-3775-4c66-99ae-d4aa616820ab service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:28.531611 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-62b0fab6-6ffd-40e8-9328-1c7aabe03eec req-3e4dc73e-3775-4c66-99ae-d4aa616820ab service nova] Creating event network-vif-plugged:29e5531f-d2b8-49c4-8efa-543c9739ee88 for instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 on nch1-master-1 May 07 21:59:28.565346 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-62b0fab6-6ffd-40e8-9328-1c7aabe03eec req-3e4dc73e-3775-4c66-99ae-d4aa616820ab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085452 May 07 21:59:28.566645 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1751/3569] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:28.687715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:28.695685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dae4246f-ee9c-4199-8246-0daecd53207f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.811867 May 07 21:59:28.696281 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1819/3570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:27 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:29.070609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:29.072729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:29.102593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:29.108463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:29.109734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:29.110464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:29.247579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:29.259444 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e0e31bb1-caa9-4cd1-a537-798a9131452c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1455 microversion: 2.1 time: 0.202802 May 07 21:59:29.263794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1752/3571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:29 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1455 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:29.496945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:29.497691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:29.518315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9f476a19-5484-4f85-b566-d320c7a9955b req-aeee743c-81d8-4b60-883f-c090cb10a6da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5d0aa6-f907-4569-bedc-2979f6637d33", "tag": "73e10226-084a-4235-a376-31a716d63e44"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:29.539063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:29.542013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:29.546712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9f476a19-5484-4f85-b566-d320c7a9955b req-aeee743c-81d8-4b60-883f-c090cb10a6da service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:29.547169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:29.547778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:29.549838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9f476a19-5484-4f85-b566-d320c7a9955b req-aeee743c-81d8-4b60-883f-c090cb10a6da service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:29.595239 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9f476a19-5484-4f85-b566-d320c7a9955b req-aeee743c-81d8-4b60-883f-c090cb10a6da service nova] Creating event network-changed:73e10226-084a-4235-a376-31a716d63e44 for instance 5d5d0aa6-f907-4569-bedc-2979f6637d33 on nch2-master-1 May 07 21:59:29.602034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9f476a19-5484-4f85-b566-d320c7a9955b req-aeee743c-81d8-4b60-883f-c090cb10a6da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093146 May 07 21:59:29.607864 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1753/3572] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 07 21:59:29.723738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:29.725217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:29.744947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:29.745413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:29.746881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:29.747520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:30.117625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:30.139907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:30.157292 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-10ce9820-307b-4644-9e8a-a8b4d4c15110 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1328 microversion: 2.1 time: 0.666798 May 07 21:59:30.158376 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1820/3573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:29 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1328 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:30.170398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7417beb7-b2da-4209-8765-c775feaa945d req-0b3645c6-fae5-41d2-aa39-65e79e37848a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16037dee-704d-447b-9523-4b2728e5d647", "name": "network-vif-deleted", "tag": "36a9af4d-8e33-4f5e-81b0-dfddd8e4aada"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:30.170626 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-00cca9e4-7f20-4ae8-bdfe-353bffa85d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.445976 May 07 21:59:30.176849 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1754/3574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:29 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:30.194999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7417beb7-b2da-4209-8765-c775feaa945d req-0b3645c6-fae5-41d2-aa39-65e79e37848a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:30.195412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7417beb7-b2da-4209-8765-c775feaa945d req-0b3645c6-fae5-41d2-aa39-65e79e37848a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:30.210536 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7417beb7-b2da-4209-8765-c775feaa945d req-0b3645c6-fae5-41d2-aa39-65e79e37848a service nova] Creating event network-vif-deleted:36a9af4d-8e33-4f5e-81b0-dfddd8e4aada for instance 16037dee-704d-447b-9523-4b2728e5d647 on nch2-master-1 May 07 21:59:30.232658 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7417beb7-b2da-4209-8765-c775feaa945d req-0b3645c6-fae5-41d2-aa39-65e79e37848a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072657 May 07 21:59:30.233496 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1821/3575] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:30.280326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:30.281382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:30.299767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:30.300466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:30.301531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:30.302233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:30.386174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:30.386966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:30.388342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lazy-loading 'fault' on Instance uuid 16037dee-704d-447b-9523-4b2728e5d647 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:59:30.552416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228761ebf4c0406ab0977cabe351ac76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85587313eff94af59406aca0c1a96a02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:30.565997 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b8f792f-248d-4a28-bc6e-8c2dd828c1d4 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 200 len: 1304 microversion: 2.1 time: 0.290129 May 07 21:59:30.566616 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1755/3576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:30 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 1304 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:31.180974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.181908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.201232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.202842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.218720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.219482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.220812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.221559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.226167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.226784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.227695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.228935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.407369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:31.426168 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-98ecdffc-26f0-45ab-9d54-bba201c14b8a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.229313 May 07 21:59:31.427786 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1756/3577] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:31 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:31.583427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.584295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.595389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.595872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.596652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.597269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.616961 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 16037dee-704d-447b-9523-4b2728e5d647 could not be found. May 07 21:59:31.617578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 16037dee-704d-447b-9523-4b2728e5d647 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:31.618457 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-881ddfbc-d840-4cde-a9cf-647a38eeb8e9 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 404 len: 111 microversion: 2.1 time: 0.039045 May 07 21:59:31.619438 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1757/3578] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:31 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:31.629813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.630338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.636688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.637696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.638509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.638983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.658394 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 16037dee-704d-447b-9523-4b2728e5d647 could not be found. May 07 21:59:31.659378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 16037dee-704d-447b-9523-4b2728e5d647 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:31.660485 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ddb65dc-b1e8-4407-b1e3-061d10ea8507 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 404 len: 111 microversion: 2.1 time: 0.034603 May 07 21:59:31.664571 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1758/3579] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:31 2022] DELETE /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:31.671197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4daa037f-7533-4f0d-bc4a-64f311ce544a req-53816250-71b9-4f65-ba21-b89f5b45cab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de30285c-55a0-4bf5-91e8-9bdd7282f8d7", "tag": "672e9dc5-e9c7-4350-b965-d54d762eb1d8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:31.680776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4daa037f-7533-4f0d-bc4a-64f311ce544a req-53816250-71b9-4f65-ba21-b89f5b45cab8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.681475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4daa037f-7533-4f0d-bc4a-64f311ce544a req-53816250-71b9-4f65-ba21-b89f5b45cab8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.695101 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4daa037f-7533-4f0d-bc4a-64f311ce544a req-53816250-71b9-4f65-ba21-b89f5b45cab8 service nova] Creating event network-changed:672e9dc5-e9c7-4350-b965-d54d762eb1d8 for instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 on nch2-master-1 May 07 21:59:31.702941 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4daa037f-7533-4f0d-bc4a-64f311ce544a req-53816250-71b9-4f65-ba21-b89f5b45cab8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036666 May 07 21:59:31.703574 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1759/3580] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:31.711979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.712715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 16037dee-704d-447b-9523-4b2728e5d647] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.721234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.722101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.723117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.723740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.739998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 16037dee-704d-447b-9523-4b2728e5d647 could not be found. May 07 21:59:31.740837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 16037dee-704d-447b-9523-4b2728e5d647 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:31.741896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-60258715-8186-433d-8f4b-f6e1f38b2522 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647" status: 404 len: 111 microversion: 2.1 time: 0.037223 May 07 21:59:31.742683 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1760/3581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:31 2022] GET /compute/v2.1/servers/16037dee-704d-447b-9523-4b2728e5d647 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:31.751922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.752724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.762929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.763689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.764755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.765376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.782601 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 could not be found. May 07 21:59:31.783549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:31.784829 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ba40a10b-b38f-43fd-91b1-228e551f6426 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 404 len: 111 microversion: 2.1 time: 0.037374 May 07 21:59:31.788786 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1761/3582] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:31 2022] DELETE /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:59:31.794743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.795688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c8f949ce-22d7-44fa-a1f2-d579d5bd9d12] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.803428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.804185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.805006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.805458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.828151 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 could not be found. May 07 21:59:31.829216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:31.830991 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5094f8fc-ed23-42cf-aaee-e6e0f1088c1c tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12" status: 404 len: 111 microversion: 2.1 time: 0.040779 May 07 21:59:31.831595 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1762/3583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:31 2022] GET /compute/v2.1/servers/c8f949ce-22d7-44fa-a1f2-d579d5bd9d12 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:31.843320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.844025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.852092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.852746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.853719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.854401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.889545 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b could not be found. May 07 21:59:31.890491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:31.891782 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4db674d8-1ebc-4353-802f-170a75db13da tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 404 len: 111 microversion: 2.1 time: 0.055365 May 07 21:59:31.895617 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1763/3584] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:31 2022] DELETE /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:31.902944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.903865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 76fb1f24-8416-4b15-b95f-ec086bc7ee8b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.911097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.912064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.913042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.913661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.945583 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b could not be found. May 07 21:59:31.946831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 76fb1f24-8416-4b15-b95f-ec086bc7ee8b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:31.948119 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-32c9cbd1-c1e3-4be5-ac0b-20d1b5f9927d tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b" status: 404 len: 111 microversion: 2.1 time: 0.051281 May 07 21:59:31.949078 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1764/3585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:31 2022] GET /compute/v2.1/servers/76fb1f24-8416-4b15-b95f-ec086bc7ee8b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:31.967645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:31.968294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:31.978665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.979275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:31.980629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:31.981490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:32.000679 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance ff063ae4-e930-4d7e-a587-56a10bb3d88a could not be found. May 07 21:59:32.001667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance ff063ae4-e930-4d7e-a587-56a10bb3d88a could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:32.002817 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-92524a22-1817-4315-8f22-da572de5211e tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 404 len: 111 microversion: 2.1 time: 0.044581 May 07 21:59:32.003562 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1765/3586] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:31 2022] DELETE /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:32.024527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:32.025277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: ff063ae4-e930-4d7e-a587-56a10bb3d88a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:32.045582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:32.046190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:32.047218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:32.047745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:32.068587 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance ff063ae4-e930-4d7e-a587-56a10bb3d88a could not be found. May 07 21:59:32.071099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance ff063ae4-e930-4d7e-a587-56a10bb3d88a could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:32.072088 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d4f09187-3d4b-4ffb-b171-f0c228e9bdca tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a" status: 404 len: 111 microversion: 2.1 time: 0.061918 May 07 21:59:32.073319 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1766/3587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:32 2022] GET /compute/v2.1/servers/ff063ae4-e930-4d7e-a587-56a10bb3d88a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:32.092399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c8090a9-aa75-48a0-92ff-159582245230 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:32.093053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c8090a9-aa75-48a0-92ff-159582245230 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:32.099139 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-0c8090a9-aa75-48a0-92ff-159582245230 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance c4d6ab9c-967e-4ac6-9a25-6301662fbff1 could not be found. May 07 21:59:32.099756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c8090a9-aa75-48a0-92ff-159582245230 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance c4d6ab9c-967e-4ac6-9a25-6301662fbff1 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:32.100627 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c8090a9-aa75-48a0-92ff-159582245230 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1" status: 404 len: 111 microversion: 2.1 time: 0.015629 May 07 21:59:32.104062 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1767/3588] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:32 2022] DELETE /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:32.109314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b86c459-7eef-4d71-9618-763e2f156e99 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:32.109954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5b86c459-7eef-4d71-9618-763e2f156e99 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: c4d6ab9c-967e-4ac6-9a25-6301662fbff1] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:32.116783 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5b86c459-7eef-4d71-9618-763e2f156e99 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance c4d6ab9c-967e-4ac6-9a25-6301662fbff1 could not be found. May 07 21:59:32.117403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b86c459-7eef-4d71-9618-763e2f156e99 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance c4d6ab9c-967e-4ac6-9a25-6301662fbff1 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:32.118570 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b86c459-7eef-4d71-9618-763e2f156e99 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1" status: 404 len: 111 microversion: 2.1 time: 0.012979 May 07 21:59:32.121746 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1768/3589] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:32 2022] GET /compute/v2.1/servers/c4d6ab9c-967e-4ac6-9a25-6301662fbff1 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:59:32.443523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:32.444861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:32.459837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:32.460543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:32.461554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:32.462207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:32.484590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:32.494708 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d7215f3-5e0c-4e5e-95f3-9e8ed205ea13 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1528 microversion: 2.1 time: 1.323073 May 07 21:59:32.511332 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1822/3590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:31 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1528 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:32.516511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:32.524516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:32.539511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:32.539511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:32.539511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:32.539511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:32.841974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:32.851526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9a9350db-fdc6-4fa7-9703-d9283da0d87f tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1528 microversion: 2.1 time: 0.339373 May 07 21:59:32.868174 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1823/3591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:32 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1528 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:32.901213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:32.915026 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-41d23d33-0e45-42d9-a649-d6f78d17a936 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.474620 May 07 21:59:32.915667 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1769/3592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:32 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:33.309863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:33.310478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.321379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.321852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.328900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.335572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.336575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:33.337234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.344703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.345169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.345973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.346426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.363945 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. May 07 21:59:33.365832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:33.367092 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c5beb226-debd-4e97-b59f-e25ea7eb6b40 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 404 len: 111 microversion: 2.1 time: 0.062039 May 07 21:59:33.371297 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1770/3593] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:33 2022] DELETE /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:59:33.378736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:33.379815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.386948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.388275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.389319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.389981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.403142 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] HTTP exception thrown: Instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 could not be found. May 07 21:59:33.404000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Returning 404 to user: Instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:33.405083 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8eb40d25-c864-4c50-9617-17bf9d739722 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 404 len: 111 microversion: 2.1 time: 0.535573 May 07 21:59:33.406149 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1824/3594] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:32 2022] DELETE /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 111 bytes in 537 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:33.420650 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. May 07 21:59:33.420989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:33.421400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.422154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 8d7a8b92-09df-4099-94f7-37bbd4e0fa2c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:33.423267 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e4f127d-37bd-4b05-b108-5441e24f6a89 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c" status: 404 len: 111 microversion: 2.1 time: 0.048536 May 07 21:59:33.424633 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1771/3595] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:33 2022] GET /compute/v2.1/servers/8d7a8b92-09df-4099-94f7-37bbd4e0fa2c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:33.430708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.431537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.432552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.433528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.437774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:33.449239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.467918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.468380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.469856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.470312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.502957 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 could not be found. May 07 21:59:33.503560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:33.504429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-158493e4-8b2a-4d32-97e7-2e25f5e81251 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 404 len: 111 microversion: 2.1 time: 0.076095 May 07 21:59:33.504991 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1772/3596] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:33 2022] DELETE /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 21:59:33.513533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:33.514166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] [instance: 18b8a031-b3cd-4d2f-b349-9b08eb3a6720] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.520367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.520825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.521740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.522349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.545138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] HTTP exception thrown: Instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 could not be found. May 07 21:59:33.546159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] Returning 404 to user: Instance 18b8a031-b3cd-4d2f-b349-9b08eb3a6720 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:33.547147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2b3ace5c-1d3f-4128-969f-6cd6f9ebfb55 tempest-DeleteServersTestJSON-1693230253 tempest-DeleteServersTestJSON-1693230253-project] 10.222.0.32 "GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720" status: 404 len: 111 microversion: 2.1 time: 0.038175 May 07 21:59:33.547899 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1773/3597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:33 2022] GET /compute/v2.1/servers/18b8a031-b3cd-4d2f-b349-9b08eb3a6720 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:33.706800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:33.729783 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-875990ea-dddf-423b-8838-d4ed08003fef tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1528 microversion: 2.1 time: 0.315640 May 07 21:59:33.730584 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1825/3598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:33 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1528 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:33.748815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Action: 'update', calling method: >, body: {"server": {"name": "fe14da73-2fb3-48b0-8ac2-34f544c2ee96_new"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:33.750193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.764633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.766416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.769183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.771737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.797596 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] HTTP exception thrown: Instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 could not be found. May 07 21:59:33.798726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] Returning 404 to user: Instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:33.799883 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af8f7230-619a-4bf5-baa7-9d263da4b503 tempest-ServersNegativeTestMultiTenantJSON-1757601347 tempest-ServersNegativeTestMultiTenantJSON-1757601347-project] 10.222.0.32 "PUT /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 404 len: 111 microversion: 2.1 time: 0.055872 May 07 21:59:33.801053 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1826/3599] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 21:59:33 2022] PUT /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:33.816656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:33.817558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:33.834715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.835834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.836855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:33.839993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:33.908578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:59:33.977356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0369c20c-8731-4160-93d8-7c57b9064869 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-661432672", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:33.979586 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-0369c20c-8731-4160-93d8-7c57b9064869 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] HTTP exception thrown: min_count must be <= max_count May 07 21:59:33.980279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0369c20c-8731-4160-93d8-7c57b9064869 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Returning 400 to user: min_count must be <= max_count {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:33.981293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0369c20c-8731-4160-93d8-7c57b9064869 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.292837 May 07 21:59:33.984304 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1774/3600] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:33 2022] POST /compute/v2.1/servers => generated 74 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 21:59:34.000424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:34.001343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:34.016624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:34.019307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:34.020906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:34.021712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:34.146750 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1397d6b8-e626-4969-a698-036ba7f06aa5 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 204 len: 0 microversion: 2.1 time: 0.339829 May 07 21:59:34.148396 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1827/3601] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 21:59:33 2022] DELETE /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 21:59:34.167541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ade16c1-4aca-4520-80cd-38cb3d454186 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1751262181", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "max_count": 0}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:34.171629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ade16c1-4aca-4520-80cd-38cb3d454186 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:34.173250 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ade16c1-4aca-4520-80cd-38cb3d454186 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022567 May 07 21:59:34.174090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1828/3602] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:34 2022] POST /compute/v2.1/servers => generated 130 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:59:34.186718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:34.187668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:34.204522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:34.205059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:34.206094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:34.207421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:34.520818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:34.530307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b487cd32-769c-49dd-8c0f-dc150edad85c tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1534 microversion: 2.1 time: 0.354433 May 07 21:59:34.535888 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1829/3603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:34 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1534 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:34.553351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc2766f1-b706-4b96-b2eb-c118091f6e5a tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-591819104", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "max_count": 2.5}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:34.557217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc2766f1-b706-4b96-b2eb-c118091f6e5a tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:34.566996 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc2766f1-b706-4b96-b2eb-c118091f6e5a tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020204 May 07 21:59:34.577005 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1830/3604] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:34 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:59:34.635862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a62411f3-4a4d-4db4-ab96-033b099d9814 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1471017233", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 0}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:34.637296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a62411f3-4a4d-4db4-ab96-033b099d9814 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:34.638115 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a62411f3-4a4d-4db4-ab96-033b099d9814 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.006325 May 07 21:59:34.647682 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1831/3605] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:34 2022] POST /compute/v2.1/servers => generated 130 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:59:34.710395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-45294103-91f1-4ab5-8e4d-00d42ac07511 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1931078740", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "min_count": 2.5}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:34.711852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-45294103-91f1-4ab5-8e4d-00d42ac07511 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:34.712693 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-45294103-91f1-4ab5-8e4d-00d42ac07511 tempest-MultipleCreateNegativeTestJSON-1562975170 tempest-MultipleCreateNegativeTestJSON-1562975170-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008617 May 07 21:59:34.718895 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1832/3606] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:59:34 2022] POST /compute/v2.1/servers => generated 139 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 21:59:34.754418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:34.770542 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a25721b7-30d4-4ca1-a078-e2191d3caa9b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.784542 May 07 21:59:34.771470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1775/3607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:33 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:35.552681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:35.553324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:35.578716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:35.579222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:35.581622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:35.582090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:35.788757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:35.790296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:35.797776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:35.798684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:35.799769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:35.800465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:35.987651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:36.000732 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f464c92a-deab-468a-82f1-c45241091a43 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.216147 May 07 21:59:36.001349 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1776/3608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:35 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:36.115624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:36.126791 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12d7ac82-cf66-490e-9dc0-9148e10cf71e tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1534 microversion: 2.1 time: 0.577429 May 07 21:59:36.127953 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1833/3609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:35 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1534 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:37.018174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:37.019007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:37.032695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-cf4846e9-7ecf-4b58-aff2-6d9a1bee1434 req-d49ddd8f-c4c1-4f9a-8ac9-52735e0df769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe14da73-2fb3-48b0-8ac2-34f544c2ee96", "name": "network-vif-deleted", "tag": "29e5531f-d2b8-49c4-8efa-543c9739ee88"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:37.034333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:37.036120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:37.038326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:37.039237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:37.051639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-cf4846e9-7ecf-4b58-aff2-6d9a1bee1434 req-d49ddd8f-c4c1-4f9a-8ac9-52735e0df769 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:37.052126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-cf4846e9-7ecf-4b58-aff2-6d9a1bee1434 req-d49ddd8f-c4c1-4f9a-8ac9-52735e0df769 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:37.068518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-cf4846e9-7ecf-4b58-aff2-6d9a1bee1434 req-d49ddd8f-c4c1-4f9a-8ac9-52735e0df769 service nova] Creating event network-vif-deleted:29e5531f-d2b8-49c4-8efa-543c9739ee88 for instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 on nch1-master-1 May 07 21:59:37.073916 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-cf4846e9-7ecf-4b58-aff2-6d9a1bee1434 req-d49ddd8f-c4c1-4f9a-8ac9-52735e0df769 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046732 May 07 21:59:37.086859 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1834/3610] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:59:37.145000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:37.147096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:37.159531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:37.160396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:37.161417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:37.168951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:37.250072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:37.250459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:37.250961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lazy-loading 'fault' on Instance uuid fe14da73-2fb3-48b0-8ac2-34f544c2ee96 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 21:59:37.353383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e9a3cda211245a18608ae0a25468113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1426f0d5b4ef478d91cfb1856c943052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:37.361949 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a4067ab-6d85-4ca6-8837-69586a87e450 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 200 len: 1318 microversion: 2.1 time: 0.221610 May 07 21:59:37.363768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:37.366423 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1835/3611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:37 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:37.379102 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4972b4e-10d1-4601-a4c5-4e430aa0f243 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.363948 May 07 21:59:37.381009 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1777/3612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:37 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:37.549142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c2713884-9d78-4241-a651-38bad083a3d9 req-64a11196-802c-41b4-9b04-2e9f2719500f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5d0aa6-f907-4569-bedc-2979f6637d33", "name": "network-vif-plugged", "status": "completed", "tag": "73e10226-084a-4235-a376-31a716d63e44"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:37.575390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c2713884-9d78-4241-a651-38bad083a3d9 req-64a11196-802c-41b4-9b04-2e9f2719500f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:37.576873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c2713884-9d78-4241-a651-38bad083a3d9 req-64a11196-802c-41b4-9b04-2e9f2719500f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:37.602643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c2713884-9d78-4241-a651-38bad083a3d9 req-64a11196-802c-41b4-9b04-2e9f2719500f service nova] Creating event network-vif-plugged:73e10226-084a-4235-a376-31a716d63e44 for instance 5d5d0aa6-f907-4569-bedc-2979f6637d33 on nch2-master-1 May 07 21:59:37.615877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c2713884-9d78-4241-a651-38bad083a3d9 req-64a11196-802c-41b4-9b04-2e9f2719500f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070952 May 07 21:59:37.616997 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1836/3613] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 21:59:38.379836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:38.381320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] [instance: fe14da73-2fb3-48b0-8ac2-34f544c2ee96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:38.389244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:38.389790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:38.390749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:38.391435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:38.398083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:38.398623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:38.407091 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] HTTP exception thrown: Instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 could not be found. May 07 21:59:38.407998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] Returning 404 to user: Instance fe14da73-2fb3-48b0-8ac2-34f544c2ee96 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:38.409052 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6253a32d-0d9d-43d4-98be-2853ad916206 tempest-ServersNegativeTestMultiTenantJSON-930776855 tempest-ServersNegativeTestMultiTenantJSON-930776855-project] 10.222.0.32 "GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96" status: 404 len: 111 microversion: 2.1 time: 0.033948 May 07 21:59:38.409826 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1778/3614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:38 2022] GET /compute/v2.1/servers/fe14da73-2fb3-48b0-8ac2-34f544c2ee96 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 21:59:38.411883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:38.412740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:38.413842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:38.415089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:38.847336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:38.859597 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da360980-d7cb-4c7c-af22-e8593efcafa2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1318 microversion: 2.1 time: 0.466141 May 07 21:59:38.861535 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1837/3615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:38 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:39.483099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1164105940", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "011b05b9-af33-4afd-88fa-e53f85adc730"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:39.566479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] validate_networks() for [('011b05b9-af33-4afd-88fa-e53f85adc730', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 21:59:39.730100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-44aa4854-eebd-4adb-a50a-574059bba3a9 req-53846f07-aeae-41ce-b179-d8951ae1211a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30285c-55a0-4bf5-91e8-9bdd7282f8d7", "name": "network-vif-plugged", "status": "completed", "tag": "672e9dc5-e9c7-4350-b965-d54d762eb1d8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:39.743608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-44aa4854-eebd-4adb-a50a-574059bba3a9 req-53846f07-aeae-41ce-b179-d8951ae1211a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:39.744476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-44aa4854-eebd-4adb-a50a-574059bba3a9 req-53846f07-aeae-41ce-b179-d8951ae1211a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:39.763943 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-44aa4854-eebd-4adb-a50a-574059bba3a9 req-53846f07-aeae-41ce-b179-d8951ae1211a service nova] Creating event network-vif-plugged:672e9dc5-e9c7-4350-b965-d54d762eb1d8 for instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 on nch2-master-1 May 07 21:59:39.780613 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-44aa4854-eebd-4adb-a50a-574059bba3a9 req-53846f07-aeae-41ce-b179-d8951ae1211a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043130 May 07 21:59:39.782008 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1838/3616] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:39.882513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:39.883822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:39.891955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:39.892858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:39.893871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:39.894539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:40.564662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 21:59:40.565521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 21:59:40.566159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 21:59:40.566595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 21:59:40.567334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 21:59:40.577477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:40.578314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:40.579207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:40.579846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:40.602622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Getting quotas for project 42a275b437594296b48dcf24858d61f3. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 21:59:40.609455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Getting quotas for user 489625599dce4b9ea71e3ed13c28c30f and project 42a275b437594296b48dcf24858d61f3. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 21:59:40.623631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 21:59:40.626418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 21:59:40.696719 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-78956fa6-26fe-422c-ac5e-5403f39481d3 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.427559 May 07 21:59:40.702846 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1779/3617] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 21:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 21:59:40.721450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc67fc31-a06c-4299-9e71-46808255f355 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:40.724590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc67fc31-a06c-4299-9e71-46808255f355 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:40.731561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc67fc31-a06c-4299-9e71-46808255f355 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:40.732035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc67fc31-a06c-4299-9e71-46808255f355 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:40.733563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc67fc31-a06c-4299-9e71-46808255f355 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:40.734561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc67fc31-a06c-4299-9e71-46808255f355 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:40.842091 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc67fc31-a06c-4299-9e71-46808255f355 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.131255 May 07 21:59:40.852979 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1780/3618] 10.222.0.32 () {60 vars in 1342 bytes} [Sat May 7 21:59:40 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:40.861840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80b75b92-3f0a-4d79-abd5-bafaa9e993cd tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:40.863104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80b75b92-3f0a-4d79-abd5-bafaa9e993cd tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:41.008059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80b75b92-3f0a-4d79-abd5-bafaa9e993cd tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.023735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80b75b92-3f0a-4d79-abd5-bafaa9e993cd tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.026328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80b75b92-3f0a-4d79-abd5-bafaa9e993cd tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.028140 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80b75b92-3f0a-4d79-abd5-bafaa9e993cd tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1259 microversion: 2.21 time: 0.172416 May 07 21:59:41.029742 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1781/3619] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:40 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:41.048438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:41.049453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:41.072812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:41.073634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:41.075420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:41.076738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:41.114336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:59:41.148316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.160581 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-db6443e5-289e-47bc-b506-cee0e85d098f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1466 microversion: 2.1 time: 1.283908 May 07 21:59:41.162059 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1839/3620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:39 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1466 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:41.185959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:41.187091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:41.208918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:41.209760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:41.210851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:41.211469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:41.322328 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c1348abf-f30b-459f-8801-3dbcde680250 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 204 len: 0 microversion: 2.20 time: 0.290817 May 07 21:59:41.323430 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1782/3621] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:59:41 2022] DELETE /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:59:41.343882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:41.344655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:41.360351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:41.361083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:41.362069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:41.363307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:41.726919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.744763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.747017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.752317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85d16f53-3a0b-484d-a9ff-a8b2f7b06d0e tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.423610 May 07 21:59:41.767269 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1783/3622] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:41 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:41.985330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:41.999494 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de166708-547d-457f-861d-2e29be1a2015 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1318 microversion: 2.1 time: 0.823874 May 07 21:59:42.000439 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1840/3623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:41 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:42.047179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:42.047935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:42.056972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:42.057362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:42.058161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:42.058608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:42.150994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:42.162222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:42.164304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:42.165958 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1ef5ba4a-7a0e-4ca2-9720-0a007e1f7bc4 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1263 microversion: 2.21 time: 0.123401 May 07 21:59:42.167177 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1784/3624] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:42 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1263 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:42.781653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:42.794323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:42.818857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:42.819337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:42.820235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:42.820688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:43.017848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:43.019214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:43.036020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:43.036835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:43.040149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:43.040934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:43.685260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:43.697870 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-967eb688-5456-4d13-99fd-455fb6dff0f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1466 microversion: 2.1 time: 0.685265 May 07 21:59:43.698748 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1785/3625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 21:59:43 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1466 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:43.709857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:43.710999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:43.718971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:43.719421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:43.720204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:43.720999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:43.801283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:43.819336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:43.819336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:43.819336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dab3fd19-c690-41c5-85fb-4dee60e428f2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1317 microversion: 2.21 time: 0.112760 May 07 21:59:43.819336 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1786/3626] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:43 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1317 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:43.826631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b8701fc-058a-4cdc-8693-ff91c7492af7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-738054703"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:43.827732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0b8701fc-058a-4cdc-8693-ff91c7492af7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:43.834057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8701fc-058a-4cdc-8693-ff91c7492af7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:43.834521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8701fc-058a-4cdc-8693-ff91c7492af7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:43.835343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8701fc-058a-4cdc-8693-ff91c7492af7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:43.835789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b8701fc-058a-4cdc-8693-ff91c7492af7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:44.048741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:44.062006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:44.065694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:44.069166 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 1.298486 May 07 21:59:44.070024 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1841/3627] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:42 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:44.082207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:44.083461 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9fd0dd6d-8b1a-49d9-a312-8658b97bb832 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001581 May 07 21:59:44.084376 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1842/3628] 10.222.0.32 () {56 vars in 885 bytes} [Sat May 7 21:59:44 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 07 21:59:44.146127 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b8701fc-058a-4cdc-8693-ff91c7492af7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "POST /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7/action" status: 202 len: 0 microversion: 2.1 time: 0.329961 May 07 21:59:44.152099 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1787/3629] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 21:59:43 2022] POST /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 21:59:44.159037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2133af27-f51b-4389-827b-0dfdd0239d82 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cce5f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:44.230190 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2133af27-f51b-4389-827b-0dfdd0239d82 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.075907 May 07 21:59:44.237881 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1843/3630] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:44 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:44.833665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:44.834647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:44.851010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:44.863495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:44.864592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:44.865059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:44.967724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:44.977634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:44.979601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:44.981078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eba1e7cb-10e1-4769-9928-62396ffc2e96 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1317 microversion: 2.21 time: 0.151962 May 07 21:59:44.981663 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1788/3631] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:44 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:45.089270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:45.091648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:45.099619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:45.100431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:45.101477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:45.102262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:45.243890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-164988f8-a749-4914-8a98-39c0d4e015ff tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ca884c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:45.310391 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-164988f8-a749-4914-8a98-39c0d4e015ff tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.068151 May 07 21:59:45.312418 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1789/3632] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:45 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:46.012879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:46.014755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:46.031328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:46.032357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:46.033728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:46.035193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:46.059791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:46.070995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:46.073650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:46.075443 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-49a99a42-8d02-47e1-b376-2c6c73bdd5ec tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1725 microversion: 2.20 time: 0.990782 May 07 21:59:46.076635 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1844/3633] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:45 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1725 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:46.347715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ca0ed4c-7d0e-4559-8d3d-d53346d5af21 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d601af0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:46.398708 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ca0ed4c-7d0e-4559-8d3d-d53346d5af21 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.076126 May 07 21:59:46.405020 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1845/3634] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:46 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:46.445843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:46.460197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:46.463001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:46.465490 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aad9159f-5074-4894-a019-d7db46f7f259 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1317 microversion: 2.21 time: 0.468138 May 07 21:59:46.477859 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1790/3635] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:45 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 21:59:47.098613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:47.099465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:47.116861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.117328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:47.118330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.118988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:47.252034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:47.262642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:47.272546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:47.274186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c87f120d-9e64-4917-b14f-f4bd91f696dc tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1657 microversion: 2.20 time: 0.179749 May 07 21:59:47.275328 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1791/3636] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:47 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1657 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:47.301402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:47.301936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:47.314375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.315705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:47.317033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.317907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:47.369327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 21:59:47.412994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b84c639b-09f8-410a-ae5d-fed11eea03ee tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ce48280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:47.498075 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b84c639b-09f8-410a-ae5d-fed11eea03ee tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.090180 May 07 21:59:47.499498 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1792/3637] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:47 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:47.522212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:47.523703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:47.530399 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ee4e500-0219-413b-a3cc-90d2f5d4e581 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 204 len: 0 microversion: 2.32 time: 0.564964 May 07 21:59:47.534615 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1846/3638] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 21:59:46 2022] DELETE /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:59:47.544726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:47.545785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:47.547421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.551310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:47.552317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.552862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:47.554378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.555089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:47.556226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:47.557007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:48.255286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.279628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.281300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.282512 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5f4947a-b45d-490d-b067-569f1d838194 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2950 microversion: 2.32 time: 0.744745 May 07 21:59:48.288443 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1847/3639] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:47 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2950 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:48.307047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9b6a93fd-6cf7-421c-9f18-d20c7dca8ec3 req-082b9922-eb36-43ba-99df-23960261f01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83ad7d9c-5e14-44b9-a948-c9c337d99f0c", "name": "network-vif-deleted", "tag": "d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:48.322943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9b6a93fd-6cf7-421c-9f18-d20c7dca8ec3 req-082b9922-eb36-43ba-99df-23960261f01e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:48.323391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9b6a93fd-6cf7-421c-9f18-d20c7dca8ec3 req-082b9922-eb36-43ba-99df-23960261f01e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:48.337365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.347620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.355095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.357754 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed034b4b-dd5e-4b1b-9543-e322b0b4e53d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 0.851505 May 07 21:59:48.367405 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1793/3640] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:47 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:48.392855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:48.393873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:48.394434 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9b6a93fd-6cf7-421c-9f18-d20c7dca8ec3 req-082b9922-eb36-43ba-99df-23960261f01e service nova] Creating event network-vif-deleted:d4e2b793-5d2d-4a07-9cc6-af0c205ae6e2 for instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c on nch1-master-1 May 07 21:59:48.412082 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9b6a93fd-6cf7-421c-9f18-d20c7dca8ec3 req-082b9922-eb36-43ba-99df-23960261f01e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120735 May 07 21:59:48.415505 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1848/3641] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:48.417430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:48.420599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:48.421855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:48.422532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:48.513186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4f8d97d-efcf-4d36-aed2-f7b4cf3c9aa5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc422623550>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:48.613803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4f8d97d-efcf-4d36-aed2-f7b4cf3c9aa5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.102492 May 07 21:59:48.617139 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1849/3642] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:48 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:48.739649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.778080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.780148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdc18dc6c5214fbb9c1fa61eeb514cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c3c71171814bb7b1018904086ad506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:48.785310 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e431478e-f087-4610-bebf-d85fb752dde3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 200 len: 1657 microversion: 2.20 time: 0.414855 May 07 21:59:48.802212 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1794/3643] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:48 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 1657 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:49.310426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:49.311781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:49.333685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:49.334439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:49.337048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:49.337725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:49.385392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:49.386166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:49.399900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:49.401698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:49.414959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:49.417019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:51.016052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:51.037178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:51.049065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:51.055919 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97a8724c-b912-4a75-8406-a6e69e1a9e6a tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 1.669767 May 07 21:59:51.059997 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1795/3644] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:49 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:51.083851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d8fa9ac-b985-4644-8f15-27014ec0a943 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cc9dca0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:51.192241 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d8fa9ac-b985-4644-8f15-27014ec0a943 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.130908 May 07 21:59:51.197928 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1796/3645] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:51 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:51.217862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:51.218800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:51.237663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:51.238388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:51.239464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:51.248610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:51.278149 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] HTTP exception thrown: Instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c could not be found. May 07 21:59:51.297456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Returning 404 to user: Instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 21:59:51.300522 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b47366b5-b9a3-42fe-9057-b774a5c375a7 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 404 len: 111 microversion: 2.20 time: 0.101265 May 07 21:59:51.302360 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1797/3646] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:51 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 21:59:51.314229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce863138-6583-4034-8e0e-3557576712f3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '.version_select at 0x7fc41cc9daf0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:51.381294 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce863138-6583-4034-8e0e-3557576712f3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499389669" status: 204 len: 0 microversion: 2.20 time: 0.072984 May 07 21:59:51.389747 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1798/3647] 10.222.0.32 () {60 vars in 1261 bytes} [Sat May 7 21:59:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1499389669 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 21:59:51.599729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:51.621911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:51.623656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:51.624974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d55135fc-c7eb-4b85-8f9f-54b0daf7b209 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2950 microversion: 2.32 time: 2.320295 May 07 21:59:51.635835 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1850/3648] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:49 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2950 bytes in 2330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:52.074436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:52.075191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:52.085339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:52.090871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:52.092134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:52.095120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:52.207309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9449f29f-5fcd-4fcc-8f4e-9c84534f19b9 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cce58b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:52.310957 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9449f29f-5fcd-4fcc-8f4e-9c84534f19b9 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.107263 May 07 21:59:52.311627 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1851/3649] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:52 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:52.664894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:52.666327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:52.676104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:52.682165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:52.684334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:52.690542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:53.546537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:53.568869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:53.570815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:53.572140 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b8e3a21b-9bb1-4105-a9f3-43a8a11b56d5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 1.502457 May 07 21:59:53.578516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1799/3650] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:52 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:53.597429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-675faf81-cda6-4579-9c8c-3907cb173ab0 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd961f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:53.707105 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-675faf81-cda6-4579-9c8c-3907cb173ab0 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.115764 May 07 21:59:53.708024 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1800/3651] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:53 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:53.843461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:53.857777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:53.859363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:53.860769 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7583831-a97b-485e-b3e5-09aae17cf078 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2950 microversion: 2.32 time: 1.210432 May 07 21:59:53.879195 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1852/3652] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:52 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2950 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:54.244360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-846ffb7b-7488-4de6-927b-f787ca460b45 req-9861bc1d-cf5e-4d81-9125-acd5dfbac603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30285c-55a0-4bf5-91e8-9bdd7282f8d7", "name": "network-vif-plugged", "status": "completed", "tag": "672e9dc5-e9c7-4350-b965-d54d762eb1d8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:54.277522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-846ffb7b-7488-4de6-927b-f787ca460b45 req-9861bc1d-cf5e-4d81-9125-acd5dfbac603 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:54.283659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-846ffb7b-7488-4de6-927b-f787ca460b45 req-9861bc1d-cf5e-4d81-9125-acd5dfbac603 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:54.303519 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-846ffb7b-7488-4de6-927b-f787ca460b45 req-9861bc1d-cf5e-4d81-9125-acd5dfbac603 service nova] Creating event network-vif-plugged:672e9dc5-e9c7-4350-b965-d54d762eb1d8 for instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 on nch2-master-1 May 07 21:59:54.321765 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-846ffb7b-7488-4de6-927b-f787ca460b45 req-9861bc1d-cf5e-4d81-9125-acd5dfbac603 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082772 May 07 21:59:54.323090 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1801/3653] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:54.596137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:54.596775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:54.606262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:54.606736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:54.607780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:54.608424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:54.732476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fbfb74f7-bf88-4ca5-a6f5-e9a653cb5d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd96700>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:54.832094 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fbfb74f7-bf88-4ca5-a6f5-e9a653cb5d69 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.112524 May 07 21:59:54.840680 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1802/3654] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:54 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:54.904962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:54.907050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:54.915619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:54.916527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:54.918116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:54.918839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:55.727325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:55.743635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:55.746262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:55.748154 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0dcb5bf1-361f-444d-a00a-07bc0e12df4d tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 1.156571 May 07 21:59:55.751451 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1853/3655] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:54 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:55.846007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-db59fd39-812b-4b1b-85f6-cd25bd4ec186 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc422618f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:55.918465 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-db59fd39-812b-4b1b-85f6-cd25bd4ec186 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.075552 May 07 21:59:55.920430 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1854/3656] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:55 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:56.044937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:56.060449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:56.062882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:56.068246 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b323a79-18ee-4e35-b683-dda196e880aa tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2950 microversion: 2.32 time: 1.168193 May 07 21:59:56.068859 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1803/3657] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:54 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2950 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:56.390481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-582ba3a8-e212-4b25-9ed2-49512a2c030b req-29df3ee8-1a58-472d-9071-4aed784863f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "5642df0d-b70e-45a4-b82c-4c09755c76de"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "248ca656-6bff-4ce6-b67d-1c6c09ea7b42"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "0aa75d6c-c396-4cf7-82ed-1655289562cd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:56.425596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-582ba3a8-e212-4b25-9ed2-49512a2c030b req-29df3ee8-1a58-472d-9071-4aed784863f2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:56.430036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-582ba3a8-e212-4b25-9ed2-49512a2c030b req-29df3ee8-1a58-472d-9071-4aed784863f2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:56.452835 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-582ba3a8-e212-4b25-9ed2-49512a2c030b req-29df3ee8-1a58-472d-9071-4aed784863f2 service nova] Creating event network-vif-unplugged:5642df0d-b70e-45a4-b82c-4c09755c76de for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:59:56.453356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-582ba3a8-e212-4b25-9ed2-49512a2c030b req-29df3ee8-1a58-472d-9071-4aed784863f2 service nova] Creating event network-vif-unplugged:248ca656-6bff-4ce6-b67d-1c6c09ea7b42 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:59:56.453872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-582ba3a8-e212-4b25-9ed2-49512a2c030b req-29df3ee8-1a58-472d-9071-4aed784863f2 service nova] Creating event network-vif-unplugged:0aa75d6c-c396-4cf7-82ed-1655289562cd for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:59:56.470641 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-582ba3a8-e212-4b25-9ed2-49512a2c030b req-29df3ee8-1a58-472d-9071-4aed784863f2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.084574 May 07 21:59:56.471660 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1855/3658] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:56.770018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:56.770575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:56.794251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:56.794808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:56.795691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:56.796153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:56.933069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7755390e-7c13-4fbb-a718-4c0608f31652 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d0348b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:57.036307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7755390e-7c13-4fbb-a718-4c0608f31652 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.106984 May 07 21:59:57.042030 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1856/3659] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:56 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 21:59:57.092093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:57.093109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:57.101766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:57.102530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:57.103684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:57.104300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:57.664749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:57.673954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:57.675543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:57.688121 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9f89d18c-4fee-4d6b-a93a-479e02ef49f5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 0.922600 May 07 21:59:57.691922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1804/3660] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:56 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:57.710027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e5cfbb0d-7cbe-43f8-904e-13adc441169d req-3fa94c41-37ab-42e4-a510-bc9711405692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21531192-b2b4-4fc8-8c41-e19e7301001f", "tag": "3a446051-aeee-48e0-a355-cc210b6b8602"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:57.735428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e5cfbb0d-7cbe-43f8-904e-13adc441169d req-3fa94c41-37ab-42e4-a510-bc9711405692 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:57.740785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e5cfbb0d-7cbe-43f8-904e-13adc441169d req-3fa94c41-37ab-42e4-a510-bc9711405692 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:57.770421 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e5cfbb0d-7cbe-43f8-904e-13adc441169d req-3fa94c41-37ab-42e4-a510-bc9711405692 service nova] Creating event network-changed:3a446051-aeee-48e0-a355-cc210b6b8602 for instance 21531192-b2b4-4fc8-8c41-e19e7301001f on nch1-master-1 May 07 21:59:57.776134 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e5cfbb0d-7cbe-43f8-904e-13adc441169d req-3fa94c41-37ab-42e4-a510-bc9711405692 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082986 May 07 21:59:57.789738 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1805/3661] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:58.051641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66392c7c-00f9-424e-ad6c-0ecb56b9b3f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd96af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:58.133514 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66392c7c-00f9-424e-ad6c-0ecb56b9b3f3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.086853 May 07 21:59:58.134479 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1806/3662] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:58 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:58.718072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:58.718900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 21:59:58.740125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:58.743051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:58.747185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:58.747894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:58.929336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:58.953899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:58.955506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:58.967493 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b15891b-72ec-4d9f-86cd-84da191e9f02 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2929 microversion: 2.32 time: 1.879460 May 07 21:59:58.968107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1857/3663] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:57 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2929 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:58.972879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d7ba67e5-00aa-4075-9d41-56717aee9d77 req-f9161e96-49d3-4eae-9b1e-370a3c944a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "744875ea-e246-4ecb-b60f-b9c04a274fe9"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "d3eb7f9f-cad6-43cc-b93c-f50a5e95c505"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 21:59:58.991621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d7ba67e5-00aa-4075-9d41-56717aee9d77 req-f9161e96-49d3-4eae-9b1e-370a3c944a50 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 21:59:58.997896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d7ba67e5-00aa-4075-9d41-56717aee9d77 req-f9161e96-49d3-4eae-9b1e-370a3c944a50 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 21:59:59.023017 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d7ba67e5-00aa-4075-9d41-56717aee9d77 req-f9161e96-49d3-4eae-9b1e-370a3c944a50 service nova] Creating event network-vif-unplugged:744875ea-e246-4ecb-b60f-b9c04a274fe9 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:59:59.029206 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d7ba67e5-00aa-4075-9d41-56717aee9d77 req-f9161e96-49d3-4eae-9b1e-370a3c944a50 service nova] Creating event network-vif-unplugged:d3eb7f9f-cad6-43cc-b93c-f50a5e95c505 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 21:59:59.039788 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d7ba67e5-00aa-4075-9d41-56717aee9d77 req-f9161e96-49d3-4eae-9b1e-370a3c944a50 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.070205 May 07 21:59:59.047325 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1858/3664] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 21:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 21:59:59.148662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2f4c819b-665f-4f14-a4f2-3f467b68067b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cdebe50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:59.258901 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2f4c819b-665f-4f14-a4f2-3f467b68067b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.106287 May 07 21:59:59.275156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1859/3665] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:59 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 21:59:59.770869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:59.780933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:59.785882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 21:59:59.787513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52e8974d-5894-406f-9a83-0e4ca1569749 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 1.082455 May 07 21:59:59.788624 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1807/3666] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:58 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 21:59:59.990146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 21:59:59.991554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:00.003047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:00.010146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:00.011431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:00.014829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:00.274987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a1a6aab5-7b21-43f3-910d-f5f1341deb4e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd51d30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:00.361435 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a1a6aab5-7b21-43f3-910d-f5f1341deb4e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.092085 May 07 22:00:00.374559 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1808/3667] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:00 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:00.806854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:00.807506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:00.822072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:00.823489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:00.831947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:00.833810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:01.371851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:01.388257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:01.392559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:01.394038 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a04c9b4e-952d-4375-9841-aba7e1a6dc63 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 0.592494 May 07 22:00:01.398336 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1809/3668] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:00 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:00:01.418949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:01.419793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:01.436584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:01.437071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:01.440119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:01.440644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:01.488368 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] HTTP exception thrown: Instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c could not be found. May 07 22:00:01.490548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Returning 404 to user: Instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:01.491505 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7afe95a6-7c99-4f6f-8d3c-500afaaa95ea tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 404 len: 111 microversion: 2.20 time: 0.091847 May 07 22:00:01.492106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1810/3669] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:00:01 2022] DELETE /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:01.509177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-11e7a8a8-50ed-4f2c-86e4-5ef93b0aad0d req-237ef580-9fc1-4305-b32d-18b730364882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "0f85ab7f-8d9d-42b6-bed5-f5b8be554023"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:01.545895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-11e7a8a8-50ed-4f2c-86e4-5ef93b0aad0d req-237ef580-9fc1-4305-b32d-18b730364882 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:01.546288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-11e7a8a8-50ed-4f2c-86e4-5ef93b0aad0d req-237ef580-9fc1-4305-b32d-18b730364882 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:01.584708 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-11e7a8a8-50ed-4f2c-86e4-5ef93b0aad0d req-237ef580-9fc1-4305-b32d-18b730364882 service nova] Creating event network-vif-unplugged:0f85ab7f-8d9d-42b6-bed5-f5b8be554023 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 22:00:01.593293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-11e7a8a8-50ed-4f2c-86e4-5ef93b0aad0d req-237ef580-9fc1-4305-b32d-18b730364882 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099913 May 07 22:00:01.593991 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1811/3670] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:01.606465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48e861bd-0a1b-4561-83bf-5c4dfb692354 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd96af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:01.718649 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48e861bd-0a1b-4561-83bf-5c4dfb692354 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.123424 May 07 22:00:01.719636 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1812/3671] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:01 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:01.724507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:01.733183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: 83ad7d9c-5e14-44b9-a948-c9c337d99f0c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:01.760270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:01.763080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:01.764162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:01.767795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:01.809631 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] HTTP exception thrown: Instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c could not be found. May 07 22:00:01.819074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Returning 404 to user: Instance 83ad7d9c-5e14-44b9-a948-c9c337d99f0c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:01.820152 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-99ef3b01-42c5-4d94-a11b-ff9a7e6d1a3b tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c" status: 404 len: 111 microversion: 2.20 time: 0.099262 May 07 22:00:01.821351 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1813/3672] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:01 2022] GET /compute/v2.1/servers/83ad7d9c-5e14-44b9-a948-c9c337d99f0c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:02.095559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:02.127048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:02.128935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:02.130420 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c30556bf-684f-429a-bf31-b078335d01eb tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2929 microversion: 2.32 time: 2.145516 May 07 22:00:02.131542 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1860/3673] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 21:59:59 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2929 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:02.302541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1901211126", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:02.423322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:02.424645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:02.445689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] validate_networks() for [('4e401ba0-7563-49f5-9424-036872d14546', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:00:02.456634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:02.461773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:02.463174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:02.466057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:02.907104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:02.937347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:02.939627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:02.945533 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b34c4324-f7b6-40e9-8abd-d508c9e2b15f tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 0.533583 May 07 22:00:02.955637 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1861/3674] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:02 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:02.970791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-236656c3-36b7-4345-a059-056f527ad44b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ce01310>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:03.057863 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-236656c3-36b7-4345-a059-056f527ad44b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.100095 May 07 22:00:03.058925 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1862/3675] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:02 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:03.159484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:03.161065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:03.177305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:03.178562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:03.179645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:03.180426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:03.734981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:00:03.736093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:00:03.736846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:00:03.737435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:00:03.738020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:00:03.751032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:03.751901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:03.752903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:03.753495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:03.782467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Getting quotas for project 1fb49d7a99844a7ab8ef30fb59250e7d. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:03.791946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Getting quotas for user 99294a64e28046d8b57260f74c325990 and project 1fb49d7a99844a7ab8ef30fb59250e7d. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:03.823904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:00:03.829898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:00:03.954941 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d29e424-ae50-486e-bd5f-88ce8094b0c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.817365 May 07 22:00:03.962831 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1814/3676] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:00:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:00:03.970466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:03.988101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:04.014802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:04.015256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:04.017977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:04.025491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:04.084365 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] HTTP exception thrown: Instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 could not be found. May 07 22:00:04.085000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Returning 404 to user: Instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:04.085872 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b046a6b6-06b0-40f9-bf36-89271a865226 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 404 len: 111 microversion: 2.20 time: 0.119615 May 07 22:00:04.093470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1815/3677] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:00:03 2022] DELETE /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:04.098608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a4d88961-5370-453b-aeb7-7ffdd7b66d32 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:04.099286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a4d88961-5370-453b-aeb7-7ffdd7b66d32 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:04.179427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:04.196965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:04.198953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:04.204015 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ad670e0e-6436-45bb-8236-860aafa2c301 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2908 microversion: 2.32 time: 1.054267 May 07 22:00:04.205768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1863/3678] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:03 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2908 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:00:04.215788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:04.218320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:04.240332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:04.241619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a4d88961-5370-453b-aeb7-7ffdd7b66d32 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:04.245261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:04.247205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:04.249050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:04.249976 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a4d88961-5370-453b-aeb7-7ffdd7b66d32 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1214 microversion: 2.1 time: 0.155333 May 07 22:00:04.263936 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1816/3679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:04 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:04.268898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66acb7a3-170e-4c47-89ef-834840ce6b83 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cbee1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:04.367103 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66acb7a3-170e-4c47-89ef-834840ce6b83 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.101583 May 07 22:00:04.368395 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1817/3680] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:04 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:04.378853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:04.395272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] [instance: cc6a642e-763c-4ac9-8ef7-4985bcb86060] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:04.408320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:04.425807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:04.432188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:04.436967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:04.485976 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] HTTP exception thrown: Instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 could not be found. May 07 22:00:04.487524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] Returning 404 to user: Instance cc6a642e-763c-4ac9-8ef7-4985bcb86060 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:04.489515 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-02eb40ef-8df0-461e-8ecf-4730b68c47a3 tempest-AttachVolumeShelveTestJSON-2118378341 tempest-AttachVolumeShelveTestJSON-2118378341-project] 10.222.0.32 "GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060" status: 404 len: 111 microversion: 2.20 time: 0.119172 May 07 22:00:04.490762 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1818/3681] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:04 2022] GET /compute/v2.1/servers/cc6a642e-763c-4ac9-8ef7-4985bcb86060 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:05.037988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:05.060508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:05.066410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:05.069761 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82eee36d-f146-43c5-bf1c-160aeb803c0e tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 0.862438 May 07 22:00:05.071161 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1864/3682] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:04 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:05.278144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:05.288791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:05.289289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:05.303066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:05.363275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:05.379278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:05.389659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:05.390946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:05.391636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:05.393197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:05.396638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:05.398417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:06.004998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:06.024381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:06.025915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:06.027854 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d35f4822-15f3-4939-a15f-68d4ca7e4db9 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2908 microversion: 2.32 time: 0.805750 May 07 22:00:06.028976 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1819/3683] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:05 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2908 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:06.036982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f808254-31b4-4b85-b1ed-a2341b24a86b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cea3c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:06.108712 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f808254-31b4-4b85-b1ed-a2341b24a86b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.075238 May 07 22:00:06.109322 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1820/3684] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:06 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:06.121308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:06.121954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:06.140548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:06.142711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:06.145274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:06.147079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:06.251240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:06.266352 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-97701e18-83fe-4e8a-b1d6-f19eb361f24a tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1218 microversion: 2.1 time: 1.002085 May 07 22:00:06.267930 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1865/3685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:05 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1218 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:06.986364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:07.005574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:07.008187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:07.017720 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d744eee2-4fad-4762-9113-1fc48e89e1b7 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 0.907309 May 07 22:00:07.020717 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1821/3686] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:06 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:07.052499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:07.054009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:07.074372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:07.075626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:07.076886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:07.080489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:07.123541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c3dad712-ac1f-4160-bced-ab0bb0718426 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cbc7c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:07.261977 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c3dad712-ac1f-4160-bced-ab0bb0718426 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.142568 May 07 22:00:07.268083 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1822/3687] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:07 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:07.285765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:07.286406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:07.319392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:07.319774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:07.320588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:07.328484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:07.736985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:07.752318 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6ab41101-02d4-4248-beff-2e0ba84c7220 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1272 microversion: 2.1 time: 0.465875 May 07 22:00:07.759010 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1823/3688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:07 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:07.766386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3c34a61b-1dd8-4cee-98da-d9814071e501 req-4fbb664d-c1a5-4d4c-88e4-0f2b58668df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21531192-b2b4-4fc8-8c41-e19e7301001f", "name": "network-vif-plugged", "status": "completed", "tag": "3a446051-aeee-48e0-a355-cc210b6b8602"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:07.796138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3c34a61b-1dd8-4cee-98da-d9814071e501 req-4fbb664d-c1a5-4d4c-88e4-0f2b58668df6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:07.796603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3c34a61b-1dd8-4cee-98da-d9814071e501 req-4fbb664d-c1a5-4d4c-88e4-0f2b58668df6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:07.829519 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3c34a61b-1dd8-4cee-98da-d9814071e501 req-4fbb664d-c1a5-4d4c-88e4-0f2b58668df6 service nova] Creating event network-vif-plugged:3a446051-aeee-48e0-a355-cc210b6b8602 for instance 21531192-b2b4-4fc8-8c41-e19e7301001f on nch1-master-1 May 07 22:00:07.841471 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3c34a61b-1dd8-4cee-98da-d9814071e501 req-4fbb664d-c1a5-4d4c-88e4-0f2b58668df6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080365 May 07 22:00:07.842691 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1824/3689] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:08.064720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:08.068316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:08.101726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:08.102228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:08.103115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:08.103571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:08.190949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:08.232419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:08.244028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:08.249850 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-545a6a28-be57-4143-932d-3caf5751ad74 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2862 microversion: 2.32 time: 1.202254 May 07 22:00:08.256808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1866/3690] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:07 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2862 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:08.279977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cc497b5d-1314-473d-a2b4-be6863f40abd tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d53e040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:08.347162 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cc497b5d-1314-473d-a2b4-be6863f40abd tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.075055 May 07 22:00:08.348378 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1867/3691] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:08 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:08.769529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:08.770157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:08.780504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:08.786754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:08.787608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:08.788245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:09.174506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:09.184624 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2af2009b-b774-4538-a699-2854288ba34e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1272 microversion: 2.1 time: 0.419010 May 07 22:00:09.188601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:09.200352 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1868/3692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:08 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1272 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:09.207681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:09.209576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:09.216837 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-434ab872-6c3d-4821-a527-d56cd29727c9 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1359 microversion: 2.21 time: 1.168467 May 07 22:00:09.218240 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1825/3693] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:08 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1359 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:00:09.271658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:09.272496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:09.299990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:09.300842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:09.302092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:09.302789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:09.368938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2a27b9a6-b9aa-4db2-9776-49dc1bec93aa tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cbb64c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:09.444555 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2a27b9a6-b9aa-4db2-9776-49dc1bec93aa tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.085805 May 07 22:00:09.451184 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1826/3694] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:09 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:09.583772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-39fe0fe5-1d2d-46be-a5de-eb539b9aabab req-7f311422-91cb-406c-958c-a0c7c1c71f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-deleted", "tag": "248ca656-6bff-4ce6-b67d-1c6c09ea7b42"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:09.608243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-39fe0fe5-1d2d-46be-a5de-eb539b9aabab req-7f311422-91cb-406c-958c-a0c7c1c71f11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:09.612032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-39fe0fe5-1d2d-46be-a5de-eb539b9aabab req-7f311422-91cb-406c-958c-a0c7c1c71f11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:09.663734 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-39fe0fe5-1d2d-46be-a5de-eb539b9aabab req-7f311422-91cb-406c-958c-a0c7c1c71f11 service nova] Creating event network-vif-deleted:248ca656-6bff-4ce6-b67d-1c6c09ea7b42 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 22:00:09.689110 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-39fe0fe5-1d2d-46be-a5de-eb539b9aabab req-7f311422-91cb-406c-958c-a0c7c1c71f11 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108975 May 07 22:00:09.690380 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1827/3695] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:00:10.207370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:10.208107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:10.223119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:10.223892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:10.224952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:10.225593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:10.559099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:10.568869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:10.575846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:10.577184 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd74b383-00ac-4e4b-b074-0d00c7bb4810 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2862 microversion: 2.32 time: 1.309695 May 07 22:00:10.589380 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1869/3696] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:09 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2862 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:10.589380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:10.589380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:10.610297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:10.610761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:10.611595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:10.612046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:10.797565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:10.810800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-21de73bc-47d1-4101-a72c-6fe065a560e6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1314 microversion: 2.1 time: 0.605283 May 07 22:00:10.811825 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1828/3697] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:10 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:10.824586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2a7f45c-ccef-40f3-85fa-45002e7d86dd tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caae4c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:10.968962 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2a7f45c-ccef-40f3-85fa-45002e7d86dd tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.155735 May 07 22:00:10.974942 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1829/3698] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:10 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:11.598907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:11.599661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:11.630188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:11.635359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:11.637209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:11.637922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:12.157469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:12.184032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:12.199848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:12.202171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a2aaf08-8446-4603-bf14-947dc189ee26 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1551 microversion: 2.21 time: 1.618271 May 07 22:00:12.211185 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1870/3699] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:10 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1551 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:12.226223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8ee25c2d-b8d0-4040-aaf4-b7964243c643 req-8efc2ab3-bdcf-47fb-9924-d393bfabe4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "620355ca-9580-4384-9f83-9ec1f95922e3", "tag": "13f0d3f2-8ab0-42a1-95df-5966489120ec"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:12.238788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:12.249930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:12.252989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8ee25c2d-b8d0-4040-aaf4-b7964243c643 req-8efc2ab3-bdcf-47fb-9924-d393bfabe4ac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:12.253447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8ee25c2d-b8d0-4040-aaf4-b7964243c643 req-8efc2ab3-bdcf-47fb-9924-d393bfabe4ac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:12.262416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:12.264703 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-feef3edb-d38c-43d1-8042-af6b13f63c3a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2576 microversion: 2.32 time: 0.671304 May 07 22:00:12.286486 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1830/3700] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:11 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2576 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:12.291690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:12.292900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:12.300941 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8ee25c2d-b8d0-4040-aaf4-b7964243c643 req-8efc2ab3-bdcf-47fb-9924-d393bfabe4ac service nova] Creating event network-changed:13f0d3f2-8ab0-42a1-95df-5966489120ec for instance 620355ca-9580-4384-9f83-9ec1f95922e3 on nch2-master-1 May 07 22:00:12.314415 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8ee25c2d-b8d0-4040-aaf4-b7964243c643 req-8efc2ab3-bdcf-47fb-9924-d393bfabe4ac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098799 May 07 22:00:12.316727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:12.317379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:12.318581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1871/3701] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:12.319415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:12.319886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:12.327296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9e875790-58fd-4a33-bd13-1ae11ebbed4e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cab0940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:12.402887 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9e875790-58fd-4a33-bd13-1ae11ebbed4e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.079792 May 07 22:00:12.408665 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1872/3702] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:12 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:12.421759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:12.422660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:12.429835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:12.430752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:12.431798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:12.433871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:12.480514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:00:12.633833 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8529ce91-460e-485c-9a00-01ff87487160 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "DELETE /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 204 len: 0 microversion: 2.21 time: 0.223547 May 07 22:00:12.635354 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1873/3703] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:00:12 2022] DELETE /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 22:00:12.644620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:12.645518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:12.655198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:12.656792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:12.657791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:12.659806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:13.221863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:13.234338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:13.238278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:13.239572 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-116a468d-75a4-4bb8-9cd7-b0dcbb712de5 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1557 microversion: 2.21 time: 0.599360 May 07 22:00:13.243516 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1874/3704] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:12 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1557 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:13.401953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d45aaa3e-feaa-4241-a988-a7dd2d8d2e70 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'create', calling method: .version_select at 0x7fc41cab0d30>, body: {"keypair": {"name": "tempest-keypair-2027631631"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:13.446880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d45aaa3e-feaa-4241-a988-a7dd2d8d2e70 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:13.484740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d45aaa3e-feaa-4241-a988-a7dd2d8d2e70 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for user 5ea5d144165a4e129de242905439e951 and project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:13.616389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:13.636513 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0451bdae-1c0e-42f2-8571-f72464d30de4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1314 microversion: 2.1 time: 1.344781 May 07 22:00:13.637349 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1831/3705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:12 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1314 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:13.656568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ea27eee2-248f-4517-8b2b-d8fb5ffb408f req-8ce47d3d-adc8-4169-afd0-1a61fcc57821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-deleted", "tag": "5642df0d-b70e-45a4-b82c-4c09755c76de"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:13.677333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d45aaa3e-feaa-4241-a988-a7dd2d8d2e70 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:13.686575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d45aaa3e-feaa-4241-a988-a7dd2d8d2e70 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for user 5ea5d144165a4e129de242905439e951 and project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:13.693070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ea27eee2-248f-4517-8b2b-d8fb5ffb408f req-8ce47d3d-adc8-4169-afd0-1a61fcc57821 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:13.700571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ea27eee2-248f-4517-8b2b-d8fb5ffb408f req-8ce47d3d-adc8-4169-afd0-1a61fcc57821 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:13.723481 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d45aaa3e-feaa-4241-a988-a7dd2d8d2e70 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.475600 May 07 22:00:13.726097 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1875/3706] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:00:13 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:13.737625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:13.740543 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ea27eee2-248f-4517-8b2b-d8fb5ffb408f req-8ce47d3d-adc8-4169-afd0-1a61fcc57821 service nova] Creating event network-vif-deleted:5642df0d-b70e-45a4-b82c-4c09755c76de for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 22:00:13.744085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:13.751674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:13.752063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:13.753967 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ea27eee2-248f-4517-8b2b-d8fb5ffb408f req-8ce47d3d-adc8-4169-afd0-1a61fcc57821 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101517 May 07 22:00:13.754788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:13.755278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:13.757404 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1832/3707] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:13.770431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bafc40a8-ac72-410e-8eca-bad39f3a4b89 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c3504c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:13.882519 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bafc40a8-ac72-410e-8eca-bad39f3a4b89 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1452 microversion: 2.1 time: 0.123635 May 07 22:00:13.883286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1833/3708] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:13 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:14.406405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:14.407402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:14.417718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:14.422358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:14.430906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:14.434298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:15.221707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:15.252198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:15.263578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:15.267549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-029cb5f2-91f4-456d-8dfc-ef62ec161208 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1557 microversion: 2.21 time: 0.866790 May 07 22:00:15.273052 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1834/3709] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:14 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1557 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:15.278910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:15.279991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:15.287758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:15.288484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:15.289485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:15.290679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:15.321057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:15.338085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:15.341212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:15.346255 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-721639f7-c515-4a6d-bac0-18d529522561 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2530 microversion: 2.32 time: 1.618277 May 07 22:00:15.350699 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1876/3710] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:13 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2530 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:15.368948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf3f98c3-b87b-427e-a373-2ff385081de6 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4226234c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:15.451550 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf3f98c3-b87b-427e-a373-2ff385081de6 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1461 microversion: 2.1 time: 0.086665 May 07 22:00:15.452163 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1877/3711] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:15 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:15.467887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-56e6d4ef-ff22-4e8b-b5ec-c85e675b412f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d2deb80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:15.523269 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-56e6d4ef-ff22-4e8b-b5ec-c85e675b412f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 200 len: 1461 microversion: 2.1 time: 0.060737 May 07 22:00:15.531699 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1878/3712] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:15 2022] GET /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 1461 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:15.537024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:15.543927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:15.554373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:15.554696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:15.562925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:15.563732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:15.819503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:15.839973 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0aed3877-cece-4206-8df0-465481edd17b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1314 microversion: 2.1 time: 0.564560 May 07 22:00:15.841969 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1835/3713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:15 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:15.863812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0790bb99-2732-4fdc-96d1-84f9447f0b34 req-c0c565c4-5185-4f84-a2ee-dda281a41a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-deleted", "tag": "0f85ab7f-8d9d-42b6-bed5-f5b8be554023"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:15.884224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0790bb99-2732-4fdc-96d1-84f9447f0b34 req-c0c565c4-5185-4f84-a2ee-dda281a41a49 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:15.887000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0790bb99-2732-4fdc-96d1-84f9447f0b34 req-c0c565c4-5185-4f84-a2ee-dda281a41a49 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:15.933333 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0790bb99-2732-4fdc-96d1-84f9447f0b34 req-c0c565c4-5185-4f84-a2ee-dda281a41a49 service nova] Creating event network-vif-deleted:0f85ab7f-8d9d-42b6-bed5-f5b8be554023 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 22:00:15.948034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0790bb99-2732-4fdc-96d1-84f9447f0b34 req-c0c565c4-5185-4f84-a2ee-dda281a41a49 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087973 May 07 22:00:15.950712 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1836/3714] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:00:16.276753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:16.299273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:16.300704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:16.309441 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-74a99cfa-d93c-45b2-83a4-493d86dde293 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1479 microversion: 2.1 time: 0.774196 May 07 22:00:16.321761 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1879/3715] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:15 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1479 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:16.325777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:16.326423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:16.327347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:16.327864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:16.379257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:16.386692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:16.410409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:16.412372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:16.424490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:16.427261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:16.546833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:16.571065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:16.574166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '489625599dce4b9ea71e3ed13c28c30f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a275b437594296b48dcf24858d61f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:16.577571 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c3636b29-4e5b-4d82-ac45-f875d6e3ea94 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 200 len: 1515 microversion: 2.21 time: 0.287676 May 07 22:00:16.582892 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1837/3716] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:16 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:16.858309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:16.859031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:16.875428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:16.876084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:16.877819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:16.878430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:16.908746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:16.953738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:16.955879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:16.958669 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82491ac6-2ef6-4722-91e8-95e8d7b2c5e6 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2257 microversion: 2.32 time: 0.590684 May 07 22:00:16.962470 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1880/3717] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:16 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2257 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:17.336612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:17.337244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:17.351771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:17.353181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:17.354226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:17.355309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:17.949635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:17.959544 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0fe7669-f1a5-43e5-93c5-fc308413850e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1314 microversion: 2.1 time: 1.105757 May 07 22:00:17.963100 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1838/3718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:16 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1314 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:17.968315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:17.980345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:17.994610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:17.995710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:17.996523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:17.997166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.028928 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] HTTP exception thrown: Instance 21531192-b2b4-4fc8-8c41-e19e7301001f could not be found. May 07 22:00:18.029500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Returning 404 to user: Instance 21531192-b2b4-4fc8-8c41-e19e7301001f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:18.031119 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ede5080b-9091-44fb-8aaa-e30c1a3992a1 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 404 len: 111 microversion: 2.21 time: 0.066058 May 07 22:00:18.031740 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1839/3719] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:17 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:18.046359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:18.047327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:18.056950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:18.059375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.060416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:18.065845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.325866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:18.338145 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-70355b9d-3292-41d1-986b-a92970f0fd9a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1466 microversion: 2.1 time: 1.005459 May 07 22:00:18.343572 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1881/3720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:17 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1466 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:18.349385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e99f7aed-9551-45f5-a79d-d11ff84b8b77 req-fa8b863e-66dc-4637-96eb-5edb1a840866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21531192-b2b4-4fc8-8c41-e19e7301001f", "name": "network-vif-deleted", "tag": "3a446051-aeee-48e0-a355-cc210b6b8602"}, {"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-deleted", "tag": "744875ea-e246-4ecb-b60f-b9c04a274fe9"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:18.371029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e99f7aed-9551-45f5-a79d-d11ff84b8b77 req-fa8b863e-66dc-4637-96eb-5edb1a840866 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:18.371484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e99f7aed-9551-45f5-a79d-d11ff84b8b77 req-fa8b863e-66dc-4637-96eb-5edb1a840866 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.395620 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e99f7aed-9551-45f5-a79d-d11ff84b8b77 req-fa8b863e-66dc-4637-96eb-5edb1a840866 service nova] Creating event network-vif-deleted:3a446051-aeee-48e0-a355-cc210b6b8602 for instance 21531192-b2b4-4fc8-8c41-e19e7301001f on nch1-master-1 May 07 22:00:18.396348 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e99f7aed-9551-45f5-a79d-d11ff84b8b77 req-fa8b863e-66dc-4637-96eb-5edb1a840866 service nova] Creating event network-vif-deleted:744875ea-e246-4ecb-b60f-b9c04a274fe9 for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 22:00:18.405788 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e99f7aed-9551-45f5-a79d-d11ff84b8b77 req-fa8b863e-66dc-4637-96eb-5edb1a840866 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060249 May 07 22:00:18.406705 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1882/3721] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:18.413044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6320d209-af49-4764-acc3-623ce5d87dea tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '.version_select at 0x7fc41d53e310>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:18.413986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6320d209-af49-4764-acc3-623ce5d87dea tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:18.423391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6320d209-af49-4764-acc3-623ce5d87dea tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:18.424039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6320d209-af49-4764-acc3-623ce5d87dea tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.425082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6320d209-af49-4764-acc3-623ce5d87dea tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:18.426422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6320d209-af49-4764-acc3-623ce5d87dea tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.545436 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6320d209-af49-4764-acc3-623ce5d87dea tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.137303 May 07 22:00:18.554467 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1883/3722] 10.222.0.32 () {60 vars in 1336 bytes} [Sat May 7 22:00:18 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f/os-instance-actions => generated 611 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:00:18.564538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64f75b8f-d72c-4152-b9aa-d0d0b673fb30 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-855636717"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:18.565597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64f75b8f-d72c-4152-b9aa-d0d0b673fb30 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:18.581463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64f75b8f-d72c-4152-b9aa-d0d0b673fb30 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:18.581933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64f75b8f-d72c-4152-b9aa-d0d0b673fb30 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.582734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64f75b8f-d72c-4152-b9aa-d0d0b673fb30 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:18.583223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64f75b8f-d72c-4152-b9aa-d0d0b673fb30 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:18.953510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:18.967771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:18.969362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:18.975478 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-876bc944-ae53-4d1e-bf80-ce43830e183e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 2211 microversion: 2.32 time: 0.937922 May 07 22:00:18.991980 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1840/3723] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:18 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 2211 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:19.003849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:19.005383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:19.020161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:19.022707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:19.023671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:19.027425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:19.056598 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] HTTP exception thrown: Instance 21531192-b2b4-4fc8-8c41-e19e7301001f could not be found. May 07 22:00:19.058563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Returning 404 to user: Instance 21531192-b2b4-4fc8-8c41-e19e7301001f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:19.060290 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b435957f-f84f-46d7-b903-a1e56f2563fe tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "DELETE /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 404 len: 111 microversion: 2.21 time: 0.066679 May 07 22:00:19.061875 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1841/3724] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:00:18 2022] DELETE /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:19.068669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:19.070048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:19.077612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:19.078656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:19.079692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:19.080443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:19.200912 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64f75b8f-d72c-4152-b9aa-d0d0b673fb30 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "POST /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33/action" status: 202 len: 0 microversion: 2.1 time: 0.640596 May 07 22:00:19.201642 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1884/3725] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:00:18 2022] POST /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 22:00:19.218364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:19.219115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] [instance: 21531192-b2b4-4fc8-8c41-e19e7301001f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:19.236136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:19.236630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:19.237497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:19.238208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:19.265625 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] HTTP exception thrown: Instance 21531192-b2b4-4fc8-8c41-e19e7301001f could not be found. May 07 22:00:19.275836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] Returning 404 to user: Instance 21531192-b2b4-4fc8-8c41-e19e7301001f could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:19.278887 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90bef610-5cf7-4233-80ab-2bb84afbe6e2 tempest-InstanceActionsV221TestJSON-1399132138 tempest-InstanceActionsV221TestJSON-1399132138-project] 10.222.0.32 "GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f" status: 404 len: 111 microversion: 2.21 time: 0.069422 May 07 22:00:19.280090 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1885/3726] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:19 2022] GET /compute/v2.1/servers/21531192-b2b4-4fc8-8c41-e19e7301001f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:19.310046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89883429-d571-483f-8259-f676dade63ab tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d564dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:19.437810 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-89883429-d571-483f-8259-f676dade63ab tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.156218 May 07 22:00:19.439259 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1886/3727] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:19 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:19.669198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:19.681637 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ab449a09-666c-402f-a4d6-b4c2c1e4e3e4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1314 microversion: 2.1 time: 0.618316 May 07 22:00:19.685055 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1842/3728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:19 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:20.002268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:20.004303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:20.064237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:20.066140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:20.069255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:20.070498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:20.135450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:20.136084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:20.136961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lazy-loading 'fault' on Instance uuid dfb18387-ba8a-4070-aa1b-42824ed0c7ec {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:00:20.253644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:20.275260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:20.293455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '58c7ff193f244ddfa887908f05a920c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70a2fded25c74c839c01e55a91e7f7fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:20.295215 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d1e3fffe-54cc-4a4e-bd64-347dbd75ae7b tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 200 len: 1609 microversion: 2.32 time: 0.298760 May 07 22:00:20.299160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1887/3729] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:19 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 1609 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:00:20.335226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1435257312", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750e8121-2671-438f-9a42-169be7e47286"}], "security_groups": [{"name": "tempest-securitygroup--1159194357"}], "key_name": "tempest-keypair-2027631631", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:20.459284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-047d464c-be6a-473e-ae91-d51575d9a6ca tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc42261fe50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:20.542833 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-047d464c-be6a-473e-ae91-d51575d9a6ca tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.094976 May 07 22:00:20.544219 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1888/3730] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:20 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:20.561684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b2ceb1ed-0ef9-4ed1-a038-47f8e6640564 req-4e198de4-24fa-4e22-a737-2cb2373a5426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb18387-ba8a-4070-aa1b-42824ed0c7ec", "name": "network-vif-deleted", "tag": "0aa75d6c-c396-4cf7-82ed-1655289562cd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:20.584239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b2ceb1ed-0ef9-4ed1-a038-47f8e6640564 req-4e198de4-24fa-4e22-a737-2cb2373a5426 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:20.585446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b2ceb1ed-0ef9-4ed1-a038-47f8e6640564 req-4e198de4-24fa-4e22-a737-2cb2373a5426 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:20.601328 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b2ceb1ed-0ef9-4ed1-a038-47f8e6640564 req-4e198de4-24fa-4e22-a737-2cb2373a5426 service nova] Creating event network-vif-deleted:0aa75d6c-c396-4cf7-82ed-1655289562cd for instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec on nch1-master-1 May 07 22:00:20.607938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] validate_networks() for [('750e8121-2671-438f-9a42-169be7e47286', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:00:20.628815 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b2ceb1ed-0ef9-4ed1-a038-47f8e6640564 req-4e198de4-24fa-4e22-a737-2cb2373a5426 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073954 May 07 22:00:20.628815 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1889/3731] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:20.701990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:20.702871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:20.714253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:20.714888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:20.719262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:20.719888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:21.052518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:21.066063 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14334ec2-c2e3-44df-bf49-1795c4409645 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1314 microversion: 2.1 time: 0.367599 May 07 22:00:21.074974 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1890/3732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:20 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:21.237733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c17013b0-574c-4cee-8ae2-c62f703d1857 req-4263e563-a716-482c-aea7-55faa6132732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620355ca-9580-4384-9f83-9ec1f95922e3", "name": "network-vif-plugged", "status": "completed", "tag": "13f0d3f2-8ab0-42a1-95df-5966489120ec"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:21.258563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c17013b0-574c-4cee-8ae2-c62f703d1857 req-4263e563-a716-482c-aea7-55faa6132732 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:21.259134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c17013b0-574c-4cee-8ae2-c62f703d1857 req-4263e563-a716-482c-aea7-55faa6132732 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:21.287084 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c17013b0-574c-4cee-8ae2-c62f703d1857 req-4263e563-a716-482c-aea7-55faa6132732 service nova] Creating event network-vif-plugged:13f0d3f2-8ab0-42a1-95df-5966489120ec for instance 620355ca-9580-4384-9f83-9ec1f95922e3 on nch2-master-1 May 07 22:00:21.302761 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c17013b0-574c-4cee-8ae2-c62f703d1857 req-4263e563-a716-482c-aea7-55faa6132732 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069458 May 07 22:00:21.305936 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1891/3733] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:21.328680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:21.330212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:21.366348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:21.368497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:21.371606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:21.373405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:21.400185 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] HTTP exception thrown: Instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec could not be found. May 07 22:00:21.400798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Returning 404 to user: Instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:21.402299 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-28ff81ab-e3be-4b59-905f-20a46aa7c56f tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 404 len: 111 microversion: 2.32 time: 0.087766 May 07 22:00:21.403208 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1892/3734] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:21 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:21.412846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5f399038-0070-4a7b-8ddd-b3418790472e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '.version_select at 0x7fc41cdebe50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:21.447111 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5f399038-0070-4a7b-8ddd-b3418790472e tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598958658" status: 204 len: 0 microversion: 2.32 time: 0.036366 May 07 22:00:21.449701 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1893/3735] 10.222.0.32 () {60 vars in 1258 bytes} [Sat May 7 22:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598958658 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 22:00:21.564598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c813955-c3c1-485c-bdba-1a578d8933dc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224fe3a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:21.657209 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c813955-c3c1-485c-bdba-1a578d8933dc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.105184 May 07 22:00:21.658116 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1894/3736] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:21 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:22.082945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:22.083832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:22.090751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:22.091573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:22.092574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:22.093278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:22.217798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:00:22.219438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:00:22.220208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:00:22.220817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:00:22.221471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:00:22.241062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:22.246602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:22.248396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:22.250333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:22.281767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:22.288537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for user 5ea5d144165a4e129de242905439e951 and project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:22.304887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:00:22.307311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:00:22.367755 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9e095e3-5407-442c-90a8-5c6972237605 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.041516 May 07 22:00:22.369121 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1843/3737] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:00:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:00:22.380068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb4a7360-9835-4398-8b5c-91c9ac8c9670 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:22.381731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb4a7360-9835-4398-8b5c-91c9ac8c9670 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:22.479917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:22.488340 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b2c87b02-925e-4198-96ca-3089a56d1b31 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1314 microversion: 2.1 time: 0.409419 May 07 22:00:22.489472 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1895/3738] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:22 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:22.513578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb4a7360-9835-4398-8b5c-91c9ac8c9670 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:22.529468 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb4a7360-9835-4398-8b5c-91c9ac8c9670 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1238 microversion: 2.1 time: 0.151472 May 07 22:00:22.531028 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1844/3739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:22 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1238 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:22.671156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cd14f3b9-f34d-4a15-81f8-ef682f579a0e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cdde280>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:22.759559 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cd14f3b9-f34d-4a15-81f8-ef682f579a0e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.066329 May 07 22:00:22.763339 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1896/3740] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:22 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:23.338752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-dfac4d7d-feed-40e2-b75c-28b40c775e22 req-2fb86e87-755e-4820-a245-fbf8ce1f0004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30285c-55a0-4bf5-91e8-9bdd7282f8d7", "name": "network-vif-unplugged", "status": "completed", "tag": "672e9dc5-e9c7-4350-b965-d54d762eb1d8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:23.368027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dfac4d7d-feed-40e2-b75c-28b40c775e22 req-2fb86e87-755e-4820-a245-fbf8ce1f0004 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:23.372048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dfac4d7d-feed-40e2-b75c-28b40c775e22 req-2fb86e87-755e-4820-a245-fbf8ce1f0004 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:23.414033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-dfac4d7d-feed-40e2-b75c-28b40c775e22 req-2fb86e87-755e-4820-a245-fbf8ce1f0004 service nova] Creating event network-vif-unplugged:672e9dc5-e9c7-4350-b965-d54d762eb1d8 for instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 on nch2-master-1 May 07 22:00:23.435960 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-dfac4d7d-feed-40e2-b75c-28b40c775e22 req-2fb86e87-755e-4820-a245-fbf8ce1f0004 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101377 May 07 22:00:23.439248 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1845/3741] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:23.506973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:23.507908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:23.534284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:23.537758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:23.541117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:23.544088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:23.549444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:23.550438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:23.583298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:23.584389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:23.588264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:23.594569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:23.886614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:23.899943 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e822bd2a-ccf4-45e2-bd1b-df178613ad9a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1234 microversion: 2.1 time: 0.355425 May 07 22:00:23.930296 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1846/3742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:23 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1234 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:23.952981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e42eeb5a-ef49-41c5-899a-2575be4d7ebc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cb04430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:24.048804 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e42eeb5a-ef49-41c5-899a-2575be4d7ebc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.114835 May 07 22:00:24.051822 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1847/3743] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:23 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:24.532185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:24.559480 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9180fb38-d93c-4c53-a572-42a3ceeaa2a6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1500 microversion: 2.1 time: 1.055401 May 07 22:00:24.571433 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1897/3744] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:23 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1500 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:24.580752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:24.583375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:24.598195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:24.599227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:24.600978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:24.601715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:24.674065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lazy-loading 'flavor' on Instance uuid 620355ca-9580-4384-9f83-9ec1f95922e3 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:00:24.820544 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61a9da0a-0396-4df4-927c-d264c6a3d045 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "POST /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3/action" status: 200 len: 32 microversion: 2.1 time: 0.246881 May 07 22:00:24.825819 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1848/3745] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:00:24 2022] POST /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 07 22:00:24.831506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:24.833241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:24.849881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:24.853678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:24.857038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:24.861233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:24.923704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:24.924688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:24.943032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:24.943786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:24.944719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:24.945277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:25.174507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:25.184514 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2d5ff4bb-9c1c-4c96-b70c-03119d0f5bba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1296 microversion: 2.1 time: 0.265054 May 07 22:00:25.216742 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1849/3746] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:24 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1296 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:25.221847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6154e3c4-b9c3-4adf-b31a-111bc07920bd tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ceca550>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:25.379911 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6154e3c4-b9c3-4adf-b31a-111bc07920bd tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.161834 May 07 22:00:25.386827 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1850/3747] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:25 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:25.655107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ce831779-e173-4fd1-b95f-646abc89850f req-5bb68c87-4825-4322-996d-5fb5b20d83fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5d0aa6-f907-4569-bedc-2979f6637d33", "name": "network-vif-plugged", "status": "completed", "tag": "73e10226-084a-4235-a376-31a716d63e44"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:25.716186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ce831779-e173-4fd1-b95f-646abc89850f req-5bb68c87-4825-4322-996d-5fb5b20d83fa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:25.716613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ce831779-e173-4fd1-b95f-646abc89850f req-5bb68c87-4825-4322-996d-5fb5b20d83fa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:25.754066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ce831779-e173-4fd1-b95f-646abc89850f req-5bb68c87-4825-4322-996d-5fb5b20d83fa service nova] Creating event network-vif-plugged:73e10226-084a-4235-a376-31a716d63e44 for instance 5d5d0aa6-f907-4569-bedc-2979f6637d33 on nch2-master-1 May 07 22:00:25.766203 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ce831779-e173-4fd1-b95f-646abc89850f req-5bb68c87-4825-4322-996d-5fb5b20d83fa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116517 May 07 22:00:25.767318 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1851/3748] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:00:26.127517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:26.141691 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b5730eb-b590-4612-845b-5293b830e861 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 1.314503 May 07 22:00:26.143838 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1898/3749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:24 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:26.202787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:26.203572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:26.212278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:26.212903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:26.226989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:26.228012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:26.399501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-279b508f-7ff3-4dd8-ba6a-7c450654112b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cee1dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:26.447785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:26.457599 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dde688e1-0501-453b-89f8-54cd23d64b3c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1296 microversion: 2.1 time: 0.259728 May 07 22:00:26.459450 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1852/3750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:26 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1296 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:26.492621 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-279b508f-7ff3-4dd8-ba6a-7c450654112b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.096990 May 07 22:00:26.500830 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1899/3751] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:26 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:27.161550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:27.169546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:27.205712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:27.206372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:27.208080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:27.219128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:27.474868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:27.476601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:27.496925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:27.497656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:27.498689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:27.509886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:27.638920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:27.656049 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d229ade7-f6b4-44d1-b46b-be8b0c6d45d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1296 microversion: 2.1 time: 0.185206 May 07 22:00:27.656987 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1900/3752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:27 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1296 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:27.670266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8c8d6f3-0d44-4650-8244-d59d5966404b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ceb6940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:27.770537 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8c8d6f3-0d44-4650-8244-d59d5966404b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.110438 May 07 22:00:27.778523 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1901/3753] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:27 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:28.675685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:28.676512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:28.696707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:28.704166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:28.705582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:28.706582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:28.747014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:28.766020 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-62748071-1c7c-4421-a893-0dc3b37bc5b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 1.606605 May 07 22:00:28.769940 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1853/3754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:27 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:28.792800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a61a0f14-16d4-41a5-9d18-ea0cb9b96764 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ce7e9d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:28.900660 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a61a0f14-16d4-41a5-9d18-ea0cb9b96764 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.114275 May 07 22:00:28.909690 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1854/3755] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:28 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:29.786849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:29.788310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:29.798559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:29.811536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:29.817296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:29.826071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:29.834600 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0504e7d3-238f-467d-a31e-a72f9b02b578 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 1.165200 May 07 22:00:29.835774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:29.844542 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1902/3756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:28 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:29.919664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-457c6de7-3985-4025-ad4a-60525fd5fe8e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cee1dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:29.990378 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-457c6de7-3985-4025-ad4a-60525fd5fe8e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.075710 May 07 22:00:29.991633 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1903/3757] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:29 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:30.253563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:30.266445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56d46d85-f977-4926-9437-d5c00fab362c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 0.483696 May 07 22:00:30.269647 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1855/3758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:29 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:30.859181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:30.859806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:30.879475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:30.879943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:30.880755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:30.881194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:31.005902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8bd58c3d-f6d5-459b-89dd-7e9416156da3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cc30f70>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:31.105177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8bd58c3d-f6d5-459b-89dd-7e9416156da3 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.103932 May 07 22:00:31.106084 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1856/3759] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:31 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:31.432057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:31.453026 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ed9feba-0d6b-4ba2-88d2-d2d07417313d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 0.587201 May 07 22:00:31.454325 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1904/3760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:30 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:31.461685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1216157588", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "a83f92af-3764-4eda-a668-51a2c691a258"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:31.500941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:31.506819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:31.538110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:31.538464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:31.543011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:31.543502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:31.598002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] validate_networks() for [('a83f92af-3764-4eda-a668-51a2c691a258', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:00:33.103860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:33.121686 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bef34e7f-96a0-4f02-bee1-c7332479f398 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 1.641341 May 07 22:00:33.123483 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1905/3761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:31 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:33.143333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ad8d195-8ef8-49fe-92e3-23e29e1e9df2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d2c65e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:33.148467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:00:33.149283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:00:33.149883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:00:33.150401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:00:33.151200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:00:33.173212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:33.173992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:33.176211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:33.176879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:33.216488 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ad8d195-8ef8-49fe-92e3-23e29e1e9df2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.090903 May 07 22:00:33.217849 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1906/3762] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:33 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:33.231347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:33.232194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:33.248469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:33.249229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:33.251322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Getting quotas for project 169e1e6f26414e3eaa454bc14100fece. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:33.252600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:33.253229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:33.265047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Getting quotas for user ddc30338eaa944db87c27cab6eb949ca and project 169e1e6f26414e3eaa454bc14100fece. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:33.295693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:00:33.301712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:00:33.414715 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a183dc48-7647-47a5-8c77-7b2683f7f003 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252625 May 07 22:00:33.420337 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1857/3763] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:00:33.581717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1379551573", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "a83f92af-3764-4eda-a668-51a2c691a258"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:33.678808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] validate_networks() for [('a83f92af-3764-4eda-a668-51a2c691a258', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:00:34.059769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:34.069818 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d3570740-a6ec-42ac-b831-2e9da4c9199c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 0.850686 May 07 22:00:34.082076 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1907/3764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:33 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:34.090561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7e141ee4-3780-4208-b1ef-9195d2236cb2 req-a42a9426-1096-4fc2-b0a8-9ae8afe457b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f9d622-1591-4442-9da0-167bdb326758", "tag": "7246b97e-cc3a-4e69-8bd1-0d36632d83ff"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:34.144539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7e141ee4-3780-4208-b1ef-9195d2236cb2 req-a42a9426-1096-4fc2-b0a8-9ae8afe457b6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:34.144539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7e141ee4-3780-4208-b1ef-9195d2236cb2 req-a42a9426-1096-4fc2-b0a8-9ae8afe457b6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:34.192008 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7e141ee4-3780-4208-b1ef-9195d2236cb2 req-a42a9426-1096-4fc2-b0a8-9ae8afe457b6 service nova] Creating event network-changed:7246b97e-cc3a-4e69-8bd1-0d36632d83ff for instance 95f9d622-1591-4442-9da0-167bdb326758 on nch1-master-1 May 07 22:00:34.215241 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7e141ee4-3780-4208-b1ef-9195d2236cb2 req-a42a9426-1096-4fc2-b0a8-9ae8afe457b6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126068 May 07 22:00:34.216111 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1908/3765] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:34.251935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:34.257400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:34.288632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:34.289357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:34.290523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:34.291240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:35.642127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:35.651983 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-29bfe8b9-88f8-4bb5-bfcc-41206047452c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 1.434479 May 07 22:00:35.663569 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1909/3766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:34 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:35.678399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf7f48b0-7005-4544-ba24-fa695231e526 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c5840d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:35.758409 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf7f48b0-7005-4544-ba24-fa695231e526 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.083805 May 07 22:00:35.759723 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1910/3767] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:35 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:35.769761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:35.774899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:35.788815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:35.789575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:35.790615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:35.791258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:36.080796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:00:36.081765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:00:36.082255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:00:36.082681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:00:36.083115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:00:36.106672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:36.110133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:36.111253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:36.117682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:36.184141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Getting quotas for project 169e1e6f26414e3eaa454bc14100fece. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:36.198812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Getting quotas for user ddc30338eaa944db87c27cab6eb949ca and project 169e1e6f26414e3eaa454bc14100fece. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:36.279308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:00:36.281772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:00:36.399970 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-baebf189-a5d5-4ebb-88d0-dbb49c84081c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.822989 May 07 22:00:36.409926 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1858/3768] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:00:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:00:36.516103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-316083208", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "451", "networks": [{"uuid": "a83f92af-3764-4eda-a668-51a2c691a258"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:36.607065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] validate_networks() for [('a83f92af-3764-4eda-a668-51a2c691a258', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:00:36.947964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:36.998284 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0db9ff1-df88-41a3-b31c-33e28ccdbb8a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 1.233672 May 07 22:00:37.000192 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1911/3769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:35 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:37.014825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:37.018219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:37.050035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:37.050035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:37.050035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:37.050035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:37.798671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:37.808195 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7cbc5d94-27d3-436b-87ce-13abf35535cc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 0.803999 May 07 22:00:37.809213 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1912/3770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:37 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:37.824303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0b8868f4-dfe9-4290-8b82-6eec0b6f1e3f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cab0b80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:37.894301 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0b8868f4-dfe9-4290-8b82-6eec0b6f1e3f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.083083 May 07 22:00:37.895270 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1913/3771] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:37 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:37.912501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:37.913874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:37.926367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:37.929888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:37.933692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:37.934348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:37.971406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] HTTP exception thrown: Instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec could not be found. May 07 22:00:37.972106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Returning 404 to user: Instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:37.972880 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ece0155-fc11-4d58-a4f0-0301eeb09be7 tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 404 len: 111 microversion: 2.32 time: 0.071137 May 07 22:00:37.973462 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1914/3772] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:00:37 2022] DELETE /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:37.992252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:37.993554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] [instance: dfb18387-ba8a-4070-aa1b-42824ed0c7ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:38.007441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.007974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:38.011897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.015289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:38.050471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] HTTP exception thrown: Instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec could not be found. May 07 22:00:38.051154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] Returning 404 to user: Instance dfb18387-ba8a-4070-aa1b-42824ed0c7ec could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:00:38.052245 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92b34a6a-9150-4fab-8018-d4f38883068a tempest-TaggedBootDevicesTest-1550846050 tempest-TaggedBootDevicesTest-1550846050-project] 10.222.0.32 "GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec" status: 404 len: 111 microversion: 2.32 time: 0.072152 May 07 22:00:38.054281 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1915/3773] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:00:37 2022] GET /compute/v2.1/servers/dfb18387-ba8a-4070-aa1b-42824ed0c7ec => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:00:38.069700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:38.070364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:38.084696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.085422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:38.088740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.089383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:38.467299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:00:38.467876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:00:38.468561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:00:38.468994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:00:38.471259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:00:38.500749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.501213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:38.511362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.516884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:38.590617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Getting quotas for project 169e1e6f26414e3eaa454bc14100fece. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:38.602001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Getting quotas for user ddc30338eaa944db87c27cab6eb949ca and project 169e1e6f26414e3eaa454bc14100fece. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:38.630321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:00:38.633969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:00:38.747198 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a81cb5b4-74b4-4c38-972d-d9eadae2023a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.234874 May 07 22:00:38.748405 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1859/3774] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:00:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:00:38.768149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a598426a-f96d-45b2-9c95-7e20b99f8376 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:38.770890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a598426a-f96d-45b2-9c95-7e20b99f8376 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:38.919177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a598426a-f96d-45b2-9c95-7e20b99f8376 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:38.929082 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a598426a-f96d-45b2-9c95-7e20b99f8376 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1220 microversion: 2.1 time: 0.168660 May 07 22:00:38.946729 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1860/3775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:38 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1220 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:38.961340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:38.966128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:38.990492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.991003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:38.991808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:38.992263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:39.414478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:39.430730 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-30544684-5630-4b27-b24e-62e94e30bedc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 0.478570 May 07 22:00:39.433549 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1861/3776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:38 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:39.439262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff6bb111-7b17-4030-991b-51c8389f05bb tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caae670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:39.543840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff6bb111-7b17-4030-991b-51c8389f05bb tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.108950 May 07 22:00:39.551220 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1862/3777] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:39 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:39.946892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:39.948247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:39.956878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:39.964930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:39.966137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:39.969218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:40.109626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:40.118374 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-08de06e1-224e-496f-a08a-d485ed080b23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1224 microversion: 2.1 time: 0.175845 May 07 22:00:40.124306 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1863/3778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:39 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1224 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:40.442834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:40.452777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:40.453682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:40.467792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:40.469385 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6d20809e-3f18-44dd-ab32-2c1999a37d97 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 2.401971 May 07 22:00:40.478487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1916/3779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:38 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:40.480235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:40.482547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:40.483730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:40.564374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-56d7325d-7602-4636-aa42-846711c09ecc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d04bee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:40.649425 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-56d7325d-7602-4636-aa42-846711c09ecc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.089135 May 07 22:00:40.653813 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1917/3780] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:40 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:41.137602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:41.138630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:41.154311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:41.155152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:41.156303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:41.157287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:41.373443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:41.381576 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4c12901a-e9dd-4615-986a-0bbe8de455d2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1272 microversion: 2.1 time: 0.248188 May 07 22:00:41.388508 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1918/3781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:41 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1272 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:41.490531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:41.493124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:41.537260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:41.540016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:41.545160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:41.547148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:41.891124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:41.907494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e26c3f76-f73a-4791-bac6-16d33d906cc2 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 1.460469 May 07 22:00:41.925443 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1864/3782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:40 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:41.954296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-09eb9a11-2053-4df6-9935-51dda4380df0 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd484c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:42.087033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-09eb9a11-2053-4df6-9935-51dda4380df0 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.154744 May 07 22:00:42.090364 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1865/3783] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:41 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:42.424039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:42.433950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:42.455587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:42.456292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:42.457717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:42.458182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:42.532033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:42.540106 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2dc69b64-a33e-4c4f-87b8-1e60dad5511f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 1.055751 May 07 22:00:42.568878 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1919/3784] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:41 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:42.702130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:42.710584 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-65e3a0ad-2e4d-45ca-ae6c-5933a33ebaad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1278 microversion: 2.1 time: 0.308076 May 07 22:00:42.719944 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1866/3785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:42 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:42.928036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:42.929407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:42.943357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:42.944216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:42.945259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:42.948526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:43.103358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-055e3eec-15a6-4403-8abc-f5a6b6da2de2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d6954c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:43.259405 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-055e3eec-15a6-4403-8abc-f5a6b6da2de2 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.161717 May 07 22:00:43.265645 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1867/3786] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:43 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:43.579172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:43.579926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:43.601367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:43.601829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:43.602634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:43.618504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:44.290537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:44.303227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1dc3fdda-7fd0-4101-9096-edd6530ce4fa tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 0.739376 May 07 22:00:44.305275 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1868/3787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:43 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:44.318015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:44.323236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:44.348442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:44.352482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:44.355339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:44.357460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:44.766591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:44.781552 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-397ae567-852c-467c-bbda-b6b529dd0767 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1278 microversion: 2.1 time: 0.468592 May 07 22:00:44.792452 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1869/3788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:44 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1278 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:44.808893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-060cecdc-0141-4364-8e7b-adafe9dc8309 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d6cfaf0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:44.893719 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-060cecdc-0141-4364-8e7b-adafe9dc8309 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.099416 May 07 22:00:44.895036 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1870/3789] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:44 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:45.321712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:45.327418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:45.342939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:45.343410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:45.344225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:45.344682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:45.803381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:45.817119 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f170ebb-6190-4d05-be20-b478907164e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 2.893899 May 07 22:00:45.817741 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1920/3790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:42 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 2895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:45.827984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:45.828614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:45.865119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:45.865954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:45.867034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:45.867651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:45.929400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:45.942033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5ca6348-0a81-4342-8b05-22796778697a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 0.624658 May 07 22:00:45.947129 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1871/3791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:45 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:45.955434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e6a1a83-7b76-4f00-8dea-4825c925b581 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ceddc10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:46.079459 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e6a1a83-7b76-4f00-8dea-4825c925b581 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.129919 May 07 22:00:46.080611 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1872/3792] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:45 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:46.516588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:46.540857 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd06de47-8209-47cf-a8d0-16abe8743023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1278 microversion: 2.1 time: 0.718529 May 07 22:00:46.543188 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1921/3793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:45 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1278 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:46.837295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:46.838983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:46.852631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:46.854548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:46.858985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:46.859722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:46.964408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:46.964957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:46.971841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:46.972308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:46.973106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:46.973554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:47.164482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:47.178525 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3d00111c-0d6f-438d-b486-d553d4f3d1af tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 0.346691 May 07 22:00:47.179684 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1873/3794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:46 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:47.199039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5f73e859-30f8-4e15-89ba-f9d5644c4ae6 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ceca310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:47.594813 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5f73e859-30f8-4e15-89ba-f9d5644c4ae6 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.411232 May 07 22:00:47.595430 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1874/3795] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:47 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:47.608985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:47.609620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:47.635848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:47.636319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:47.637327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:47.637958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:48.262214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:48.276509 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-085e5ab0-3ba3-4310-b72a-51bea6d41f24 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1278 microversion: 2.1 time: 0.679837 May 07 22:00:48.277125 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1875/3796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:47 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1278 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:48.290083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:48.290751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:48.298122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:48.301445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:48.303457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:48.304299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:48.304754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:48.310019 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8dc57d31-4c14-49c1-afc3-78659d4294d3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 1.349447 May 07 22:00:48.315264 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1922/3797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:46 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:48.609465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-379f7a13-746d-4feb-93a9-3a31b916cea7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224c7820>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:48.683792 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-379f7a13-746d-4feb-93a9-3a31b916cea7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.078472 May 07 22:00:48.684662 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1923/3798] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:48 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:48.798847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-df8bd884-7f25-42e5-a549-96b30cb1a05d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: .version_select at 0x7fc41d034550>, body: {"keypair": {"name": "tempest-keypair-351009029"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:48.846433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-df8bd884-7f25-42e5-a549-96b30cb1a05d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:48.858805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-df8bd884-7f25-42e5-a549-96b30cb1a05d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:49.125784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-df8bd884-7f25-42e5-a549-96b30cb1a05d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:00:49.151104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-df8bd884-7f25-42e5-a549-96b30cb1a05d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:00:49.184682 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-df8bd884-7f25-42e5-a549-96b30cb1a05d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.472383 May 07 22:00:49.185884 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1924/3799] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:00:48 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:49.200517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f94086d2-e29b-4ec9-af20-e6352b1ac1e1 req-20c3b285-f9e2-4319-8a03-cedca2f2f293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20117710-052c-46c3-8ca2-f601df488811", "tag": "f94f9f68-04c4-4723-8e48-775481388884"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:49.240020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f94086d2-e29b-4ec9-af20-e6352b1ac1e1 req-20c3b285-f9e2-4319-8a03-cedca2f2f293 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:49.240813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f94086d2-e29b-4ec9-af20-e6352b1ac1e1 req-20c3b285-f9e2-4319-8a03-cedca2f2f293 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:49.285835 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f94086d2-e29b-4ec9-af20-e6352b1ac1e1 req-20c3b285-f9e2-4319-8a03-cedca2f2f293 service nova] Creating event network-changed:f94f9f68-04c4-4723-8e48-775481388884 for instance 20117710-052c-46c3-8ca2-f601df488811 on nch1-master-1 May 07 22:00:49.302910 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f94086d2-e29b-4ec9-af20-e6352b1ac1e1 req-20c3b285-f9e2-4319-8a03-cedca2f2f293 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114965 May 07 22:00:49.304599 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1925/3800] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:49.313865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:49.314911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:49.326171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:49.327006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:49.328074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:49.329159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:49.653956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:49.680996 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0be9551-0e94-4177-93a8-397812a1c5a7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1278 microversion: 2.1 time: 0.368972 May 07 22:00:49.685524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:49.689441 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1926/3801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:49 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1278 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:49.704993 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ca9051d1-a5aa-4397-9c73-ed48ac0ad5e0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 1.426685 May 07 22:00:49.707516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:49.710107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:49.710791 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1876/3802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:48 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:49.716191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7abde583-9a9b-45e4-893d-1ac2db6cfdf4 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ce7e790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:49.738913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:49.747021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:49.748229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:49.751011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:49.853863 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7abde583-9a9b-45e4-893d-1ac2db6cfdf4 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.141731 May 07 22:00:49.855936 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1877/3803] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:49 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:49.950398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5ae7da5c-c2ee-442c-bff9-b88f1fdb9d51 req-51d13f08-6462-4da0-a360-c8c2b29605d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f9d622-1591-4442-9da0-167bdb326758", "name": "network-vif-plugged", "status": "completed", "tag": "7246b97e-cc3a-4e69-8bd1-0d36632d83ff"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:49.988026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5ae7da5c-c2ee-442c-bff9-b88f1fdb9d51 req-51d13f08-6462-4da0-a360-c8c2b29605d1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:49.993138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5ae7da5c-c2ee-442c-bff9-b88f1fdb9d51 req-51d13f08-6462-4da0-a360-c8c2b29605d1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:50.031780 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5ae7da5c-c2ee-442c-bff9-b88f1fdb9d51 req-51d13f08-6462-4da0-a360-c8c2b29605d1 service nova] Creating event network-vif-plugged:7246b97e-cc3a-4e69-8bd1-0d36632d83ff for instance 95f9d622-1591-4442-9da0-167bdb326758 on nch1-master-1 May 07 22:00:50.065981 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5ae7da5c-c2ee-442c-bff9-b88f1fdb9d51 req-51d13f08-6462-4da0-a360-c8c2b29605d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130448 May 07 22:00:50.071462 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1878/3804] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:50.716757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:50.724143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:50.760080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:50.760850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:50.765984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:50.765984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:51.453328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:51.461453 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c32b403e-6a6e-4587-ae16-9171c0fb73d8 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1364 microversion: 2.1 time: 1.769966 May 07 22:00:51.472377 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1927/3805] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:49 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1364 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:51.477992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:51.479278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:51.488204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:51.489080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:51.490127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:51.490852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:51.580069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:51.587481 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f0ae10bd-43ec-4448-a6a3-1e5a2209bbc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.884741 May 07 22:00:51.604191 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1879/3806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:50 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:51.612688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8cb96e39-06fc-4d3f-b8f4-d3ff92ddec0d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d442ee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:51.672423 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8cb96e39-06fc-4d3f-b8f4-d3ff92ddec0d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.067004 May 07 22:00:51.683351 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1880/3807] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:51 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:52.481761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:52.482588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:52.501807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:52.507320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:52.508351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:52.513037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:52.876077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:52.883763 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13ab0fdb-9484-4ffc-b532-972b58367399 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1550 microversion: 2.1 time: 0.408396 May 07 22:00:52.895143 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1881/3808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:52 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1550 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:52.904918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:52.909399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:52.927379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:52.936222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:52.937366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:52.940639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:53.021016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:53.039780 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e13c719b-9c67-41ef-bc57-2de924068d59 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 1.565813 May 07 22:00:53.040780 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1928/3809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:51 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:53.054815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7456382c-7c61-437a-99aa-a8654e9e2ae1 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224fe670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:53.130489 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7456382c-7c61-437a-99aa-a8654e9e2ae1 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1452 microversion: 2.1 time: 0.087863 May 07 22:00:53.131408 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1929/3810] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:53 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:53.141682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da3def44-71dd-4e90-b6a4-f78d7f3b663e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:53.148099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da3def44-71dd-4e90-b6a4-f78d7f3b663e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:53.157511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3def44-71dd-4e90-b6a4-f78d7f3b663e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:53.167594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3def44-71dd-4e90-b6a4-f78d7f3b663e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:53.169407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3def44-71dd-4e90-b6a4-f78d7f3b663e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:53.170034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da3def44-71dd-4e90-b6a4-f78d7f3b663e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:53.742701 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da3def44-71dd-4e90-b6a4-f78d7f3b663e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.609370 May 07 22:00:53.743723 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1930/3811] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:00:53 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-interface => generated 285 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:53.883395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:53.897702 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e298754-5fc0-410b-91a5-5dc4b441f574 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.999676 May 07 22:00:53.899217 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1882/3812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:52 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:54.058170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:54.058820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:54.076646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:54.077265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:54.078982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:54.079726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:54.144134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fe400c20-e105-46a7-b406-282006b57efc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d442670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:54.211030 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fe400c20-e105-46a7-b406-282006b57efc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1461 microversion: 2.1 time: 0.070760 May 07 22:00:54.212575 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1883/3813] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:54 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1461 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:54.227329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a68233d-6e8c-402f-8843-a788470049dc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d6419d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:54.321059 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a68233d-6e8c-402f-8843-a788470049dc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 200 len: 1461 microversion: 2.1 time: 0.100585 May 07 22:00:54.321984 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1884/3814] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:54 2022] GET /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:54.335025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:54.335811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:54.345411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:54.349237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:54.350810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:54.355003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:55.067319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:55.082509 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fcf745e8-2d87-4f98-9d97-41e47039d22f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1479 microversion: 2.1 time: 0.750321 May 07 22:00:55.083371 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1885/3815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:54 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1479 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:55.112932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:55.113588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:55.133004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:55.133477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:55.134281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:55.134801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:56.082288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:56.090883 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-575a4179-bfeb-4bdf-9483-017f3007ebf7 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 1.005918 May 07 22:00:56.094509 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1886/3816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:55 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:56.108334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:56.117406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:56.140973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:56.141737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:56.142238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:56.142681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:57.101093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:57.141004 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c23f88c-b4af-4c38-914c-9c184655f770 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1506 microversion: 2.1 time: 3.087298 May 07 22:00:57.152905 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1931/3817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:54 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1506 bytes in 3100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:57.168618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b06e563e-9d62-4955-999a-e59a38cf32fe req-0bc657ad-02d4-4d38-aa31-f54269a2d05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdd32653-348f-44ed-80fe-0a58500e3ced", "tag": "4cb9d745-576d-4349-82d0-2e6fc098ae28"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:57.192864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b06e563e-9d62-4955-999a-e59a38cf32fe req-0bc657ad-02d4-4d38-aa31-f54269a2d05c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:57.193105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b06e563e-9d62-4955-999a-e59a38cf32fe req-0bc657ad-02d4-4d38-aa31-f54269a2d05c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:57.219933 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b06e563e-9d62-4955-999a-e59a38cf32fe req-0bc657ad-02d4-4d38-aa31-f54269a2d05c service nova] Creating event network-changed:4cb9d745-576d-4349-82d0-2e6fc098ae28 for instance bdd32653-348f-44ed-80fe-0a58500e3ced on nch1-master-1 May 07 22:00:57.227494 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b06e563e-9d62-4955-999a-e59a38cf32fe req-0bc657ad-02d4-4d38-aa31-f54269a2d05c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069377 May 07 22:00:57.231468 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1932/3818] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:57.256063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:57.264963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:57.285384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:57.286718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:57.292453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:57.293152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:57.799953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:57.814506 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-968554cb-ee8d-4cdb-9504-772c44df880b tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1466 microversion: 2.1 time: 1.711006 May 07 22:00:57.815876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1887/3819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:56 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1466 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:00:57.831679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-536f07c3-4a57-40cb-8aa7-6faaae7bd517 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-874136121"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:57.832967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-536f07c3-4a57-40cb-8aa7-6faaae7bd517 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:57.851482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-536f07c3-4a57-40cb-8aa7-6faaae7bd517 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:57.854119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-536f07c3-4a57-40cb-8aa7-6faaae7bd517 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:57.858549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-536f07c3-4a57-40cb-8aa7-6faaae7bd517 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:57.859375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-536f07c3-4a57-40cb-8aa7-6faaae7bd517 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:58.403921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-536f07c3-4a57-40cb-8aa7-6faaae7bd517 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "POST /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7/action" status: 202 len: 0 microversion: 2.1 time: 0.576018 May 07 22:00:58.405031 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1888/3820] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:00:57 2022] POST /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 07 22:00:58.411226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-caae52ef-6956-4568-8011-86fa158af3d4 req-80d3516e-0a5b-41a9-9800-a912f8a9f4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ba773a-10d4-4c62-b1a6-a64c236b6bff", "tag": "90263e81-473d-4dcc-9c1f-3f7af137021b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:58.424452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-caae52ef-6956-4568-8011-86fa158af3d4 req-80d3516e-0a5b-41a9-9800-a912f8a9f4b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:58.425045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-caae52ef-6956-4568-8011-86fa158af3d4 req-80d3516e-0a5b-41a9-9800-a912f8a9f4b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:58.441746 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-caae52ef-6956-4568-8011-86fa158af3d4 req-80d3516e-0a5b-41a9-9800-a912f8a9f4b7 service nova] Creating event network-changed:90263e81-473d-4dcc-9c1f-3f7af137021b for instance 77ba773a-10d4-4c62-b1a6-a64c236b6bff on nch2-master-1 May 07 22:00:58.450353 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-caae52ef-6956-4568-8011-86fa158af3d4 req-80d3516e-0a5b-41a9-9800-a912f8a9f4b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042972 May 07 22:00:58.451329 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1889/3821] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:00:58.461215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:58.462138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:58.470520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:58.471293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:58.472251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:58.472858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:58.535797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:58.548512 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0dff3e09-5fc4-4f00-b592-33ac77051090 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 1.312570 May 07 22:00:58.549518 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1933/3822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:57 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:58.561270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b95058d-5bfc-4c28-896d-f4143afffb34 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224f09d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:58.631320 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b95058d-5bfc-4c28-896d-f4143afffb34 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.080310 May 07 22:00:58.631929 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1934/3823] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:58 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:59.098447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:59.112406 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-21130715-e92e-4c54-bd29-d14a1bf3f40d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1486 microversion: 2.1 time: 0.659587 May 07 22:00:59.113854 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1890/3824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:58 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1486 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:00:59.344423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1014574281", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:00:59.429850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] validate_networks() for [('4e401ba0-7563-49f5-9424-036872d14546', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:00:59.565314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:00:59.566074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:00:59.573642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:59.580131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:59.585284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:00:59.585848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:00:59.953197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:00:59.971448 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-34d3f23b-bb94-4671-9ee0-75e57b461ccd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.405103 May 07 22:00:59.995734 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1891/3825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:00:59 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:00.000984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2cc37a2a-217d-4b5b-b0f8-2f91c08808d1 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cdaab80>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:00.088981 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2cc37a2a-217d-4b5b-b0f8-2f91c08808d1 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.081198 May 07 22:01:00.090324 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1892/3826] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:59 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:00.109386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1122920680", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64cbfbe-feaa-48dc-9089-9445aa1eaa5a"}], "security_groups": [{"name": "tempest-securitygroup--1690864392"}], "key_name": "tempest-keypair-351009029", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:00.323558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] validate_networks() for [('f64cbfbe-feaa-48dc-9089-9445aa1eaa5a', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:01:01.810045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:01:01.810705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:01:01.810966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:01:01.811387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:01:01.811806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:01:01.826171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:01.833000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:01.834592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:01.835258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:01.879727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:01:01.893113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:01:01.927848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:01:01.934509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:01:02.038839 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db430234-649e-4a7a-b098-48d74da9e3fc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.947126 May 07 22:01:02.049495 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1893/3827] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:01:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:01:02.062659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cbb21762-8125-4158-9594-eccf790900dc req-e42bd91b-c923-4ff3-932e-146687711555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5d0aa6-f907-4569-bedc-2979f6637d33", "name": "network-vif-unplugged", "status": "completed", "tag": "73e10226-084a-4235-a376-31a716d63e44"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:02.103838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cbb21762-8125-4158-9594-eccf790900dc req-e42bd91b-c923-4ff3-932e-146687711555 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:02.104535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cbb21762-8125-4158-9594-eccf790900dc req-e42bd91b-c923-4ff3-932e-146687711555 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:02.146237 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cbb21762-8125-4158-9594-eccf790900dc req-e42bd91b-c923-4ff3-932e-146687711555 service nova] Creating event network-vif-unplugged:73e10226-084a-4235-a376-31a716d63e44 for instance 5d5d0aa6-f907-4569-bedc-2979f6637d33 on nch2-master-1 May 07 22:01:02.166989 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cbb21762-8125-4158-9594-eccf790900dc req-e42bd91b-c923-4ff3-932e-146687711555 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115221 May 07 22:01:02.179357 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1894/3828] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:02.189318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:02.190246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:02.203863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:02.204525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:02.223806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:02.227702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:02.445611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:01:02.446111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:01:02.447125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:01:02.447713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:01:02.448886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:01:02.491023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:02.491829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:02.496034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:02.498286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:02.551832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:02.566859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Getting quotas for project 1fb49d7a99844a7ab8ef30fb59250e7d. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:01:02.567298 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-804d3723-b8d7-4335-9870-4dbc03188ede tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.382886 May 07 22:01:02.570707 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1895/3829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:02 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:02.583608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-075513a7-a492-4ecd-97fc-d534f83723ce req-2f054893-9865-406c-92a0-7f50697ad97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f9d622-1591-4442-9da0-167bdb326758", "tag": "7246b97e-cc3a-4e69-8bd1-0d36632d83ff"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:02.592543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Getting quotas for user 99294a64e28046d8b57260f74c325990 and project 1fb49d7a99844a7ab8ef30fb59250e7d. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:01:02.608313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-075513a7-a492-4ecd-97fc-d534f83723ce req-2f054893-9865-406c-92a0-7f50697ad97f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:02.615446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-075513a7-a492-4ecd-97fc-d534f83723ce req-2f054893-9865-406c-92a0-7f50697ad97f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:02.626850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:01:02.631804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:01:02.641684 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-075513a7-a492-4ecd-97fc-d534f83723ce req-2f054893-9865-406c-92a0-7f50697ad97f service nova] Creating event network-changed:7246b97e-cc3a-4e69-8bd1-0d36632d83ff for instance 95f9d622-1591-4442-9da0-167bdb326758 on nch1-master-1 May 07 22:01:02.659324 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-075513a7-a492-4ecd-97fc-d534f83723ce req-2f054893-9865-406c-92a0-7f50697ad97f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087058 May 07 22:01:02.660597 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1896/3830] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:02.667881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97d13266-716f-4b23-bb78-1af0229cbd1a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cc754c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:02.728944 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a5ed7359-0465-483a-a851-0975f9049b77 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.388278 May 07 22:01:02.734962 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1935/3831] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:00:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:01:02.752300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8784ea84-71a1-42c3-8273-106c50886423 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:02.752937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8784ea84-71a1-42c3-8273-106c50886423 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:02.773650 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97d13266-716f-4b23-bb78-1af0229cbd1a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.111946 May 07 22:01:02.775711 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1897/3832] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:02 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:02.795611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ae042c7-2253-4a44-8857-e9a47c3751ef tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:02.799163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ae042c7-2253-4a44-8857-e9a47c3751ef tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:03.055556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3ae042c7-2253-4a44-8857-e9a47c3751ef tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:03.065749 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ae042c7-2253-4a44-8857-e9a47c3751ef tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1214 microversion: 2.1 time: 0.286271 May 07 22:01:03.067089 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1898/3833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:02 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1214 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:03.529546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8784ea84-71a1-42c3-8273-106c50886423 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:03.548118 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8784ea84-71a1-42c3-8273-106c50886423 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1241 microversion: 2.1 time: 0.815522 May 07 22:01:03.548472 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1936/3834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:02 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1241 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:03.586855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:03.587578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:03.601368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:03.602072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:03.603631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:03.610310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:03.789198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51a9fcd8-ccf3-4b5b-be8d-f237c526266d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc42250ec10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:03.903176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-51a9fcd8-ccf3-4b5b-be8d-f237c526266d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.118390 May 07 22:01:03.904104 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1937/3835] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:03 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:04.085134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:04.086255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:04.105471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:04.114002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:04.115289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:04.116475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:04.211575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:04.222930 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2d1a12ac-8a5e-4104-b060-f516a85b7e0c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.639815 May 07 22:01:04.225996 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1899/3836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:03 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:04.482190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a3a65caa-d79b-4716-b66a-3e03e0b0ab21 req-7a18c2c3-2b9d-44f1-974d-fc0a91e4217d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20117710-052c-46c3-8ca2-f601df488811", "name": "network-vif-plugged", "status": "completed", "tag": "f94f9f68-04c4-4723-8e48-775481388884"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:04.506023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a3a65caa-d79b-4716-b66a-3e03e0b0ab21 req-7a18c2c3-2b9d-44f1-974d-fc0a91e4217d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:04.512991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a3a65caa-d79b-4716-b66a-3e03e0b0ab21 req-7a18c2c3-2b9d-44f1-974d-fc0a91e4217d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:04.555041 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a3a65caa-d79b-4716-b66a-3e03e0b0ab21 req-7a18c2c3-2b9d-44f1-974d-fc0a91e4217d service nova] Creating event network-vif-plugged:f94f9f68-04c4-4723-8e48-775481388884 for instance 20117710-052c-46c3-8ca2-f601df488811 on nch1-master-1 May 07 22:01:04.570237 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a3a65caa-d79b-4716-b66a-3e03e0b0ab21 req-7a18c2c3-2b9d-44f1-974d-fc0a91e4217d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106974 May 07 22:01:04.571521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1900/3837] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:04.588042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:04.591152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:04.624002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:04.624484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:04.629048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:04.629588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:04.766351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:04.776743 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-39e2fa63-27ac-4fc2-924f-7dff688526aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1210 microversion: 2.1 time: 0.696177 May 07 22:01:04.779823 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1938/3838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:04 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1210 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:04.917504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55a50841-79d1-489c-8aff-654252f5170e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224f0670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:05.001220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:05.007488 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55a50841-79d1-489c-8aff-654252f5170e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.094510 May 07 22:01:05.008675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1939/3839] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:04 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:05.028958 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9e6e06e7-a732-4ff9-a834-753bc7dc4f20 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1301 microversion: 2.1 time: 0.449537 May 07 22:01:05.032334 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1901/3840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:04 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1301 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:05.243638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:05.244644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:05.254390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:05.258911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:05.261611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:05.262245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:05.796606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:05.797354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:05.820938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:05.824789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:05.826038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:05.827773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:06.350167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:06.362590 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cfd6ff8d-4657-4b5a-b9cc-849f3342ce95 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 1.123835 May 07 22:01:06.364624 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1940/3841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:05 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:06.379170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-78819f96-e6ba-48d2-ac75-12354e952748 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224cc8b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:06.533161 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-78819f96-e6ba-48d2-ac75-12354e952748 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.159975 May 07 22:01:06.535777 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1941/3842] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:06 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:06.544014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:06.548675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:06.564409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:06.565172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:06.567927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:06.568547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:06.707709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:06.717256 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d5f2e10-aadc-40ac-b34c-9d52fb8299d5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1299 microversion: 2.1 time: 0.180120 May 07 22:01:06.725417 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1942/3843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:06 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:06.934722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:06.958537 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4fb3c7f-7a2f-438d-9b9f-fc18289d6d06 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1272 microversion: 2.1 time: 1.161881 May 07 22:01:06.965034 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1902/3844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:05 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1272 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:07.381206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:07.382699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:07.393625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:07.396624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:07.402517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:07.407842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:07.547349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5ba57e80-cde2-438f-a159-dc8198a66c1d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd48550>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:07.622147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5ba57e80-cde2-438f-a159-dc8198a66c1d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.079496 May 07 22:01:07.628022 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1903/3845] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:07 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:07.742105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:07.743937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:07.755772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:07.764414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:07.772220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:07.772904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:07.879191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:07.890221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-13bab525-bd05-46f8-b814-f9b52a630d94 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.512973 May 07 22:01:07.899162 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1943/3846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:07 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:07.981059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:07.981689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:07.994438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:07.994985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:07.995814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:07.996270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:08.008894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:08.019944 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7173c0e9-ccbe-40d1-9d7f-c68711cdd3b2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1299 microversion: 2.1 time: 0.282239 May 07 22:01:08.020544 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1904/3847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:07 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:08.121705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:08.133026 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77df6e8e-98b2-4773-85a6-9678092f83aa tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1272 microversion: 2.1 time: 0.155188 May 07 22:01:08.135154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1944/3848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:07 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:08.637489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7e7336da-98f2-4712-9890-76249624cde8 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cf493a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:08.709701 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7e7336da-98f2-4712-9890-76249624cde8 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.077540 May 07 22:01:08.710714 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1905/3849] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:08 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:08.907376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:08.908739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:08.925120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:08.925904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:08.926963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:08.927595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:09.039987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:09.043760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:09.060393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:09.061148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:09.062131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:09.070116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:09.368120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:09.376363 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c2d9bec-b906-4334-bbf9-9da216c21604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1299 microversion: 2.1 time: 0.341542 May 07 22:01:09.386582 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1906/3850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:09 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1299 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:09.393919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:09.396903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:09.416228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:09.416920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:09.418061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:09.420123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:09.619093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:09.628752 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ad87a38c-4bbd-4e78-8de5-c5e539a65c8f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.724371 May 07 22:01:09.633016 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1945/3851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:08 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:09.723460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00b3ff1f-ee79-42a8-a852-f1173e798dab tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cf89700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:09.795638 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00b3ff1f-ee79-42a8-a852-f1173e798dab tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.076037 May 07 22:01:09.796543 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1946/3852] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:09 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:09.882638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:09.898160 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c873d74-458a-4712-93f5-79fe23c0f157 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.503011 May 07 22:01:09.901277 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1907/3853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:09 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:10.396730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:10.397395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:10.419375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:10.422305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:10.425810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:10.428847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:10.650433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:10.652188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:10.665249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:10.671547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:10.673017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:10.675218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:10.827003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:10.834665 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52f0fa35-fb21-4f19-84b2-3c717c8c4855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.442054 May 07 22:01:10.837014 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1947/3854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:10 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:10.851604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a90307c-45b4-4e8d-97cd-fa4e90fff600 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cf89670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:10.924208 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a90307c-45b4-4e8d-97cd-fa4e90fff600 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.085373 May 07 22:01:10.924806 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1948/3855] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:10 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:10.941267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:10.942085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:10.949547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:10.952580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:10.954793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:10.960482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:11.546941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:11.559870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-604ca01c-3995-4863-875a-3a4eba40fa16 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.633032 May 07 22:01:11.564436 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1949/3856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:10 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:11.855596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:11.856568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:11.886091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:11.888485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:11.889582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:11.891286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:12.100111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:12.116243 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7e93fdec-5d13-4e9c-8b84-0cacd5ec88e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.266176 May 07 22:01:12.120504 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1950/3857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:11 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:12.131448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f8c43d06-c97f-47e7-a8a5-cf8db92613ea tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c4ecc10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:12.215541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f8c43d06-c97f-47e7-a8a5-cf8db92613ea tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.092786 May 07 22:01:12.216418 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1951/3858] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:12 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:12.241256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:12.260447 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12b04cf1-c95d-4c80-a40c-11a359ea73c1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 1.614468 May 07 22:01:12.272926 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1908/3859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:10 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:12.442384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-be314245-153a-4b63-afd8-76cffaae148a req-2c6b55d3-44f5-4638-8cf4-1cb8b0a534a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd32653-348f-44ed-80fe-0a58500e3ced", "name": "network-vif-plugged", "status": "completed", "tag": "4cb9d745-576d-4349-82d0-2e6fc098ae28"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:12.456712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-be314245-153a-4b63-afd8-76cffaae148a req-2c6b55d3-44f5-4638-8cf4-1cb8b0a534a0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:12.457460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-be314245-153a-4b63-afd8-76cffaae148a req-2c6b55d3-44f5-4638-8cf4-1cb8b0a534a0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:12.476669 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-be314245-153a-4b63-afd8-76cffaae148a req-2c6b55d3-44f5-4638-8cf4-1cb8b0a534a0 service nova] Creating event network-vif-plugged:4cb9d745-576d-4349-82d0-2e6fc098ae28 for instance bdd32653-348f-44ed-80fe-0a58500e3ced on nch1-master-1 May 07 22:01:12.483576 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-be314245-153a-4b63-afd8-76cffaae148a req-2c6b55d3-44f5-4638-8cf4-1cb8b0a534a0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146126 May 07 22:01:12.484550 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1952/3860] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:01:12.582374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:12.583575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:12.607050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:12.609503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:12.610569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:12.613562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:13.043839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:13.059279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-129f1b49-8f1a-4b5b-a4c3-cfb60e820340 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.480861 May 07 22:01:13.060170 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1909/3861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:12 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:13.136867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:13.137576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:13.150140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:13.155529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:13.158117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:13.162410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:13.229461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-56be0187-6608-475b-b1a1-24e8fb9e9052 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caae550>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:13.299059 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56be0187-6608-475b-b1a1-24e8fb9e9052 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.073376 May 07 22:01:13.305636 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1910/3862] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:13 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:13.322626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:13.323178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:13.362695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:13.365586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:13.365586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:13.365586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:13.486401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:13.496841 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-32b6a4f6-db49-40e8-b18e-de3ab554fa27 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.364660 May 07 22:01:13.515332 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1953/3863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:13 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:14.079150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:14.079793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:14.093967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:14.096146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:14.096978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:14.099014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:14.393230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:14.401437 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-38bcaea4-3499-42a3-9930-5f6aa0c15289 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.327682 May 07 22:01:14.404244 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1954/3864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:14 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:14.419749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ceab26a-b3fd-4763-ac9b-aeae7808bc26 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224f0c10>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:14.501897 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ceab26a-b3fd-4763-ac9b-aeae7808bc26 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.083812 May 07 22:01:14.503072 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1955/3865] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:14 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:14.525102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:14.527291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:14.549543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:14.550940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:14.553272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:14.554075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:14.555005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:14.567856 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-32bbcec5-6512-4419-9405-c36d92e043bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 1.260379 May 07 22:01:14.571196 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1911/3866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:13 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:14.591107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2d349602-8b81-4a0d-8aae-05b4cc0ae08e req-026c2948-b134-49b3-9957-df29d570cc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30285c-55a0-4bf5-91e8-9bdd7282f8d7", "name": "network-vif-plugged", "status": "completed", "tag": "672e9dc5-e9c7-4350-b965-d54d762eb1d8"}, {"server_uuid": "77ba773a-10d4-4c62-b1a6-a64c236b6bff", "name": "network-vif-plugged", "status": "completed", "tag": "90263e81-473d-4dcc-9c1f-3f7af137021b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:14.644952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2d349602-8b81-4a0d-8aae-05b4cc0ae08e req-026c2948-b134-49b3-9957-df29d570cc4f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:14.650540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2d349602-8b81-4a0d-8aae-05b4cc0ae08e req-026c2948-b134-49b3-9957-df29d570cc4f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:14.686541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2d349602-8b81-4a0d-8aae-05b4cc0ae08e req-026c2948-b134-49b3-9957-df29d570cc4f service nova] Creating event network-vif-plugged:672e9dc5-e9c7-4350-b965-d54d762eb1d8 for instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 on nch2-master-1 May 07 22:01:14.687648 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2d349602-8b81-4a0d-8aae-05b4cc0ae08e req-026c2948-b134-49b3-9957-df29d570cc4f service nova] Creating event network-vif-plugged:90263e81-473d-4dcc-9c1f-3f7af137021b for instance 77ba773a-10d4-4c62-b1a6-a64c236b6bff on nch2-master-1 May 07 22:01:14.712909 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2d349602-8b81-4a0d-8aae-05b4cc0ae08e req-026c2948-b134-49b3-9957-df29d570cc4f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.128341 May 07 22:01:14.715573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1912/3867] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:14.879486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:14.889598 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a9048cc-7925-4690-ac1e-bbc895b3c7eb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.369581 May 07 22:01:14.893660 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1956/3868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:14 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:15.422714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:15.424703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:15.441958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:15.443326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:15.444902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:15.445530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:15.520782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8c1dcd92-6f3b-4306-a201-75e671bd83d4 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc4224f0820>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:15.593564 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8c1dcd92-6f3b-4306-a201-75e671bd83d4 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.081106 May 07 22:01:15.594759 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1957/3869] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:15 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:15.607085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:15.609982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:15.629372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:15.631761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:15.635086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:15.637058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:15.962587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:15.970735 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ca546f7f-27b9-441b-8456-87fe62156fa1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1320 microversion: 2.1 time: 0.374516 May 07 22:01:15.973779 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1958/3870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:15 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:15.990443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:15.991277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:15.998259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:16.000376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:16.001424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:16.004308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:16.196097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:16.219024 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50098a9b-343a-4ae7-93be-c7c58621cfb1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.800880 May 07 22:01:16.223589 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1913/3871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:15 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:16.232376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3efb14bd-c2bf-473c-86de-d857d28ce70d req-5347a34c-eeb6-4af3-90c0-30c30b497b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931cb167-5bcb-4aef-8b2b-029dbcb4d7e9", "tag": "aa4c2169-baeb-4b6e-a6e2-98691784c4a7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:16.262350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3efb14bd-c2bf-473c-86de-d857d28ce70d req-5347a34c-eeb6-4af3-90c0-30c30b497b7d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:16.263064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3efb14bd-c2bf-473c-86de-d857d28ce70d req-5347a34c-eeb6-4af3-90c0-30c30b497b7d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:16.288341 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3efb14bd-c2bf-473c-86de-d857d28ce70d req-5347a34c-eeb6-4af3-90c0-30c30b497b7d service nova] Creating event network-changed:aa4c2169-baeb-4b6e-a6e2-98691784c4a7 for instance 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 on nch2-master-1 May 07 22:01:16.300941 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3efb14bd-c2bf-473c-86de-d857d28ce70d req-5347a34c-eeb6-4af3-90c0-30c30b497b7d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075902 May 07 22:01:16.302570 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1914/3872] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:16.303714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:16.328049 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f4a47a69-01d0-4d0e-be5e-1fd5f694b3b6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.341181 May 07 22:01:16.328764 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1959/3873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:15 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:16.610527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-330cb0db-1664-4437-8dda-fc4324d71f4e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d113160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:16.676104 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-330cb0db-1664-4437-8dda-fc4324d71f4e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.072064 May 07 22:01:16.677545 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1915/3874] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:16 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:16.999507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:17.000084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:17.011552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.013166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.014195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.014849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.245389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:17.246314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:17.268757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.270581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.273684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.275411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.305168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:17.316497 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee277d2b-99b9-447b-872b-34e4a4db7ba8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1512 microversion: 2.1 time: 0.330733 May 07 22:01:17.318901 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1960/3875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:16 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:17.334113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:17.336118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:17.343813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.344541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.345574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.346246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.565980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:17.575586 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a840cce9-58cb-4589-95c4-d311bf4b6db0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1512 microversion: 2.1 time: 0.245249 May 07 22:01:17.580043 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1961/3876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:17 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:17.588136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:17.588912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:17.595789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.596313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.597360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.612577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.904705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:17.931617 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-399df874-8c83-4763-b820-daad4601e855 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.348740 May 07 22:01:17.933788 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1962/3877] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:17 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:17.945018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:17.945830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:17.954350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.955456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:17.958347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:17.958997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.241093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:18.260487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb92707a-2588-421d-84ab-82734db01023 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 200 len: 1512 microversion: 2.1 time: 0.323632 May 07 22:01:18.261106 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1963/3878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:17 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:18.270647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3e9845e2-4719-4c61-a700-a9eaf3ec40a1 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc422567b80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:18.361600 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3e9845e2-4719-4c61-a700-a9eaf3ec40a1 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.096823 May 07 22:01:18.362201 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1964/3879] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:18 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:18.380369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:18.387547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:18.388525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:18.402624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.403192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.404013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.404468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.466748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:18.489010 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97307c6e-e0f3-42bf-a102-6e3251ac63c0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 1.253040 May 07 22:01:18.501217 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1916/3880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:17 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:18.511093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:18.513329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3a30dec9-3e13-47ba-936e-e4939eed9d49 req-0a536aed-1d6f-4f12-81f7-02b6f32aad24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8141d2fb-0f50-41fb-bce0-7a6c7f7fc949", "tag": "2e46252a-79ff-49d8-a0dc-dceb03f5d5ae"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:18.537171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3a30dec9-3e13-47ba-936e-e4939eed9d49 req-0a536aed-1d6f-4f12-81f7-02b6f32aad24 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.539055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3a30dec9-3e13-47ba-936e-e4939eed9d49 req-0a536aed-1d6f-4f12-81f7-02b6f32aad24 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.565742 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3a30dec9-3e13-47ba-936e-e4939eed9d49 req-0a536aed-1d6f-4f12-81f7-02b6f32aad24 service nova] Creating event network-changed:2e46252a-79ff-49d8-a0dc-dceb03f5d5ae for instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 on nch2-master-1 May 07 22:01:18.577538 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3a30dec9-3e13-47ba-936e-e4939eed9d49 req-0a536aed-1d6f-4f12-81f7-02b6f32aad24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067363 May 07 22:01:18.578845 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1917/3881] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:18.596690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:18.604528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.604850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.758682 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1d5247fd-bfcc-4803-bb52-a89c3276bef0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.395410 May 07 22:01:18.759530 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1965/3882] 10.222.0.32 () {58 vars in 1166 bytes} [Sat May 7 22:01:18 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:18.778921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:18.803347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:18.804565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1216157588', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:18.819279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.820046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.821090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.822262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.948708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:18.955113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:18.956070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:18.970389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.970922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:18.971895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:18.972254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:19.114278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:19.127169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:19.127629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:19.399259 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ab191f5-abc0-4984-9659-37bb291e2cab tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1216157588" status: 200 len: 1515 microversion: 2.1 time: 0.625141 May 07 22:01:19.400896 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1918/3883] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:01:18 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1216157588 => generated 1515 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:19.405518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7a91676-097b-43ad-ae14-012bf13c549f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d14b1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:19.504040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:19.514802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-700f3f17-13c8-4c9f-9346-ffd4c8acf266 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.562663 May 07 22:01:19.525858 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1966/3884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:18 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:19.526049 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e7a91676-097b-43ad-ae14-012bf13c549f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.118629 May 07 22:01:19.526496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:19.527924 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1919/3885] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:19 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:19.536250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:19.537408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:19.541647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:19.555867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:19.557038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:19.557697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:19.559703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:19.561060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:19.579666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:19.580134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:19.580951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:19.581409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:19.751217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:19.850892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:19.865669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:19.868063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.062816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:20.071196 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-507109fa-3b38-4814-adcb-f1d281a11228 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.541926 May 07 22:01:20.082611 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1920/3886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:19 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:20.364451 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-34f0a8d8-833f-437a-b3b7-d6e03bf03536 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.846189 May 07 22:01:20.365056 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1967/3887] 10.222.0.32 () {58 vars in 1172 bytes} [Sat May 7 22:01:19 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:20.384807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:20.388381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:20.388838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.servers [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Removing options 'limit' from query {{(pid=136681) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 07 22:01:20.389592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:20.405598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:20.406463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.407494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:20.419512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.483888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:20.490733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:20.491440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.536409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:20.537734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:20.546628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:20.548242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.549677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:20.550520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.756801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2587a8aa-fb06-4cf3-88b2-7d3431912aec tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.376485 May 07 22:01:20.758662 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1921/3888] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 22:01:20 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:20.771840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1fa78736-e0a5-4276-9553-2928ac21be59 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d594550>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:20.864434 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1fa78736-e0a5-4276-9553-2928ac21be59 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.104150 May 07 22:01:20.875477 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1922/3889] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:20 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:20.882209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:20.888831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:20.892094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:20.905258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:20.908504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.909863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:20.911268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:20.948401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:21.049107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:21.060631 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ccedc359-15f4-45b9-8c4d-d2fda19aab29 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.528934 May 07 22:01:21.062891 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1968/3890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:20 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:21.076436 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7b73d289-b07c-4791-97f8-4085b1911260 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.182659 May 07 22:01:21.077204 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1923/3891] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 22:01:20 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:21.092231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:21.100789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:21.101172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:21.101891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.compute.servers [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Removing options 'limit' from query {{(pid=136682) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 07 22:01:21.102734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:21.103610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:21.115465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.116353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.117174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.118592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.118982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.119955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.120723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.121340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.176412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:21.227124 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9935a38e-5784-42a5-9a58-e1b5a57c23b9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.142129 May 07 22:01:21.228834 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1969/3892] 10.222.0.32 () {58 vars in 1149 bytes} [Sat May 7 22:01:21 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:21.242071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:21.247013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:21.247920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:21.253876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.254684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.255765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.256384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.318198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:21.372542 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7960aa2f-7ac3-4f61-9e41-1e0e32ac6f9d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.136271 May 07 22:01:21.391896 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1970/3893] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 22:01:21 2022] GET /compute/v2.1/servers => generated 1011 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:21.403287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:21.414072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:21.415313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:21.444274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.445208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.446262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.448206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.649861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:21.773374 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-13c4d529-4b31-41ed-8a85-48d255bb4500 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.379427 May 07 22:01:21.774146 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1971/3894] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 22:01:21 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:21.788701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:21.795291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:21.795821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.compute.servers [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Removing options 'limit' from query {{(pid=136682) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 07 22:01:21.796997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:21.802978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.803565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.804479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.805078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.854132 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-179461d0-0f6e-4dcc-a531-177f45c67b8b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.071140 May 07 22:01:21.861091 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1972/3895] 10.222.0.32 () {58 vars in 1139 bytes} [Sat May 7 22:01:21 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:21.866560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:21.872235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:21.872235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1216157588', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:21.877380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.877844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.878655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:21.879132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:21.991768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:22.069153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:22.117501 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-258ac8b6-fcf8-436a-8341-8715a82aa3ac tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 1.023604 May 07 22:01:22.124355 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1924/3896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:21 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:22.143392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86ac1f34-aa92-4271-993f-ad2df272a601 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d113dc0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:22.144141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a98ca5b2-adee-4f01-ad7e-c31d415b533a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1216157588" status: 200 len: 346 microversion: 2.1 time: 0.280963 May 07 22:01:22.144776 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1973/3897] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:01:21 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1216157588 => generated 346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:22.167226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:22.167862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:22.221432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:22.221898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:22.222706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:22.223180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:22.285637 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-86ac1f34-aa92-4271-993f-ad2df272a601 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.147790 May 07 22:01:22.299311 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1925/3898] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:22 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:22.312885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-00f0ff42-699a-4461-bc1d-74b039111988 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:22.355062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00f0ff42-699a-4461-bc1d-74b039111988 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:22.363791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00f0ff42-699a-4461-bc1d-74b039111988 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:22.417434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-00f0ff42-699a-4461-bc1d-74b039111988 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Going to try to stop instance {{(pid=136681) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:01:22.542277 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-00f0ff42-699a-4461-bc1d-74b039111988 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "POST /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811/action" status: 202 len: 0 microversion: 2.1 time: 0.239736 May 07 22:01:22.543644 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1926/3899] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:01:22 2022] POST /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:01:22.586862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:22.589806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:22.611655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:22.615747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:22.617113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:22.617848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:22.827897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:22.836318 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82db3f52-a5b5-4e4f-94fe-91362e35725e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.679459 May 07 22:01:22.836582 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1974/3900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:22 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:23.130844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:23.140967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:23.141804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:23.142185 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f1a01f18-5ec8-4196-9953-08d42ddfff44 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.583536 May 07 22:01:23.156463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:23.162692 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1927/3901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:22 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:23.163602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:23.167797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:23.168292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:23.304949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed6551a7-caac-4f80-9d4c-016637216dc0 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cd96430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:23.389955 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed6551a7-caac-4f80-9d4c-016637216dc0 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.088764 May 07 22:01:23.390905 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1928/3902] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:23 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:23.824127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:23.834394 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e0b5a6dc-b6be-44cc-afdd-6ca876a98c53 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.698317 May 07 22:01:23.835678 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1975/3903] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:23 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:23.853641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:23.854576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:23.870137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:23.871054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:23.872356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:23.874068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:24.160980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:24.163753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:24.173976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:24.175033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:24.176797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:24.178449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:24.382293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:24.397270 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54402e5c-6123-4b7a-aec4-cc7b2d0b2106 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.545688 May 07 22:01:24.398488 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1929/3904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:23 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:24.410562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8242b46f-5852-42c0-8ba5-7d5d7d964ca5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d594940>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:24.559022 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8242b46f-5852-42c0-8ba5-7d5d7d964ca5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.159163 May 07 22:01:24.560156 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1930/3905] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:24 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:24.682576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:24.725979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7c5a8f45-7d00-4c5c-aaf3-e146140c4e88 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.565447 May 07 22:01:24.755707 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1976/3906] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:24 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:24.876219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:24.877199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:24.886836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:24.887590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:24.888575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:24.889395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:25.391780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:25.400358 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91cf2571-f1f2-4e26-8535-53a7994efa83 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.534902 May 07 22:01:25.403514 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1931/3907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:24 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:25.419231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:25.419840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:25.438165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:25.439106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:25.440414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:25.441221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:25.571996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9949b8db-af03-4982-bd8f-74aaf30c8029 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d594550>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:25.645510 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9949b8db-af03-4982-bd8f-74aaf30c8029 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.077610 May 07 22:01:25.646641 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1932/3908] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:25 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:25.761511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:25.762414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:25.773659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:25.776511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:25.777426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:25.779307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:25.968709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:25.978179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-53dbba64-a806-4923-b806-0098df0dd5fa tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.562555 May 07 22:01:25.982174 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1977/3909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:25 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:26.132523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d9e5eb5-4a55-4cb5-8b60-99aaed2aa02e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:26.133406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d9e5eb5-4a55-4cb5-8b60-99aaed2aa02e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:26.145204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d9e5eb5-4a55-4cb5-8b60-99aaed2aa02e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:26.146545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d9e5eb5-4a55-4cb5-8b60-99aaed2aa02e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:26.150522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d9e5eb5-4a55-4cb5-8b60-99aaed2aa02e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:26.151181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d9e5eb5-4a55-4cb5-8b60-99aaed2aa02e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:26.173875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:26.189072 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f1c76576-4a9f-4152-beb4-e4b12b5ff745 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.428909 May 07 22:01:26.204969 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1933/3910] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:25 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:26.231798 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d9e5eb5-4a55-4cb5-8b60-99aaed2aa02e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/ips" status: 200 len: 146 microversion: 2.1 time: 0.102336 May 07 22:01:26.232766 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1978/3911] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:01:26 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/ips => generated 146 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:01:26.420299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:26.421270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:26.430505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:26.434271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:26.435499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:26.437831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:26.661191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67ba6159-4b04-4978-b9e4-5704b924913c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c2f8e50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:26.793765 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67ba6159-4b04-4978-b9e4-5704b924913c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1452 microversion: 2.1 time: 0.138653 May 07 22:01:26.794434 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1979/3912] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:26 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:26.974407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:26.986133 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-16af138b-5322-4efa-890d-3e620b019685 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.566999 May 07 22:01:26.986759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1934/3913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:26 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:26.996915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:26.997820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:27.009741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:27.010217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:27.011055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:27.016808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:27.214135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:27.215303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:27.232780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:27.233246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:27.234265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:27.234908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:27.297560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:27.313238 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64859b67-45f9-496f-ab0f-93afb95d8c98 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.322007 May 07 22:01:27.314439 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1980/3914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:26 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:27.588787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:27.605671 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-763b1c66-bacf-4be4-8117-027d8777dfad tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.396367 May 07 22:01:27.606274 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1935/3915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:27 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:27.807366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ac046de-fac8-47c5-b320-5fb38d8f27d7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c2f8160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:27.870580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ac046de-fac8-47c5-b320-5fb38d8f27d7 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1461 microversion: 2.1 time: 0.067762 May 07 22:01:27.871473 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1981/3916] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:27 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1461 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:27.884275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66aa9bc5-756a-4701-ad34-3b386e281194 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caae4c0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:27.975533 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66aa9bc5-756a-4701-ad34-3b386e281194 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 200 len: 1461 microversion: 2.1 time: 0.095499 May 07 22:01:27.976810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1936/3917] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:27 2022] GET /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 1461 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:27.988400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:27.995140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:28.004546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:28.010581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:28.011296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:28.011450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:28.012161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:28.015904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:28.021498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:28.022480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:28.023579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:28.024285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:28.441717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:28.450510 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-126477c6-92f4-4486-a641-06f04d67a97a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1466 microversion: 2.1 time: 0.466063 May 07 22:01:28.454637 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1982/3918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:27 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1466 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:28.471014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:28.472596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:28.492140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:28.494281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:28.497054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:28.497759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:28.728893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:28.737263 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9acdfc7-177f-49ee-ba9f-74ed11b1f1d8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.270140 May 07 22:01:28.742459 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1983/3919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:28 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:28.747347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0636ba6-8e90-4565-93c1-25fcd6704836 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c3dde50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:29.038221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0636ba6-8e90-4565-93c1-25fcd6704836 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?changes-since=2022-05-07T21%3A59%3A20Z" status: 200 len: 1901 microversion: 2.1 time: 0.293756 May 07 22:01:29.047546 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1984/3920] 10.222.0.32 () {58 vars in 1198 bytes} [Sat May 7 22:01:28 2022] GET /compute/v2.1/images?changes-since=2022-05-07T21%3A59%3A20Z => generated 1901 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:29.062406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:29.070210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:29.084453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:29.085187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:29.086185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:29.087505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:29.277969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:29.289243 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8c171a0f-5290-49bf-88c5-36fbf9318b34 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 1.288628 May 07 22:01:29.293495 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1937/3921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:27 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:29.303872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96a5e735-94db-478f-84a1-29e8f6aafcde tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caae310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:29.469669 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96a5e735-94db-478f-84a1-29e8f6aafcde tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1616310219" status: 200 len: 485 microversion: 2.1 time: 0.174792 May 07 22:01:29.471132 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1938/3922] 10.222.0.32 () {58 vars in 1230 bytes} [Sat May 7 22:01:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1616310219 => generated 485 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:29.497192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb70a0e5-3e6b-4698-b8d3-a02bc020c5b9 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d5f4c10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:29.516735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:29.556965 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e40052c9-771a-4c84-9bc2-14b43e91ef19 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.507684 May 07 22:01:29.572935 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1985/3923] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:29 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:29.707122 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb70a0e5-3e6b-4698-b8d3-a02bc020c5b9 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?server=de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 956 microversion: 2.1 time: 0.228494 May 07 22:01:29.708093 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1939/3924] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 22:01:29 2022] GET /compute/v2.1/images?server=de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 956 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:29.728534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c5f802e6-4462-4ef9-bec9-a8c53024df11 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c3dd940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:29.760430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:29.761457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:29.775927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:29.778078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:29.791985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:29.792971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:29.821226 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c5f802e6-4462-4ef9-bec9-a8c53024df11 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 484 microversion: 2.1 time: 0.104378 May 07 22:01:29.827817 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1986/3925] 10.222.0.32 () {58 vars in 1316 bytes} [Sat May 7 22:01:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 484 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:29.839007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dbd1cd7d-23ea-4101-8fe5-436ab6be8536 req-13599205-b8d4-4ec2-8328-bde86b36487b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931cb167-5bcb-4aef-8b2b-029dbcb4d7e9", "name": "network-vif-plugged", "status": "completed", "tag": "aa4c2169-baeb-4b6e-a6e2-98691784c4a7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:29.857783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dbd1cd7d-23ea-4101-8fe5-436ab6be8536 req-13599205-b8d4-4ec2-8328-bde86b36487b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:29.859285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dbd1cd7d-23ea-4101-8fe5-436ab6be8536 req-13599205-b8d4-4ec2-8328-bde86b36487b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:29.882277 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dbd1cd7d-23ea-4101-8fe5-436ab6be8536 req-13599205-b8d4-4ec2-8328-bde86b36487b service nova] Creating event network-vif-plugged:aa4c2169-baeb-4b6e-a6e2-98691784c4a7 for instance 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 on nch2-master-1 May 07 22:01:29.889245 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dbd1cd7d-23ea-4101-8fe5-436ab6be8536 req-13599205-b8d4-4ec2-8328-bde86b36487b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065684 May 07 22:01:29.900274 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1987/3926] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:29.922707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6e23796-cf6f-4511-ac8e-af9f27a2cf84 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c3515e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:29.993734 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6e23796-cf6f-4511-ac8e-af9f27a2cf84 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 484 microversion: 2.1 time: 0.091264 May 07 22:01:29.994637 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1988/3927] 10.222.0.32 () {58 vars in 1302 bytes} [Sat May 7 22:01:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 484 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:30.008367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a504d98-ac0b-4e87-8bd3-ea95e1bede0d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c3ddb80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:30.340258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:30.348078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4607d53f-05b1-4ebc-8d0a-934496e871dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.593266 May 07 22:01:30.361328 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1940/3928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:29 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:30.374123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:30.375014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:30.391184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:30.391852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:30.392827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:30.393281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:30.418225 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a504d98-ac0b-4e87-8bd3-ea95e1bede0d tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.416439 May 07 22:01:30.429617 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1989/3929] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 22:01:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:30.436700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de06d29e-8e19-4902-9b8e-7a2a27729dcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "563e3251-764b-419d-8f65-8e94c270df50"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:30.438625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-de06d29e-8e19-4902-9b8e-7a2a27729dcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:30.447192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de06d29e-8e19-4902-9b8e-7a2a27729dcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:30.448274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de06d29e-8e19-4902-9b8e-7a2a27729dcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:30.449863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de06d29e-8e19-4902-9b8e-7a2a27729dcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:30.450530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de06d29e-8e19-4902-9b8e-7a2a27729dcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:30.853928 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de06d29e-8e19-4902-9b8e-7a2a27729dcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422509 May 07 22:01:30.855238 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1990/3930] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:01:30 2022] POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:30.878539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7f03d739-4396-42ba-a34f-5a01c4a2b231 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c3893a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:31.022789 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7f03d739-4396-42ba-a34f-5a01c4a2b231 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.165617 May 07 22:01:31.028533 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1991/3931] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 22:01:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:31.044503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:31.046666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:31.060801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:31.061278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:31.062344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:31.069265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:31.237222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:31.251972 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fc6edc05-921c-4019-be8b-fc7efdedb6a3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1314 microversion: 2.1 time: 0.889222 May 07 22:01:31.252704 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1941/3932] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:30 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:31.258082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7de0471-ff92-4352-aaf6-35a13b7647ce tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d5f4820>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:31.330453 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7de0471-ff92-4352-aaf6-35a13b7647ce tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.076165 May 07 22:01:31.339219 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1942/3933] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 22:01:31 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:31.345247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd03530c-f750-4531-ab29-acc1c2d08102 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caf0a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:31.542319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd03530c-f750-4531-ab29-acc1c2d08102 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/detail?changes-since=2022-05-07T21%3A59%3A16Z" status: 200 len: 6326 microversion: 2.1 time: 0.200660 May 07 22:01:31.546604 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1943/3934] 10.222.0.32 () {58 vars in 1219 bytes} [Sat May 7 22:01:31 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-07T21%3A59%3A16Z => generated 6326 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:31.561215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:31.561879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:31.579490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:31.579960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:31.580775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:31.585639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:31.828219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:31.841521 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-240127d8-309a-4831-bbb5-1ee3b088f97a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.803983 May 07 22:01:31.849168 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1992/3935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:31 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:31.871523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21fdec59-431a-4e68-82a2-91005634cf20 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c351ee0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:31.925807 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21fdec59-431a-4e68-82a2-91005634cf20 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1616310219" status: 200 len: 665 microversion: 2.1 time: 0.074967 May 07 22:01:31.926466 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1993/3936] 10.222.0.32 () {58 vars in 1251 bytes} [Sat May 7 22:01:31 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1616310219 => generated 665 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:31.942401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-273196d0-dd5e-490a-993a-4e3e2ca3e5ce tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41cc50790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.048201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-273196d0-dd5e-490a-993a-4e3e2ca3e5ce tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1464 microversion: 2.1 time: 0.107727 May 07 22:01:32.052488 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1994/3937] 10.222.0.32 () {58 vars in 1337 bytes} [Sat May 7 22:01:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1464 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:32.068273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ca37bb8f-240d-4098-972a-f08da6bc8af0 req-1c71845b-6992-43f3-be78-c58da6b2fb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8141d2fb-0f50-41fb-bce0-7a6c7f7fc949", "name": "network-vif-plugged", "status": "completed", "tag": "2e46252a-79ff-49d8-a0dc-dceb03f5d5ae"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:32.104299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ca37bb8f-240d-4098-972a-f08da6bc8af0 req-1c71845b-6992-43f3-be78-c58da6b2fb24 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:32.105136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ca37bb8f-240d-4098-972a-f08da6bc8af0 req-1c71845b-6992-43f3-be78-c58da6b2fb24 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:32.138921 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ca37bb8f-240d-4098-972a-f08da6bc8af0 req-1c71845b-6992-43f3-be78-c58da6b2fb24 service nova] Creating event network-vif-plugged:2e46252a-79ff-49d8-a0dc-dceb03f5d5ae for instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 on nch2-master-1 May 07 22:01:32.160027 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ca37bb8f-240d-4098-972a-f08da6bc8af0 req-1c71845b-6992-43f3-be78-c58da6b2fb24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105975 May 07 22:01:32.161057 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1995/3938] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:32.171746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-456738f1-afd5-4b0a-98e7-b01e13968b6a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41c2f8af0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.291468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-456738f1-afd5-4b0a-98e7-b01e13968b6a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1464 microversion: 2.1 time: 0.129111 May 07 22:01:32.296014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:32.302552 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1996/3939] 10.222.0.32 () {58 vars in 1323 bytes} [Sat May 7 22:01:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:32.307840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.308706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:32.309076 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13bc1ba9-23b3-4450-9909-c94faa8d9e7d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.757220 May 07 22:01:32.309834 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1944/3940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:31 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:32.317805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:32.318483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:32.319876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:32.320493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:32.324118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3708f398-ba5f-4f27-b36f-b08210b23154 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d3b61f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.468128 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3708f398-ba5f-4f27-b36f-b08210b23154 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.150429 May 07 22:01:32.483729 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1945/3941] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 22:01:32 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:32.494962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18b292d4-bf6c-4110-bf73-33bd40fa6623 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d3b6430>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.601347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:32.605171 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-18b292d4-bf6c-4110-bf73-33bd40fa6623 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.119721 May 07 22:01:32.606440 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1946/3942] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 22:01:32 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:32.615445 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ab82915-05aa-42c1-ad25-ebd94dcc281e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1500 microversion: 2.1 time: 0.311646 May 07 22:01:32.621226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-238b710c-b67b-42f8-a88b-b27ec10f86f8 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caf0280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.628143 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1997/3943] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:32 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1500 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:32.635569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:32.637947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:32.656071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:32.656796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:32.657795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:32.658412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:32.696589 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-238b710c-b67b-42f8-a88b-b27ec10f86f8 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c" status: 200 len: 784 microversion: 2.1 time: 0.081091 May 07 22:01:32.697912 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1947/3944] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:32 2022] GET /compute/v2.1/images/3756ae98-5c12-48e7-920e-ef5d1dd5543c => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:01:32.713170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4dcd4cd4-209b-4639-bb38-1c71278a385a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ca841f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.721699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lazy-loading 'flavor' on Instance uuid 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:01:32.821907 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4dcd4cd4-209b-4639-bb38-1c71278a385a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.107311 May 07 22:01:32.826383 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1948/3945] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 22:01:32 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:32.840607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f914448-db37-4584-b84d-aa2922811a59 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d14b1f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.909220 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-146b40d2-76da-41b9-8766-84b9b9550cd3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "POST /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9/action" status: 200 len: 32 microversion: 2.1 time: 0.278233 May 07 22:01:32.912936 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1998/3946] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:01:32 2022] POST /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:01:32.942743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:32.943750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:32.962827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:32.972060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:32.975807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:32.986246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:33.391392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:33.403874 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9451199f-adc1-4272-9019-446da2652fde tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.487346 May 07 22:01:33.404579 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 1999/3947] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:32 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:33.420621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:33.421702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:33.436340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:33.443225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:33.444315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:33.445026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:33.941201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:33.959881 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb160e85-c4fb-4cad-938f-635dec470fa6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.541185 May 07 22:01:33.969367 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2000/3948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:33 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:33.969367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:33.969367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:33.984543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:33.986880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:33.990276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:33.990952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:34.051895 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f914448-db37-4584-b84d-aa2922811a59 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2" status: 204 len: 0 microversion: 2.1 time: 1.217075 May 07 22:01:34.052489 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1949/3949] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:32 2022] DELETE /compute/v2.1/images/d8d80cf1-7d07-4e19-92dc-4eb97eaf5ac2 => generated 0 bytes in 1218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:01:34.060861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2b928a2-db94-4d1a-9704-b5f86d256e5a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41d4eb3a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:34.585465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:34.594208 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3aa44d47-56e5-4b15-a9fd-2b61742202f9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1367 microversion: 2.1 time: 0.632186 May 07 22:01:34.604630 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2001/3950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:33 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1367 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:34.610374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9262577f-8a94-4f99-bf7a-541d2864bf21 req-66defd4f-ded9-4f15-abe4-66e342d58fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30285c-55a0-4bf5-91e8-9bdd7282f8d7", "name": "network-vif-unplugged", "status": "completed", "tag": "672e9dc5-e9c7-4350-b965-d54d762eb1d8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:34.624064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9262577f-8a94-4f99-bf7a-541d2864bf21 req-66defd4f-ded9-4f15-abe4-66e342d58fa7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:34.624756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9262577f-8a94-4f99-bf7a-541d2864bf21 req-66defd4f-ded9-4f15-abe4-66e342d58fa7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:34.639311 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9262577f-8a94-4f99-bf7a-541d2864bf21 req-66defd4f-ded9-4f15-abe4-66e342d58fa7 service nova] Creating event network-vif-unplugged:672e9dc5-e9c7-4350-b965-d54d762eb1d8 for instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 on nch2-master-1 May 07 22:01:34.645347 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9262577f-8a94-4f99-bf7a-541d2864bf21 req-66defd4f-ded9-4f15-abe4-66e342d58fa7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038887 May 07 22:01:34.646725 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2002/3951] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:34.653276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:34.654408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:34.671155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:34.672192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:34.673173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:34.673779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:34.934704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2b928a2-db94-4d1a-9704-b5f86d256e5a tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580" status: 204 len: 0 microversion: 2.1 time: 0.874275 May 07 22:01:34.936248 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1950/3952] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:34 2022] DELETE /compute/v2.1/images/200e6466-a876-4099-bc31-69c4c76a0580 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:01:34.952840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dcfba6aa-302e-44b6-a19c-2d226e40c602 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41ca84040>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:35.049848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:35.072303 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e6253b84-645b-43f6-8ef4-3bdaedc662bf tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.423358 May 07 22:01:35.073535 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2003/3953] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:34 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:35.085606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:35.087212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:35.094410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:35.095302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:35.100339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:35.100930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:35.835472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:35.848712 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-54fe4b34-6b11-4053-9d96-f4e5a681c730 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.772868 May 07 22:01:35.849947 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2004/3954] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:35 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:35.867026 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dcfba6aa-302e-44b6-a19c-2d226e40c602 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651" status: 204 len: 0 microversion: 2.1 time: 0.925743 May 07 22:01:35.867579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce8af4a6-e5a4-45c4-bce2-90017be26b69 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:35.869395 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1951/3955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:34 2022] DELETE /compute/v2.1/images/edc82ef6-ae3c-44c6-bd59-5fd636491651 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:35.879270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:35.880807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:35.881946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8af4a6-e5a4-45c4-bce2-90017be26b69 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:35.884511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8af4a6-e5a4-45c4-bce2-90017be26b69 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:35.898850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:35.899542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:35.900456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:35.900910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:35.945948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce8af4a6-e5a4-45c4-bce2-90017be26b69 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:01:36.061223 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce8af4a6-e5a4-45c4-bce2-90017be26b69 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action" status: 202 len: 0 microversion: 2.1 time: 0.209557 May 07 22:01:36.062425 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2005/3956] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:01:35 2022] POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:01:36.112585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:36.114032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:36.124032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.124516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.125301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.127428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.162198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:01:36.353714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:36.371706 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-45204635-b550-4270-b414-1fe748b6320d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1558 microversion: 2.1 time: 0.499290 May 07 22:01:36.374015 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1952/3957] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:35 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1558 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:36.375685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-400f03ae-3d19-4711-bef3-ee84452a2a63 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 204 len: 0 microversion: 2.1 time: 0.298294 May 07 22:01:36.376575 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2006/3958] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:01:36 2022] DELETE /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:36.395263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:36.396815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:36.397877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:36.403263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:36.418077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.418553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.421042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.421677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.433476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.434461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.435605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.436472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.782632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:36.792392 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f52dcd64-5ae9-45c1-a099-0d2837622cd5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.414154 May 07 22:01:36.792998 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2007/3959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:36 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:36.814811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:36.815440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:36.831689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.832365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.833543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.834145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.923337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:36.947238 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31612f2e-ada0-4de3-80bf-695322feaed5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1725 microversion: 2.1 time: 0.565446 May 07 22:01:36.948545 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1953/3960] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:36 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1725 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:36.955675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-34285ae7-5809-4543-9d08-e0e03cfe6d11 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:36.956184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-34285ae7-5809-4543-9d08-e0e03cfe6d11 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:36.967739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34285ae7-5809-4543-9d08-e0e03cfe6d11 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.968211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34285ae7-5809-4543-9d08-e0e03cfe6d11 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:36.969143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34285ae7-5809-4543-9d08-e0e03cfe6d11 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:36.969782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-34285ae7-5809-4543-9d08-e0e03cfe6d11 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:37.122931 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-34285ae7-5809-4543-9d08-e0e03cfe6d11 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173077 May 07 22:01:37.123858 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1954/3961] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:01:36 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:37.230744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:37.245953 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b33e91f-750d-4408-ba2b-61c642165d35 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1472 microversion: 2.1 time: 0.448896 May 07 22:01:37.248222 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2008/3962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:36 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1472 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:37.261809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:37.264911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:37.282035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:37.283319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:37.288263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:37.288967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:37.357184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-10383a24-af93-42b6-8dae-4c5704282c58 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'create', calling method: .version_select at 0x7fc41d088af0>, body: {"keypair": {"name": "tempest-keypair-99976929"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:37.375268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-10383a24-af93-42b6-8dae-4c5704282c58 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for project 759c66c34f414c19b2109393738ef639. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:01:37.390387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-10383a24-af93-42b6-8dae-4c5704282c58 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for user 8cdc0c878f6e4e5da2a2848d63a02f0d and project 759c66c34f414c19b2109393738ef639. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:01:37.638637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-10383a24-af93-42b6-8dae-4c5704282c58 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for project 759c66c34f414c19b2109393738ef639. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:01:37.648869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-10383a24-af93-42b6-8dae-4c5704282c58 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for user 8cdc0c878f6e4e5da2a2848d63a02f0d and project 759c66c34f414c19b2109393738ef639. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:01:37.683822 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-10383a24-af93-42b6-8dae-4c5704282c58 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.558827 May 07 22:01:37.685183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1955/3963] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:01:37 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:37.733352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:37.741389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6c6f355-384b-4d8a-9aab-f48f69d061c1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.491860 May 07 22:01:37.750904 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2009/3964] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:37 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:37.809064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:37.809705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:37.827592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:37.828064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:37.828882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:37.832679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:37.964312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:37.965302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:37.989110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:37.990338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:37.996104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:38.001981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:38.362201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:38.375996 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e486ab6b-215d-4873-b067-6d137c3169b1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1522 microversion: 2.1 time: 0.570204 May 07 22:01:38.378512 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1956/3965] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:37 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:38.397097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:38.398812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:38.416065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:38.416784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:38.417781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:38.421429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:38.621082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:38.635755 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-46cf50b5-fe8a-4f72-8b3f-7e7b920df6b7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1725 microversion: 2.1 time: 0.675442 May 07 22:01:38.653124 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2010/3966] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:37 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1725 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:38.762170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:38.762827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:38.779782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:38.781607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:38.784694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:38.785528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:38.815314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:38.824334 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7013e1b9-25e5-4c68-a671-e46cf0645574 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1472 microversion: 2.1 time: 0.443058 May 07 22:01:38.827495 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1957/3967] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:38 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:39.376915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6cb68c1f-7715-4866-84b8-c547bf056867 req-d60bccc6-76f7-422f-be62-282b561d0d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5d0aa6-f907-4569-bedc-2979f6637d33", "name": "network-vif-deleted", "tag": "73e10226-084a-4235-a376-31a716d63e44"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:39.385742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6cb68c1f-7715-4866-84b8-c547bf056867 req-d60bccc6-76f7-422f-be62-282b561d0d3f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.386811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6cb68c1f-7715-4866-84b8-c547bf056867 req-d60bccc6-76f7-422f-be62-282b561d0d3f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.407525 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6cb68c1f-7715-4866-84b8-c547bf056867 req-d60bccc6-76f7-422f-be62-282b561d0d3f service nova] Creating event network-vif-deleted:73e10226-084a-4235-a376-31a716d63e44 for instance 5d5d0aa6-f907-4569-bedc-2979f6637d33 on nch2-master-1 May 07 22:01:39.414358 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6cb68c1f-7715-4866-84b8-c547bf056867 req-d60bccc6-76f7-422f-be62-282b561d0d3f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155539 May 07 22:01:39.416177 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1958/3968] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:39.424634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:39.426147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:39.433572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.434111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.435019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.435528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.603020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:39.624061 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc5c96ed-22d7-4f1f-91e0-bb18b8bab5cd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.865790 May 07 22:01:39.626903 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2011/3969] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:38 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:39.668649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:39.669263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:39.671124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:39.681838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.682680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.684048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.684728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.709129 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f15c55a6-66ac-429f-aec2-78aea5bd2e8d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1499 microversion: 2.1 time: 0.291166 May 07 22:01:39.709723 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1959/3970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:39 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:39.737732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:39.745335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:39.746467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:39.761887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.770094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.771307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.771919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.832534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:39.902246 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bbd109b7-9b21-4151-86ad-2a84e03bbbdc tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.168231 May 07 22:01:39.905002 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1960/3971] 10.222.0.32 () {58 vars in 1153 bytes} [Sat May 7 22:01:39 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:01:39.916399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:39.917279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:39.931436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.932646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:39.933560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:39.935685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:40.017899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:40.018731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:40.019552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lazy-loading 'fault' on Instance uuid 5d5d0aa6-f907-4569-bedc-2979f6637d33 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:01:40.139078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:40.147737 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d9e1859-b1be-4ae3-bd96-ecb2e616497f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 200 len: 1308 microversion: 2.1 time: 0.241386 May 07 22:01:40.152855 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1961/3972] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:39 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:40.158325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e9e923e8-81fa-476d-b219-0886fa9760a3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:40.193755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9e923e8-81fa-476d-b219-0886fa9760a3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:40.194021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9e923e8-81fa-476d-b219-0886fa9760a3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:40.248510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e9e923e8-81fa-476d-b219-0886fa9760a3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Going to try to start instance {{(pid=136681) start /opt/stack/nova/nova/compute/api.py:2730}} May 07 22:01:40.366033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e9e923e8-81fa-476d-b219-0886fa9760a3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "POST /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811/action" status: 202 len: 0 microversion: 2.1 time: 0.211687 May 07 22:01:40.367180 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1962/3973] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:01:40 2022] POST /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:01:40.378284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:40.379699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:40.398121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:40.399381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:40.402207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:40.403320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:40.681323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:40.688240 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63a7bae5-922b-4f05-a700-8a23863bc51b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1725 microversion: 2.1 time: 1.033885 May 07 22:01:40.688969 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2012/3974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:39 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1725 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:40.695485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:40.696378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:40.705460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:40.706022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:40.707084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:40.707609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:40.742237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:40.757734 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80ade643-6ef6-4e85-8285-466600f749dd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1508 microversion: 2.1 time: 0.384621 May 07 22:01:40.758397 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1963/3975] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:40 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1508 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:41.164628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:41.165252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: 5d5d0aa6-f907-4569-bedc-2979f6637d33] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:41.171400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:41.171851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:41.172625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:41.173071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:41.205084 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] HTTP exception thrown: Instance 5d5d0aa6-f907-4569-bedc-2979f6637d33 could not be found. May 07 22:01:41.205968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Returning 404 to user: Instance 5d5d0aa6-f907-4569-bedc-2979f6637d33 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:01:41.207077 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bf403df0-2987-47da-8480-2f9ca31f7fdc tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33" status: 404 len: 111 microversion: 2.1 time: 0.046316 May 07 22:01:41.207814 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1964/3976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:41 2022] GET /compute/v2.1/servers/5d5d0aa6-f907-4569-bedc-2979f6637d33 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:01:41.223000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-701420757", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33b52409-fae0-4935-b5d0-15acefaa0f3f"}], "security_groups": [{"name": "tempest-securitygroup--1924358836"}], "key_name": "tempest-keypair-99976929", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:41.267973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:41.280918 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d118b269-e7b4-4ca3-a937-049fe1b313ea tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.589914 May 07 22:01:41.281878 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2013/3977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:40 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:41.287014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:41.287770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:41.295236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:41.296152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:41.297261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:41.297899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:41.330170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:01:41.427823 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-063a6a4a-5eb8-454e-bb0c-94ad2650c414 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 204 len: 0 microversion: 2.1 time: 0.143852 May 07 22:01:41.429041 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2014/3978] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:01:41 2022] DELETE /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:41.443689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:41.444835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:41.453875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:41.454454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:41.455446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:41.456578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:41.700821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] validate_networks() for [('33b52409-fae0-4935-b5d0-15acefaa0f3f', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:01:42.123480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:42.141581 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64b9d881-4c7e-4a78-83b7-a80ef6d571f5 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1472 microversion: 2.1 time: 0.707242 May 07 22:01:42.148204 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2015/3979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:41 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1472 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:42.153463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:42.154090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:42.171540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:42.172001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:42.173377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:42.173377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:42.770490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:01:42.771068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:01:42.771672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:01:42.772118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:01:42.772688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:01:42.788208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:42.788809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:42.789699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:42.790155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:42.817882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:01:42.826410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for user 8cdc0c878f6e4e5da2a2848d63a02f0d and project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:01:42.844494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:01:42.846870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:01:42.937371 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-879866ea-3686-47bf-bf1e-5a72c4b79c8e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.727854 May 07 22:01:42.937981 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1965/3980] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:01:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:01:42.943349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:42.943349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:42.953594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:42.955852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:42.958650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:42.959399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:43.106307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:43.116559 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7526266a-e3a8-4525-8e03-7fc4154c94ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1725 microversion: 2.1 time: 0.967289 May 07 22:01:43.120502 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2016/3981] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:42 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1725 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:43.286536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a488eedd-40e9-466c-8efc-6dbe804ae13a req-38c71d8b-8cc3-4c79-80a7-e26179539066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8141d2fb-0f50-41fb-bce0-7a6c7f7fc949", "tag": "2e46252a-79ff-49d8-a0dc-dceb03f5d5ae"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:43.308097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a488eedd-40e9-466c-8efc-6dbe804ae13a req-38c71d8b-8cc3-4c79-80a7-e26179539066 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:43.308836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a488eedd-40e9-466c-8efc-6dbe804ae13a req-38c71d8b-8cc3-4c79-80a7-e26179539066 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:43.337560 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a488eedd-40e9-466c-8efc-6dbe804ae13a req-38c71d8b-8cc3-4c79-80a7-e26179539066 service nova] Creating event network-changed:2e46252a-79ff-49d8-a0dc-dceb03f5d5ae for instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 on nch2-master-1 May 07 22:01:43.357593 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a488eedd-40e9-466c-8efc-6dbe804ae13a req-38c71d8b-8cc3-4c79-80a7-e26179539066 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234908 May 07 22:01:43.359211 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2017/3982] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:43.383613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:43.387431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:43.408098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:43.408610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:43.411637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:43.412095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:43.435020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:43.449148 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4ab35b1d-a120-4701-bc4c-ce0b64e35b7b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1508 microversion: 2.1 time: 0.509921 May 07 22:01:43.460262 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1966/3983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:42 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:43.465972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-224d01ff-9f1c-4d2d-ba1e-9403f80d3448 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:43.466908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-224d01ff-9f1c-4d2d-ba1e-9403f80d3448 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:43.557364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-224d01ff-9f1c-4d2d-ba1e-9403f80d3448 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:43.574116 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-224d01ff-9f1c-4d2d-ba1e-9403f80d3448 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1236 microversion: 2.1 time: 0.112232 May 07 22:01:43.581594 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1967/3984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:43 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1236 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:43.627265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:43.631250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:43.647678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:43.650506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:43.651537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:43.654239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.074684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:44.089259 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6f0224de-c13e-470c-9951-e598ad58e02c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.728478 May 07 22:01:44.090220 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2018/3985] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:43 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:44.136489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:44.137788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:44.153402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.169166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.172384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.174438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.253211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:44.269285 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be8ac11f-0c23-4f5c-be7b-3ff79ee91116 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1472 microversion: 2.1 time: 0.658898 May 07 22:01:44.271106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1968/3986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:43 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1472 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:44.466757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:44.467660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:44.474717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.475527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.476528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.477742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.530483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:44.538812 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0569438-32de-442b-b622-32e5e614e6fe tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1725 microversion: 2.1 time: 0.408012 May 07 22:01:44.551720 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2019/3987] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:44 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1725 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:44.603998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:44.604765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:44.615484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.616295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.617705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.629194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.848318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:44.859353 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-339e39f1-8d97-4d09-8cea-1b77303effc2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1296 microversion: 2.1 time: 0.263979 May 07 22:01:44.869736 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2020/3988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:44 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1296 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:44.954215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:44.968275 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61b85e36-038c-4f50-833f-b5bda7d3e5c8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1512 microversion: 2.1 time: 0.506534 May 07 22:01:44.969500 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1969/3989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:44 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1512 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:44.987435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:44.991673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:44.992133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.compute.servers [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Removing options 'limit' from query {{(pid=136682) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 07 22:01:44.992964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:44.997849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.998431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:44.999379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:44.999829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.005848 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3e31bf47-4bf1-4bbf-8a76-56393aae30d9 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.022026 May 07 22:01:45.009485 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2021/3990] 10.222.0.32 () {58 vars in 1139 bytes} [Sat May 7 22:01:44 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:01:45.019545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:45.020442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:45.033779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.034478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.035468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.036423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.120147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:45.121046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:45.135767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.136285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.137124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.137575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.381485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:45.396177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a06eb4e-a0e7-40a0-b894-0f0c018ae3b5 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.279701 May 07 22:01:45.397739 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2022/3991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:45 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:45.402986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:45.404419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:45.413950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.414933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.415957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.416639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.515376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:45.524181 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab0973d6-b7c9-4fd1-bb4b-ceaf02fa753f tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1430 microversion: 2.1 time: 0.125033 May 07 22:01:45.534171 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2023/3992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:45 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1430 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:45.560752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:45.561152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:45.568528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.569223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.570088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.570627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.807422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:45.821662 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7c3749f-1341-465b-80c0-f284a933f1ff tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1725 microversion: 2.1 time: 0.264038 May 07 22:01:45.835985 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2024/3993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:45 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:45.877916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:45.879000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:45.887573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.888286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:45.889448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:45.890107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.238802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:46.243705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:46.248979 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f0e03e32-8dfd-41c5-a472-a5c15522f74b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1512 microversion: 2.1 time: 1.234803 May 07 22:01:46.252395 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1970/3994] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:45 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1512 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:46.257471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f613861c-64d0-4130-a426-bcb41abf130f req-c78939fc-ff7c-42d7-a625-672eb3a2d1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de30285c-55a0-4bf5-91e8-9bdd7282f8d7", "name": "network-vif-deleted", "tag": "672e9dc5-e9c7-4350-b965-d54d762eb1d8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:46.260114 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ebd3523-d205-425d-a78d-0719d4669b3a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.378763 May 07 22:01:46.268149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f613861c-64d0-4130-a426-bcb41abf130f req-c78939fc-ff7c-42d7-a625-672eb3a2d1a1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.269822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f613861c-64d0-4130-a426-bcb41abf130f req-c78939fc-ff7c-42d7-a625-672eb3a2d1a1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.273444 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2025/3995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:45 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:46.280303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:46.281277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:46.284480 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f613861c-64d0-4130-a426-bcb41abf130f req-c78939fc-ff7c-42d7-a625-672eb3a2d1a1 service nova] Creating event network-vif-deleted:672e9dc5-e9c7-4350-b965-d54d762eb1d8 for instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 on nch2-master-1 May 07 22:01:46.288985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.290010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.290143 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f613861c-64d0-4130-a426-bcb41abf130f req-c78939fc-ff7c-42d7-a625-672eb3a2d1a1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035703 May 07 22:01:46.290732 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1971/3996] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:46.291716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.292164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.421312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:46.422046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:46.433503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.433952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.435110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.435710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.658228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:46.670601 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ef53a02-7e34-44a9-82b0-215095bc8efb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 200 len: 1512 microversion: 2.1 time: 0.394953 May 07 22:01:46.671204 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2026/3997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:46 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:46.689404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:46.690165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:46.707064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.707707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.708695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.709287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.754399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.755174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.755798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lazy-loading 'fault' on Instance uuid de30285c-55a0-4bf5-91e8-9bdd7282f8d7 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:01:46.780922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:46.790848 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-36685834-7951-4f95-a620-05e866a3e2e7 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.379882 May 07 22:01:46.792179 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1972/3998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:46 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:46.804833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:46.807628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:46.827718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.827718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.827718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.827718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.836007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0de8764373461eaad7ac7b5f3eba3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:46.844486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a132492f-b0f4-464a-b32b-00244455954c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 200 len: 1308 microversion: 2.1 time: 0.160160 May 07 22:01:46.845071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2027/3999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:46 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:46.861481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:46.862100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:46.873452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.874453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:46.875373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:46.876347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:47.069466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:47.090862 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-73c6d54b-d847-4d50-a4d0-c5c73f9e4594 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1702 microversion: 2.1 time: 0.238986 May 07 22:01:47.092051 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2028/4000] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:46 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1702 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:47.115765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af04d66c-3e2e-4181-a2f4-b35c1ccde791 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:47.133503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af04d66c-3e2e-4181-a2f4-b35c1ccde791 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:47.134794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af04d66c-3e2e-4181-a2f4-b35c1ccde791 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:47.171051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af04d66c-3e2e-4181-a2f4-b35c1ccde791 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Going to try to start instance {{(pid=136682) start /opt/stack/nova/nova/compute/api.py:2730}} May 07 22:01:47.249012 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af04d66c-3e2e-4181-a2f4-b35c1ccde791 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action" status: 202 len: 0 microversion: 2.1 time: 0.144017 May 07 22:01:47.250424 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2029/4001] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:01:47 2022] POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:01:47.263087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:47.263903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:47.271387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:47.271957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:47.273540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:47.274248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:47.324091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:47.336401 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b8844931-9695-4a9f-afa4-0a49d6e98cc2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1512 microversion: 2.1 time: 0.542345 May 07 22:01:47.348453 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1973/4002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:46 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:47.354026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:47.354658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:47.363985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:47.365025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:47.365844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:47.366296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:47.711732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:47.721955 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8135da3-4c4c-4937-9f50-798e9b5f4638 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.372363 May 07 22:01:47.722734 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1974/4003] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:47 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:47.736300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:47.741850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:47.743017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:47.810629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:47.821709 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d041a7ef-3738-4988-b6dc-f9ff605f5415 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1711 microversion: 2.1 time: 0.567144 May 07 22:01:47.823332 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2030/4004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:47 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1711 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:47.837761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:47.838643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:47.845324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:47.845886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:47.846750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:47.847319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.013152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.013616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.014439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.014913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.111021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:48.206921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54533ec2-8ae7-470e-bf3f-8bb94bcbfb0b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.482596 May 07 22:01:48.208449 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1975/4005] 10.222.0.32 () {58 vars in 1153 bytes} [Sat May 7 22:01:47 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:48.220182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:48.227538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] [instance: de30285c-55a0-4bf5-91e8-9bdd7282f8d7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:48.240263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.241877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.243454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.243942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.276311 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] HTTP exception thrown: Instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 could not be found. May 07 22:01:48.276944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Returning 404 to user: Instance de30285c-55a0-4bf5-91e8-9bdd7282f8d7 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:01:48.277824 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-066c589a-b856-480f-95b9-b0c994032d1e tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7" status: 404 len: 111 microversion: 2.1 time: 0.064795 May 07 22:01:48.278411 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1976/4006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:48 2022] GET /compute/v2.1/servers/de30285c-55a0-4bf5-91e8-9bdd7282f8d7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:01:48.294621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:48.295625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:48.309136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.309782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.310599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.311068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.416661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:48.433187 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e00f087a-5e5c-499e-b15f-1a048a67af27 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.600209 May 07 22:01:48.433895 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2031/4007] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:47 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:48.448174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a367e49-8a35-4707-b678-c442f99bf47c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc40fef5ca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:48.828058 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a367e49-8a35-4707-b678-c442f99bf47c tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/images/67f03483-e421-4171-b320-97965d840a86" status: 204 len: 0 microversion: 2.1 time: 0.390233 May 07 22:01:48.828665 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2032/4008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:48 2022] DELETE /compute/v2.1/images/67f03483-e421-4171-b320-97965d840a86 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:48.842746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5e422f56-4385-41da-bb33-c4f426d12fc4 req-4045b84a-c2c5-49b0-b6da-9e20f8ac06db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:48.851853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5e422f56-4385-41da-bb33-c4f426d12fc4 req-4045b84a-c2c5-49b0-b6da-9e20f8ac06db service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.852715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5e422f56-4385-41da-bb33-c4f426d12fc4 req-4045b84a-c2c5-49b0-b6da-9e20f8ac06db service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.866120 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5e422f56-4385-41da-bb33-c4f426d12fc4 req-4045b84a-c2c5-49b0-b6da-9e20f8ac06db service nova] Creating event network-changed:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:01:48.875171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5e422f56-4385-41da-bb33-c4f426d12fc4 req-4045b84a-c2c5-49b0-b6da-9e20f8ac06db service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039864 May 07 22:01:48.875171 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2033/4009] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:48.880252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:48.881142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:48.888574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.889142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:48.890029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:48.890556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.227111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:49.248408 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-572c4a65-7cf8-45a3-8341-5ce496d58031 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1512 microversion: 2.1 time: 0.965853 May 07 22:01:49.251261 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1977/4010] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:48 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1512 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:49.257223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-896f3de5-dadb-4d9d-b13c-6f469560b057 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc41caf0e50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:49.260857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:49.274100 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3786791-1112-4528-b29c-7a5833967bb7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.399394 May 07 22:01:49.276293 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2034/4011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:48 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:49.284563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:49.286125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:49.300585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.301378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.302651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.303518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.475940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:49.488218 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-328f6796-cea5-4231-a798-eaa6a77ae99c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1711 microversion: 2.1 time: 0.209145 May 07 22:01:49.500922 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2035/4012] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:49 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1711 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:49.513474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:49.514151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:49.521364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.522542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.523384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.524005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.593680 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-896f3de5-dadb-4d9d-b13c-6f469560b057 tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/images/27a99201-de89-474f-8d04-3b599ba212d2" status: 204 len: 0 microversion: 2.1 time: 0.338430 May 07 22:01:49.593680 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1978/4013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:49 2022] DELETE /compute/v2.1/images/27a99201-de89-474f-8d04-3b599ba212d2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:49.599250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:49.600132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:49.608299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.608815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.610030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.610816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.749505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:49.759099 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41f4a4f7-5c13-4202-84eb-4673aca33d3b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 200 len: 1512 microversion: 2.1 time: 0.250393 May 07 22:01:49.760641 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2036/4014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:49 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:49.771991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0aee5159-5c69-4242-92e1-dc05320dfede tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] Calling method '.version_select at 0x7fc40fe6f3a0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:49.888756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:49.898374 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12626d8c-ade3-4163-a426-27e6471614fb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.304592 May 07 22:01:49.899539 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1979/4015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:49 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:49.907066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:49.907707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:49.920025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.920747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:49.921676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:49.922292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.062350 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0aee5159-5c69-4242-92e1-dc05320dfede tempest-ListImageFiltersTestJSON-360862580 tempest-ListImageFiltersTestJSON-360862580-project] 10.222.0.32 "DELETE /compute/v2.1/images/6547f23a-a39f-4460-8494-684f9a6b66aa" status: 204 len: 0 microversion: 2.1 time: 0.299670 May 07 22:01:50.062967 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2037/4016] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:49 2022] DELETE /compute/v2.1/images/6547f23a-a39f-4460-8494-684f9a6b66aa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:50.165392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:50.176769 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f32da9fd-76cf-4cb6-a9d0-505e6d9610bb tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1512 microversion: 2.1 time: 0.275019 May 07 22:01:50.177644 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1980/4017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:49 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:50.193437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:50.198214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:50.200867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:50.209644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.210650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.212986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.213609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.267709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:50.295446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:50.298004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:50.308232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:50.309093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.309606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.311663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.312386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.316993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.317697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.515638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:50.527977 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7be5f8cd-89f0-4dde-9181-572021c1e0b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.236053 May 07 22:01:50.529108 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1981/4018] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:50 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:50.542217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:50.544545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:50.556134 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-973db570-0d7d-492c-974b-123f508e4fe4 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.366874 May 07 22:01:50.557151 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2038/4019] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 22:01:50 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:50.566962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.566962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.566962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.566962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.580283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:50.585666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:50.586634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:50.793953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.794934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.795929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.796622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.836690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:50.844623 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee68a47d-69ff-4e24-94b2-e546606e4a00 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1715 microversion: 2.1 time: 0.314348 May 07 22:01:50.845849 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1982/4020] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:50 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1715 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:50.903220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:50.915799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:50.916777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:50.924314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.925035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.926167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:50.926874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:50.981869 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d414314f-d0a4-43c7-ba44-eddc98103dae tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.406657 May 07 22:01:50.987891 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2039/4021] 10.222.0.32 () {58 vars in 1149 bytes} [Sat May 7 22:01:50 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:51.000969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:51.005430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:51.006364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:51.012525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.013181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.014189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.014829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.105243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:51.110730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:51.119982 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f3379ac7-3a4b-4f75-ba3b-101dfd32f2e1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.208561 May 07 22:01:51.121200 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1983/4022] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:50 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:51.462873 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd9fd89f-d6ad-49d7-a034-24051825ff40 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.467028 May 07 22:01:51.466331 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2040/4023] 10.222.0.32 () {58 vars in 1211 bytes} [Sat May 7 22:01:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:51.475058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:51.479966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:51.482969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:51.497003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.498207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.499550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.501789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.546510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:51.547524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:51.557293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.558856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.560642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.561656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.713736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:51.839252 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8d210dd6-2ce3-4514-935d-ec967132df1a tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.365317 May 07 22:01:51.841810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1984/4024] 10.222.0.32 () {58 vars in 1195 bytes} [Sat May 7 22:01:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:51.853392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:51.863607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:51.864828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'name': '1216157588', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:51.876369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.877441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.880818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:51.881394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:51.908769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:51.937239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d86e9d9e-c35b-4a19-9182-920b243a0f72 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.394922 May 07 22:01:51.943140 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2041/4025] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:51 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:52.020664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:52.138123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:52.138757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:52.145882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.146354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.147179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.147630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.173399 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ebec1a88-f0f7-4a91-bf17-328b50eebf51 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?name=1216157588" status: 200 len: 346 microversion: 2.1 time: 0.325164 May 07 22:01:52.180704 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1985/4026] 10.222.0.32 () {58 vars in 1155 bytes} [Sat May 7 22:01:51 2022] GET /compute/v2.1/servers?name=1216157588 => generated 346 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:52.192629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:52.208163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:52.210120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:52.222156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.223458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.225839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.226292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.378267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:52.456713 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d38ce287-2e26-4ccd-8401-37e37339cbd6 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.268392 May 07 22:01:52.457913 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1986/4027] 10.222.0.32 () {58 vars in 1153 bytes} [Sat May 7 22:01:52 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:52.471635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:52.474931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:52.475573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:52.476433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-121615758', 'deleted': False, 'project_id': '169e1e6f26414e3eaa454bc14100fece'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:01:52.485214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.485680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.486077 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5663ed86-c85f-4332-bf7e-776e7a15d246 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.351687 May 07 22:01:52.486483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.487143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.495778 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2042/4028] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:52 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:52.622503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:01:52.706070 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f012625-0d2c-4244-8ae3-25f013b9feb1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-121615758" status: 200 len: 346 microversion: 2.1 time: 0.241136 May 07 22:01:52.707531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1987/4029] 10.222.0.32 () {58 vars in 1227 bytes} [Sat May 7 22:01:52 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-121615758 => generated 346 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:52.725361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:52.728317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:52.741029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.743807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.744662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.746912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.790390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:01:52.804235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22604700-2f53-4d0d-86b2-8a6e4281ebad tempest-AbsoluteLimitsTestJSON-1491143788 tempest-AbsoluteLimitsTestJSON-1491143788-project] Calling method '.version_select at 0x7fc41c2f80d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:52.825303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22604700-2f53-4d0d-86b2-8a6e4281ebad tempest-AbsoluteLimitsTestJSON-1491143788 tempest-AbsoluteLimitsTestJSON-1491143788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.826227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22604700-2f53-4d0d-86b2-8a6e4281ebad tempest-AbsoluteLimitsTestJSON-1491143788 tempest-AbsoluteLimitsTestJSON-1491143788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.829254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22604700-2f53-4d0d-86b2-8a6e4281ebad tempest-AbsoluteLimitsTestJSON-1491143788 tempest-AbsoluteLimitsTestJSON-1491143788-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.829883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22604700-2f53-4d0d-86b2-8a6e4281ebad tempest-AbsoluteLimitsTestJSON-1491143788 tempest-AbsoluteLimitsTestJSON-1491143788-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.880477 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-22604700-2f53-4d0d-86b2-8a6e4281ebad tempest-AbsoluteLimitsTestJSON-1491143788 tempest-AbsoluteLimitsTestJSON-1491143788-project] 10.222.0.32 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.249251 May 07 22:01:52.881081 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2043/4030] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:01:52.923193 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bcc46a28-299f-4429-9fcf-230df678f9c0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "DELETE /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 204 len: 0 microversion: 2.1 time: 0.206459 May 07 22:01:52.924102 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1988/4031] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:01:52 2022] DELETE /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:52.933488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:52.934437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:52.942796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.943937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.945565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.946247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.956209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:52.957307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:52.981002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.982008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:52.984246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:52.986686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:53.145869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:53.160232 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-26805ddb-ea0d-4624-bc9c-96e587d9fb4b tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1518 microversion: 2.1 time: 0.231956 May 07 22:01:53.161726 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2044/4032] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:52 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:53.200049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:53.208308 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dced6e2f-3395-47ce-a294-f1f26b8384e6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.257809 May 07 22:01:53.219119 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1989/4033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:52 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:53.503707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:53.504913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:53.512712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:53.514397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:53.515729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:53.517000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:54.177509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:54.178136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:54.199177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:54.199656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:54.200436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:54.201067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:54.290091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:54.323418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fd0d6d0e-6e75-4505-b929-b7842fe60d11 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.804830 May 07 22:01:54.328516 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2045/4034] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:53 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:54.335428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:54.337252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:54.354750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:54.355286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:54.356655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:54.357423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:54.478856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:54.493424 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12f27028-0396-42c3-8ca2-dbad99350254 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1518 microversion: 2.1 time: 0.318964 May 07 22:01:54.494034 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1990/4035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:54 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1518 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:54.834963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:54.848583 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2df4b959-892a-4366-a614-2376e04a011e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.515503 May 07 22:01:54.849201 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2046/4036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:54 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:55.307231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-863f071b-e7a5-4724-8931-b14c6f854f96 req-e0fe810b-ab35-4256-b1c5-5d35e2409da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ba773a-10d4-4c62-b1a6-a64c236b6bff", "name": "network-vif-deleted", "tag": "90263e81-473d-4dcc-9c1f-3f7af137021b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:55.336466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-863f071b-e7a5-4724-8931-b14c6f854f96 req-e0fe810b-ab35-4256-b1c5-5d35e2409da4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.336466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-863f071b-e7a5-4724-8931-b14c6f854f96 req-e0fe810b-ab35-4256-b1c5-5d35e2409da4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.348092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:55.348708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:55.385449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.385939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.389209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.390424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.393434 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-863f071b-e7a5-4724-8931-b14c6f854f96 req-e0fe810b-ab35-4256-b1c5-5d35e2409da4 service nova] Creating event network-vif-deleted:90263e81-473d-4dcc-9c1f-3f7af137021b for instance 77ba773a-10d4-4c62-b1a6-a64c236b6bff on nch2-master-1 May 07 22:01:55.411348 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-863f071b-e7a5-4724-8931-b14c6f854f96 req-e0fe810b-ab35-4256-b1c5-5d35e2409da4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118465 May 07 22:01:55.412850 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1991/4037] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:55.513625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:55.514688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:55.560641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.562987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.569003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.571069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.667164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.667888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.669855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lazy-loading 'fault' on Instance uuid 77ba773a-10d4-4c62-b1a6-a64c236b6bff {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:01:55.779903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:55.791102 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c18d098f-c321-406c-a625-ae82c1477cdf tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.448234 May 07 22:01:55.794370 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2047/4038] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:55 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:55.810834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-42874d7e-b311-4a7f-9aec-4e388c3ce8aa req-99a900af-1936-485d-8170-5c437729cd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-plugged", "status": "completed", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:55.826112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:55.837708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-42874d7e-b311-4a7f-9aec-4e388c3ce8aa req-99a900af-1936-485d-8170-5c437729cd4a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.838126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-42874d7e-b311-4a7f-9aec-4e388c3ce8aa req-99a900af-1936-485d-8170-5c437729cd4a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.846031 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9f9907d8-6b62-4ad6-bd88-66083bc8a382 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 200 len: 1310 microversion: 2.1 time: 0.338169 May 07 22:01:55.863325 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1992/4039] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:55 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:55.876139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:55.878896 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-42874d7e-b311-4a7f-9aec-4e388c3ce8aa req-99a900af-1936-485d-8170-5c437729cd4a service nova] Creating event network-vif-plugged:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:01:55.881320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:55.900012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.900495 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-42874d7e-b311-4a7f-9aec-4e388c3ce8aa req-99a900af-1936-485d-8170-5c437729cd4a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089658 May 07 22:01:55.901352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:55.901497 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2048/4040] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:01:55.905696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:55.907150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:56.255055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:56.269718 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-652ca02a-839e-4f5c-a4b7-c3f63b007fed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.401350 May 07 22:01:56.272694 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1993/4041] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:55 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:56.821870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:56.824804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:56.836852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:56.838180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:56.840902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:56.842847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:56.873609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:56.874254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 77ba773a-10d4-4c62-b1a6-a64c236b6bff] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:56.886405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:56.888296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:56.892416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:56.893131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:56.937781 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] HTTP exception thrown: Instance 77ba773a-10d4-4c62-b1a6-a64c236b6bff could not be found. May 07 22:01:56.940008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Returning 404 to user: Instance 77ba773a-10d4-4c62-b1a6-a64c236b6bff could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:01:56.942575 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-19e7ff19-e140-4c0c-90c4-9db5618005e0 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff" status: 404 len: 111 microversion: 2.1 time: 0.074059 May 07 22:01:56.947135 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1994/4042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:56 2022] GET /compute/v2.1/servers/77ba773a-10d4-4c62-b1a6-a64c236b6bff => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:01:56.952432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:56.953140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:56.959502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:56.960190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:56.961710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:56.963322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:57.004346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:01:57.167573 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9bc74a5e-e393-4857-a891-f05ba486ab66 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 204 len: 0 microversion: 2.1 time: 0.218606 May 07 22:01:57.168648 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1995/4043] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:01:56 2022] DELETE /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:01:57.177959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:57.179183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:57.187010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:57.187951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:57.189116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:57.189765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:57.361642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:57.384321 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6523406-36cc-430e-b9a6-072927a771c8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.575260 May 07 22:01:57.385867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2049/4044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:56 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:01:57.393592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:57.394436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:57.433034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:57.434862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:57.435793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:57.436343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:57.454518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:57.469384 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6cef4699-d957-4fe4-ab88-99ab501e5af1 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 200 len: 1518 microversion: 2.1 time: 0.295765 May 07 22:01:57.472068 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1996/4045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:57 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 1518 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:57.822618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1834854432", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "b8c5cd68-631f-446d-9bed-fb4205a5cef7"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:01:57.911072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] validate_networks() for [('b8c5cd68-631f-446d-9bed-fb4205a5cef7', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:01:57.913351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:57.938089 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-241f2a54-6ef4-421d-ae11-c302fa0aa6ae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1362 microversion: 2.1 time: 0.549168 May 07 22:01:57.943246 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2050/4046] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:57 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1362 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:58.407186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:58.408477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:58.418105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:58.419968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:58.422606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:58.423300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:58.687041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:58.698628 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce815734-cc34-49b4-a0d6-b948f1e57dcd tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.300799 May 07 22:01:58.699548 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2051/4047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:58 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:58.704462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:58.705309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:58.715613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:58.716140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:58.718562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:58.746997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:58.763618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:01:58.764073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:01:58.764532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:01:58.765198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:01:58.765791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:01:58.788353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:58.789185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:58.791047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:58.794758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:58.841181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Getting quotas for project 7c1ba68595ec4a0ab30a1245d2af00b4. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:01:58.856841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Getting quotas for user f7b6cdf678924373bb24bb562faf90c2 and project 7c1ba68595ec4a0ab30a1245d2af00b4. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:01:58.888358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:01:58.890617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:01:59.014032 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3f8cce2-4be8-40fd-95c9-5d28c13726fe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334059 May 07 22:01:59.020489 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1997/4048] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:01:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:01:59.049439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:59.051664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:59.070820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:59.071985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:59.073450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:59.074059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:59.290967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:59.306615 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b53245a-bf19-4c09-b59a-6e9702252bd3 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 200 len: 1518 microversion: 2.1 time: 0.605375 May 07 22:01:59.316772 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2052/4049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:58 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 1518 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:59.324262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-84664743-0c46-4979-9c2d-5a1998dbe72a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:59.325481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-84664743-0c46-4979-9c2d-5a1998dbe72a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:59.396812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:59.409738 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-00dc1b3f-3c55-4cef-9f10-177c3ec2284f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1550 microversion: 2.1 time: 0.387969 May 07 22:01:59.410940 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1998/4050] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:59 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1550 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:59.432238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fae87674-2464-4b17-ab75-45d58488f815 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:59.432768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fae87674-2464-4b17-ab75-45d58488f815 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:59.440546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fae87674-2464-4b17-ab75-45d58488f815 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:59.441203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fae87674-2464-4b17-ab75-45d58488f815 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:59.442498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fae87674-2464-4b17-ab75-45d58488f815 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:59.444335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fae87674-2464-4b17-ab75-45d58488f815 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:59.540950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-84664743-0c46-4979-9c2d-5a1998dbe72a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:01:59.558683 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-84664743-0c46-4979-9c2d-5a1998dbe72a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1225 microversion: 2.1 time: 0.240001 May 07 22:01:59.560366 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2053/4051] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:59 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1225 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:01:59.647988 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fae87674-2464-4b17-ab75-45d58488f815 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.224040 May 07 22:01:59.649794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 1999/4052] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:01:59 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/os-interface => generated 285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:01:59.717091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:01:59.718095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:01:59.732566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:59.733125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:01:59.733858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:01:59.734315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:00.333978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:00.335871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:00.351245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:00.351744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:00.352563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:00.353014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:00.464316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:00.471865 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09033e86-017a-45f2-bc1a-ddeade0bee4c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.759577 May 07 22:02:00.475592 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2054/4053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:01:59 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:00.576510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:00.577217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:00.595086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:00.596219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:00.597857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:00.598558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:00.799015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:00.812074 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-614a7858-8164-4913-95b4-3f835cad7e23 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 200 len: 1518 microversion: 2.1 time: 0.491522 May 07 22:02:00.815154 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2000/4054] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:00 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 1518 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:01.228448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:01.248789 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-16dcf5a1-3cb9-48c8-b3ba-ed233aa3bc78 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1277 microversion: 2.1 time: 0.667413 May 07 22:02:01.249699 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2055/4055] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:00 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1277 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:01.492853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:01.494116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:01.510892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:01.511362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:01.512162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:01.512803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:01.598320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a14e3156-2956-4d74-93fa-d842ea8d652e req-9df2436b-a517-41a4-bc9a-f8ebaebe6483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdd32653-348f-44ed-80fe-0a58500e3ced", "name": "network-vif-deleted", "tag": "4cb9d745-576d-4349-82d0-2e6fc098ae28"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:01.609043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a14e3156-2956-4d74-93fa-d842ea8d652e req-9df2436b-a517-41a4-bc9a-f8ebaebe6483 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:01.609508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a14e3156-2956-4d74-93fa-d842ea8d652e req-9df2436b-a517-41a4-bc9a-f8ebaebe6483 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:01.649745 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a14e3156-2956-4d74-93fa-d842ea8d652e req-9df2436b-a517-41a4-bc9a-f8ebaebe6483 service nova] Creating event network-vif-deleted:4cb9d745-576d-4349-82d0-2e6fc098ae28 for instance bdd32653-348f-44ed-80fe-0a58500e3ced on nch1-master-1 May 07 22:02:01.665636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a14e3156-2956-4d74-93fa-d842ea8d652e req-9df2436b-a517-41a4-bc9a-f8ebaebe6483 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070875 May 07 22:02:01.669801 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2056/4056] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:01.836771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:01.837893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:01.856161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:01.857039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:01.861219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:01.861949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:02.003130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:02.009153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:02.009886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lazy-loading 'fault' on Instance uuid bdd32653-348f-44ed-80fe-0a58500e3ced {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:02:02.193458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:02.205569 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d34d3d56-b29b-4461-a095-832a2b687ab2 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 200 len: 1311 microversion: 2.1 time: 0.376769 May 07 22:02:02.208848 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2057/4057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:01 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 1311 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:02.266662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:02.267454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:02.276408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:02.277965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:02.279993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:02.281275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:02.421632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:02.433208 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76c3291d-c1b7-420d-b12f-ad9c5351aa17 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1283 microversion: 2.1 time: 0.170362 May 07 22:02:02.433796 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2058/4058] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:02 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1283 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:02.452456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:02.460101 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-75c9e937-e508-4c9c-bc28-6107c501dce1 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.971107 May 07 22:02:02.465937 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2001/4059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:01 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:03.225164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:03.227185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: bdd32653-348f-44ed-80fe-0a58500e3ced] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:03.235006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.235572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.236446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.236971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.252070 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] HTTP exception thrown: Instance bdd32653-348f-44ed-80fe-0a58500e3ced could not be found. May 07 22:02:03.252777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Returning 404 to user: Instance bdd32653-348f-44ed-80fe-0a58500e3ced could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:03.253900 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-838f26bf-46ea-4a9c-9329-551fa85b27f5 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced" status: 404 len: 111 microversion: 2.1 time: 0.032844 May 07 22:02:03.254954 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2059/4060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:03 2022] GET /compute/v2.1/servers/bdd32653-348f-44ed-80fe-0a58500e3ced => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:02:03.263244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:03.263663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:03.270831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.271415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.272476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.273006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.301390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:02:03.386726 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f06590ed-2790-4374-b3d2-8628d729298d tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "DELETE /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 204 len: 0 microversion: 2.1 time: 0.127308 May 07 22:02:03.388794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2002/4061] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:02:03 2022] DELETE /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:02:03.398672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:03.399820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:03.406586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.407416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.408198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.408647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.455627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:03.456634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:03.463873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.465361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.466521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.467241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.716845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:03.724419 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b34b6124-0815-47c1-9787-38f71753ed1a tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1325 microversion: 2.1 time: 0.277753 May 07 22:02:03.725569 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2003/4062] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:03 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:03.732187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:03.733315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:03.740197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.740854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.741810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.742465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.767092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:03.775629 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b14fd86f-b45c-43cb-94a7-538ca7dfe8b8 tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1518 microversion: 2.1 time: 0.382447 May 07 22:02:03.776429 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2060/4063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:03 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1518 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:03.792365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:03.793002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:03.799119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.799847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:03.800803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:03.801418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:04.002685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:04.013113 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-981214c1-8a55-4e28-97e4-fb72f86fa83b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.286024 May 07 22:02:04.023000 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2004/4064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:03 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:04.029022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4bca5202-684e-4490-badb-41f87c1949e5 req-a029274a-d5dd-4e0e-93fd-7c3a1697961b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:04.043398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4bca5202-684e-4490-badb-41f87c1949e5 req-a029274a-d5dd-4e0e-93fd-7c3a1697961b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:04.044115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4bca5202-684e-4490-badb-41f87c1949e5 req-a029274a-d5dd-4e0e-93fd-7c3a1697961b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:04.056461 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4bca5202-684e-4490-badb-41f87c1949e5 req-a029274a-d5dd-4e0e-93fd-7c3a1697961b service nova] Creating event network-changed:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:02:04.062040 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4bca5202-684e-4490-badb-41f87c1949e5 req-a029274a-d5dd-4e0e-93fd-7c3a1697961b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037185 May 07 22:02:04.063401 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2005/4065] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:04.085343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:04.096492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-45c31015-fd61-4b8b-bb0e-75f97e67e5bb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1550 microversion: 2.1 time: 0.318905 May 07 22:02:04.108825 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2061/4066] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:03 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1550 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:04.119264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:04.120344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:04.130104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:04.131357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:04.132420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:04.133757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:04.506851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:04.518266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5174748f-407f-4d85-8ebf-7b93604b732d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1550 microversion: 2.1 time: 0.408088 May 07 22:02:04.522586 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2006/4067] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:04 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1550 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:04.741579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:04.742245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:04.754882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:04.754882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:04.755427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:04.760783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:04.802191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:04.803523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:04.816423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:04.817464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:04.818448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:04.819058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:05.130448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:05.143092 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e81e77aa-e4ab-46b8-9f77-9c28812a492c tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1518 microversion: 2.1 time: 0.351256 May 07 22:02:05.145524 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2007/4068] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:04 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:05.161996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:05.162637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:05.173076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:05.173881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:05.174971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:05.175643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:05.637459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:05.646880 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e46ac2c3-3074-4529-a4e5-66ba82d0781b tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.500256 May 07 22:02:05.656489 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2008/4069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:05 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:05.662793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:05.663483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:05.670377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:05.671507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:05.672288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:05.672886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:05.719534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:05.735776 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91293f26-b0b9-47ce-83ee-a879d34f32f7 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1325 microversion: 2.1 time: 0.990906 May 07 22:02:05.736442 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2062/4070] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:04 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1325 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:06.058003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:06.069853 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d9f37b51-f1f2-4260-a6aa-cfb318968617 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1550 microversion: 2.1 time: 0.411762 May 07 22:02:06.071337 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2009/4071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:05 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1550 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:06.085198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c74db63a-6b0c-4b64-89e7-18832699d3ff req-a94b0a68-c31d-4ff1-bf5e-0ff2a4b667f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab416e9a-a8b3-4a20-acca-1fea061a2a40", "tag": "a5aad234-046b-402f-b295-a91c2ba9d613"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:06.094708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c74db63a-6b0c-4b64-89e7-18832699d3ff req-a94b0a68-c31d-4ff1-bf5e-0ff2a4b667f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.095203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c74db63a-6b0c-4b64-89e7-18832699d3ff req-a94b0a68-c31d-4ff1-bf5e-0ff2a4b667f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.107117 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c74db63a-6b0c-4b64-89e7-18832699d3ff req-a94b0a68-c31d-4ff1-bf5e-0ff2a4b667f0 service nova] Creating event network-changed:a5aad234-046b-402f-b295-a91c2ba9d613 for instance ab416e9a-a8b3-4a20-acca-1fea061a2a40 on nch2-master-1 May 07 22:02:06.112078 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c74db63a-6b0c-4b64-89e7-18832699d3ff req-a94b0a68-c31d-4ff1-bf5e-0ff2a4b667f0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030540 May 07 22:02:06.113039 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2063/4072] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:06.167445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:06.168443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:06.174618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.175281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.176173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.176885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.423530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddc30338eaa944db87c27cab6eb949ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169e1e6f26414e3eaa454bc14100fece', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:06.435957 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c0f8aba9-0d86-48fa-9826-dc8aee2497cd tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 200 len: 1518 microversion: 2.1 time: 0.273009 May 07 22:02:06.436901 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2010/4073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:06 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:06.581322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c5c4c964-b3b8-427c-88fc-42a4f0158d69 req-5501edd5-f4c7-441a-9657-8950328343a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20117710-052c-46c3-8ca2-f601df488811", "name": "network-vif-deleted", "tag": "f94f9f68-04c4-4723-8e48-775481388884"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:06.589265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c5c4c964-b3b8-427c-88fc-42a4f0158d69 req-5501edd5-f4c7-441a-9657-8950328343a3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.589979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c5c4c964-b3b8-427c-88fc-42a4f0158d69 req-5501edd5-f4c7-441a-9657-8950328343a3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.605348 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c5c4c964-b3b8-427c-88fc-42a4f0158d69 req-5501edd5-f4c7-441a-9657-8950328343a3 service nova] Creating event network-vif-deleted:f94f9f68-04c4-4723-8e48-775481388884 for instance 20117710-052c-46c3-8ca2-f601df488811 on nch1-master-1 May 07 22:02:06.610867 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c5c4c964-b3b8-427c-88fc-42a4f0158d69 req-5501edd5-f4c7-441a-9657-8950328343a3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035796 May 07 22:02:06.614475 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2064/4074] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:06.665170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:06.665838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:06.676064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.676531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.677324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.677821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.758537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:06.759503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:06.770168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.772131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.773811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:06.774496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:06.951234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:06.961374 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c855269c-541a-46fe-a093-f5fa8c5fc9d9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1325 microversion: 2.1 time: 0.207216 May 07 22:02:06.964886 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2065/4075] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:06 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:07.028406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:07.042390 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6e37b2ff-ca20-489a-ba5a-d4f2a3defec8 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.381483 May 07 22:02:07.045800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2011/4076] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:06 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:07.095301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:07.095930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:07.108078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.109623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.110639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.111458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.308786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:07.318377 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00bb9d17-576e-40de-9bbb-c043838e55fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.233618 May 07 22:02:07.319227 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2066/4077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:07 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:07.334550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:07.335131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:07.341211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.341681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.342470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.342952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.453511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:07.454243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] [instance: 20117710-052c-46c3-8ca2-f601df488811] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:07.460761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.461347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.462234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.462989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.477425 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] HTTP exception thrown: Instance 20117710-052c-46c3-8ca2-f601df488811 could not be found. May 07 22:02:07.478170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] Returning 404 to user: Instance 20117710-052c-46c3-8ca2-f601df488811 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:07.479149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-878c6a8e-0bbf-4552-a600-f054d48cf10f tempest-ListServerFiltersTestJSON-2070292709 tempest-ListServerFiltersTestJSON-2070292709-project] 10.222.0.32 "GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811" status: 404 len: 111 microversion: 2.1 time: 0.029613 May 07 22:02:07.480088 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2067/4078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:07 2022] GET /compute/v2.1/servers/20117710-052c-46c3-8ca2-f601df488811 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:02:07.524613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:07.532610 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fea953f-95cf-4410-81e0-061429ad968a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.201856 May 07 22:02:07.533185 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2012/4079] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:07 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:07.550698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0959e641-f71b-4367-af6b-805eed5ff069 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1773697499"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:07.552361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0959e641-f71b-4367-af6b-805eed5ff069 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:07.559483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0959e641-f71b-4367-af6b-805eed5ff069 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.559938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0959e641-f71b-4367-af6b-805eed5ff069 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.561097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0959e641-f71b-4367-af6b-805eed5ff069 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.562034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0959e641-f71b-4367-af6b-805eed5ff069 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:07.951298 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0959e641-f71b-4367-af6b-805eed5ff069 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.405434 May 07 22:02:07.954398 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2068/4080] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:02:07 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 07 22:02:07.981471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:07.982201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:07.999099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:07.999569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:08.000385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:08.000836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:08.062587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:08.063334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:08.077533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:08.078001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:08.080228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:08.083195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:08.452108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:08.464295 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d34651ef-376c-4e8f-82a8-d1e54569ccb4 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.406409 May 07 22:02:08.465584 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2069/4081] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:08 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:08.666024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:08.675102 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eccc5a5b-56db-4ca4-ac9f-e5ea2e2bd44b tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1325 microversion: 2.1 time: 0.699496 May 07 22:02:08.675697 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2013/4082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:07 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1325 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:09.482391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:09.483065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:09.489739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.490209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.491036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.491490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.664622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:09.673677 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-75918157-ad20-4661-9764-60768b58bd8e tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1486 microversion: 2.1 time: 0.195623 May 07 22:02:09.674310 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2070/4083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:09 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1486 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:09.697571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2ea24ff2-5247-4e44-8de8-c24d7755f1dc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:09.698089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2ea24ff2-5247-4e44-8de8-c24d7755f1dc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:09.699905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:09.700711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:09.712744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea24ff2-5247-4e44-8de8-c24d7755f1dc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.714164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.714831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.715622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.716273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea24ff2-5247-4e44-8de8-c24d7755f1dc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.717180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea24ff2-5247-4e44-8de8-c24d7755f1dc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.717629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ea24ff2-5247-4e44-8de8-c24d7755f1dc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.719308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.839285 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2ea24ff2-5247-4e44-8de8-c24d7755f1dc tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "POST /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9/action" status: 202 len: 0 microversion: 2.1 time: 0.152306 May 07 22:02:09.840136 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2014/4084] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:02:09 2022] POST /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:02:09.849515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:09.850599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:09.858293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.859165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.860491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:09.861163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:09.935611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:09.943301 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-697e819e-191a-46ba-94ad-fe10da97b275 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1325 microversion: 2.1 time: 0.254548 May 07 22:02:09.945485 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2071/4085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:09 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:10.339312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:10.349127 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1004bc03-8977-402e-aa3b-697a1fe4a9ed tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1494 microversion: 2.1 time: 0.504221 May 07 22:02:10.349732 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2015/4086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:09 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1494 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:10.400892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6627ac02-f6d8-4eb2-87c7-14d5403eaf9a req-d33b70f6-1193-4d63-884d-7231736cc2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab416e9a-a8b3-4a20-acca-1fea061a2a40", "name": "network-vif-plugged", "status": "completed", "tag": "a5aad234-046b-402f-b295-a91c2ba9d613"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:10.416163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6627ac02-f6d8-4eb2-87c7-14d5403eaf9a req-d33b70f6-1193-4d63-884d-7231736cc2b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:10.417865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6627ac02-f6d8-4eb2-87c7-14d5403eaf9a req-d33b70f6-1193-4d63-884d-7231736cc2b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:10.451826 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6627ac02-f6d8-4eb2-87c7-14d5403eaf9a req-d33b70f6-1193-4d63-884d-7231736cc2b7 service nova] Creating event network-vif-plugged:a5aad234-046b-402f-b295-a91c2ba9d613 for instance ab416e9a-a8b3-4a20-acca-1fea061a2a40 on nch2-master-1 May 07 22:02:10.463693 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6627ac02-f6d8-4eb2-87c7-14d5403eaf9a req-d33b70f6-1193-4d63-884d-7231736cc2b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067569 May 07 22:02:10.464444 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2072/4087] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:10.961944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:10.962560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:10.970283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:10.970686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:10.971588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:10.972037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:11.368882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:11.370323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:11.378627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:11.379453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:11.380563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:11.381239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:11.398740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:11.423282 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50a5f8b4-6b95-4a29-9bb0-f785a9b5f7b1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1325 microversion: 2.1 time: 0.465705 May 07 22:02:11.425127 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2016/4088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:10 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:11.568051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:11.579099 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ca82babe-3742-4d72-b50d-2de93874705c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1494 microversion: 2.1 time: 0.214749 May 07 22:02:11.579698 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2073/4089] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:11 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1494 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:12.441704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:12.442315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:12.464857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:12.475501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:12.485340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:12.485340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:12.676970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03a1afca-7064-4d86-8a31-a8b9d0e59d73 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Action: 'create', calling method: .version_select at 0x7fc41cc50e50>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:12.701167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-03a1afca-7064-4d86-8a31-a8b9d0e59d73 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Getting quotas for project 85c3142e67d842ef8c79c4f7ff74bbe9. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:12.708956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-03a1afca-7064-4d86-8a31-a8b9d0e59d73 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Getting quotas for user 63dccfa2a6544fc6bbe30f7d8b53c2de and project 85c3142e67d842ef8c79c4f7ff74bbe9. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:12.765318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:12.776983 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63fd34e3-bfc0-4187-905d-b488d7b2e2f5 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1325 microversion: 2.1 time: 0.340175 May 07 22:02:12.778094 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2017/4090] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:12 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1325 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:12.783847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-03a1afca-7064-4d86-8a31-a8b9d0e59d73 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Getting quotas for project 85c3142e67d842ef8c79c4f7ff74bbe9. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:12.786069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:12.786969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:12.795055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:12.795857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:12.797067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:12.797735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:12.806992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-03a1afca-7064-4d86-8a31-a8b9d0e59d73 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Getting quotas for user 63dccfa2a6544fc6bbe30f7d8b53c2de and project 85c3142e67d842ef8c79c4f7ff74bbe9. Resources: {'server_groups'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:12.832972 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03a1afca-7064-4d86-8a31-a8b9d0e59d73 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.346141 May 07 22:02:12.833590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2074/4091] 10.222.0.32 () {62 vars in 1213 bytes} [Sat May 7 22:02:12 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 07 22:02:12.844571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c7f42e08-5d58-4653-b99a-bdaff2658370 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:12.860568 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c7f42e08-5d58-4653-b99a-bdaff2658370 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.019622 May 07 22:02:12.861628 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2075/4092] 10.222.0.32 () {60 vars in 1192 bytes} [Sat May 7 22:02:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:02:12.873953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc45ea41-0477-43f5-baff-67035e78cade tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:12.890317 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc45ea41-0477-43f5-baff-67035e78cade tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/e2e16992-2c79-4396-aedc-20af6527277a" status: 200 len: 235 microversion: 2.64 time: 0.019542 May 07 22:02:12.895791 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2076/4093] 10.222.0.32 () {60 vars in 1303 bytes} [Sat May 7 22:02:12 2022] GET /compute/v2.1/os-server-groups/e2e16992-2c79-4396-aedc-20af6527277a => generated 235 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:02:12.904706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95a7d62e-8e6d-495c-a2e8-f2f735a5b7e4 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:12.943967 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95a7d62e-8e6d-495c-a2e8-f2f735a5b7e4 tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/e2e16992-2c79-4396-aedc-20af6527277a" status: 204 len: 0 microversion: 2.64 time: 0.046682 May 07 22:02:12.947990 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2077/4094] 10.222.0.32 () {60 vars in 1306 bytes} [Sat May 7 22:02:12 2022] DELETE /compute/v2.1/os-server-groups/e2e16992-2c79-4396-aedc-20af6527277a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 22:02:12.960747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3ec028c-4c1f-47f4-9c4b-ca86e7af41da tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:12.969949 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a3ec028c-4c1f-47f4-9c4b-ca86e7af41da tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] HTTP exception thrown: Instance group e2e16992-2c79-4396-aedc-20af6527277a could not be found. May 07 22:02:12.975600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3ec028c-4c1f-47f4-9c4b-ca86e7af41da tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] Returning 404 to user: Instance group e2e16992-2c79-4396-aedc-20af6527277a could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:12.977678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a3ec028c-4c1f-47f4-9c4b-ca86e7af41da tempest-ServerGroup264TestJSON-1099835454 tempest-ServerGroup264TestJSON-1099835454-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/e2e16992-2c79-4396-aedc-20af6527277a" status: 404 len: 117 microversion: 2.64 time: 0.022022 May 07 22:02:12.984786 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2078/4095] 10.222.0.32 () {60 vars in 1306 bytes} [Sat May 7 22:02:12 2022] DELETE /compute/v2.1/os-server-groups/e2e16992-2c79-4396-aedc-20af6527277a => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:02:13.149456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:13.165448 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4770d819-1ee0-4e67-9ade-ec6d0334ecfb tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1494 microversion: 2.1 time: 0.382851 May 07 22:02:13.171946 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2018/4096] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:12 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1494 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:13.794999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:13.796329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:13.808933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:13.809710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:13.812141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:13.814472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:13.979180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9bd42319-37b6-4088-a45a-5c047993f327 req-4dad7b31-b724-4a2f-aa5d-4e6b8033937f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-plugged", "status": "completed", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:14.015874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9bd42319-37b6-4088-a45a-5c047993f327 req-4dad7b31-b724-4a2f-aa5d-4e6b8033937f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.017639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9bd42319-37b6-4088-a45a-5c047993f327 req-4dad7b31-b724-4a2f-aa5d-4e6b8033937f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.052295 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9bd42319-37b6-4088-a45a-5c047993f327 req-4dad7b31-b724-4a2f-aa5d-4e6b8033937f service nova] Creating event network-vif-plugged:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:02:14.069348 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9bd42319-37b6-4088-a45a-5c047993f327 req-4dad7b31-b724-4a2f-aa5d-4e6b8033937f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114744 May 07 22:02:14.075393 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2019/4097] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:14.192364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:14.193423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:14.212056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.214192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.216437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.218682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.316746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:14.331884 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-453218cb-dc0e-4048-a92c-6f559fc6ce8e tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1522 microversion: 2.1 time: 0.541124 May 07 22:02:14.333115 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2079/4098] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:13 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:14.350282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:14.351731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:14.359928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.365652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.367443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.370706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.417319 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] HTTP exception thrown: Instance is not a member of specified network May 07 22:02:14.418245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Returning 404 to user: Instance is not a member of specified network {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:14.419460 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0bedabb8-dec7-4d59-9493-f18154e9ac22 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.073139 May 07 22:02:14.420542 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2080/4099] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 22:02:14 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40/ips/invalid => generated 91 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 22:02:14.437658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55e164f6-18b0-4e5a-83f0-6fd133fa3cfe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:14.444646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55e164f6-18b0-4e5a-83f0-6fd133fa3cfe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Failed to fetch instance by id 999 {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2926}} May 07 22:02:14.445927 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-55e164f6-18b0-4e5a-83f0-6fd133fa3cfe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] HTTP exception thrown: Instance 999 could not be found. May 07 22:02:14.446798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55e164f6-18b0-4e5a-83f0-6fd133fa3cfe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Returning 404 to user: Instance 999 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:14.447954 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55e164f6-18b0-4e5a-83f0-6fd133fa3cfe tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.022579 May 07 22:02:14.449086 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2081/4100] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 22:02:14 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 22:02:14.465841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:14.468472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:14.485597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.488077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.489199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.490347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.534037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:02:14.547800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:14.562351 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a7de5c63-4306-4563-831c-43900edce917 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1500 microversion: 2.1 time: 0.376110 May 07 22:02:14.567125 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2020/4101] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:14 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1500 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:14.594351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:14.594993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:14.615238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.615692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.627460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.627930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.691799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:02:14.778022 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-87436d07-0eda-4633-9e55-a889cf66cf68 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 204 len: 0 microversion: 2.1 time: 0.318818 May 07 22:02:14.779449 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2082/4102] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:02:14 2022] DELETE /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:02:14.793469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:14.797657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:14.811287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.812452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.813969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.814884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.916351 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5c10fd35-c5d1-4d64-9679-935fda4eaa7d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "DELETE /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 204 len: 0 microversion: 2.1 time: 0.327986 May 07 22:02:14.916541 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2021/4103] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:02:14 2022] DELETE /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:02:14.928656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:14.929950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:14.943819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.944282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:14.945135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:14.945601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:15.125967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:15.137872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fabb7e13-14db-48b2-bc6f-cfc29eaaa9bd tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1528 microversion: 2.1 time: 0.353467 May 07 22:02:15.142221 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2083/4104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:14 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1528 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:15.315104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:15.344372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-139fa394-f892-4ebc-8e65-520be624e589 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:15.345399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-139fa394-f892-4ebc-8e65-520be624e589 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:15.347481 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ba22655-cab2-4f8a-a84f-6429c201bc95 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.419385 May 07 22:02:15.355550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-139fa394-f892-4ebc-8e65-520be624e589 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:15.356339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-139fa394-f892-4ebc-8e65-520be624e589 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:15.357368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-139fa394-f892-4ebc-8e65-520be624e589 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:15.358067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-139fa394-f892-4ebc-8e65-520be624e589 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:15.363926 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2022/4105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:14 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:15.415876 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-139fa394-f892-4ebc-8e65-520be624e589 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/ips" status: 200 len: 150 microversion: 2.1 time: 0.075891 May 07 22:02:15.419539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2084/4106] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:02:15 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/ips => generated 150 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:16.162857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:16.162857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:16.176788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:16.177249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:16.178073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:16.183747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:16.365360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:16.366255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:16.376764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:16.377183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:16.378591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:16.379120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:16.678076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:16.688192 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f09afca-f12a-4ea5-8e20-9297a96c449c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.326943 May 07 22:02:16.689102 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2085/4107] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:16 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:16.710990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:16.739449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5351716a-225c-4c53-a489-85f6d557eac1 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1528 microversion: 2.1 time: 0.583546 May 07 22:02:16.755081 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2023/4108] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:16 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1528 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:17.162420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-afaea28e-a66f-4744-abe0-e7ebb963e2cd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df3e22c-323c-404a-a8e6-d7e28dc9b693"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:17.169210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-afaea28e-a66f-4744-abe0-e7ebb963e2cd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:17.193219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afaea28e-a66f-4744-abe0-e7ebb963e2cd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:17.196898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afaea28e-a66f-4744-abe0-e7ebb963e2cd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:17.202808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afaea28e-a66f-4744-abe0-e7ebb963e2cd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:17.209029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afaea28e-a66f-4744-abe0-e7ebb963e2cd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:17.705715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:17.706332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:17.729724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:17.734088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:17.735080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:17.735700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:18.204628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:18.216783 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a94003ff-a177-4aef-8521-b2afa7e77749 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 0.514793 May 07 22:02:18.217800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2024/4109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:17 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:18.222517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:18.223130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:18.243286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:18.243984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:18.245179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:18.245625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:18.518190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:18.528953 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a49d498-2e21-435f-a0bc-33d767af45e9 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1528 microversion: 2.1 time: 0.309853 May 07 22:02:18.529628 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2025/4110] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:18 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1528 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:18.999458 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-afaea28e-a66f-4744-abe0-e7ebb963e2cd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.842964 May 07 22:02:19.004999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2086/4111] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:02:17 2022] POST /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments => generated 194 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:19.233370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:19.234805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:19.259679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:19.260240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:19.261111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:19.261467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:19.549083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:19.550136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:19.572804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:19.573279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:19.574063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:19.574509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:19.973065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:19.989963 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e13a636-3ce7-415d-8af9-f468bd4c8d82 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1528 microversion: 2.1 time: 0.446066 May 07 22:02:19.993587 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2087/4112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:19 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1528 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:20.337346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:20.349847 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d14585ac-003a-4751-b32a-7c821725a23c tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1506 microversion: 2.1 time: 1.120176 May 07 22:02:20.362121 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2026/4113] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:19 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1506 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:21.009654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:21.010274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:21.020308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:21.021076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:21.022052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:21.022670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:21.298031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:21.307999 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fccbf3f0-e8f1-4fb6-91d6-239e751acd1c tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1528 microversion: 2.1 time: 0.302138 May 07 22:02:21.308606 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2088/4114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:21 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1528 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:21.364571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-578a4d14-9cfe-4d41-8ef2-80d28b3e1cea req-a3d7d711-e22d-4a24-99ff-16a11cfd5574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931cb167-5bcb-4aef-8b2b-029dbcb4d7e9", "name": "network-vif-deleted", "tag": "aa4c2169-baeb-4b6e-a6e2-98691784c4a7"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:21.367850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:21.371061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:21.382074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:21.384019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:21.384707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-578a4d14-9cfe-4d41-8ef2-80d28b3e1cea req-a3d7d711-e22d-4a24-99ff-16a11cfd5574 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:21.385513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-578a4d14-9cfe-4d41-8ef2-80d28b3e1cea req-a3d7d711-e22d-4a24-99ff-16a11cfd5574 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:21.397196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:21.404658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:21.407116 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-578a4d14-9cfe-4d41-8ef2-80d28b3e1cea req-a3d7d711-e22d-4a24-99ff-16a11cfd5574 service nova] Creating event network-vif-deleted:aa4c2169-baeb-4b6e-a6e2-98691784c4a7 for instance 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 on nch2-master-1 May 07 22:02:21.422665 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-578a4d14-9cfe-4d41-8ef2-80d28b3e1cea req-a3d7d711-e22d-4a24-99ff-16a11cfd5574 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062435 May 07 22:02:21.424023 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2027/4115] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:21.565995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:21.595018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c642f63d-f37f-4c24-ba8d-c7c883bd2417 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 200 len: 1299 microversion: 2.1 time: 0.230713 May 07 22:02:21.595960 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2089/4116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:21 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:22.332904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:22.333852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:22.346729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:22.347530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:22.350089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:22.352670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:22.432500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:22.433111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:22.433428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lazy-loading 'fault' on Instance uuid ab416e9a-a8b3-4a20-acca-1fea061a2a40 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:02:22.621443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:22.622067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:22.645646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:22.651996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:22.659781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:22.660262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:22.774465 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] HTTP exception thrown: Instance 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 could not be found. May 07 22:02:22.775481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Returning 404 to user: Instance 931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:22.777801 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c7305fab-0f6d-40ea-a17b-925fc8989024 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9" status: 404 len: 111 microversion: 2.1 time: 0.169517 May 07 22:02:22.804334 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2090/4117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:22 2022] GET /compute/v2.1/servers/931cb167-5bcb-4aef-8b2b-029dbcb4d7e9 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:02:22.820869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8726c1c1-1227-42ed-a4db-47d239a90a38 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: .version_select at 0x7fc4224cc790>, body: {"keypair": {"name": "tempest-keypair-1107617182"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:22.872486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7b6cdf678924373bb24bb562faf90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1ba68595ec4a0ab30a1245d2af00b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:22.875753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8726c1c1-1227-42ed-a4db-47d239a90a38 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:22.883856 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-95839ddc-05e0-4179-93e9-ba50f0f95f96 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 200 len: 1315 microversion: 2.1 time: 0.555743 May 07 22:02:22.884516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2028/4118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:22 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:22.907117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8726c1c1-1227-42ed-a4db-47d239a90a38 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:22.914669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:22.926665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:22.945395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:22.951490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:22.953167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:22.954708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:23.026606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:02:23.258755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8726c1c1-1227-42ed-a4db-47d239a90a38 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:23.264911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8726c1c1-1227-42ed-a4db-47d239a90a38 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:23.287077 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c119a2bf-9981-4176-beac-2823cf8b346d tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "DELETE /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 204 len: 0 microversion: 2.1 time: 0.387659 May 07 22:02:23.288029 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2029/4119] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:02:22 2022] DELETE /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:02:23.299499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:23.301211 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8726c1c1-1227-42ed-a4db-47d239a90a38 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.493228 May 07 22:02:23.301747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:23.301883 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2091/4120] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:02:22 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:23.329236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:23.333233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:23.335724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:23.342972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:23.487486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5d621813-e569-49b7-84ae-87b035419bbf req-39d1313b-1f96-45a6-9c29-28aa7ce35ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab416e9a-a8b3-4a20-acca-1fea061a2a40", "name": "network-vif-deleted", "tag": "a5aad234-046b-402f-b295-a91c2ba9d613"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:23.501378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5d621813-e569-49b7-84ae-87b035419bbf req-39d1313b-1f96-45a6-9c29-28aa7ce35ade service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:23.501889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5d621813-e569-49b7-84ae-87b035419bbf req-39d1313b-1f96-45a6-9c29-28aa7ce35ade service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:23.527783 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5d621813-e569-49b7-84ae-87b035419bbf req-39d1313b-1f96-45a6-9c29-28aa7ce35ade service nova] Creating event network-vif-deleted:a5aad234-046b-402f-b295-a91c2ba9d613 for instance ab416e9a-a8b3-4a20-acca-1fea061a2a40 on nch2-master-1 May 07 22:02:23.540623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5d621813-e569-49b7-84ae-87b035419bbf req-39d1313b-1f96-45a6-9c29-28aa7ce35ade service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057521 May 07 22:02:23.541881 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2092/4121] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:02:23.854534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:23.868468 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e03d2cce-0db0-49b1-93db-9188e41330b3 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1492 microversion: 2.1 time: 0.573582 May 07 22:02:23.870375 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2030/4122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:23 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1492 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:23.906711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:23.907446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] [instance: ab416e9a-a8b3-4a20-acca-1fea061a2a40] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:23.926660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:23.929763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:23.932734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:23.933342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:23.959462 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] HTTP exception thrown: Instance ab416e9a-a8b3-4a20-acca-1fea061a2a40 could not be found. May 07 22:02:23.961494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] Returning 404 to user: Instance ab416e9a-a8b3-4a20-acca-1fea061a2a40 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:23.963166 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bdcf538c-e4f0-4644-ace3-73bfc2f06048 tempest-ServerAddressesNegativeTestJSON-2078801146 tempest-ServerAddressesNegativeTestJSON-2078801146-project] 10.222.0.32 "GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40" status: 404 len: 111 microversion: 2.1 time: 0.065358 May 07 22:02:23.963949 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2093/4123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:23 2022] GET /compute/v2.1/servers/ab416e9a-a8b3-4a20-acca-1fea061a2a40 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:02:24.886372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:24.887894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:24.900018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:24.905177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:24.906325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:24.910216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:25.914697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:25.925711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-df4085b1-1ed8-4e60-9694-021e5c5bc2a9 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1492 microversion: 2.1 time: 1.043752 May 07 22:02:25.928253 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2031/4124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:24 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1492 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:26.945960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:26.946579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:26.976975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:26.979534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:26.983679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:26.985180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:27.231211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-62fc2786-b38e-4b20-8de4-d0ac55f6ec68 req-b716eb65-2847-42b3-a06e-5be85146f255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "620355ca-9580-4384-9f83-9ec1f95922e3", "name": "network-vif-deleted", "tag": "13f0d3f2-8ab0-42a1-95df-5966489120ec"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:27.279081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-62fc2786-b38e-4b20-8de4-d0ac55f6ec68 req-b716eb65-2847-42b3-a06e-5be85146f255 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:27.280151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-62fc2786-b38e-4b20-8de4-d0ac55f6ec68 req-b716eb65-2847-42b3-a06e-5be85146f255 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:27.318641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99294a64e28046d8b57260f74c325990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb49d7a99844a7ab8ef30fb59250e7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:27.326582 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-62fc2786-b38e-4b20-8de4-d0ac55f6ec68 req-b716eb65-2847-42b3-a06e-5be85146f255 service nova] Creating event network-vif-deleted:13f0d3f2-8ab0-42a1-95df-5966489120ec for instance 620355ca-9580-4384-9f83-9ec1f95922e3 on nch2-master-1 May 07 22:02:27.339240 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5fafc62-e139-4ad2-adc2-8ecce5625cc0 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 200 len: 1450 microversion: 2.1 time: 0.397795 May 07 22:02:27.347295 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-62fc2786-b38e-4b20-8de4-d0ac55f6ec68 req-b716eb65-2847-42b3-a06e-5be85146f255 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123981 May 07 22:02:27.352495 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2094/4125] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:26 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 1450 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:27.352893 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2032/4126] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:27.661849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-342110188", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64cbfbe-feaa-48dc-9089-9445aa1eaa5a"}], "security_groups": [{"name": "tempest-securitygroup--522064219"}], "key_name": "tempest-keypair-1107617182", "user_data": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:27.957022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] validate_networks() for [('f64cbfbe-feaa-48dc-9089-9445aa1eaa5a', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:02:28.382818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2034477616", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": "none"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:28.526542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:02:28.527004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:02:28.527494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:02:28.527914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:02:28.528336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:02:28.542222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:28.544583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:28.545819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:28.546750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:28.568479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Getting quotas for project 6c27fff94315415da226f59a0c9de354. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:28.575408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Getting quotas for user a8eb802dd28d4b3696d33a882edb6c6e and project 6c27fff94315415da226f59a0c9de354. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:28.608636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:02:28.612006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:02:28.738685 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2bf8e9bd-88bb-4261-9a9f-0873fd0ee929 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.643190 May 07 22:02:28.745265 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2033/4127] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 22:02:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 22:02:28.751079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:28.751922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] [instance: 620355ca-9580-4384-9f83-9ec1f95922e3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:28.772114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:28.773123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:28.774170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:28.778131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:28.814117 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] HTTP exception thrown: Instance 620355ca-9580-4384-9f83-9ec1f95922e3 could not be found. May 07 22:02:28.815028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] Returning 404 to user: Instance 620355ca-9580-4384-9f83-9ec1f95922e3 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:02:28.820951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2335577-5e19-4cf2-b0b1-8b83b1ff9da6 tempest-ServerRescueTestJSON-2085094885 tempest-ServerRescueTestJSON-2085094885-project] 10.222.0.32 "GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3" status: 404 len: 111 microversion: 2.1 time: 0.069575 May 07 22:02:28.829365 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2034/4128] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:28 2022] GET /compute/v2.1/servers/620355ca-9580-4384-9f83-9ec1f95922e3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:02:28.841509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b989bdf-a645-4194-967f-64c7a0376885 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:28.843596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5b989bdf-a645-4194-967f-64c7a0376885 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:28.960962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b989bdf-a645-4194-967f-64c7a0376885 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:28.973234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b989bdf-a645-4194-967f-64c7a0376885 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:28.979269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5b989bdf-a645-4194-967f-64c7a0376885 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:28.983103 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b989bdf-a645-4194-967f-64c7a0376885 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1278 microversion: 2.54 time: 0.153553 May 07 22:02:29.011594 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2035/4129] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:28 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:29.273254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:29.274097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:29.307293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:29.307844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:29.308933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:29.309575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:29.518849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lazy-loading 'services' on Instance uuid 95f9d622-1591-4442-9da0-167bdb326758 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:02:29.708799 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-964f8561-0255-4788-8faf-0340402a969f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-volume_attachments/563e3251-764b-419d-8f65-8e94c270df50" status: 202 len: 0 microversion: 2.1 time: 0.439361 May 07 22:02:29.710458 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2036/4130] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:02:29 2022] DELETE /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-volume_attachments/563e3251-764b-419d-8f65-8e94c270df50 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:02:30.007415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:30.008702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:30.034916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:02:30.036077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:02:30.036917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:02:30.037348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:02:30.038137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:02:30.047289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:30.050848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:30.053996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:30.054757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:30.066514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:30.067286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:30.069221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:30.070408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:30.136877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:30.148260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:30.234517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:02:30.240003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:02:30.440601 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-afbb6563-4d9a-411a-8875-95a5d151b733 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.795819 May 07 22:02:30.449575 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2095/4131] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:02:30.459070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9958fd74-3856-4899-a821-3002c189b529 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:30.460948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9958fd74-3856-4899-a821-3002c189b529 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:30.529341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:30.540577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:30.558392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:30.559563 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bdd6018a-5123-4fe4-b75c-ed15136b9601 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1330 microversion: 2.54 time: 0.557788 May 07 22:02:30.562185 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2037/4132] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:30 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1330 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:02:30.794598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9958fd74-3856-4899-a821-3002c189b529 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:30.847996 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9958fd74-3856-4899-a821-3002c189b529 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1241 microversion: 2.1 time: 0.377699 May 07 22:02:30.862116 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2096/4133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:30 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1241 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:31.041163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c255410-bf24-48ca-bd02-a55a0011cab3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:31.060493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c255410-bf24-48ca-bd02-a55a0011cab3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:31.060951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c255410-bf24-48ca-bd02-a55a0011cab3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:31.115430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c255410-bf24-48ca-bd02-a55a0011cab3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Going to try to stop instance {{(pid=136681) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:02:31.217551 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c255410-bf24-48ca-bd02-a55a0011cab3 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action" status: 202 len: 0 microversion: 2.1 time: 0.172046 May 07 22:02:31.221579 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2038/4134] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:02:31 2022] POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:02:31.227169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:31.227786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:31.241494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:31.242117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:31.243114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:31.243748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:31.514391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1000420037", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:31.611018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] validate_networks() for [('f2a2f1f2-e03e-4e0b-afec-6667bd4eb44b', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:02:31.680806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:31.693201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9754f812-55d5-4313-8eb8-aff5a61f0625 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1679 microversion: 2.1 time: 0.466900 May 07 22:02:31.694307 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2097/4135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:31 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1679 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:31.722023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:31.723035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:31.741570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:31.742474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:31.743528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:31.744479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:31.912408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:31.926805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:31.928507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:31.933855 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2aaa726e-ce8f-4718-88b5-f6aee4070950 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1336 microversion: 2.54 time: 0.224500 May 07 22:02:31.934670 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2098/4136] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:31 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1336 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:31.956447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:31.957398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:31.992406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:31.993836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:31.994761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:31.998954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:32.132902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:32.141599 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7f49b3fb-32d4-4696-9714-7eaccd682320 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1237 microversion: 2.1 time: 0.203963 May 07 22:02:32.147763 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2099/4137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:31 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1237 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:32.518757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:02:32.519213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:02:32.519814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:02:32.520300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:02:32.520728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:02:32.557975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:32.559358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:32.560820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:32.563016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:32.609918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:32.619225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for user 4fb48e4d50184d2e97674324027d9ec0 and project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:32.637198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:02:32.640604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:02:32.712632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:32.713282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:32.724616 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-86364661-c1ee-4d24-b11f-848a2b62b32b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.310082 May 07 22:02:32.727643 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2039/4138] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:02:32.739790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8196c933-3840-44be-9a24-f7e3784b230b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:32.741735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8196c933-3840-44be-9a24-f7e3784b230b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:32.747012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:32.747487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:32.759149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:32.759635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:32.876647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8196c933-3840-44be-9a24-f7e3784b230b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:32.885342 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8196c933-3840-44be-9a24-f7e3784b230b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1222 microversion: 2.1 time: 0.150279 May 07 22:02:32.889597 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2040/4139] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:32 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:32.955371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:32.956612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:32.997340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:32.998217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:32.999688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:33.002806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:33.302112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:33.320569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:33.324094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:33.327412 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-620501a2-628f-4c55-b386-0077d2efdd4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1336 microversion: 2.54 time: 0.377855 May 07 22:02:33.328733 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2041/4140] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:32 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1336 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:33.349952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1757882786", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:33.463604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] validate_networks() for [('f2a2f1f2-e03e-4e0b-afec-6667bd4eb44b', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:02:33.747186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:33.769387 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a06e7c8-57bb-43c5-b0f7-be66c708b490 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1679 microversion: 2.1 time: 1.052285 May 07 22:02:33.770102 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2100/4141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:32 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1679 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:33.805517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:33.806287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:33.855198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:33.857998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:33.862040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:33.862625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:34.230883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:34.240457 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3e8586b0-f47a-4b21-8f45-eddfbc74b87a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1299 microversion: 2.1 time: 0.463402 May 07 22:02:34.241104 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2101/4142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:33 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1299 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:34.347413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:34.348044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:34.361776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:34.362257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:34.363106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:34.368866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:34.511810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:02:34.513124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:02:34.513764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:02:34.514454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:02:34.515138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:02:34.529767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:34.531183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:34.532296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:34.533807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:34.540206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:34.558243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:34.559855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:34.565421 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-22a9ffd5-5c4b-4bae-8b84-66c4482ca609 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1357 microversion: 2.54 time: 0.222878 May 07 22:02:34.568224 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2102/4143] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:34 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:34.587324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86f18c80-a71a-48af-84f0-d0501a259f09 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Action: 'create', calling method: .version_select at 0x7fc4224cc4c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1013078567"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:34.609588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:34.618826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-86f18c80-a71a-48af-84f0-d0501a259f09 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Getting quotas for project 6c27fff94315415da226f59a0c9de354. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:34.623055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for user 4fb48e4d50184d2e97674324027d9ec0 and project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:34.634620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-86f18c80-a71a-48af-84f0-d0501a259f09 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Getting quotas for user a8eb802dd28d4b3696d33a882edb6c6e and project 6c27fff94315415da226f59a0c9de354. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:34.652309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:02:34.656778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:02:34.762214 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4694eb3e-ca7c-41b3-ab5e-a395eedceb9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.432343 May 07 22:02:34.767257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2042/4144] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:02:34.788161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2957a388-e8bd-40c2-9301-3eccf613bc7d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:34.792448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2957a388-e8bd-40c2-9301-3eccf613bc7d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:34.816600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-86f18c80-a71a-48af-84f0-d0501a259f09 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Getting quotas for project 6c27fff94315415da226f59a0c9de354. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:02:34.838551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-86f18c80-a71a-48af-84f0-d0501a259f09 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Getting quotas for user a8eb802dd28d4b3696d33a882edb6c6e and project 6c27fff94315415da226f59a0c9de354. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:02:34.862914 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86f18c80-a71a-48af-84f0-d0501a259f09 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.54 time: 0.280158 May 07 22:02:34.869087 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2103/4145] 10.222.0.32 () {62 vars in 1198 bytes} [Sat May 7 22:02:34 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 282 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 07 22:02:34.875470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:34.876818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:34.891001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:34.891503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:34.893349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:34.893884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:35.059037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2957a388-e8bd-40c2-9301-3eccf613bc7d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:35.069039 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2957a388-e8bd-40c2-9301-3eccf613bc7d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1222 microversion: 2.1 time: 0.297649 May 07 22:02:35.072186 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2043/4146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:34 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1222 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:35.081781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1013078567", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:35.086180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:35.094902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:35.096381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:35.097445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:35.098355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:35.457935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:02:35.458370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:02:35.458901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:02:35.459323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:02:35.460336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:02:35.848967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:35.890379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:35.891603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:35.897822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:35.903009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:36.031477 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-deb91f0a-01b3-4ecf-bc79-3135ae626149 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "POST /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920/action" status: 202 len: 1140 microversion: 2.54 time: 0.944118 May 07 22:02:36.033098 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2044/4147] 10.222.0.32 () {62 vars in 1319 bytes} [Sat May 7 22:02:35 2022] POST /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920/action => generated 1140 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 07 22:02:36.045561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:36.046898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:36.064034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:36.065313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:36.066484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:36.067412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:36.071450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:36.091305 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-578b424c-6578-4f83-bddf-9348a93960c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1679 microversion: 2.1 time: 1.222102 May 07 22:02:36.092134 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2104/4148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:34 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1679 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:36.113923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:36.120447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:36.159431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:36.160479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:36.161487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:36.162207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:36.383056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:36.418241 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2d1cd6f8-62ae-409a-ab6d-f78ec21a9497 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1299 microversion: 2.1 time: 0.382589 May 07 22:02:36.424033 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2045/4149] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:36 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1299 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:36.436354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:36.436995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:36.452576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:36.453131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:36.453805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:36.454241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:36.563440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:36.597325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:36.604315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:36.610386 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-efb36f5a-34cd-46b5-b6f4-947ec70a1f24 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.515333 May 07 22:02:36.615428 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2105/4150] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:36 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:37.004476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:37.019357 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-060fc557-a328-4516-a8dd-29b5cc4eb91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1274 microversion: 2.1 time: 0.593834 May 07 22:02:37.019948 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2046/4151] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:36 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1274 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:37.111435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:37.112234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:37.133040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:37.140962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:37.141893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:37.149463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:37.442156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:37.442929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:37.454122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:37.454583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:37.468495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:37.469438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:37.863047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:37.872038 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-892d0ae3-9888-4d2a-aabb-ca7f4482a552 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.434133 May 07 22:02:37.872733 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2047/4152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:37 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:37.879509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:37.880406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:37.887286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:37.887813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:37.888687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:37.889360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.194626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:38.211279 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc6bfb14-b8e6-4f9c-96cd-885071b18f67 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1679 microversion: 2.1 time: 1.105507 May 07 22:02:38.214795 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2106/4153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:37 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1679 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:38.221876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:38.227728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:38.292622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.300106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.301089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.305178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.309843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:38.321561 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12b3e5ea-4e76-4ef9-8a0d-fe48d3dfa89d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.447208 May 07 22:02:38.328815 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2048/4154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:37 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:38.343155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:38.344730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:38.362014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.363619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.365685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.366410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.602648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:38.617482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1ae8b0d1-d54e-4a58-a2a6-07fab3c57410 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1280 microversion: 2.1 time: 0.284575 May 07 22:02:38.623494 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2049/4155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:38 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1280 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:38.630458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23950c05-4594-4764-8877-512223834696 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-454317157"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:38.633018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-23950c05-4594-4764-8877-512223834696 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:38.644328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23950c05-4594-4764-8877-512223834696 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.644776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23950c05-4594-4764-8877-512223834696 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.645584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23950c05-4594-4764-8877-512223834696 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.646040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23950c05-4594-4764-8877-512223834696 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.664915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:38.675085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:38.677115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:38.679037 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-87863a06-a278-46e7-baf1-3277fb334944 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.462869 May 07 22:02:38.680421 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2107/4156] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:38 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:38.891667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:38.892381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:38.906875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.909767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:38.911542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:38.911999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.120922 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23950c05-4594-4764-8877-512223834696 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.495642 May 07 22:02:39.122285 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2050/4157] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:02:38 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 07 22:02:39.232713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:39.233675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:39.241617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:39.243550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.244821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:39.245692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.521797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:39.535993 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eacc59d2-c909-4e8e-8cbe-0168c12fb92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.647248 May 07 22:02:39.537279 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2108/4158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:38 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:39.593605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9bf00ec7-c33b-46ab-832d-a0eabc8b5e10 req-d11a8c3d-718d-4072-ba14-3622bcff8de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e381dd-9f23-442c-80d2-8623a85c3e50", "tag": "8c6248c5-d242-4598-8d78-5b4023298e63"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:39.611343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9bf00ec7-c33b-46ab-832d-a0eabc8b5e10 req-d11a8c3d-718d-4072-ba14-3622bcff8de5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:39.613962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9bf00ec7-c33b-46ab-832d-a0eabc8b5e10 req-d11a8c3d-718d-4072-ba14-3622bcff8de5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.667499 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9bf00ec7-c33b-46ab-832d-a0eabc8b5e10 req-d11a8c3d-718d-4072-ba14-3622bcff8de5 service nova] Creating event network-changed:8c6248c5-d242-4598-8d78-5b4023298e63 for instance 96e381dd-9f23-442c-80d2-8623a85c3e50 on nch2-master-1 May 07 22:02:39.683975 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9bf00ec7-c33b-46ab-832d-a0eabc8b5e10 req-d11a8c3d-718d-4072-ba14-3622bcff8de5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094145 May 07 22:02:39.685030 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2109/4159] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:02:39.703070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:39.704012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:39.727643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:39.728101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.729120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:39.731407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.835542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:39.847482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e5639cde-8244-4535-b391-d876c480b975 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1679 microversion: 2.1 time: 0.619876 May 07 22:02:39.857482 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2051/4160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:39 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1679 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:39.857482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:39.857482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:39.865066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:39.865526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.866934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:39.867600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:39.951436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:39.972250 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76efc295-ec9b-449c-a261-c6600d3cf520 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1280 microversion: 2.1 time: 0.285559 May 07 22:02:39.972865 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2110/4161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:39 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:40.291955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-374a843f-f7f6-4ee1-8245-7d7f0bae1d0c req-9cdd24a9-6bb6-45c1-aa53-24a6e425dc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac24695-8d11-4a29-bf87-a5c11bd5c2e6", "tag": "4b1c916d-b8cd-474a-b59a-7503fddbe26b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:40.316129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-374a843f-f7f6-4ee1-8245-7d7f0bae1d0c req-9cdd24a9-6bb6-45c1-aa53-24a6e425dc3d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:40.317260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-374a843f-f7f6-4ee1-8245-7d7f0bae1d0c req-9cdd24a9-6bb6-45c1-aa53-24a6e425dc3d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:40.335895 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-374a843f-f7f6-4ee1-8245-7d7f0bae1d0c req-9cdd24a9-6bb6-45c1-aa53-24a6e425dc3d service nova] Creating event network-changed:4b1c916d-b8cd-474a-b59a-7503fddbe26b for instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 on nch1-master-1 May 07 22:02:40.348439 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-374a843f-f7f6-4ee1-8245-7d7f0bae1d0c req-9cdd24a9-6bb6-45c1-aa53-24a6e425dc3d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060962 May 07 22:02:40.349792 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2111/4162] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:40.450663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:40.462891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:40.468086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:40.469647 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-75a99cd2-4cf9-46e1-8d1b-ca1372da173a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.620220 May 07 22:02:40.487741 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2052/4163] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:39 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:40.559620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:40.560424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:40.568115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:40.569416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:40.570314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:40.573008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:40.866005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:40.868434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:40.890452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:40.892411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:40.896875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:40.901523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:40.959309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:40.969189 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-402a6116-f715-4b80-bb02-ffacc1b6d8a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.419364 May 07 22:02:40.969793 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2112/4164] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:40 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:40.994706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:40.996159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:41.002804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:41.004132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:41.005331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:41.005961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:41.219574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:41.227142 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b2cf1b2-9de0-4c88-8f2b-4218ab382f4d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1679 microversion: 2.1 time: 0.365708 May 07 22:02:41.238628 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2053/4165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:40 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1679 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:41.350615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:41.360712 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59f9ac75-7923-44a4-8acf-a84266000d75 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.368284 May 07 22:02:41.360712 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2113/4166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:40 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:41.498257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:41.499255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:41.512419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:41.514699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:41.516836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:41.518447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:41.541506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e5ab0dbc-1b0d-46fc-8e96-4c965810c613 req-7a996b35-9a7f-49c2-ab66-3a8568505dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-unplugged", "status": "completed", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:41.576614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e5ab0dbc-1b0d-46fc-8e96-4c965810c613 req-7a996b35-9a7f-49c2-ab66-3a8568505dc0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:41.577334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e5ab0dbc-1b0d-46fc-8e96-4c965810c613 req-7a996b35-9a7f-49c2-ab66-3a8568505dc0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:41.591728 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e5ab0dbc-1b0d-46fc-8e96-4c965810c613 req-7a996b35-9a7f-49c2-ab66-3a8568505dc0 service nova] Creating event network-vif-unplugged:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:02:41.598921 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e5ab0dbc-1b0d-46fc-8e96-4c965810c613 req-7a996b35-9a7f-49c2-ab66-3a8568505dc0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062426 May 07 22:02:41.602125 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2114/4167] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:02:41.644478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:41.655662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:41.657342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:41.658557 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8ddb1889-b0bd-4105-8a6c-195a6b172c16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.167682 May 07 22:02:41.665114 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2054/4168] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:41 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:41.988215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:41.989032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:42.001097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.003631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.005447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.008291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.192063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:42.201815 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-448c39fb-3aaf-4b82-8952-3db9e802265e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.218796 May 07 22:02:42.223179 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2115/4169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:41 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:42.244866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:42.245505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:42.258246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.259089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.275720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.276314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.367720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4f7f60be-92b8-48fb-b5dc-785c8eaba228 req-56793b9e-dac2-4102-a5ba-c88d2404248a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7872598a-70de-4e95-af09-8b55fd257508", "tag": "127ac58f-e629-45c6-b98f-fcf671fde77b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:42.390293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f7f60be-92b8-48fb-b5dc-785c8eaba228 req-56793b9e-dac2-4102-a5ba-c88d2404248a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.390756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4f7f60be-92b8-48fb-b5dc-785c8eaba228 req-56793b9e-dac2-4102-a5ba-c88d2404248a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.415709 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4f7f60be-92b8-48fb-b5dc-785c8eaba228 req-56793b9e-dac2-4102-a5ba-c88d2404248a service nova] Creating event network-changed:127ac58f-e629-45c6-b98f-fcf671fde77b for instance 7872598a-70de-4e95-af09-8b55fd257508 on nch1-master-1 May 07 22:02:42.424987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4f7f60be-92b8-48fb-b5dc-785c8eaba228 req-56793b9e-dac2-4102-a5ba-c88d2404248a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060086 May 07 22:02:42.427695 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2116/4170] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:02:42.439500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:42.441367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:42.461256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.463790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.464776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.467010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.688571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:42.699565 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bdf6af75-a775-4ba4-af3a-4e57ec334112 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1679 microversion: 2.1 time: 0.458249 May 07 22:02:42.708040 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2055/4171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:42 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1679 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:42.713858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:42.714752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:42.721003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.721744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.722718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:42.723356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:42.900279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:42.912140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:42.916247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:42.919220 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-16fa1fc4-10d7-4388-a866-76403ba04b30 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.209742 May 07 22:02:42.925826 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2056/4172] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:42 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:43.160882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:43.170714 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fe454e6b-9580-41ba-9204-fe9622b9ddac tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.739441 May 07 22:02:43.175185 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2117/4173] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:42 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:43.224417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:43.225096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:43.254645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:43.257561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:43.259886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:43.261731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:43.717412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:43.718582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:43.736384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:43.738984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:43.738984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:43.741544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:43.953155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:43.964298 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a963bd18-62a7-4f9b-b3c7-dbf2f91a752e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.747838 May 07 22:02:43.970913 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2057/4174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:43 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:43.987222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:43.989795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:44.002839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:44.008766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:44.011100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:44.011777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:44.184183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:44.201474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:44.208204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:44.212327 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f18f7d3-0ed4-45a5-aaaa-155ab4ec805e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.237290 May 07 22:02:44.227070 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2058/4175] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:43 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:44.236313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:44.237247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:44.246527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:44.247416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:44.249053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:44.249847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:44.544073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:44.558131 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3c0286a-5584-4ada-a8b3-2be5a4aa4182 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.329149 May 07 22:02:44.576175 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2059/4176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:44 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:44.592953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:44.647918 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-299ef8bf-ea82-47c7-a107-68f400498c92 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1656 microversion: 2.1 time: 0.921591 May 07 22:02:44.648596 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2118/4177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:43 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1656 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:44.670128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9895ef3e-ee24-4cba-9077-f56851cd9054 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:44.683741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9895ef3e-ee24-4cba-9077-f56851cd9054 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:44.684896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9895ef3e-ee24-4cba-9077-f56851cd9054 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:44.759942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9895ef3e-ee24-4cba-9077-f56851cd9054 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Going to try to start instance {{(pid=136681) start /opt/stack/nova/nova/compute/api.py:2730}} May 07 22:02:44.861464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9895ef3e-ee24-4cba-9077-f56851cd9054 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action" status: 202 len: 0 microversion: 2.1 time: 0.195745 May 07 22:02:44.866069 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2060/4178] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:02:44 2022] POST /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:02:44.875451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:44.875451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:44.884532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:44.899097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:44.900102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:44.900577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:44.990825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:44.992269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:45.017326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:45.018500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:45.020491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:45.020954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:45.262713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:45.277054 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-349e79dd-47b4-43ac-91a4-7afdcbc7386d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.298785 May 07 22:02:45.280780 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2061/4179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:44 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:45.302682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:45.303989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:45.317897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:45.318634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:45.321904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:45.326717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:45.467496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:45.495158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:45.497579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:45.499340 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-67304bbe-eeb3-4fa4-aa3a-d82f78ee69b3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.214585 May 07 22:02:45.500106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2062/4180] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:45 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:45.509314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-74b3fafe-759d-47a8-91bf-487d74c83116 req-fe2ea23a-eb0c-428e-bea2-6b126a2dfd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e381dd-9f23-442c-80d2-8623a85c3e50", "name": "network-vif-plugged", "status": "completed", "tag": "8c6248c5-d242-4598-8d78-5b4023298e63"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:45.529579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-74b3fafe-759d-47a8-91bf-487d74c83116 req-fe2ea23a-eb0c-428e-bea2-6b126a2dfd50 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:45.531963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-74b3fafe-759d-47a8-91bf-487d74c83116 req-fe2ea23a-eb0c-428e-bea2-6b126a2dfd50 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:45.563202 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-74b3fafe-759d-47a8-91bf-487d74c83116 req-fe2ea23a-eb0c-428e-bea2-6b126a2dfd50 service nova] Creating event network-vif-plugged:8c6248c5-d242-4598-8d78-5b4023298e63 for instance 96e381dd-9f23-442c-80d2-8623a85c3e50 on nch2-master-1 May 07 22:02:45.607687 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-74b3fafe-759d-47a8-91bf-487d74c83116 req-fe2ea23a-eb0c-428e-bea2-6b126a2dfd50 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105936 May 07 22:02:45.629506 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2063/4181] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:45.652122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:45.657032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:45.699331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:45.706243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:45.707130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:45.707583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:46.340207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:46.347766 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-493d057c-3fe1-43ec-9066-db768c497e7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.711811 May 07 22:02:46.355132 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2064/4182] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:45 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:46.360049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:46.369250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:46.383749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:46.384482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:46.386387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:46.390547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:46.627705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:46.636399 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d2b5b86-0cb6-40b3-ae7d-80c3e3c9532f tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1665 microversion: 2.1 time: 1.768285 May 07 22:02:46.637589 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2119/4183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:44 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1665 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:46.643950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:46.644852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:46.654313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:46.655502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:46.663533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:46.664331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:46.729425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:46.740249 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05eb630e-13c7-4d17-9946-89e9ea0b2a7e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.383956 May 07 22:02:46.751241 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2065/4184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:46 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:47.038509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:47.052161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:47.054203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:47.059678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b3ff59f-19f3-4605-b35c-400ff64fdb1e tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.420394 May 07 22:02:47.061826 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2120/4185] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:46 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:47.366537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:47.367709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:47.388585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:47.389054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:47.389852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:47.390310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:47.654514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:47.655152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:47.667736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:47.671795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:47.672653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:47.673107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:47.781742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:47.792503 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81bc497c-63c7-4a4a-81f7-f598afeff91a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.432410 May 07 22:02:47.795460 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2066/4186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:47 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:47.811824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:47.820811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:47.829213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:47.829867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:47.831346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:47.831980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:48.175913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:48.203292 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54caa06e-2324-462a-8cf1-6527cee06a3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.405424 May 07 22:02:48.208982 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2067/4187] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:47 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:48.216317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d834519b-2eb9-49ab-9d2f-984977fa1d8f req-ed0b7e80-50dd-4c0b-ae9d-33d064b33f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac24695-8d11-4a29-bf87-a5c11bd5c2e6", "name": "network-vif-plugged", "status": "completed", "tag": "4b1c916d-b8cd-474a-b59a-7503fddbe26b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:48.219478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:48.238872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d1e9bd12-0037-4317-8c76-d69492261575 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1665 microversion: 2.1 time: 0.587583 May 07 22:02:48.249378 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2121/4188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:47 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1665 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:48.252766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:48.253701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d834519b-2eb9-49ab-9d2f-984977fa1d8f req-ed0b7e80-50dd-4c0b-ae9d-33d064b33f74 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:48.254651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:48.254843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d834519b-2eb9-49ab-9d2f-984977fa1d8f req-ed0b7e80-50dd-4c0b-ae9d-33d064b33f74 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:48.270743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:48.271539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:48.273470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:48.274112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:48.284168 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d834519b-2eb9-49ab-9d2f-984977fa1d8f req-ed0b7e80-50dd-4c0b-ae9d-33d064b33f74 service nova] Creating event network-vif-plugged:4b1c916d-b8cd-474a-b59a-7503fddbe26b for instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 on nch1-master-1 May 07 22:02:48.300978 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d834519b-2eb9-49ab-9d2f-984977fa1d8f req-ed0b7e80-50dd-4c0b-ae9d-33d064b33f74 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090205 May 07 22:02:48.302000 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2068/4189] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:48.518134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:48.574325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:48.576109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:48.577347 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6b3aa68-7933-47ac-bf3b-e0587e5a9289 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.333627 May 07 22:02:48.608279 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2122/4190] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:48 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:48.813297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:48.814013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:48.829023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:48.829763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:48.830738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:48.831427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:49.101912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:49.115447 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b54fe5f7-dd16-4d21-83e6-94d2254f99f9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.307430 May 07 22:02:49.117536 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2069/4191] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:48 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:49.223316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:49.223943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:49.231363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:49.232038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:49.233009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:49.233611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:49.260249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:49.260935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:49.277979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:49.278460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:49.282233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:49.283145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:49.435578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:49.444933 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b1da3ce6-56bc-4419-b78a-d6ed9034c396 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1366 microversion: 2.1 time: 0.227073 May 07 22:02:49.458498 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2123/4192] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:49 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:49.483804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:49.492674 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e22ee212-86e4-4667-b3ef-385f7aee1666 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1665 microversion: 2.1 time: 0.238318 May 07 22:02:49.493263 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2070/4193] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:49 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1665 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:49.617389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:49.618343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:49.626469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:49.627280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:49.628559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:49.629233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:49.797873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:49.814370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:49.816646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:49.818476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-29ffb743-96ba-4ef6-880d-c22f1ed67e16 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.206492 May 07 22:02:49.831065 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2124/4194] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:49 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:50.139373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:50.140166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:50.163226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.164843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.167179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.168083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.327877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-07a6dfaa-9d61-4e48-823c-b672a2466f10 req-1930f2b8-5e07-496e-a8dd-66568910af07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-plugged", "status": "completed", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:50.355206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-07a6dfaa-9d61-4e48-823c-b672a2466f10 req-1930f2b8-5e07-496e-a8dd-66568910af07 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.360034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-07a6dfaa-9d61-4e48-823c-b672a2466f10 req-1930f2b8-5e07-496e-a8dd-66568910af07 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.416138 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-07a6dfaa-9d61-4e48-823c-b672a2466f10 req-1930f2b8-5e07-496e-a8dd-66568910af07 service nova] Creating event network-vif-plugged:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:02:50.433566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-07a6dfaa-9d61-4e48-823c-b672a2466f10 req-1930f2b8-5e07-496e-a8dd-66568910af07 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115263 May 07 22:02:50.440683 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2125/4195] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:50.465560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:50.466648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:50.476901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:50.479874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.481440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.495712 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed874ca1-685f-404c-a587-0c44ae728858 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.365601 May 07 22:02:50.496265 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2071/4196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:50 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:50.502171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.505325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.525444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:50.526102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:50.550538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.550538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.554728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.555202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.808637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:50.819464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2ed8b1a7-c60a-4ac6-8e26-fcd90bd85895 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1669 microversion: 2.1 time: 0.310766 May 07 22:02:50.822502 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2072/4197] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:50 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:50.837986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:50.839708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:50.840583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:50.847426 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d5df6c34-1e5e-4111-9cb8-5f5da897a049 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1556 microversion: 2.1 time: 0.386876 May 07 22:02:50.848593 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2126/4198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:50 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1556 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:50.853736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.854210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.855488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.855950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.871975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d1977d4d-78e6-4cd8-93dd-b33ad6ea5f57 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:50.873317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d1977d4d-78e6-4cd8-93dd-b33ad6ea5f57 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:50.883469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1977d4d-78e6-4cd8-93dd-b33ad6ea5f57 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.885633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1977d4d-78e6-4cd8-93dd-b33ad6ea5f57 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.886449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1977d4d-78e6-4cd8-93dd-b33ad6ea5f57 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:50.886937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d1977d4d-78e6-4cd8-93dd-b33ad6ea5f57 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:50.967733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:50.978832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:50.981358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:50.982790 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91a75264-8b95-42d7-8d99-06ce93c2e1c3 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.148958 May 07 22:02:50.983822 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2073/4199] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:50 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:02:51.024372 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d1977d4d-78e6-4cd8-93dd-b33ad6ea5f57 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157720 May 07 22:02:51.025202 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2127/4200] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:02:50 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:51.523054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:51.526424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:51.555275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:51.555994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:51.556853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:51.557279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:51.938671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:51.951245 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53c4f820-653a-47fa-923d-ccdc4c15944e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.439264 May 07 22:02:51.951880 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2074/4201] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:51 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:02:52.005156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:52.006529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:52.025754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:52.026509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:52.027544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:52.029008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:52.289053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:52.301565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:52.304447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:52.312752 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e17c296-a9e6-4a1a-bfd2-c49dbb512090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.312438 May 07 22:02:52.326575 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2128/4202] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:51 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:52.968891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:52.969527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:52.993820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:52.994409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:52.996545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:52.997014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:53.306184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:53.326466 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-094a5eda-e72e-4823-a913-e739febbfbca tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.350895 May 07 22:02:53.326466 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2075/4203] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:52 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:53.332895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:53.334098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:53.345461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:53.345927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:53.346733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:53.351338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:53.550440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:53.559892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:53.573082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:53.583683 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-524e98d4-5b59-4063-a00c-1ae1cad5b0f1 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.252474 May 07 22:02:53.585129 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2129/4204] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:53 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:53.734486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-37aa6af6-3b9b-4bb3-9833-0695be444798 req-d0f70502-5c71-43de-bd5d-7c823d743cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7872598a-70de-4e95-af09-8b55fd257508", "name": "network-vif-plugged", "status": "completed", "tag": "127ac58f-e629-45c6-b98f-fcf671fde77b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:53.747190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-37aa6af6-3b9b-4bb3-9833-0695be444798 req-d0f70502-5c71-43de-bd5d-7c823d743cec service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:53.747644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-37aa6af6-3b9b-4bb3-9833-0695be444798 req-d0f70502-5c71-43de-bd5d-7c823d743cec service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:53.796773 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-37aa6af6-3b9b-4bb3-9833-0695be444798 req-d0f70502-5c71-43de-bd5d-7c823d743cec service nova] Creating event network-vif-plugged:127ac58f-e629-45c6-b98f-fcf671fde77b for instance 7872598a-70de-4e95-af09-8b55fd257508 on nch1-master-1 May 07 22:02:53.807775 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-37aa6af6-3b9b-4bb3-9833-0695be444798 req-d0f70502-5c71-43de-bd5d-7c823d743cec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078030 May 07 22:02:53.813588 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2076/4205] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:02:54.117508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ffa46b03-8d85-486b-b3e2-6b0c6349b08a req-204543a1-b8f8-426b-830a-8007e07ba1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac24695-8d11-4a29-bf87-a5c11bd5c2e6", "tag": "4b1c916d-b8cd-474a-b59a-7503fddbe26b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:54.138453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ffa46b03-8d85-486b-b3e2-6b0c6349b08a req-204543a1-b8f8-426b-830a-8007e07ba1f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:54.140858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ffa46b03-8d85-486b-b3e2-6b0c6349b08a req-204543a1-b8f8-426b-830a-8007e07ba1f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:54.164805 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ffa46b03-8d85-486b-b3e2-6b0c6349b08a req-204543a1-b8f8-426b-830a-8007e07ba1f7 service nova] Creating event network-changed:4b1c916d-b8cd-474a-b59a-7503fddbe26b for instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 on nch1-master-1 May 07 22:02:54.172869 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ffa46b03-8d85-486b-b3e2-6b0c6349b08a req-204543a1-b8f8-426b-830a-8007e07ba1f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060957 May 07 22:02:54.174290 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2130/4206] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:02:54.347307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:54.361008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:54.403872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:54.406173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:54.407231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:54.410452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:54.607779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:54.609228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:54.636382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:54.642019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:54.646270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:54.647299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:54.836507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:54.850440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:54.855228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:54.857195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:54.857512 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0b698fe-3649-4337-b532-fd6f03b6c384 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.256925 May 07 22:02:54.858383 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2131/4207] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:54 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:02:54.866932 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-680c0b52-34aa-4dcd-ae89-a033ee524d87 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1322 microversion: 2.1 time: 0.528940 May 07 22:02:54.867521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2077/4208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:54 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:55.886968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:55.887712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:55.891722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:55.892366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:55.905673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:55.906143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:55.906982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:55.907455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:55.911877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:55.919301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:55.920967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:55.922295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:56.182384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:56.208104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:56.215960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:56.221154 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c562db18-aed6-4eb8-b718-270596fbfee9 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.346788 May 07 22:02:56.239928 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2132/4209] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:55 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:56.305139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:56.325821 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd0d08b8-7793-4a73-81c8-fe13a1c3a739 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1516 microversion: 2.1 time: 0.445606 May 07 22:02:56.341036 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2078/4210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:55 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1516 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:56.348604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:02:56.350262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:56.363860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:56.364331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:56.365427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:56.366412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:56.445700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lazy-loading 'flavor' on Instance uuid 7872598a-70de-4e95-af09-8b55fd257508 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:02:56.653767 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-120d05cd-89da-450e-aa81-84df8a851d41 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508/action" status: 200 len: 32 microversion: 2.1 time: 0.313463 May 07 22:02:56.655576 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2133/4211] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:02:56 2022] POST /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508/action => generated 32 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 07 22:02:56.666033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:56.666946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:56.674073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:56.674811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:56.675950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:56.676589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:56.956070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:56.978300 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7db825d-187d-4715-9c14-53d3584b79d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.317943 May 07 22:02:56.979947 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2079/4212] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:56 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:57.249078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:57.251323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:57.265021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:57.266058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:57.269625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:57.271291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:57.473014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:57.484854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:57.487870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:57.491276 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48d062d6-a63a-4800-8fd3-3026daaaf848 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.248614 May 07 22:02:57.492541 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2134/4213] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:57 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:57.996958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:57.997587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:58.009734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:58.015037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:58.015844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:58.016301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:58.269039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:58.280037 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb0d5981-4adc-4f83-b78a-a7a40dd319cc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.287259 May 07 22:02:58.280963 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2080/4214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:57 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:58.509792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:58.511086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:58.519387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:58.520086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:58.521057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:58.521725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:58.636720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:58.649142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:58.652058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:58.653650 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a7d5a2ef-fad8-41d0-b146-95e6ea7f7690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.148016 May 07 22:02:58.667315 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2135/4215] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:58 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:02:59.298392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:59.299066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:59.307841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:59.308541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:59.309329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:59.309777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:59.542691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:59.552212 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fcdf751-7ac8-41f8-8dd8-ee040d7620a4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.256908 May 07 22:02:59.553455 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2081/4216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:02:59 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:02:59.674003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:02:59.674633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:02:59.682461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:59.686389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:59.687759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:02:59.691936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:02:59.778240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:59.789409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:59.791930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:02:59.794097 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cee68f65-3d76-4957-9648-43703f065690 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.124438 May 07 22:02:59.795934 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2136/4217] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:02:59 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:03:00.572982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:00.573593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:00.592464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:00.598327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:00.599469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:00.601228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:00.815286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:00.816056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:00.829560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:00.829942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:00.830754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:00.831230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:00.893962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:00.904800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc308c66-0ee7-4612-8858-3b973f679b82 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.336881 May 07 22:03:00.914378 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2082/4218] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:00 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:00.955012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:00.974187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:00.976746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:00.979314 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-23806477-1b93-4be0-abf8-6b2ab1675090 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.168437 May 07 22:03:00.981096 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2137/4219] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:00 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:03:01.921813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:01.922427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:01.929394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:01.934080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:01.936051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:01.936726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:02.001329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:02.001989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:02.012708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:02.015198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:02.015198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:02.015198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:02.120169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:02.124835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:02.128736 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5511796-690f-4bd2-978d-c4248b27f6c2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.211066 May 07 22:03:02.129335 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2083/4220] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:01 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:02.134904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:02.135306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:02.136614 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5803861d-c23e-42fc-9f97-868f11ad7c73 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1409 microversion: 2.54 time: 0.139991 May 07 22:03:02.137673 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2138/4221] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:01 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1409 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:03:02.206598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:02.207259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:02.214023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:02.219409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:02.220388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:02.221025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:02.398937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:02.410509 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ed562e0-5ca8-4c2e-b302-a52222348e7c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.208979 May 07 22:03:02.414823 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2139/4222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:02 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:03.148151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:03.148782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:03.155786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.156459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:03.157088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:03.160291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.161896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.163192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.171222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.171912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.172843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.173428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.251200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:03.260069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:03.262297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:03.263808 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1c9c8b6-176c-411c-b8f9-c646b3887cbf tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1415 microversion: 2.54 time: 0.111995 May 07 22:03:03.264415 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2140/4223] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:03 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1415 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:03:03.321431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:03.328928 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f526f8c5-c664-4d30-af3b-15165198796c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.184735 May 07 22:03:03.329683 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2084/4224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:03 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:03.429100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:03.429643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:03.436212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.436678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.437465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.437912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.599227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:03.607959 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-073628cb-f08a-4ffa-a5de-59a2599ac074 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.183558 May 07 22:03:03.619861 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2141/4225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:03 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:03.625383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8384385-0436-4af4-a985-25de79ba043d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1267344456"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:03.626755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c8384385-0436-4af4-a985-25de79ba043d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:03.632995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8384385-0436-4af4-a985-25de79ba043d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.633684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8384385-0436-4af4-a985-25de79ba043d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.634462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8384385-0436-4af4-a985-25de79ba043d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.634940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8384385-0436-4af4-a985-25de79ba043d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.962600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c8384385-0436-4af4-a985-25de79ba043d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.340779 May 07 22:03:03.966820 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2085/4226] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:03 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 07 22:03:03.973251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:03.974179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:03.991140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.992008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:03.993065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:03.993884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:04.157129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:04.170659 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da019230-172f-417b-a75e-d0053f511774 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.201307 May 07 22:03:04.171733 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2142/4227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:03 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:04.284795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:04.285584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:04.294517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:04.295220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:04.296216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:04.297435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:04.346195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:04.346990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:04.386374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:04.387080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:04.388157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:04.394183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:04.407076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:04.419781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:04.422106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:04.423902 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-256f4016-729a-40ba-ab74-8c0489ac6b4b tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1415 microversion: 2.54 time: 0.144343 May 07 22:03:04.436734 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2086/4228] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:04 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1415 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:03:04.561415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:04.569746 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5f09ea0-3b2e-459b-ae42-f16e26ff99da tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.228139 May 07 22:03:04.570371 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2143/4229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:04 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:05.189165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:05.190039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:05.196888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.197436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.198312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.198853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.343184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:05.352364 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29248ae5-4807-44a2-a43c-aaa89d36d117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.167608 May 07 22:03:05.362465 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2087/4230] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:05 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:05.446305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:05.447032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:05.455225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.455794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.456773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.457332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.535557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:05.546922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:05.548724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:05.549935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aec6ff9e-da6a-4466-9c25-3f6bc3d084bb tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1400 microversion: 2.54 time: 0.108720 May 07 22:03:05.550817 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2144/4231] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:05 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1400 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:03:05.568487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3789e17d-7fa6-4e1a-a88d-4cfea0cb1013 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '.version_select at 0x7fc40fc64040>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:05.589122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:05.589795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:05.592726 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3789e17d-7fa6-4e1a-a88d-4cfea0cb1013 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1013078567" status: 204 len: 0 microversion: 2.54 time: 0.028538 May 07 22:03:05.593754 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2088/4232] 10.222.0.32 () {60 vars in 1318 bytes} [Sat May 7 22:03:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1013078567 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 22:03:05.598258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.598979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.600369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.601000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.611908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:05.613073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:05.621068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.621644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.623031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.623591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.659392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:03:05.791892 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff63a52b-d9e1-480e-85a2-1a29779ddace tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "DELETE /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 204 len: 0 microversion: 2.54 time: 0.184383 May 07 22:03:05.793208 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2089/4233] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:03:05 2022] DELETE /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 07 22:03:05.816606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:05.817269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:05.826501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.827671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.828635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:05.829252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:05.836962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:05.847737 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4722f1a9-9fac-47af-b65e-42fa36c9706a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.261515 May 07 22:03:05.847737 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2145/4234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:05 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:06.236336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:06.247981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:06.250270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:06.251531 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-253195e3-5e68-4d4e-8c09-90f395ed5a76 tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1406 microversion: 2.54 time: 0.454293 May 07 22:03:06.254990 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2090/4235] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:05 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:03:06.370216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:06.370969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:06.377707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:06.378242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:06.379141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:06.379663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:06.531196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:06.541326 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd7aef2e-afed-4185-9a16-9937acc39d2b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1687 microversion: 2.1 time: 0.174934 May 07 22:03:06.555878 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2146/4236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:06 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:06.863499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:06.865757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:06.891689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:06.892257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:06.893980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:06.894647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:07.072095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:07.080063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b228686-dcef-4ca2-9e4e-07d7699f84d4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.221037 May 07 22:03:07.084483 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2091/4237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:06 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:07.274343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:07.275955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:07.288331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:07.289024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:07.290121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:07.291008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:07.375159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:07.383602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:07.385130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb802dd28d4b3696d33a882edb6c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c27fff94315415da226f59a0c9de354', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:07.388241 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ebde238-8f32-4c60-9f48-c51eabac11af tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 200 len: 1406 microversion: 2.54 time: 0.118712 May 07 22:03:07.389955 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2147/4238] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:07 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 1406 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:03:07.562252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:07.563234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:07.572010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:07.572717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:07.573919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:07.574939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:07.748955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:07.758618 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-73feca0d-19bf-492a-ba9b-0b640e54c58c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1687 microversion: 2.1 time: 0.200818 May 07 22:03:07.759232 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2092/4239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:07 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:07.898090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-be118f4f-9f16-4463-bb32-34e9a90a8c18 req-aa9c4c06-89ad-431c-93b3-d66a9ac6194a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-unplugged", "status": "completed", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:07.923961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-be118f4f-9f16-4463-bb32-34e9a90a8c18 req-aa9c4c06-89ad-431c-93b3-d66a9ac6194a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:07.924431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-be118f4f-9f16-4463-bb32-34e9a90a8c18 req-aa9c4c06-89ad-431c-93b3-d66a9ac6194a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:07.982131 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-be118f4f-9f16-4463-bb32-34e9a90a8c18 req-aa9c4c06-89ad-431c-93b3-d66a9ac6194a service nova] Creating event network-vif-unplugged:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:03:07.998473 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-be118f4f-9f16-4463-bb32-34e9a90a8c18 req-aa9c4c06-89ad-431c-93b3-d66a9ac6194a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103969 May 07 22:03:08.006189 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2148/4240] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:08.101969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:08.103436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:08.119073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:08.121410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:08.122499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:08.125536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:08.410817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:08.410817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] [instance: 812c917a-3e44-4477-9f38-9154224d4920] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:08.420830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:08.421305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:08.422109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:08.422747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:08.472752 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] HTTP exception thrown: Instance 812c917a-3e44-4477-9f38-9154224d4920 could not be found. May 07 22:03:08.476586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] Returning 404 to user: Instance 812c917a-3e44-4477-9f38-9154224d4920 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:08.478643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1fed371e-1d06-4e65-842f-ad5333ed202a tempest-ServerShowV254Test-111077960 tempest-ServerShowV254Test-111077960-project] 10.222.0.32 "GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920" status: 404 len: 111 microversion: 2.54 time: 0.072841 May 07 22:03:08.479060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:08.480806 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2149/4241] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:03:08 2022] GET /compute/v2.1/servers/812c917a-3e44-4477-9f38-9154224d4920 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 07 22:03:08.487035 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-73fbfe90-c990-424f-98d2-7d650d32a102 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.389961 May 07 22:03:08.492673 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2093/4242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:08 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:08.776500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:08.777144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:08.786210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:08.787576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:08.798458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:08.799258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:09.061813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:09.077830 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-96b8b55e-9580-475c-a7c3-38783762e661 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.305749 May 07 22:03:09.084865 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2150/4243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:08 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:09.509331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:09.510383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:09.531250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:09.532057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:09.534009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:09.534665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:10.101939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dbe61629-f36d-49d5-991e-b7b57c99d9f9 req-c9c06657-28c6-4756-802d-5bd831e72cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-plugged", "status": "completed", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:10.130396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dbe61629-f36d-49d5-991e-b7b57c99d9f9 req-c9c06657-28c6-4756-802d-5bd831e72cb2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:10.131370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dbe61629-f36d-49d5-991e-b7b57c99d9f9 req-c9c06657-28c6-4756-802d-5bd831e72cb2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:10.169244 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dbe61629-f36d-49d5-991e-b7b57c99d9f9 req-c9c06657-28c6-4756-802d-5bd831e72cb2 service nova] Creating event network-vif-plugged:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:03:10.176533 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dbe61629-f36d-49d5-991e-b7b57c99d9f9 req-c9c06657-28c6-4756-802d-5bd831e72cb2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078299 May 07 22:03:10.178526 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2151/4244] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:03:10.187976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:10.188952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:10.198293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:10.199590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:10.200918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:10.201623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:10.540040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:10.552294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:10.565906 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0da17309-8c9b-4b09-9811-586e13215c15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 1.061122 May 07 22:03:10.567251 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2094/4245] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:09 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:10.567906 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-626952b9-fa30-4286-adbc-5065ead42263 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.387606 May 07 22:03:10.568764 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2152/4246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:10 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:11.597997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:11.598730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:11.599527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:11.600365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:11.619339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:11.619808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:11.620626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:11.622558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:11.624376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:11.625712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:11.626945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:11.635781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:11.958591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:11.977199 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8da85c36-c7f5-485f-95c7-b5b5587ad120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.394705 May 07 22:03:11.977800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2095/4247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:11 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:12.056239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:12.068848 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4728df39-2f94-49d3-bbf8-4f46457c6a05 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.485631 May 07 22:03:12.070327 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2153/4248] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:11 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:13.000101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:13.001180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:13.014149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:13.014726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:13.015697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:13.016300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:13.090126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:13.091458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:13.110627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:13.111385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:13.114119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:13.118460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:13.392675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:13.407320 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e748446-d257-48d4-bccd-10c9288d6584 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.324813 May 07 22:03:13.408416 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2154/4249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:13 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:13.443308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:13.472036 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2238bd0a-b66d-43aa-addf-955d739e5eca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.477058 May 07 22:03:13.474023 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2096/4250] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:12 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:13.692727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-839283089", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:13.785634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] validate_networks() for [('cd3974b0-b5b4-4267-bd42-3bc0d892b541', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:03:14.430975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:14.440243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:14.466434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:14.467455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:14.478578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:14.479901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:14.745889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:14.756342 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d4d25e8-ed47-4857-9e87-f1addc9cdc1d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.333019 May 07 22:03:14.760501 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2097/4251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:14 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:14.768321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:14.768960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:14.785184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:14.790884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:14.793267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:14.796711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:15.016038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:03:15.016967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:03:15.017171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:03:15.017803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:03:15.018508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:03:15.044074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:15.045775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:15.047939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:15.048916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:15.092869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Getting quotas for project 8cdcd8ea83db42c996b9c0cb8bac89aa. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:15.100071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Getting quotas for user e6abaee58e2540e090b6f53b6f6ef587 and project 8cdcd8ea83db42c996b9c0cb8bac89aa. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:15.123547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:03:15.127187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:03:15.205237 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1ed3b8c2-f08a-46c4-b7b0-dad6bff1f09d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793846 May 07 22:03:15.206758 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2155/4252] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:03:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:03:15.237112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69426e89-95d3-45b3-bded-12cddb18ab6b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:15.238923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69426e89-95d3-45b3-bded-12cddb18ab6b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:15.261869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:15.274753 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c325f3dc-5d48-42f1-bdb8-010e160f3d3b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.513019 May 07 22:03:15.276066 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2098/4253] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:14 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:15.383626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-69426e89-95d3-45b3-bded-12cddb18ab6b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:15.394727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69426e89-95d3-45b3-bded-12cddb18ab6b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1216 microversion: 2.1 time: 0.171484 May 07 22:03:15.398296 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2156/4254] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:15 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:15.777437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:15.781331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:15.800825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:15.802293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:15.804435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:15.807349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:16.120054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:16.138831 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0355446e-9961-4c47-8847-6c260e9d0fcf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.365200 May 07 22:03:16.142217 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2099/4255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:15 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:16.294327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:16.298310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:16.318724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:16.319218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:16.320033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:16.320472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:16.423882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:16.424535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:16.440986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:16.443288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:16.445121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:16.445576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:16.584521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:16.596952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-926d9b55-1571-4845-96ac-c50a7d1bd9e9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1268 microversion: 2.1 time: 0.188991 May 07 22:03:16.600441 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2100/4256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:16 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:16.850343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:16.862439 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f311bcb-613d-4f43-913d-3a37dae38116 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.572562 May 07 22:03:16.868220 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2157/4257] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:16 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:17.176247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:17.177696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:17.189946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:17.190689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:17.191748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:17.192678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:17.616247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:17.617637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:17.623844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:17.624561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:17.625543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:17.626164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:17.757355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:17.773663 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2441eb72-beec-486b-8759-036deff2363f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1274 microversion: 2.1 time: 0.162732 May 07 22:03:17.785392 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2158/4258] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:17 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:17.895963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:17.896941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:17.910140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:17.911303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:17.913532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:17.914728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:17.960391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:17.974983 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-61525ddd-4754-4f6d-9301-0ccd8c4623a3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.812871 May 07 22:03:17.980982 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2101/4259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:17 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:18.462316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:18.475791 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a9fbf3f-b463-4355-9fbb-4d02f7f592cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.594763 May 07 22:03:18.476414 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2159/4260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:17 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:18.793938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:18.794591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:18.809597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:18.810070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:18.817335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:18.824059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:18.991869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:18.992504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:19.003515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:19.003989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:19.004803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:19.005290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:19.352666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:19.370934 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-30340709-02b8-418e-b306-92773e2192a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.581002 May 07 22:03:19.372614 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2102/4261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:18 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:19.380817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d23ca4e8-d29f-4540-8394-0036d0d15032 req-7912afd3-8411-4e95-b644-8bea5da7e059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6", "tag": "49671dbb-1f39-4903-a9e1-e283831ec748"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:19.391846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d23ca4e8-d29f-4540-8394-0036d0d15032 req-7912afd3-8411-4e95-b644-8bea5da7e059 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:19.392978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d23ca4e8-d29f-4540-8394-0036d0d15032 req-7912afd3-8411-4e95-b644-8bea5da7e059 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:19.411920 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d23ca4e8-d29f-4540-8394-0036d0d15032 req-7912afd3-8411-4e95-b644-8bea5da7e059 service nova] Creating event network-changed:49671dbb-1f39-4903-a9e1-e283831ec748 for instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 on nch2-master-1 May 07 22:03:19.419590 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d23ca4e8-d29f-4540-8394-0036d0d15032 req-7912afd3-8411-4e95-b644-8bea5da7e059 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045054 May 07 22:03:19.420698 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2103/4262] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:19.437488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:19.451933 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7c42eb99-3987-4502-bcc1-d001d85c2927 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.463770 May 07 22:03:19.456456 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2160/4263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:18 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:19.498521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:19.499740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:19.522815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:19.525246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:19.530522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:19.532103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:20.077571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:20.089720 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ccfd2eef-aae8-4d5f-abaa-8de3cda065b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.598381 May 07 22:03:20.093019 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2104/4264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:19 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:20.390702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:20.391482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:20.403690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:20.404489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:20.405767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:20.406043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:20.473655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:20.475261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:20.484546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:20.491053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:20.492117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:20.492983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:20.801141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:20.804043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:20.809549 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-59875f6a-cc79-4306-b460-46a2ff855f31 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.424282 May 07 22:03:20.820102 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2161/4265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:20 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:20.820341 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c645acd7-c04b-44c8-9871-e3f6249b57de tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.345379 May 07 22:03:20.824711 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2105/4266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:20 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:21.111056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:21.111969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:21.123437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:21.124196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:21.127894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:21.129191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:21.698546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:21.714160 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-978c0a6b-50f6-4879-bbe3-db48ff9411e8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.607728 May 07 22:03:21.715199 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2162/4267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:21 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:21.833900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:21.835558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:21.837471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:21.847799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:21.853033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:21.853489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:21.854278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:21.854733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:21.894867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:21.895285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:21.899208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:21.907855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:22.230834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:22.238575 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-35b59a7e-383d-4cd1-805a-a90d6c23079d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.413559 May 07 22:03:22.241158 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2106/4268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:21 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:22.476089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:22.485169 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea19c7c1-af00-4375-98f7-c0795fffdddf tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.656805 May 07 22:03:22.493867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2163/4269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:21 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:22.732172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:22.732877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:22.743721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:22.746066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:22.750892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:22.752578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:22.958544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:22.970086 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ffd07ca-6cb8-40e2-89e9-3cd4b0e8f9bf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.242027 May 07 22:03:22.971518 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2107/4270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:22 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:23.257957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:23.258633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:23.270500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:23.276813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:23.277792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:23.292083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:23.502716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:23.503398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:23.524877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:23.525347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:23.526161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:23.526617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:23.790102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:23.803476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed9dbd74-b7df-4fa7-a84e-8094a8d8d2df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.551154 May 07 22:03:23.806900 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2164/4271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:23 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:23.990226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:23.991577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:24.002601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:24.011967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:24.013345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:24.013995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:24.173734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:24.182336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05f9a33f-9f33-4979-a861-d29425915d2e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.683565 May 07 22:03:24.194799 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2108/4272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:23 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:24.477164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:24.489081 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5c747e5-9757-4d4f-9d7f-ba3f83c8e846 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.503323 May 07 22:03:24.491076 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2165/4273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:23 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:24.824290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:24.824931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:24.844144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:24.844618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:24.845436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:24.854540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:25.140818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:25.150207 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6eb16680-f311-4052-83d5-a4d8a179fcae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.330318 May 07 22:03:25.155216 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2109/4274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:24 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:25.200384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:25.201290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:25.211424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:25.215330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:25.216384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:25.220426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:25.519345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:25.524750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:25.531197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:25.545941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:25.546757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:25.551641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:25.552893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:25.556173 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a78bae33-cb05-495e-8ebf-dc23ac8e5c29 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.357495 May 07 22:03:25.560036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2166/4275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:25 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:25.937550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:25.953978 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-57febf87-3ca0-4f26-80f7-6146743175da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.443915 May 07 22:03:25.955945 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2110/4276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:25 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:26.174934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:26.175577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:26.191287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:26.191765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:26.200531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:26.203672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:26.521672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:26.534218 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f701c56-7fb2-4cb1-944e-70b038e3c456 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.368459 May 07 22:03:26.535483 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2167/4277] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:26 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:26.578492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:26.579165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:26.593488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:26.594374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:26.595462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:26.596207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:27.025472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:27.026425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:27.050725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:27.055148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:27.056310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:27.059634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:27.217126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:27.235551 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-78e42d58-83c1-47c2-a312-a393ee5071e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.663687 May 07 22:03:27.236565 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2111/4278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:26 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:27.551524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:27.552730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:27.560790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:27.561259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:27.562047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:27.562504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:27.878973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:27.889611 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-028b1104-457e-4535-871b-8f0b4fe1ce8a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.870676 May 07 22:03:27.896692 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2168/4279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:27 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:28.227049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:28.249696 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dfec30bf-c22c-401c-bc89-eeef36b24867 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.701929 May 07 22:03:28.252074 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2112/4280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:27 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:28.254368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:28.255340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:28.264456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.265049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:28.265908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.266437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:28.617122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:28.628266 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7f140985-ee8c-4d4d-9e09-925f972a6f8f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.378548 May 07 22:03:28.629091 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2169/4281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:28 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:28.840411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-667b3957-641c-442d-b619-1bceedb71a87 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:28.841084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-667b3957-641c-442d-b619-1bceedb71a87 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:28.847687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667b3957-641c-442d-b619-1bceedb71a87 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.848940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667b3957-641c-442d-b619-1bceedb71a87 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:28.849763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667b3957-641c-442d-b619-1bceedb71a87 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.850395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667b3957-641c-442d-b619-1bceedb71a87 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:28.894170 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-667b3957-641c-442d-b619-1bceedb71a87 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6/ips" status: 200 len: 150 microversion: 2.1 time: 0.057316 May 07 22:03:28.895349 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2113/4282] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:03:28 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:28.905990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df3e22c-323c-404a-a8e6-d7e28dc9b693"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:28.907543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:28.916947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.920246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:28.921080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.921532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:28.924897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:28.933410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:28.958265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.958733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:28.959566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:28.960014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.093808 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Invalid volume: volume 5df3e22c-323c-404a-a8e6-d7e28dc9b693 is already attached to instances: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 May 07 22:03:29.094499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 400 to user: Invalid volume: volume 5df3e22c-323c-404a-a8e6-d7e28dc9b693 is already attached to instances: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:29.095495 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9826c40c-f880-413e-af98-80061e1c05e2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.194088 May 07 22:03:29.099768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2170/4283] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:03:28 2022] POST /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6/os-volume_attachments => generated 174 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:03:29.111894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-12067f62-18c3-4829-82f5-59e8d33794f9 req-03e3cc71-d0b4-4adb-a206-437d023df4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6", "name": "network-vif-plugged", "status": "completed", "tag": "49671dbb-1f39-4903-a9e1-e283831ec748"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:29.132378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-12067f62-18c3-4829-82f5-59e8d33794f9 req-03e3cc71-d0b4-4adb-a206-437d023df4a3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.132948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-12067f62-18c3-4829-82f5-59e8d33794f9 req-03e3cc71-d0b4-4adb-a206-437d023df4a3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.156360 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-12067f62-18c3-4829-82f5-59e8d33794f9 req-03e3cc71-d0b4-4adb-a206-437d023df4a3 service nova] Creating event network-vif-plugged:49671dbb-1f39-4903-a9e1-e283831ec748 for instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 on nch2-master-1 May 07 22:03:29.166729 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-12067f62-18c3-4829-82f5-59e8d33794f9 req-03e3cc71-d0b4-4adb-a206-437d023df4a3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065085 May 07 22:03:29.168851 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2171/4284] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:29.179581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:29.180731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:29.191268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.192015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.193640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.198211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.259934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:03:29.312687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:29.324924 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85b6c9e3-3867-46d1-85c9-4cdc3f53e903 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.412800 May 07 22:03:29.326621 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2114/4285] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:28 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:29.344090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3224c8b-8767-425c-8d77-3a25bc2ddfc4 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:29.345117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b3224c8b-8767-425c-8d77-3a25bc2ddfc4 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:29.369501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3224c8b-8767-425c-8d77-3a25bc2ddfc4 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.370561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3224c8b-8767-425c-8d77-3a25bc2ddfc4 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.371823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3224c8b-8767-425c-8d77-3a25bc2ddfc4 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.373633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3224c8b-8767-425c-8d77-3a25bc2ddfc4 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.390075 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae154763-5b40-47b0-bb2b-e18d81f4c563 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 204 len: 0 microversion: 2.1 time: 0.219182 May 07 22:03:29.391387 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2172/4286] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:03:29 2022] DELETE /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:03:29.402619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:29.403944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:29.413252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.414068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.415375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.416598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.442865 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b3224c8b-8767-425c-8d77-3a25bc2ddfc4 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102772 May 07 22:03:29.450954 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2115/4287] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:03:29 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:03:29.478603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:29.479269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:29.498434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.498925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.508358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.510786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.685158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:29.701606 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5d5f3743-8207-40e0-985d-bf88324e6617 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1316 microversion: 2.1 time: 0.299267 May 07 22:03:29.709905 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2173/4288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:29 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:29.735074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:29.736507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:29.747081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.747737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.748759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.749503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.822139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:03:29.868637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:29.896952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e609eb75-bdf5-4352-b57d-4601f824e6fe tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1681 microversion: 2.1 time: 0.440550 May 07 22:03:29.898229 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2116/4289] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:29 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1681 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:29.911292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:29.911928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:29.924018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.925692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.926877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.927522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.963002 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a69022e4-f9bd-4af6-940c-19086f42441d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 204 len: 0 microversion: 2.1 time: 0.244168 May 07 22:03:29.963684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2174/4290] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:03:29 2022] DELETE /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:03:29.980237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:29.981936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:29.988465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.989003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:29.990179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:29.991040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:30.205011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:30.219987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47918f46-a400-420a-95ff-80f552e8a2e6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1675 microversion: 2.1 time: 0.251492 May 07 22:03:30.223499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2175/4291] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:29 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:30.344920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:30.346331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:30.362347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:30.362857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:30.363652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:30.365340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:30.369118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:30.392394 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6232fa0d-42c3-4ea3-8fb4-58eb14d813c7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.492964 May 07 22:03:30.396435 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2117/4292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:29 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:30.625253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:30.636406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa444f78-7ee5-475f-ae86-6bee6d6d5426 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1682 microversion: 2.1 time: 0.296420 May 07 22:03:30.642287 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2176/4293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:30 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:30.725947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:30.727055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:30.736845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:30.737575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:30.739305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:30.740105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:30.917363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:30.918001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:30.944546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:30.948876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:30.952376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:30.952849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:31.108003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:31.116008 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec4ccf60-d8e5-4485-aadf-cfbee914b4d5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.394274 May 07 22:03:31.116583 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2118/4294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:30 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:31.244225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:31.247340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:31.248383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:31.257170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:31.258308 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-860888db-2b54-4e03-b365-317ab03527e9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1681 microversion: 2.1 time: 0.342827 May 07 22:03:31.258519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:31.259541 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2177/4295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:30 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1681 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:31.260349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:31.261041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:31.338476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1090030377", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:31.421495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] validate_networks() for [('cd3974b0-b5b4-4267-bd42-3bc0d892b541', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:03:31.525580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:31.538871 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a30daddd-bf64-4981-8dbd-07b0c74ae46b tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1675 microversion: 2.1 time: 0.295379 May 07 22:03:31.548843 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2119/4296] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:31 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1675 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:31.554545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:31.555213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:31.563039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:31.563429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:31.564392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:31.564875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:31.817509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:31.825987 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4117fc90-c1df-4e07-9d0b-e26ed29d9787 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.275773 May 07 22:03:31.827072 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2120/4297] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:31 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:31.838232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:31.839199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:31.851556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:31.852983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:31.854037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:31.854937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.030815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:03:32.031742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:03:32.032423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:03:32.033909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:03:32.035049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:03:32.052315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.053174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.054993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.056072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.087288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Getting quotas for project 8cdcd8ea83db42c996b9c0cb8bac89aa. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:32.094220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Getting quotas for user e6abaee58e2540e090b6f53b6f6ef587 and project 8cdcd8ea83db42c996b9c0cb8bac89aa. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:32.110386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:03:32.113989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:03:32.221061 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8e9669b2-3d30-4f94-95b1-f76828d28e4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883693 May 07 22:03:32.223680 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2178/4298] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:03:32.236429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af51f808-3826-4d49-a7c6-01d2bf5a13bb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:32.237592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af51f808-3826-4d49-a7c6-01d2bf5a13bb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:32.321493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af51f808-3826-4d49-a7c6-01d2bf5a13bb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:32.332095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af51f808-3826-4d49-a7c6-01d2bf5a13bb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1217 microversion: 2.1 time: 0.102599 May 07 22:03:32.334615 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2179/4299] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:32 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:32.341768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:32.344757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:32.357280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.358206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.359186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.360089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.655959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:32.663990 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-37e2b640-17f1-4038-968e-3031b0413cc6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1681 microversion: 2.1 time: 0.327845 May 07 22:03:32.667661 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2180/4300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:32 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1681 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:32.679778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:32.681100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:32.696262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.696726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.699904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.702178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.732810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:32.751172 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e2da1b61-eb50-45fa-a784-4c6ca4a6b2d2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.922635 May 07 22:03:32.764355 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2121/4301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:31 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:32.845792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:32.846687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:32.870152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.901297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:32.903902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:32.912097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:33.481157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:33.495249 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84a2bb62-4b17-47fc-988c-107f9b5d808b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1522 microversion: 2.1 time: 0.654432 May 07 22:03:33.498206 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2122/4302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:32 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:33.512333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:33.513285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:33.532821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:33.533467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:33.535012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:33.535717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:33.709115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:33.719178 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-16e43c35-952d-4a86-8d4b-df008f54a175 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1213 microversion: 2.1 time: 0.218709 May 07 22:03:33.719943 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2123/4303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:33 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1213 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:33.748348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:33.749026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:33.770035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:33.778969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:33.780026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:33.780491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:34.710996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:34.726647 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6a2aa979-1aa3-4259-b61e-1f53bb4c4c69 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1681 microversion: 2.1 time: 1.005739 May 07 22:03:34.727699 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2124/4304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:33 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1681 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:34.742101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-45ee25a5-ab87-4b23-83db-6b978373b5e6 req-961fb4b4-181d-4e5c-b8a8-ea146579f9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-unplugged", "status": "completed", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:34.757667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-45ee25a5-ab87-4b23-83db-6b978373b5e6 req-961fb4b4-181d-4e5c-b8a8-ea146579f9ff service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:34.758356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-45ee25a5-ab87-4b23-83db-6b978373b5e6 req-961fb4b4-181d-4e5c-b8a8-ea146579f9ff service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:34.790148 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-45ee25a5-ab87-4b23-83db-6b978373b5e6 req-961fb4b4-181d-4e5c-b8a8-ea146579f9ff service nova] Creating event network-vif-unplugged:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:03:34.809355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-45ee25a5-ab87-4b23-83db-6b978373b5e6 req-961fb4b4-181d-4e5c-b8a8-ea146579f9ff service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075879 May 07 22:03:34.810804 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2125/4305] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:34.833777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:34.836388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:34.852839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:34.853471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:34.859825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:34.860430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:34.872030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:34.890993 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd8f8c06-bc19-46b7-bf4b-eb76be1b8fa6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1675 microversion: 2.1 time: 2.220186 May 07 22:03:34.891596 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2181/4306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:32 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1675 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:34.909931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:34.910571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:34.937300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:34.937800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:34.938635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:34.939124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:35.252397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:35.265470 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44e4cfb6-6aff-4c5e-ac59-b7face4d738e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1275 microversion: 2.1 time: 0.372776 May 07 22:03:35.266743 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2182/4307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:34 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1275 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:35.272485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:35.277962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:35.294511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:35.295291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:35.296292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:35.296932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:35.849996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:35.863784 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e3014b2d-b29e-4e79-8a56-54bbe2c57873 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.595277 May 07 22:03:35.864605 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2183/4308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:35 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:35.897819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:35.900856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:35.928100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:35.928590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:35.932339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:35.933542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:36.148816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:36.161684 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-448cb062-702a-4671-81ba-ccc5815dc06f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1502 microversion: 2.1 time: 1.348666 May 07 22:03:36.162260 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2126/4309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:34 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1502 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:36.182563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:36.195459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:36.233697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:36.234382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:36.235037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:36.235495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:36.931995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:36.945275 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a224c06d-fcc1-4a29-8326-985e475009ee tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1675 microversion: 2.1 time: 0.775402 May 07 22:03:36.945896 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2127/4310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:36 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1675 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:36.955089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:36.965632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:36.980351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:36.980818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:36.981632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:36.982089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:37.078518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:37.096310 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-df6418bf-354c-4ef1-a173-a3bdc6226c28 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1614 microversion: 2.1 time: 1.229947 May 07 22:03:37.105041 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2184/4311] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:35 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1614 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:37.122202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:37.125460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:37.139767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:37.141114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:37.142690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:37.143340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:37.530908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:37.540809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac1d5369-e551-42f1-abc8-6929ea40008f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1516 microversion: 2.1 time: 0.593765 May 07 22:03:37.543688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2128/4312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:36 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1516 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:37.555316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ee307fd8-7291-424d-8e40-0c34ae61439d req-0d666c3f-a52d-4efa-84ff-ea8be9a4ba2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f9d622-1591-4442-9da0-167bdb326758", "name": "network-vif-unplugged", "status": "completed", "tag": "7246b97e-cc3a-4e69-8bd1-0d36632d83ff"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:37.575321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ee307fd8-7291-424d-8e40-0c34ae61439d req-0d666c3f-a52d-4efa-84ff-ea8be9a4ba2d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:37.575818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ee307fd8-7291-424d-8e40-0c34ae61439d req-0d666c3f-a52d-4efa-84ff-ea8be9a4ba2d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:37.603297 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ee307fd8-7291-424d-8e40-0c34ae61439d req-0d666c3f-a52d-4efa-84ff-ea8be9a4ba2d service nova] Creating event network-vif-unplugged:7246b97e-cc3a-4e69-8bd1-0d36632d83ff for instance 95f9d622-1591-4442-9da0-167bdb326758 on nch1-master-1 May 07 22:03:37.637011 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ee307fd8-7291-424d-8e40-0c34ae61439d req-0d666c3f-a52d-4efa-84ff-ea8be9a4ba2d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091652 May 07 22:03:37.639058 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2129/4313] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:37.648939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-606d28da-c685-40cb-b7a0-20c43b6a2031 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:37.650565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-606d28da-c685-40cb-b7a0-20c43b6a2031 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 6ccf7e63-dd4d-4675-a9bb-f026d61ee38c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:37.679865 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-606d28da-c685-40cb-b7a0-20c43b6a2031 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Instance 6ccf7e63-dd4d-4675-a9bb-f026d61ee38c could not be found. May 07 22:03:37.686571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-606d28da-c685-40cb-b7a0-20c43b6a2031 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 404 to user: Instance 6ccf7e63-dd4d-4675-a9bb-f026d61ee38c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:37.687725 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-606d28da-c685-40cb-b7a0-20c43b6a2031 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/6ccf7e63-dd4d-4675-a9bb-f026d61ee38c/action" status: 404 len: 111 microversion: 2.1 time: 0.045224 May 07 22:03:37.688810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2130/4314] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:37 2022] POST /compute/v2.1/servers/6ccf7e63-dd4d-4675-a9bb-f026d61ee38c/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:03:37.704070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8baba612-e27b-4252-92f8-cd5b9c5c8e16 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:37.704875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8baba612-e27b-4252-92f8-cd5b9c5c8e16 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:37.728270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8baba612-e27b-4252-92f8-cd5b9c5c8e16 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:37.728990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8baba612-e27b-4252-92f8-cd5b9c5c8e16 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:37.747830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8baba612-e27b-4252-92f8-cd5b9c5c8e16 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:37.749217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8baba612-e27b-4252-92f8-cd5b9c5c8e16 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:37.985694 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8baba612-e27b-4252-92f8-cd5b9c5c8e16 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action" status: 202 len: 0 microversion: 2.1 time: 0.288525 May 07 22:03:37.987300 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2131/4315] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:37 2022] POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:03:38.017967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:38.019840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:38.064745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.073796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:38.076593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.077255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:38.384000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:38.401839 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-38c2bb3f-7eb4-4735-8656-9fa99f5397b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1317 microversion: 2.1 time: 1.293598 May 07 22:03:38.402880 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2185/4316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:37 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1317 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:38.424607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:38.426415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:38.438973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.439793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:38.445842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.447620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:38.838919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:38.851562 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3c4f95f8-ed68-431f-a905-cadba3a93b02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1501 microversion: 2.1 time: 0.434440 May 07 22:03:38.854370 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2186/4317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:38 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1501 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:38.886461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:38.889345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:38.891758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:38.900078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2a536e53-ea69-428c-aa23-9e0af9ff06a9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 200 len: 1607 microversion: 2.1 time: 0.910860 May 07 22:03:38.906856 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2132/4318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:37 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 1607 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:38.921339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:38.922494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.923229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:38.923394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:38.926006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.931410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:38.945838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.951822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:38.957515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:38.957515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.001373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.002131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.002799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lazy-loading 'fault' on Instance uuid fac24695-8d11-4a29-bf87-a5c11bd5c2e6 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:03:39.157004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:39.166367 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b8c26b37-abeb-4173-b714-8131fe091544 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 200 len: 1331 microversion: 2.1 time: 0.310507 May 07 22:03:39.167004 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2187/4319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:38 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 1331 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:39.187646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-79fac6bc-b4b4-4c37-b9f4-3dc112dfe4ee req-2374a13b-6cc2-43f0-80b2-67f5936b4c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac24695-8d11-4a29-bf87-a5c11bd5c2e6", "name": "network-vif-deleted", "tag": "4b1c916d-b8cd-474a-b59a-7503fddbe26b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:39.202358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-79fac6bc-b4b4-4c37-b9f4-3dc112dfe4ee req-2374a13b-6cc2-43f0-80b2-67f5936b4c02 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.203155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-79fac6bc-b4b4-4c37-b9f4-3dc112dfe4ee req-2374a13b-6cc2-43f0-80b2-67f5936b4c02 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.225886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-79fac6bc-b4b4-4c37-b9f4-3dc112dfe4ee req-2374a13b-6cc2-43f0-80b2-67f5936b4c02 service nova] Creating event network-vif-deleted:4b1c916d-b8cd-474a-b59a-7503fddbe26b for instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 on nch1-master-1 May 07 22:03:39.232480 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-79fac6bc-b4b4-4c37-b9f4-3dc112dfe4ee req-2374a13b-6cc2-43f0-80b2-67f5936b4c02 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049328 May 07 22:03:39.233485 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2188/4320] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:39.241180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:39.242724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:39.251822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.255632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.257382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.261122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.319521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lazy-loading 'flavor' on Instance uuid 96e381dd-9f23-442c-80d2-8623a85c3e50 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:03:39.348001 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Cannot 'rescue' instance 96e381dd-9f23-442c-80d2-8623a85c3e50 while it is in vm_state paused May 07 22:03:39.348669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 409 to user: Cannot 'rescue' instance 96e381dd-9f23-442c-80d2-8623a85c3e50 while it is in vm_state paused {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:39.349583 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-06bd1704-30c8-4953-83ee-381a9e910b23 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action" status: 409 len: 144 microversion: 2.1 time: 0.114663 May 07 22:03:39.360734 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2189/4321] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:39 2022] POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action => generated 144 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:03:39.366457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d80a4f28-b0b1-4785-a7bb-c6b1f54f0cb9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:39.367042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d80a4f28-b0b1-4785-a7bb-c6b1f54f0cb9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:39.373946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d80a4f28-b0b1-4785-a7bb-c6b1f54f0cb9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.374965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d80a4f28-b0b1-4785-a7bb-c6b1f54f0cb9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.376092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d80a4f28-b0b1-4785-a7bb-c6b1f54f0cb9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.376773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d80a4f28-b0b1-4785-a7bb-c6b1f54f0cb9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.479124 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d80a4f28-b0b1-4785-a7bb-c6b1f54f0cb9 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action" status: 202 len: 0 microversion: 2.1 time: 0.116041 May 07 22:03:39.481271 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2190/4322] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:39 2022] POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:03:39.488293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:39.499921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e4871bb-2055-44ca-b7b9-77b4c9b7b0ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.589883 May 07 22:03:39.500201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:39.501146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:39.502384 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2133/4323] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:38 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:39.513799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:39.515270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:39.527548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.528388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.529449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.530415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.534444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.534937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.536492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.537117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.905141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:39.917567 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c697f270-36a9-49a7-99d7-3ac3a0caf1bb tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1508 microversion: 2.1 time: 0.411763 May 07 22:03:39.923382 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2134/4324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:39 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:39.929016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:39.929645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:39.960673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.961171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:39.961994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:39.962448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.334489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:40.353812 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-24af8ec5-aa3d-4e90-90fc-af7a984f6ee7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.429177 May 07 22:03:40.355717 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2135/4325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:39 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:40.415210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:40.419935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:40.446721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.449245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.452480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.452955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.490684 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] HTTP exception thrown: Instance 95f9d622-1591-4442-9da0-167bdb326758 could not be found. May 07 22:03:40.498923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Returning 404 to user: Instance 95f9d622-1591-4442-9da0-167bdb326758 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:40.499831 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c8397129-4c88-4151-9662-866e1ea7c7c7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 404 len: 111 microversion: 2.1 time: 0.142898 May 07 22:03:40.500888 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2136/4326] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:40 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:03:40.510746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:40.511673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:40.518895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.519627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.521266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.521919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.549025 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 could not be found. May 07 22:03:40.550362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:40.551562 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f7acc2f-eebc-48fa-a589-98e279688ecb tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 404 len: 111 microversion: 2.1 time: 0.044727 May 07 22:03:40.557953 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2137/4327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:40 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:03:40.570441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:40.571764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:40.579958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.580802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.582118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.583898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.752172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:40.775023 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d873d06-7664-4d08-b26e-f7b4c02b9f65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1317 microversion: 2.1 time: 1.291776 May 07 22:03:40.777284 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2191/4328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:39 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1317 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:40.792976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3e30a934-c5e3-4c9f-a94a-716aec31fa4f req-763f4a59-f19e-4206-907b-7bb8d413eed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8493ed-ecbc-4c5d-b60d-da501dd918ee", "tag": "97a27940-706a-4478-97b8-2f47b67e4146"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:40.814029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e30a934-c5e3-4c9f-a94a-716aec31fa4f req-763f4a59-f19e-4206-907b-7bb8d413eed7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.814487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e30a934-c5e3-4c9f-a94a-716aec31fa4f req-763f4a59-f19e-4206-907b-7bb8d413eed7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.849861 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3e30a934-c5e3-4c9f-a94a-716aec31fa4f req-763f4a59-f19e-4206-907b-7bb8d413eed7 service nova] Creating event network-changed:97a27940-706a-4478-97b8-2f47b67e4146 for instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee on nch2-master-1 May 07 22:03:40.856051 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3e30a934-c5e3-4c9f-a94a-716aec31fa4f req-763f4a59-f19e-4206-907b-7bb8d413eed7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072748 May 07 22:03:40.857042 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2192/4329] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:40.868434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a6cd9554-2cb6-4ad6-b691-afb66db0296d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '.version_select at 0x7fc4226238b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:40.903801 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a6cd9554-2cb6-4ad6-b691-afb66db0296d tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027631631" status: 202 len: 0 microversion: 2.1 time: 0.044885 May 07 22:03:40.904827 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2193/4330] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027631631 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:03:40.910675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ec31b7f2-6623-4e97-980e-688d9a273660 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '.version_select at 0x7fc41cda9ca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:40.940461 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ec31b7f2-6623-4e97-980e-688d9a273660 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107617182" status: 202 len: 0 microversion: 2.1 time: 0.033239 May 07 22:03:40.941381 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2194/4331] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107617182 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:03:40.970091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:40.972913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:40.992602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.993350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:40.995799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:40.998269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:41.136765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:41.151788 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f6f303fc-8c94-4c66-87bb-ef09644b61de tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.592290 May 07 22:03:41.153020 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2138/4332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:40 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:41.168432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29c51922-c22b-49d6-b3c5-16851b489626 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:41.169724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29c51922-c22b-49d6-b3c5-16851b489626 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:41.178550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29c51922-c22b-49d6-b3c5-16851b489626 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:41.179325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29c51922-c22b-49d6-b3c5-16851b489626 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:41.186246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29c51922-c22b-49d6-b3c5-16851b489626 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:41.188814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29c51922-c22b-49d6-b3c5-16851b489626 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:41.343551 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29c51922-c22b-49d6-b3c5-16851b489626 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.177450 May 07 22:03:41.346065 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2139/4333] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:41 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:03:41.364910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-50dcc425-f2f7-49a9-a214-5adc64c7738d req-7f6b187a-8f74-4782-bd87-6faa518c440b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f9d622-1591-4442-9da0-167bdb326758", "name": "network-vif-deleted", "tag": "7246b97e-cc3a-4e69-8bd1-0d36632d83ff"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:41.393285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-50dcc425-f2f7-49a9-a214-5adc64c7738d req-7f6b187a-8f74-4782-bd87-6faa518c440b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:41.393730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-50dcc425-f2f7-49a9-a214-5adc64c7738d req-7f6b187a-8f74-4782-bd87-6faa518c440b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:41.421143 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-50dcc425-f2f7-49a9-a214-5adc64c7738d req-7f6b187a-8f74-4782-bd87-6faa518c440b service nova] Creating event network-vif-deleted:7246b97e-cc3a-4e69-8bd1-0d36632d83ff for instance 95f9d622-1591-4442-9da0-167bdb326758 on nch1-master-1 May 07 22:03:41.437136 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-50dcc425-f2f7-49a9-a214-5adc64c7738d req-7f6b187a-8f74-4782-bd87-6faa518c440b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087842 May 07 22:03:41.441426 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2140/4334] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:41.456037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:41.456800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:41.470886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:41.471340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:41.472129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:41.474978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:41.955313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:41.968862 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-53145665-ab3d-4b10-b84b-a144d9cdfdec tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1516 microversion: 2.1 time: 1.021451 May 07 22:03:41.969861 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2195/4335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:40 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1516 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:41.975519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:41.976141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:42.006099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:42.006581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:42.007408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:42.007865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:42.159638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:42.169772 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8309f0b7-8093-4043-9148-d3d9e9c30bcd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1671 microversion: 2.1 time: 0.727097 May 07 22:03:42.172346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2141/4336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:41 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1671 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:43.165385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:43.206055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:43.207758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:43.217121 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1fd0c9fa-caa3-4855-98b4-a348c8948b99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1317 microversion: 2.1 time: 1.220842 May 07 22:03:43.218192 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2196/4337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:41 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1317 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:43.228266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:43.232190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:43.234542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:43.239838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:43.709315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:43.724455 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b3c103b8-b999-4347-8360-320c2c1cbaf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1671 microversion: 2.1 time: 0.522386 May 07 22:03:43.725017 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2142/4338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:43 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1671 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:43.951128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:43.952119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:43.968827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:43.969299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:43.970100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:43.970745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:44.005306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lazy-loading 'flavor' on Instance uuid 96e381dd-9f23-442c-80d2-8623a85c3e50 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:03:44.168624 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b16c54f-5fee-4219-ba2c-098ba8228133 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action" status: 200 len: 32 microversion: 2.1 time: 0.223109 May 07 22:03:44.170410 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2197/4339] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:43 2022] POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:03:44.182284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:44.183310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:44.194897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:44.196982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:44.197709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:44.198163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:44.236369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:44.237264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:44.249061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:44.249525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:44.253572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:44.256044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:44.667393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:44.681138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2a28a2af-b0d2-446f-acd7-baa544dd9053 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.505665 May 07 22:03:44.695361 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2143/4340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:44 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:44.709932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:44.711861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:44.729244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:44.730037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:44.731113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:44.731730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:44.918208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lazy-loading 'services' on Instance uuid 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:03:45.021998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e2b1b6f3-e5ff-4437-81ed-ee46bbb197ef tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments/5df3e22c-323c-404a-a8e6-d7e28dc9b693" status: 202 len: 0 microversion: 2.1 time: 0.322358 May 07 22:03:45.022622 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2144/4341] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:03:44 2022] DELETE /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments/5df3e22c-323c-404a-a8e6-d7e28dc9b693 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:03:45.028834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:45.029563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:45.036208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.036667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.037684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.038301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.286728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:45.298701 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff7885e0-0ddf-42d6-a42a-0679a83ec25d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1317 microversion: 2.1 time: 1.066719 May 07 22:03:45.299894 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2198/4342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:44 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1317 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:45.313964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41f68f9d-157f-40ab-883d-2dc8719cda82 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:45.314251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41f68f9d-157f-40ab-883d-2dc8719cda82 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:45.343389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f68f9d-157f-40ab-883d-2dc8719cda82 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.343860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f68f9d-157f-40ab-883d-2dc8719cda82 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.344686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f68f9d-157f-40ab-883d-2dc8719cda82 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.345135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41f68f9d-157f-40ab-883d-2dc8719cda82 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.439288 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41f68f9d-157f-40ab-883d-2dc8719cda82 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138071 May 07 22:03:45.440253 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2199/4343] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:03:45 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:45.443595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:45.446026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-66cc4f6d-3c12-48a4-b69b-1445abe0c476 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'create', calling method: .version_select at 0x7fc41cda9790>, body: {"keypair": {"name": "tempest-keypair-2027021224"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:45.456074 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b6ada31-17d1-4e1e-9cbb-d1508f284e61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.428513 May 07 22:03:45.456810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2145/4344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:45 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:45.473463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cea67728-70e7-44fb-b063-1dcc43a913a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:45.474746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cea67728-70e7-44fb-b063-1dcc43a913a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:45.485546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-66cc4f6d-3c12-48a4-b69b-1445abe0c476 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:45.485785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cea67728-70e7-44fb-b063-1dcc43a913a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.486178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cea67728-70e7-44fb-b063-1dcc43a913a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.491455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cea67728-70e7-44fb-b063-1dcc43a913a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.491983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cea67728-70e7-44fb-b063-1dcc43a913a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.498697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-66cc4f6d-3c12-48a4-b69b-1445abe0c476 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for user 5ea5d144165a4e129de242905439e951 and project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:45.566527 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cea67728-70e7-44fb-b063-1dcc43a913a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 200 len: 322 microversion: 2.1 time: 0.097202 May 07 22:03:45.567821 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2146/4345] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:03:45 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 322 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:45.578180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:45.579595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:45.587617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.588354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.589481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.590236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.771838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:45.784581 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-483d3783-1c47-4179-a3a6-2720a15834c0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.210313 May 07 22:03:45.786414 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2147/4346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:45 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:45.791843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:45.792633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:45.819683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.821252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:45.824395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:45.826430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.008553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-66cc4f6d-3c12-48a4-b69b-1445abe0c476 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:46.020546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-66cc4f6d-3c12-48a4-b69b-1445abe0c476 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for user 5ea5d144165a4e129de242905439e951 and project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:46.070152 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-66cc4f6d-3c12-48a4-b69b-1445abe0c476 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.628515 May 07 22:03:46.077040 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2200/4347] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:03:45 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:46.095612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:46.095997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:46.123629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.128667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.128809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.129271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.227975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:46.246922 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80404c78-f79c-4a22-84e7-16fb95598b12 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.459175 May 07 22:03:46.248224 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2148/4348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:45 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:46.316782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:46.317960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:46.330129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.330985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.331410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.340434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.654433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:46.674894 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fbc06eed-8fe2-4fce-baf3-47ea68c51ed8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1317 microversion: 2.1 time: 0.362113 May 07 22:03:46.681800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2149/4349] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:46 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:46.712352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc0f7099-32fd-4e93-982d-d9e926cb6cb2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:46.713798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bc0f7099-32fd-4e93-982d-d9e926cb6cb2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:46.728326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc0f7099-32fd-4e93-982d-d9e926cb6cb2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.730534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc0f7099-32fd-4e93-982d-d9e926cb6cb2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.731565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc0f7099-32fd-4e93-982d-d9e926cb6cb2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.735120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc0f7099-32fd-4e93-982d-d9e926cb6cb2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.782410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:46.790913 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f8c35576-43fa-4df1-adff-9a1dad5f95ed tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.712685 May 07 22:03:46.796320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2201/4350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:46 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:46.812245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:46.818058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:46.826306 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc0f7099-32fd-4e93-982d-d9e926cb6cb2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134462 May 07 22:03:46.827915 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2150/4351] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:03:46 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:03:46.876534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.877008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.877836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:46.878289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:46.986963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:46.988384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:47.001479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.007230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.010240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.011848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.094699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:03:47.266731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:47.288030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4b56fbc-2ad6-4d75-a4e5-3185ddcc0f64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.476637 May 07 22:03:47.290261 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2202/4352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:46 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:47.307977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:47.308855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:47.315033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06b5f44d-197d-4c88-959e-b9626fba94e3 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 204 len: 0 microversion: 2.1 time: 0.333468 May 07 22:03:47.317257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2151/4353] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:03:46 2022] DELETE /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:03:47.329945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:47.333677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:47.335318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.337986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.342265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.343052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.354390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.354879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.355850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.356343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.612458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:47.620877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-035fc081-7761-4339-85b2-033d9b7182d6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.328695 May 07 22:03:47.631408 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2203/4354] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:47 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:47.636991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:47.638590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:47.645813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.646535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.647526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.648134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.773480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:47.789108 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc50af80-2c25-45c7-aa41-dcefc5e76edb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.468170 May 07 22:03:47.790572 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2152/4355] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:47 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:47.853997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:47.862566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-40351b06-bd57-4a81-9917-582803acad10 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1682 microversion: 2.1 time: 0.230041 May 07 22:03:47.865701 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2204/4356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:47 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:47.873046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:47.873908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:47.889996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.891022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:47.892651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:47.894363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:48.142059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d7a2d53-1468-49c7-8038-bf0558df317d tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Action: 'create', calling method: .version_select at 0x7fc422526a60>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1293994012"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:48.169297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5d7a2d53-1468-49c7-8038-bf0558df317d tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:48.173849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:48.185480 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-51fa25df-09fc-4170-b523-8af776be6bbc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1317 microversion: 2.1 time: 0.317918 May 07 22:03:48.187644 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2205/4357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:47 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:48.196268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1349288573", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "33b52409-fae0-4935-b5d0-15acefaa0f3f"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:48.198217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5d7a2d53-1468-49c7-8038-bf0558df317d tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for user 0cd1a3e3a02a4a7889ad46c94fbe8e4d and project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:48.310810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] validate_networks() for [('33b52409-fae0-4935-b5d0-15acefaa0f3f', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:03:48.510887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5d7a2d53-1468-49c7-8038-bf0558df317d tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:48.532361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5d7a2d53-1468-49c7-8038-bf0558df317d tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for user 0cd1a3e3a02a4a7889ad46c94fbe8e4d and project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:48.587028 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d7a2d53-1468-49c7-8038-bf0558df317d tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.792174 May 07 22:03:48.592636 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2153/4358] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:03:47 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:48.637387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:48.638422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:48.653464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:48.660212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:48.663704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:48.664393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:49.744313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:03:49.744830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:03:49.745227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:03:49.745652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:03:49.746071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:03:49.767679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:49.768504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:49.769602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:49.770195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:49.845005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:49.855798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for user 8cdc0c878f6e4e5da2a2848d63a02f0d and project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:49.888127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:03:49.890895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:03:49.977343 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-596fe3df-56a6-4bf7-8044-9188057d50c1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787612 May 07 22:03:49.979352 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2206/4359] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:03:49.991621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:49.994980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:50.017176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:50.018086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:50.021134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:50.026011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:50.227200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:50.236854 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb8e6186-6379-4027-9533-2387809afd40 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 1.603298 May 07 22:03:50.245949 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2154/4360] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:48 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:50.259541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-58acdff4-8a81-4843-96f5-36be6bb03bbf req-2d2cc89c-4d13-4554-a1c8-85fa7d2c2d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8493ed-ecbc-4c5d-b60d-da501dd918ee", "name": "network-vif-plugged", "status": "completed", "tag": "97a27940-706a-4478-97b8-2f47b67e4146"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:50.300428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-58acdff4-8a81-4843-96f5-36be6bb03bbf req-2d2cc89c-4d13-4554-a1c8-85fa7d2c2d14 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:50.301248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-58acdff4-8a81-4843-96f5-36be6bb03bbf req-2d2cc89c-4d13-4554-a1c8-85fa7d2c2d14 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:50.317099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-58acdff4-8a81-4843-96f5-36be6bb03bbf req-2d2cc89c-4d13-4554-a1c8-85fa7d2c2d14 service nova] Creating event network-vif-plugged:97a27940-706a-4478-97b8-2f47b67e4146 for instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee on nch2-master-1 May 07 22:03:50.326609 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-58acdff4-8a81-4843-96f5-36be6bb03bbf req-2d2cc89c-4d13-4554-a1c8-85fa7d2c2d14 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077099 May 07 22:03:50.327677 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2155/4361] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:50.339379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:50.342268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:50.354195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:50.355534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:50.356530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:50.357217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:50.604701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:50.629029 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d44e94ad-39c0-4472-97ef-12756fe70944 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1682 microversion: 2.1 time: 0.648318 May 07 22:03:50.632586 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2207/4362] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:49 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1682 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:50.653892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c3701210-97a9-4ad0-8ac5-259f352c99e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:50.654735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c3701210-97a9-4ad0-8ac5-259f352c99e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:50.778115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c3701210-97a9-4ad0-8ac5-259f352c99e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:50.792265 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c3701210-97a9-4ad0-8ac5-259f352c99e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1215 microversion: 2.1 time: 0.158501 May 07 22:03:50.803674 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2208/4363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:50 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:51.048974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-304209575", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750e8121-2671-438f-9a42-169be7e47286"}], "security_groups": [{"name": "tempest-securitygroup--1264479433"}], "key_name": "tempest-keypair-2027021224", "user_data": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:51.154709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:51.172662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a06ca8a-06d6-480b-8650-e540f65c0caa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1317 microversion: 2.1 time: 0.832700 May 07 22:03:51.173736 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2156/4364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:50 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:51.262540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:51.264256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:51.278349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:51.279101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:51.281434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:51.300381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:51.357767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] validate_networks() for [('750e8121-2671-438f-9a42-169be7e47286', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:03:51.665865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:51.683348 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9025c784-b2c7-4f2f-9cf7-fa047b0b361f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.424935 May 07 22:03:51.684535 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2157/4365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:51 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:51.689993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:51.690911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:51.717906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:51.719023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:51.724347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:51.728821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.024246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:52.035612 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ecfc2fba-9d61-48ce-97d1-30b3275e82cf tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1682 microversion: 2.1 time: 0.349476 May 07 22:03:52.039197 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2158/4366] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:51 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1682 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:52.050797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:52.062357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:52.089256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.089725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.090524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.097068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.246361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:52.260320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea80ef78-d24e-41e1-9371-1e894f388f4c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1285 microversion: 2.1 time: 0.213135 May 07 22:03:52.261297 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2159/4367] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:52 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:52.293165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:52.295068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:52.309446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.312169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.313773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.314411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.542507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:52.554516 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6ec71149-4250-4db5-a153-ec752a1cc73f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1506 microversion: 2.1 time: 0.288824 May 07 22:03:52.556677 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2160/4368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:52 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:52.578359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:52.579294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:52.586580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.587365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.588369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.588992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.637028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:03:52.811691 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8ef4f592-c9c4-4f3a-b247-a20bdcac64dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 204 len: 0 microversion: 2.1 time: 0.235856 May 07 22:03:52.813908 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2161/4369] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:03:52 2022] DELETE /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:03:52.824840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-33aa2979-f6da-4a42-82ec-3d55b90ff9cf req-b7f29af7-b86f-4896-a446-1b3e1866b3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8141d2fb-0f50-41fb-bce0-7a6c7f7fc949", "name": "network-vif-deleted", "tag": "2e46252a-79ff-49d8-a0dc-dceb03f5d5ae"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:52.837168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-33aa2979-f6da-4a42-82ec-3d55b90ff9cf req-b7f29af7-b86f-4896-a446-1b3e1866b3cb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.838003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-33aa2979-f6da-4a42-82ec-3d55b90ff9cf req-b7f29af7-b86f-4896-a446-1b3e1866b3cb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.856707 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-33aa2979-f6da-4a42-82ec-3d55b90ff9cf req-b7f29af7-b86f-4896-a446-1b3e1866b3cb service nova] Creating event network-vif-deleted:2e46252a-79ff-49d8-a0dc-dceb03f5d5ae for instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 on nch2-master-1 May 07 22:03:52.866254 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-33aa2979-f6da-4a42-82ec-3d55b90ff9cf req-b7f29af7-b86f-4896-a446-1b3e1866b3cb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049981 May 07 22:03:52.867429 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2162/4370] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:52.876706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:52.877427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:52.885422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.886171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.887374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.887789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.927700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:03:52.928223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:03:52.928624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:03:52.929048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:03:52.929637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:03:52.949952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.953429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:52.955196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:52.955692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.018863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:53.034357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Getting quotas for user 5ea5d144165a4e129de242905439e951 and project 81e5c5d849ea4fc59d5c4fc58b31530f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:53.057417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:03:53.060569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:03:53.114594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:53.126382 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3808ac7-bdcb-4a44-8219-0cdf6373bc8b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.257402 May 07 22:03:53.127287 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2163/4371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:52 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:53.134040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:53.134506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:53.143000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:53.143510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.144370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:53.144926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.157683 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3672ef34-e789-4f12-b9e1-d1d4ff21b0bf tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.114407 May 07 22:03:53.158969 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2209/4372] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:03:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:03:53.165211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:53.174697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:53.183094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:53.184060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.188641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:53.190289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.305037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:53.305503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.308923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lazy-loading 'fault' on Instance uuid 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:03:53.424993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:53.438942 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6594995-8c29-459b-b21f-6812af1cb1f4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 200 len: 1331 microversion: 2.1 time: 0.278340 May 07 22:03:53.440388 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2210/4373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:53 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 1331 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:53.449874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5fd3c6b2-cd83-4b9d-8d6b-918e56247238 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:53.450926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5fd3c6b2-cd83-4b9d-8d6b-918e56247238 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:53.527658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:53.545636 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2feabb4b-fc55-451d-b9ea-2b85952fb04a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1512 microversion: 2.1 time: 0.414947 May 07 22:03:53.557752 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2164/4374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:53 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:53.571295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:53.573074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:53.591059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:53.592508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.593901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:53.596076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:53.710696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5fd3c6b2-cd83-4b9d-8d6b-918e56247238 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:53.721555 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5fd3c6b2-cd83-4b9d-8d6b-918e56247238 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1237 microversion: 2.1 time: 0.279380 May 07 22:03:53.726479 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2211/4375] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:53 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1237 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:54.144219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:54.145092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:54.172134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:54.172757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:54.173428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:54.174446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:54.175139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:54.181461 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c0ea8110-2ca6-43da-854d-2c2e2143c0bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1315 microversion: 2.1 time: 0.627252 May 07 22:03:54.187651 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2165/4376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:53 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:54.284363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-709531443", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1293994012", "security_groups": [{"name": "tempest-secgroup-smoke-420166329"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "8d88d076-afcc-46ea-aeef-47274d5a0fc9"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:54.635166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] validate_networks() for [('8d88d076-afcc-46ea-aeef-47274d5a0fc9', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:03:54.817650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:54.831207 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0b585791-34d2-4baf-8850-bea74decf092 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.690793 May 07 22:03:54.833436 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2212/4377] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:54 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:54.852315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:54.853273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:54.870939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:54.872521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:54.873546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:54.874002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:54.909971 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 could not be found. May 07 22:03:54.910646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:54.911531 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7076ab40-efea-49e0-87e9-232293e647ec tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 404 len: 111 microversion: 2.1 time: 0.076693 May 07 22:03:54.912117 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2213/4378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:54 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:03:54.921020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:54.921660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:54.941435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:54.943913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:54.945240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:54.945953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.397410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:55.440038 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-034a4147-9bf1-4408-8965-75fb0c914693 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 200 len: 1470 microversion: 2.1 time: 0.523054 May 07 22:03:55.443552 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2214/4379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:54 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 1470 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:55.450894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:55.452222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:55.462148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.463266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.466596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.472209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.610324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:55.622740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for user 0cd1a3e3a02a4a7889ad46c94fbe8e4d and project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: dict_keys(['metadata_items']) {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:55.641708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:55.653539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:03:55.654079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:03:55.654464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:03:55.654919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:03:55.655354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:03:55.661101 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1daa0c30-1f07-4c24-a08c-d3cd1ce0b52e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1295 microversion: 2.1 time: 0.214064 May 07 22:03:55.663096 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2215/4380] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:55 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1295 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:55.682963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22bdb314-3d47-4aee-9f16-52d486803348 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '.version_select at 0x7fc41cadf430>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:55.686635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.687401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.688236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.688695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.738991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:55.753661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Getting quotas for user 0cd1a3e3a02a4a7889ad46c94fbe8e4d and project e5bd7ffaf96c48688d8ebe954dc7912f. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:55.762760 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-22bdb314-3d47-4aee-9f16-52d486803348 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351009029" status: 202 len: 0 microversion: 2.1 time: 0.097852 May 07 22:03:55.765547 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2216/4381] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 22:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351009029 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:03:55.779569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:03:55.782200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:03:55.801733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:55.802207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:55.837786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.838661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.840097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.841197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.875544 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bd534ae2-02dc-4dc7-a8e6-16834c9ebd3e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.597937 May 07 22:03:55.877188 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2166/4382] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:03:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:03:55.883613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-51d592f3-ea94-4223-8a2f-3d691e92330c req-023d0da9-f4c4-4aa7-b8fa-c5348e8b221d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8493ed-ecbc-4c5d-b60d-da501dd918ee", "name": "network-vif-deleted", "tag": "97a27940-706a-4478-97b8-2f47b67e4146"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:55.900336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-51d592f3-ea94-4223-8a2f-3d691e92330c req-023d0da9-f4c4-4aa7-b8fa-c5348e8b221d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.901105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-51d592f3-ea94-4223-8a2f-3d691e92330c req-023d0da9-f4c4-4aa7-b8fa-c5348e8b221d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.915012 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-51d592f3-ea94-4223-8a2f-3d691e92330c req-023d0da9-f4c4-4aa7-b8fa-c5348e8b221d service nova] Creating event network-vif-deleted:97a27940-706a-4478-97b8-2f47b67e4146 for instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee on nch2-master-1 May 07 22:03:55.921784 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-51d592f3-ea94-4223-8a2f-3d691e92330c req-023d0da9-f4c4-4aa7-b8fa-c5348e8b221d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042956 May 07 22:03:55.923176 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2167/4383] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:55.929374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:55.930653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:55.939615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.940431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:55.941454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:55.942226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.338190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:56.351311 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d295dce6-66fc-4c0d-a9a5-0c36086cd36a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.426674 May 07 22:03:56.367541 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2168/4384] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:55 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:56.378339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f750eead-670a-4c5c-9c62-f986ab40c903 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:56.381356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f750eead-670a-4c5c-9c62-f986ab40c903 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:56.418534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:56.431873 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2bd865f6-b49d-40df-98af-e4a1b453e9c8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1315 microversion: 2.1 time: 0.646760 May 07 22:03:56.434488 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2217/4385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:55 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:56.466922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e0e321a5-dc18-4d1e-9725-2ac5d19024ea req-f728bb09-b0d4-4e9f-9a75-0a83910fdf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba61d59b-e750-459a-a73a-0376bdf5ca51", "tag": "21b489d6-f673-44e1-848f-8bbe1b3aef5c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:56.487485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e0e321a5-dc18-4d1e-9725-2ac5d19024ea req-f728bb09-b0d4-4e9f-9a75-0a83910fdf11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:56.488310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e0e321a5-dc18-4d1e-9725-2ac5d19024ea req-f728bb09-b0d4-4e9f-9a75-0a83910fdf11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.520093 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e0e321a5-dc18-4d1e-9725-2ac5d19024ea req-f728bb09-b0d4-4e9f-9a75-0a83910fdf11 service nova] Creating event network-changed:21b489d6-f673-44e1-848f-8bbe1b3aef5c for instance ba61d59b-e750-459a-a73a-0376bdf5ca51 on nch1-master-1 May 07 22:03:56.534030 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e0e321a5-dc18-4d1e-9725-2ac5d19024ea req-f728bb09-b0d4-4e9f-9a75-0a83910fdf11 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092549 May 07 22:03:56.534841 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2218/4386] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:03:56.545407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:56.549152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:56.560859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:56.565130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.569123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:56.569702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.603074 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. May 07 22:03:56.603275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f750eead-670a-4c5c-9c62-f986ab40c903 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:56.604764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:56.606224 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-35303377-82ca-41e4-a7d0-9022d79717b9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 404 len: 111 microversion: 2.1 time: 0.069886 May 07 22:03:56.613410 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f750eead-670a-4c5c-9c62-f986ab40c903 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1302 microversion: 2.1 time: 0.241503 May 07 22:03:56.614802 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2219/4387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:56 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:03:56.617274 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2169/4388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:56 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1302 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:56.641792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:56.641792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:56.641792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:56.641792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.641792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:56.641792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.682176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:56.685293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:56.695539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:56.696879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.697926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:56.698693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:56.865187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:56.874323 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7f8f65d5-d0f2-4c45-8392-a1f012030df7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1295 microversion: 2.1 time: 0.198827 May 07 22:03:56.885234 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2170/4389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:56 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:56.999125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:57.016747 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c7c977de-90d0-452c-ae37-2cbb51b82c0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.401715 May 07 22:03:57.018601 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2220/4390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:56 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:57.148360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7c155cc-6ee9-4b39-8b17-3d0d8fbc96f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:57.149888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7c155cc-6ee9-4b39-8b17-3d0d8fbc96f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:03:57.150710 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e7c155cc-6ee9-4b39-8b17-3d0d8fbc96f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.006350 May 07 22:03:57.151317 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2171/4391] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:03:57 2022] POST /compute/v2.1/servers => generated 127 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:03:57.159973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:57.160917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:57.173968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.175271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:57.177851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.179030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:57.369922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:57.370914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:57.386974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.388576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:57.390457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.392033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:57.628179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:57.639304 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e995b937-91af-432c-a77a-d8c128552d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.483504 May 07 22:03:57.641072 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2221/4392] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:57 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:03:57.647276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:57.648026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:57.665332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.666220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:57.667371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.668045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:57.791314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:57.802560 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2eebf2b8-be6d-4486-9fc1-0402f6df95e2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.436891 May 07 22:03:57.804133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2172/4393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:57 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:57.809705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:57.811066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:57.818840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.819606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:57.821268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:57.822484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:58.032740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:58.033373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:58.042082 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-19814899-ed72-4dc6-a555-ce9406f223bb tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1360 microversion: 2.1 time: 0.236443 May 07 22:03:58.042704 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2173/4394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:57 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1360 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:58.043986 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e2a36cb1-8cb2-48af-9d18-c48800e542a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1315 microversion: 2.1 time: 0.399484 May 07 22:03:58.052311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:58.055909 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2222/4395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:57 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:58.057951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:58.067722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:58.068175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:58.069085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:58.069671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:58.069940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4bc4771-9a3b-42fd-8d13-ae5d2bc2726c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: .version_select at 0x7fc4225cf550>, body: {"keypair": {"name": "tempest-keypair-1721414158"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:03:58.105303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e4bc4771-9a3b-42fd-8d13-ae5d2bc2726c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:58.119876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e4bc4771-9a3b-42fd-8d13-ae5d2bc2726c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:58.502741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e4bc4771-9a3b-42fd-8d13-ae5d2bc2726c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:03:58.513948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:58.524011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e4bc4771-9a3b-42fd-8d13-ae5d2bc2726c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:03:58.524638 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eb2fcb89-906d-4727-81f9-e39b94237b93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.480842 May 07 22:03:58.525574 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2174/4396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:58 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:58.531187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:58.532903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:58.551855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:58.552336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:58.553145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:58.553600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:58.573584 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4bc4771-9a3b-42fd-8d13-ae5d2bc2726c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.516109 May 07 22:03:58.585455 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2223/4397] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:03:58 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:58.825807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:58.826476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:58.835180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:58.842879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:58.849260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:58.851133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:59.313042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:59.327839 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d7d0ce9d-dd65-4df1-aeca-dd762810d284 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 0.800232 May 07 22:03:59.328455 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2175/4398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:58 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:59.336921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:59.344056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:59.353401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:59.359400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:59.361522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:59.363464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:59.466883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:59.490805 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a600249-3400-4f0e-b5d7-890750ae51fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.659562 May 07 22:03:59.490805 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2224/4399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:58 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:59.496858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:03:59.496858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:03:59.512620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:59.513160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:59.513964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:03:59.514416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:03:59.893402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:59.904766 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8d72eeb3-8a63-48a7-9107-a6fd5c27eeb9 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1427 microversion: 2.1 time: 0.575216 May 07 22:03:59.905379 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2176/4400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:59 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1427 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:03:59.983387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:03:59.991697 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14effeca-9d9c-4ebb-a2c5-89e3c0c4fbb2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1315 microversion: 2.1 time: 0.499190 May 07 22:03:59.994842 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2225/4401] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:03:59 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:00.373367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:00.376249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:00.389667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:00.391925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:00.392888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:00.393352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:00.505154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:00.505910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:00.522784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:00.523278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:00.525926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:00.527303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.124106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:01.139333 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ce24d26-d70a-4903-b8a3-b131324cffe5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.640025 May 07 22:04:01.140299 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2226/4402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:00 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:01.146632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed32046b-1850-4524-b3f0-05d1dec8e710 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-14749882", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ca043d28-1974-421c-89fa-77065888ac9d", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:01.215355 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ed32046b-1850-4524-b3f0-05d1dec8e710 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Block Device ca043d28-1974-421c-89fa-77065888ac9d is not bootable. May 07 22:04:01.216367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed32046b-1850-4524-b3f0-05d1dec8e710 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Block Device ca043d28-1974-421c-89fa-77065888ac9d is not bootable. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:01.217410 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed32046b-1850-4524-b3f0-05d1dec8e710 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.075737 May 07 22:04:01.218504 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2227/4403] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:01 2022] POST /compute/v2.1/servers => generated 110 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:01.226750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-bc6db924-2a0c-478f-bd49-1608fbccbda2 req-7c4f7899-d22c-44fe-9a58-962febb32462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b682b3c1-0ca9-4806-8100-908917473b27", "tag": "ebd70047-1a0a-49d6-a707-647dac8e19a2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:01.236811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bc6db924-2a0c-478f-bd49-1608fbccbda2 req-7c4f7899-d22c-44fe-9a58-962febb32462 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.237285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bc6db924-2a0c-478f-bd49-1608fbccbda2 req-7c4f7899-d22c-44fe-9a58-962febb32462 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.249156 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-bc6db924-2a0c-478f-bd49-1608fbccbda2 req-7c4f7899-d22c-44fe-9a58-962febb32462 service nova] Creating event network-changed:ebd70047-1a0a-49d6-a707-647dac8e19a2 for instance b682b3c1-0ca9-4806-8100-908917473b27 on nch2-master-1 May 07 22:04:01.254913 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-bc6db924-2a0c-478f-bd49-1608fbccbda2 req-7c4f7899-d22c-44fe-9a58-962febb32462 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034598 May 07 22:04:01.256228 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2228/4404] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:01.262888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:01.263857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:01.273059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.273595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.274734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.275280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.468888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:01.477278 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a34c6479-a9b7-4711-afb1-39b2c8b6b8b0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 1.136097 May 07 22:04:01.487588 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2177/4405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:00 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:01.488160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:01.489362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:01.502850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.503831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.504914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.505554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.654328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:01.663032 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-edb13d30-2bfc-48f2-965b-f6fe6413e6ad tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1427 microversion: 2.1 time: 0.405037 May 07 22:04:01.663943 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2229/4406] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:01 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1427 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:01.690523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:01.692419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:01.700159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.700903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.701964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.702659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.892459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:01.904557 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2a767f45-8749-4e31-9905-c26f9cd93e8c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1315 microversion: 2.1 time: 0.420063 May 07 22:04:01.905312 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2178/4407] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:01 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:01.912789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-042f6b7a-235b-4afa-aae3-7c8fd746a75b req-4865b8af-1291-4276-88e5-664b477dba2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11df3809-8e5b-40d6-adb1-393c365f9a47", "tag": "050be740-f219-402b-99ff-07b3f4f82b98"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:01.928943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-042f6b7a-235b-4afa-aae3-7c8fd746a75b req-4865b8af-1291-4276-88e5-664b477dba2a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:01.930238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-042f6b7a-235b-4afa-aae3-7c8fd746a75b req-4865b8af-1291-4276-88e5-664b477dba2a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:01.952729 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-042f6b7a-235b-4afa-aae3-7c8fd746a75b req-4865b8af-1291-4276-88e5-664b477dba2a service nova] Creating event network-changed:050be740-f219-402b-99ff-07b3f4f82b98 for instance 11df3809-8e5b-40d6-adb1-393c365f9a47 on nch1-master-1 May 07 22:04:01.973915 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-042f6b7a-235b-4afa-aae3-7c8fd746a75b req-4865b8af-1291-4276-88e5-664b477dba2a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066624 May 07 22:04:01.977358 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2179/4408] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:02.110749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:02.121903 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4f48eb18-9781-4a4d-a869-ab4da80d301c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.440874 May 07 22:04:02.123385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2230/4409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:01 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:02.147480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:02.148212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:02.155469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.156370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.157477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:02.158329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.158663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:02.159393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.168579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.169203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.169869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.172800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.375624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:02.390719 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12964136-bc2a-4bf2-9457-5d61fb513d7a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.237129 May 07 22:04:02.391912 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2231/4410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:02 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:02.495546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:02.496174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:02.503229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.503821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.505280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.505841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.643749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:02.651972 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-daf75565-da75-431d-840e-72f3f051aae7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.510264 May 07 22:04:02.652848 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2180/4411] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:02 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:02.657423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:02.668351 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ed612ce-3eb0-4518-b750-e823a7b966c5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 0.176655 May 07 22:04:02.678355 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2232/4412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:02 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:02.681320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:02.681944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:02.688409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.688866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.689643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.690091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.922056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:02.922687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:02.935448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.935937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:02.936764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:02.937218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:03.095307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:03.104891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:03.106875 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6cd19273-67b4-48c5-8164-7564f1a28782 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1427 microversion: 2.1 time: 0.429294 May 07 22:04:03.116120 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2181/4413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:02 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1427 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:03.117777 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6fcd637-e004-4eb8-8673-3688fe38d183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1315 microversion: 2.1 time: 0.199423 May 07 22:04:03.118467 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2233/4414] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:02 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:03.408416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:03.409087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:03.416456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:03.417399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:03.418745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:03.419237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:03.687131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:03.695121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:03.704863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:03.705951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:03.708425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:03.708894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:03.972982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:03.982002 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d6749723-bd13-40c9-8250-9f0997f34b9c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.577921 May 07 22:04:03.999933 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2182/4415] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:03 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:04.008809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f6a812cb-42cc-43b5-8bf3-5da8ea5fa23e req-72e1f4bf-29ed-4c2d-b471-b206521ac424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61d59b-e750-459a-a73a-0376bdf5ca51", "name": "network-vif-plugged", "status": "completed", "tag": "21b489d6-f673-44e1-848f-8bbe1b3aef5c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:04.018286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f6a812cb-42cc-43b5-8bf3-5da8ea5fa23e req-72e1f4bf-29ed-4c2d-b471-b206521ac424 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:04.018871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f6a812cb-42cc-43b5-8bf3-5da8ea5fa23e req-72e1f4bf-29ed-4c2d-b471-b206521ac424 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:04.034952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f6a812cb-42cc-43b5-8bf3-5da8ea5fa23e req-72e1f4bf-29ed-4c2d-b471-b206521ac424 service nova] Creating event network-vif-plugged:21b489d6-f673-44e1-848f-8bbe1b3aef5c for instance ba61d59b-e750-459a-a73a-0376bdf5ca51 on nch1-master-1 May 07 22:04:04.042253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f6a812cb-42cc-43b5-8bf3-5da8ea5fa23e req-72e1f4bf-29ed-4c2d-b471-b206521ac424 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040232 May 07 22:04:04.043517 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2183/4416] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:04.111181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:04.124096 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1f2680f-7a9c-41f2-bd83-deeb8f5d3343 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 0.442025 May 07 22:04:04.127441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:04.127619 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2234/4417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:03 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:04.128100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:04.136167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:04.137063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:04.146423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:04.147179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:04.148195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:04.148839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:04.151077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:04.154760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:04.157584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:04.158088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:04.462144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:04.464163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:04.471989 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-51b041e1-2d24-47d1-b5ed-98c08893693d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1315 microversion: 2.1 time: 0.340074 May 07 22:04:04.473363 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fa7f1e2b-9ca7-4761-b7bc-824d775e5aaf tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1427 microversion: 2.1 time: 0.350360 May 07 22:04:04.474316 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2235/4418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:04 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:04.482484 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2184/4419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:04 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1427 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:04.489334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2056942196", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64cbfbe-feaa-48dc-9089-9445aa1eaa5a"}], "security_groups": [{"name": "tempest-securitygroup--1860571418"}], "key_name": "tempest-keypair-1721414158", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:04.492407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1e1d5eb-710b-40b3-af97-fd18d976ec56 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2046295064", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "destination_type": "local"}, {"source_type": "volume", "uuid": "d3df800a-fdaa-4085-8fb9-311c1af45f76", "destination_type": "invalid"}], "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:04.494915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1e1d5eb-710b-40b3-af97-fd18d976ec56 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:04.499029 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1e1d5eb-710b-40b3-af97-fd18d976ec56 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.021717 May 07 22:04:04.501284 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2236/4420] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:04 2022] POST /compute/v2.1/servers => generated 155 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:04.511040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:04.511916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:04.526061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:04.526843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:04.527918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:04.528598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:04.612414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] validate_networks() for [('f64cbfbe-feaa-48dc-9089-9445aa1eaa5a', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:04:05.093983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:05.106413 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae70cd54-9a73-4af2-84c1-f0df428cf174 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.599846 May 07 22:04:05.122404 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2237/4421] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:04 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:05.129968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:05.130604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:05.137653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.138501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.139533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.140209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.220371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:04:05.220963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:04:05.221417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:04:05.221902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:04:05.222323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:04:05.238975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.239705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.240697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.242914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.265609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:05.273371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:05.294957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:04:05.298423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:04:05.381327 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b81bed5-25a9-4138-ba6f-2e6e554aa3a1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.897378 May 07 22:04:05.383469 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2185/4422] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:04:05.400687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:05.401954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:05.423941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:05.443081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.444332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.446054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.447197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.456609 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-31a0113c-bd89-4dfb-b75b-a764a020e2e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.326239 May 07 22:04:05.473894 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2238/4423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:05 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:05.480616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:05.481572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:05.491721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.492441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.493443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.494116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.688228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:05.697872 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4c16582-1916-4e74-90f5-e7dda111bb98 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.313063 May 07 22:04:05.720948 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2186/4424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:05 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:05.729818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4bf69af6-67b3-43b8-9705-301111c8021a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:05.730463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4bf69af6-67b3-43b8-9705-301111c8021a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:05.871418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:05.871418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-37aae22c-b04c-4175-8b9f-03896f4125e2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 0.353323 May 07 22:04:05.871418 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2239/4425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:05 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:05.871418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:05.871418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:05.872356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4bf69af6-67b3-43b8-9705-301111c8021a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:05.881211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.883648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.883921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4bf69af6-67b3-43b8-9705-301111c8021a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1242 microversion: 2.1 time: 0.161453 May 07 22:04:05.885009 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2187/4426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:05 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:05.893236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.901035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:05.901842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:05.911228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.912052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.912598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:05.913477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:05.914563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.185728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:06.204917 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50908816-a0e3-479a-a3dd-56321cefa025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1502 microversion: 2.1 time: 0.318577 May 07 22:04:06.206277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:06.210439 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2188/4427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:05 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1502 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:06.215757 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5f59808b-520e-47b8-a495-a5e5feebc0d6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1427 microversion: 2.1 time: 0.381072 May 07 22:04:06.216380 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2240/4428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:05 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1427 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:06.229950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a7e8d6c8-924c-488b-8bda-e85fa19955fa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-382489913", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:06.235718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a0fd85e3-5fd3-451e-b01c-27c649918845 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:06.236899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a7e8d6c8-924c-488b-8bda-e85fa19955fa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:06.237952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a7e8d6c8-924c-488b-8bda-e85fa19955fa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.026156 May 07 22:04:06.241895 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2189/4429] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:06 2022] POST /compute/v2.1/servers => generated 624 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:06.250211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0fd85e3-5fd3-451e-b01c-27c649918845 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.250899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0fd85e3-5fd3-451e-b01c-27c649918845 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.255235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:06.257357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:06.283266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.283808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.284845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.285861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.290069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a0fd85e3-5fd3-451e-b01c-27c649918845 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:04:06.364572 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a0fd85e3-5fd3-451e-b01c-27c649918845 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51/action" status: 202 len: 0 microversion: 2.1 time: 0.144801 May 07 22:04:06.368407 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2241/4430] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:06 2022] POST /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:04:06.375310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:06.376077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:06.383895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.384403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.385301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.386457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.475322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:06.484919 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9f7ce8d4-d02c-4b6a-b777-cefe35b92dfe tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.241487 May 07 22:04:06.485998 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2190/4431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:06 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:06.491275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:06.492198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:06.501637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.502417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.503494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.504190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.620988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:06.636568 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-327ae629-45a2-441f-86c0-b80366cd66e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.265457 May 07 22:04:06.639484 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2242/4432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:06 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:06.648736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:06.649784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:06.658558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.659451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.661026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.661903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.747101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:06.758764 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a332066-2ca3-4ab9-8089-07f21d9fcfe8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.271310 May 07 22:04:06.770984 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2191/4433] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:06 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:06.856507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:06.857371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:06.863606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:06.866736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.867525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.868411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.869093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.872097 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de906f8a-71e4-4fa9-a898-142528c28aec tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.231373 May 07 22:04:06.872688 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2243/4434] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:06 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:06.902026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:06.903147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:06.919721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.920785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:06.925027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:06.927038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.076855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:07.090683 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-499b9d9f-751c-46bb-98e8-19453f304970 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 0.237364 May 07 22:04:07.092362 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2192/4435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:06 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:07.099972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:07.100638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3317d2c7-97bf-4291-a590-57ff9436f4d2 req-a4f8240a-f95d-4501-8490-973b53ab0df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b682b3c1-0ca9-4806-8100-908917473b27", "name": "network-vif-plugged", "status": "completed", "tag": "ebd70047-1a0a-49d6-a707-647dac8e19a2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:07.110945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3317d2c7-97bf-4291-a590-57ff9436f4d2 req-a4f8240a-f95d-4501-8490-973b53ab0df4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.111474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3317d2c7-97bf-4291-a590-57ff9436f4d2 req-a4f8240a-f95d-4501-8490-973b53ab0df4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.118373 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a766f985-2ad7-4bc7-8bb9-84ea75b42987 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1294 microversion: 2.1 time: 0.221301 May 07 22:04:07.123913 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3317d2c7-97bf-4291-a590-57ff9436f4d2 req-a4f8240a-f95d-4501-8490-973b53ab0df4 service nova] Creating event network-vif-plugged:ebd70047-1a0a-49d6-a707-647dac8e19a2 for instance b682b3c1-0ca9-4806-8100-908917473b27 on nch2-master-1 May 07 22:04:07.130293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3317d2c7-97bf-4291-a590-57ff9436f4d2 req-a4f8240a-f95d-4501-8490-973b53ab0df4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036607 May 07 22:04:07.130421 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2244/4436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:06 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1294 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:07.131362 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2193/4437] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:07.140840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e93dbaa6-af2d-4f53-9dcf-fd6ba40bfe6c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:07.142223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e93dbaa6-af2d-4f53-9dcf-fd6ba40bfe6c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:07.143261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e93dbaa6-af2d-4f53-9dcf-fd6ba40bfe6c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011418 May 07 22:04:07.147197 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2245/4438] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:07 2022] POST /compute/v2.1/servers => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:07.152730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:07.153898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:07.164321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.169147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.171624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.178387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.211086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2014817648", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:07.270679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:04:07.591073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:04:07.591616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:04:07.592173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:04:07.592652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:04:07.593199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:04:07.603964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.604521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.605416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.605934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.625767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Getting quotas for project 17f1e26eb0cc42eea75d5194838b50f5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:07.633124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Getting quotas for user b18ec20bcd654015b37eb90758427e1e and project 17f1e26eb0cc42eea75d5194838b50f5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:07.646212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:04:07.648802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:04:07.695829 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-058c3cbf-005e-45d0-be78-c2517502ea28 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488732 May 07 22:04:07.699008 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2246/4439] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:04:07.707385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:07.709114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:07.721638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.722145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.723559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.724016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.871740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:07.879040 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81157feb-11ee-455e-bf65-5162f3e3932c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.730645 May 07 22:04:07.879635 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2194/4440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:07 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:07.896802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:07.897438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:07.904419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.904956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.905663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:07.906110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:07.949529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:07.975283 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ac85131-95f7-4441-8832-0a1b1dc2cc6b tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1427 microversion: 2.1 time: 0.269236 May 07 22:04:07.976097 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2247/4441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:07 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1427 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:07.988537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4070a27-0792-40c5-a9fe-3b4f454c647a tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:07.990132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4070a27-0792-40c5-a9fe-3b4f454c647a tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:08.077049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4070a27-0792-40c5-a9fe-3b4f454c647a tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:08.085880 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4070a27-0792-40c5-a9fe-3b4f454c647a tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1215 microversion: 2.1 time: 0.101655 May 07 22:04:08.096048 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2248/4442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:07 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:08.102060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:08.103015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:08.110401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.111267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.112002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.112641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.206470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:08.224574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-420978df-8d5a-4b67-8d2f-04c669938280 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.340580 May 07 22:04:08.232315 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2195/4443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:07 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:08.243324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:08.243960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:08.255487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.256192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.257528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.258130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.288248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:08.297328 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d85a432-4276-42a2-b8d9-0228e7e035bd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.199688 May 07 22:04:08.297965 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2249/4444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:08 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:08.313414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:08.314053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:08.321900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.322361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.323194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.323620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.453630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:08.470066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ab589e3c-238d-4290-9d6b-c76951628d67 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.236345 May 07 22:04:08.471301 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2196/4445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:08 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:08.500461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:08.508867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:08.529719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.530754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.531380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:08.532994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.533572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.541623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4f64bae-6aaf-4318-b05c-b0e8c6685bcc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 0.232739 May 07 22:04:08.551974 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2250/4446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:08 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:08.630295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb0c4bdc-c9ba-42f2-8f69-44c21bbe7d43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1433187054", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": -1, "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:08.641458 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-eb0c4bdc-c9ba-42f2-8f69-44c21bbe7d43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Flavor -1 could not be found. May 07 22:04:08.642883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb0c4bdc-c9ba-42f2-8f69-44c21bbe7d43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:08.643720 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb0c4bdc-c9ba-42f2-8f69-44c21bbe7d43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.018571 May 07 22:04:08.646941 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2251/4447] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:08 2022] POST /compute/v2.1/servers => generated 73 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 22:04:08.652360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:08.653268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:08.662751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.663458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.665080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.665703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.689431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:08.701840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e85ae2d-cd68-401a-b540-1664c73dfe7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1300 microversion: 2.1 time: 0.229230 May 07 22:04:08.703300 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2197/4448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:08 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:08.836524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:08.848612 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e07ece70-68c6-46e2-a484-97d56f0ba5d6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.200080 May 07 22:04:08.849937 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2252/4449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:08 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:08.866290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:08.866949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:08.873606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.874178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.874859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:08.875305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:08.993609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:08.994506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:09.007933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.008562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.009449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.009933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.131412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:09.148531 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4267fa6f-830f-42e5-a7fe-1184e6707241 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.286596 May 07 22:04:09.152274 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2198/4450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:08 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:09.169176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:09.169664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:09.192577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.193077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.193941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.203759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.361082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:09.373698 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4741e777-1f45-489a-bed8-fa488857c518 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1285 microversion: 2.1 time: 0.220553 May 07 22:04:09.374310 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2199/4451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:09 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:09.381183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6504328a-1a27-4448-aedf-49ca402ecae3 req-95caf8d4-6a02-49e7-89dd-ca099b1e0ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11df3809-8e5b-40d6-adb1-393c365f9a47", "name": "network-vif-plugged", "status": "completed", "tag": "050be740-f219-402b-99ff-07b3f4f82b98"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:09.393389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6504328a-1a27-4448-aedf-49ca402ecae3 req-95caf8d4-6a02-49e7-89dd-ca099b1e0ced service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.393842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6504328a-1a27-4448-aedf-49ca402ecae3 req-95caf8d4-6a02-49e7-89dd-ca099b1e0ced service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.412292 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6504328a-1a27-4448-aedf-49ca402ecae3 req-95caf8d4-6a02-49e7-89dd-ca099b1e0ced service nova] Creating event network-vif-plugged:050be740-f219-402b-99ff-07b3f4f82b98 for instance 11df3809-8e5b-40d6-adb1-393c365f9a47 on nch1-master-1 May 07 22:04:09.419077 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6504328a-1a27-4448-aedf-49ca402ecae3 req-95caf8d4-6a02-49e7-89dd-ca099b1e0ced service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043025 May 07 22:04:09.420164 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2200/4452] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:09.427264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:09.428134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:09.437495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.438054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.439557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.440017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.466161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:09.479277 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93b3b087-27fe-4b1d-8a5f-be7bd435a562 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1427 microversion: 2.1 time: 0.486871 May 07 22:04:09.483976 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2253/4453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:08 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1427 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:09.495140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:09.496412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:09.503559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.504174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.505037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.505566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.768671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:09.776822 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f4bd992-6def-496a-8b38-2751c531c588 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.355100 May 07 22:04:09.777734 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2201/4454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:09 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:09.787671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:09.790406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29c87ade-8a82-4990-967f-81dfda4f292e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1452874558", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:09.797383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29c87ade-8a82-4990-967f-81dfda4f292e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:09.798603 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29c87ade-8a82-4990-967f-81dfda4f292e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.015256 May 07 22:04:09.799132 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9dc39586-7535-480a-b350-da50d56b8d17 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.313748 May 07 22:04:09.800109 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2202/4456] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:09 2022] POST /compute/v2.1/servers => generated 145 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:09.800469 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2254/4456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:09 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:09.806367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:09.807194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:09.809512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:09.810901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:09.815835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.816502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.817702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.818436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.822687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.825258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:09.826145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:09.827252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.125304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:10.133968 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-475267b0-35fe-4fa3-952d-25df8fabf719 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.331215 May 07 22:04:10.134579 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2255/4457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:09 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:10.145857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:10.146496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:10.158383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.158876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.159687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.160875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.189885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:10.208176 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e05bd201-1254-42a4-b4f0-26a75fa6b7e7 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1363 microversion: 2.1 time: 0.406026 May 07 22:04:10.215900 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2203/4458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:09 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:10.391213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:10.391841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:10.399104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.399794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.401699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.402267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.432634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:10.459750 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af6e652a-6f22-4c7b-abd2-afe17f4c8b3a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.320618 May 07 22:04:10.465302 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2256/4459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:10 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:10.482871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:10.483583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:10.490803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.491351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.492209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.492665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.728148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:10.740457 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bca0fd24-671f-403f-b691-fbef300559ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.260803 May 07 22:04:10.742717 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2257/4460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:10 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:10.766492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:10.768495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:10.779927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:10.790757 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-30c4c6e7-044e-4a1c-9d28-af99eb8e4c8f tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.403533 May 07 22:04:10.793463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.794260 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2204/4461] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:10 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:10.796556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.798442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.799843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.807425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4045b04a-6723-47a0-9c1b-7c649dc33fa1 req-f9f45983-5714-4b63-9392-f6018dad91a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf519119-a1c9-4f1e-9d65-8f11441721a2", "tag": "53d2f822-2f8e-447c-9bcb-2e1cb411c60a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:10.833250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4045b04a-6723-47a0-9c1b-7c649dc33fa1 req-f9f45983-5714-4b63-9392-f6018dad91a6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.833711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4045b04a-6723-47a0-9c1b-7c649dc33fa1 req-f9f45983-5714-4b63-9392-f6018dad91a6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.869631 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4045b04a-6723-47a0-9c1b-7c649dc33fa1 req-f9f45983-5714-4b63-9392-f6018dad91a6 service nova] Creating event network-changed:53d2f822-2f8e-447c-9bcb-2e1cb411c60a for instance cf519119-a1c9-4f1e-9d65-8f11441721a2 on nch2-master-1 May 07 22:04:10.874932 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4045b04a-6723-47a0-9c1b-7c649dc33fa1 req-f9f45983-5714-4b63-9392-f6018dad91a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079044 May 07 22:04:10.888331 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2205/4462] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:10.893760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:10.894526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:10.907938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.908637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:10.909652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:10.910872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.184012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:11.192526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5a402de-e87d-4e93-9b91-843228930031 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1606 microversion: 2.1 time: 0.448337 May 07 22:04:11.193315 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2258/4463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:10 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1606 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:11.214965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:11.215840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:11.229347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.230202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.231365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.231715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.292520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:11.301284 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8805ac9a-8363-4a43-bbc0-fcb16af7a523 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.411000 May 07 22:04:11.301873 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2206/4464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:10 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:11.317077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aab26af5-c909-4499-bb3d-6ead3cac24d2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1704193629", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:11.320842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-aab26af5-c909-4499-bb3d-6ead3cac24d2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 07 22:04:11.321570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aab26af5-c909-4499-bb3d-6ead3cac24d2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:11.322809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aab26af5-c909-4499-bb3d-6ead3cac24d2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.009726 May 07 22:04:11.323504 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2207/4465] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:11 2022] POST /compute/v2.1/servers => generated 123 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:11.331585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:11.333019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:11.342006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.342961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.343927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.344512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.482361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:11.498814 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-002c4e66-30cd-447e-9820-ab24322695f0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.303404 May 07 22:04:11.499753 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2259/4466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:11 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:11.507577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:11.509015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:11.518958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.520055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.521104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.521663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.596496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:11.605791 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd647c70-8879-4489-ab4c-17bdd8a8de3e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.277794 May 07 22:04:11.615428 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2208/4467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:11 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:11.621271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:11.621914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:11.629578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.630233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.631113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.631717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.802589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:11.813460 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-667897f8-b52b-4124-894c-91580cdaa1e0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1549 microversion: 2.1 time: 0.196445 May 07 22:04:11.814139 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2209/4468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:11 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1549 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:11.818890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:11.819618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:11.825930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.826471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.827302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.827746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.860484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:11.869477 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2cd8b86-6bc8-44ab-b4d0-8551cf89a7fc tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1606 microversion: 2.1 time: 0.368059 May 07 22:04:11.870071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2260/4469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:11 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1606 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:11.876032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:11.881606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:11.888016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.888683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.889483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:11.889940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:11.978549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:11.987009 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71a37513-bcd4-41ed-a6d1-55f24cbed0a8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.171662 May 07 22:04:11.995077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2210/4470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:11 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:12.000890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9035aa5a-0af2-4692-9b2c-37654b980365 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:12.001406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9035aa5a-0af2-4692-9b2c-37654b980365 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:12.007473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9035aa5a-0af2-4692-9b2c-37654b980365 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.007968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9035aa5a-0af2-4692-9b2c-37654b980365 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.008923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9035aa5a-0af2-4692-9b2c-37654b980365 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.009381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9035aa5a-0af2-4692-9b2c-37654b980365 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.088757 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9035aa5a-0af2-4692-9b2c-37654b980365 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092114 May 07 22:04:12.089716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2211/4471] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:04:11 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:12.095146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:12.096062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:12.103857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.104323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.105147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.105598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.405943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:12.426429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d7a43f9-1310-4fa4-be0b-cd098c22a049 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1606 microversion: 2.1 time: 0.335021 May 07 22:04:12.427474 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2212/4472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:12 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1606 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:12.433812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:12.447879 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e15884e2-6ff2-4e0d-a746-f98e98de1b36 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.576447 May 07 22:04:12.450093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:12.450732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:12.452283 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2261/4473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:11 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:12.461360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4b0a6d15-a55f-4681-8767-c195ccebfb05 req-0adb8984-26d0-4ac0-ab5f-9d9f37e5b3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8fdf88-13b9-439a-a4f4-b4dec75e47ec", "tag": "084c853e-2bdf-48de-b632-cb35deede3f7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:12.469560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.470021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.471023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.474525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.483387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4b0a6d15-a55f-4681-8767-c195ccebfb05 req-0adb8984-26d0-4ac0-ab5f-9d9f37e5b3b8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.485740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4b0a6d15-a55f-4681-8767-c195ccebfb05 req-0adb8984-26d0-4ac0-ab5f-9d9f37e5b3b8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.507297 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4b0a6d15-a55f-4681-8767-c195ccebfb05 req-0adb8984-26d0-4ac0-ab5f-9d9f37e5b3b8 service nova] Creating event network-changed:084c853e-2bdf-48de-b632-cb35deede3f7 for instance ef8fdf88-13b9-439a-a4f4-b4dec75e47ec on nch1-master-1 May 07 22:04:12.515623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4b0a6d15-a55f-4681-8767-c195ccebfb05 req-0adb8984-26d0-4ac0-ab5f-9d9f37e5b3b8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061833 May 07 22:04:12.516858 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2262/4474] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:12.528668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:12.529795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:12.540808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.541527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.545790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.547103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.644346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:12.652908 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-98269e4c-afc4-413a-b899-5c7575546532 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.223973 May 07 22:04:12.653510 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2213/4475] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:12 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:12.658176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:12.658858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:12.665184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.665643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.666610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.667292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.806190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:12.814316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c9eacb9-9792-43a8-b74f-30ed4680ca4d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.159775 May 07 22:04:12.814973 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2214/4476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:12 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:12.820433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:12.821068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:12.827498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.827966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.828770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:12.829221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:12.964651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:12.972297 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c158ca32-6a73-44ac-8eda-c64ab70507a0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.156198 May 07 22:04:12.972895 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2215/4477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:12 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:12.977864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0dbf734b-4146-49c2-8791-366da704f417 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2057100737", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "key_name": "tempest-key-1220432329", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:13.030594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-0dbf734b-4146-49c2-8791-366da704f417 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] validate_networks() for [('cd3974b0-b5b4-4267-bd42-3bc0d892b541', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:04:13.321014 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-0dbf734b-4146-49c2-8791-366da704f417 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Invalid key_name provided. May 07 22:04:13.322223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0dbf734b-4146-49c2-8791-366da704f417 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid key_name provided. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:13.323395 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0dbf734b-4146-49c2-8791-366da704f417 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.349121 May 07 22:04:13.324331 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2216/4478] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:12 2022] POST /compute/v2.1/servers => generated 70 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 07 22:04:13.332411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:13.333226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:13.342233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.343508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.344282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.344502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.411695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:13.420069 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85675800-85a5-4f9e-89e2-68f7b2173391 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.901492 May 07 22:04:13.420865 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2263/4479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:12 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:13.474452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:13.475534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:13.482139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.482704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.483888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.484433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.577708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:13.585848 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d04cff13-ddfd-4010-a9ef-18d15fbdd3dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.257342 May 07 22:04:13.586441 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2217/4480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:13 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:13.604325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:13.604966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:13.611323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.611811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.612754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.613891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.753181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:13.760874 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f752c006-0582-40cc-825f-07e35e4e0a60 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.160524 May 07 22:04:13.761765 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2218/4481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:13 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:13.815634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-360c3413-d195-4776-8b1d-890ae6c57375 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-511902091", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:13.900420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:13.909210 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff89ca32-8a30-4fe2-b076-cf3a9a88fff0 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.439552 May 07 22:04:13.910620 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2264/4482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:13 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:13.917241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:13.918109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:13.924525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.925198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.926018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.926458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.951455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.security_group_api [None req-360c3413-d195-4776-8b1d-890ae6c57375 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Neutron security group does_not_exist not found {{(pid=136681) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 07 22:04:13.952176 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-360c3413-d195-4776-8b1d-890ae6c57375 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 07 22:04:13.952972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-360c3413-d195-4776-8b1d-890ae6c57375 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:13.953994 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-360c3413-d195-4776-8b1d-890ae6c57375 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.142409 May 07 22:04:13.955098 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2219/4483] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:13 2022] POST /compute/v2.1/servers => generated 106 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:13.964923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:13.969373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:13.977783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.978424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:13.979814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:13.980601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:14.249476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:14.259321 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cfac8e68-c4cd-4655-9052-872cc84ecb75 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.299308 May 07 22:04:14.271614 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2220/4484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:13 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:14.271614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:14.271614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:14.277609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:14.278438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:14.279426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:14.281069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:14.287024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:14.299281 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-caffdbae-e104-4f96-89a1-41837288bc2b tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.387372 May 07 22:04:14.302852 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2265/4485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:13 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:14.311372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:14.315576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:14.322226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:14.322848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:14.323642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:14.324207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:14.885980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:14.894853 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8bcce705-2e86-4a60-8371-eb147014b694 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.631693 May 07 22:04:14.895719 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2221/4486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:14 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:14.903239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:14.904218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:14.911405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:14.912545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:14.913341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:14.913999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.071037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:15.079155 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c3e9df1-e9a4-4ff5-a992-b16fd8f338a5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.774743 May 07 22:04:15.091419 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2266/4487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:14 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:15.097987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:15.098618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.105354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.105814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.106929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.107532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.161940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:15.171300 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7567a611-f366-4755-bdb2-e55d16baa3c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.272886 May 07 22:04:15.172640 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2222/4488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:14 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:15.178129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-450fbea7-e680-41ea-91be-e7f9804c1fb8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:15.178824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-450fbea7-e680-41ea-91be-e7f9804c1fb8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ee6e4218-3b40-47f6-9735-c2ff5097561d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.185021 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-450fbea7-e680-41ea-91be-e7f9804c1fb8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance ee6e4218-3b40-47f6-9735-c2ff5097561d could not be found. May 07 22:04:15.185984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-450fbea7-e680-41ea-91be-e7f9804c1fb8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance ee6e4218-3b40-47f6-9735-c2ff5097561d could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:15.187036 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-450fbea7-e680-41ea-91be-e7f9804c1fb8 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ee6e4218-3b40-47f6-9735-c2ff5097561d" status: 404 len: 111 microversion: 2.1 time: 0.013221 May 07 22:04:15.191356 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2223/4489] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:04:15 2022] DELETE /compute/v2.1/servers/ee6e4218-3b40-47f6-9735-c2ff5097561d => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:15.196913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:15.197764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.206196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.207389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.208337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.208959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.435030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:15.443377 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79d06675-2b9c-4ead-8c59-dcb41da98890 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.250660 May 07 22:04:15.455629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2224/4490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:15 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:15.461299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:15.461941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.468115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.468565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.469357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.469804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.552244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:15.562829 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e07449a3-398a-4c65-8f33-c305f984ffad tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.469689 May 07 22:04:15.564315 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2267/4491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:15 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:15.601306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:15.603636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.619558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.620245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.621770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.622527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.682112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:15.691821 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-234c82b7-c8a5-43ae-bdc8-f0714df16d42 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1502 microversion: 2.1 time: 0.234163 May 07 22:04:15.692750 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2225/4492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:15 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:15.725581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8e363d-4b8a-48db-874a-26551079d6b0"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:15.726793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.733363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.734231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.735060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.735516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.766191 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Cannot 'attach_volume' instance 96e381dd-9f23-442c-80d2-8623a85c3e50 while it is in vm_state rescued May 07 22:04:15.766684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 409 to user: Cannot 'attach_volume' instance 96e381dd-9f23-442c-80d2-8623a85c3e50 while it is in vm_state rescued {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:15.767589 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3aab6e7e-8fd9-43d9-b931-21898212d94c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051385 May 07 22:04:15.768175 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2226/4493] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:04:15 2022] POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:04:15.777094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3519c82b-6ffe-4499-9dbf-ec7bc7687518 req-6811f720-2e52-4db1-92d7-b25a4d6dbeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11df3809-8e5b-40d6-adb1-393c365f9a47", "tag": "050be740-f219-402b-99ff-07b3f4f82b98"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:15.789022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3519c82b-6ffe-4499-9dbf-ec7bc7687518 req-6811f720-2e52-4db1-92d7-b25a4d6dbeb6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.789506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3519c82b-6ffe-4499-9dbf-ec7bc7687518 req-6811f720-2e52-4db1-92d7-b25a4d6dbeb6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.804693 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3519c82b-6ffe-4499-9dbf-ec7bc7687518 req-6811f720-2e52-4db1-92d7-b25a4d6dbeb6 service nova] Creating event network-changed:050be740-f219-402b-99ff-07b3f4f82b98 for instance 11df3809-8e5b-40d6-adb1-393c365f9a47 on nch1-master-1 May 07 22:04:15.812982 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3519c82b-6ffe-4499-9dbf-ec7bc7687518 req-6811f720-2e52-4db1-92d7-b25a4d6dbeb6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038441 May 07 22:04:15.813612 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2227/4494] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:15.822722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d1dce50-a618-42c3-878a-fd4bde72f25f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:15.824278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d1dce50-a618-42c3-878a-fd4bde72f25f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.844890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1dce50-a618-42c3-878a-fd4bde72f25f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.845608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1dce50-a618-42c3-878a-fd4bde72f25f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.847253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1dce50-a618-42c3-878a-fd4bde72f25f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.848600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1dce50-a618-42c3-878a-fd4bde72f25f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:15.965779 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d1dce50-a618-42c3-878a-fd4bde72f25f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action" status: 202 len: 0 microversion: 2.1 time: 0.150283 May 07 22:04:15.967628 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2228/4495] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:15 2022] POST /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:04:15.979480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:15.980794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:15.999021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:15.999479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.000280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.000834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.058616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:16.074258 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-40bc894a-bcf9-468c-b2a5-221f68a9f666 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.481939 May 07 22:04:16.084794 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2268/4496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:15 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:16.096672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:16.100098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:16.119064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.120194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.121773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.122307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.429566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:16.439058 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96d86de9-2054-42c6-8950-6a312f86246e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.469903 May 07 22:04:16.439663 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2229/4497] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:15 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:16.444848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21846c14-e05a-4180-b1e0-4049fd915a5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:16.445780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-21846c14-e05a-4180-b1e0-4049fd915a5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Failed to fetch instance by id 9223372036854775808 {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2926}} May 07 22:04:16.445901 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-21846c14-e05a-4180-b1e0-4049fd915a5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 07 22:04:16.446388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21846c14-e05a-4180-b1e0-4049fd915a5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:16.447248 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-21846c14-e05a-4180-b1e0-4049fd915a5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.006670 May 07 22:04:16.451349 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2230/4498] 10.222.0.32 () {58 vars in 1187 bytes} [Sat May 7 22:04:16 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 22:04:16.456666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:16.457804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:16.464140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.464532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.465325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.465767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.498422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:16.506665 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ee1b1c68-d79b-4b41-af38-19f13222c45f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1510 microversion: 2.1 time: 0.420387 May 07 22:04:16.519888 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2269/4499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:16 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1510 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:16.525232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:16.525509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:16.532190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.532684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.533482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.533934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.869656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:16.885129 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5aef6b0-1da4-41a6-a513-880a34318ede tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.432523 May 07 22:04:16.886431 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2231/4500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:16 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:16.902078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:16.902826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:16.913301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.913832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.914858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.915491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.920036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:16.929791 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-958c5e50-af52-42a5-9e0e-83fb595d4f7b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.408664 May 07 22:04:16.953132 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2270/4501] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:16 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:16.958040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:16.958664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:16.971228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.971862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:16.974086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:16.979099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.273953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:17.288438 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e73a1af3-5e66-4c2b-8512-fb77a1574c45 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.400641 May 07 22:04:17.290598 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2232/4502] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:16 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:17.457797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:17.458398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:17.466224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.466752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.467496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.467947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.631566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:17.640030 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa41c391-f03d-442f-afb6-af8965bb36cc tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.187189 May 07 22:04:17.641028 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2233/4503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:17 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:17.650093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1a84c1d7-26b1-4dba-b6d8-f2c80fd22519 req-cfdcb94b-7b3b-48dc-b9cc-60675f675f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b682b3c1-0ca9-4806-8100-908917473b27", "tag": "ebd70047-1a0a-49d6-a707-647dac8e19a2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:17.661561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1a84c1d7-26b1-4dba-b6d8-f2c80fd22519 req-cfdcb94b-7b3b-48dc-b9cc-60675f675f5a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.662837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1a84c1d7-26b1-4dba-b6d8-f2c80fd22519 req-cfdcb94b-7b3b-48dc-b9cc-60675f675f5a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.677269 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1a84c1d7-26b1-4dba-b6d8-f2c80fd22519 req-cfdcb94b-7b3b-48dc-b9cc-60675f675f5a service nova] Creating event network-changed:ebd70047-1a0a-49d6-a707-647dac8e19a2 for instance b682b3c1-0ca9-4806-8100-908917473b27 on nch2-master-1 May 07 22:04:17.683179 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1a84c1d7-26b1-4dba-b6d8-f2c80fd22519 req-cfdcb94b-7b3b-48dc-b9cc-60675f675f5a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040599 May 07 22:04:17.686934 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2234/4504] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:17.693476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:17.694832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:17.702538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.703314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.705800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.706416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.716212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:17.748311 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a7b5ff87-51eb-45bc-b7db-af03461c09ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.789296 May 07 22:04:17.749241 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2271/4505] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:16 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:17.766030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-29de82d8-632a-458d-8ea6-8095ecc0f464 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:17.766649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-29de82d8-632a-458d-8ea6-8095ecc0f464 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Failed to fetch instance by id -1 {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2926}} May 07 22:04:17.767282 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-29de82d8-632a-458d-8ea6-8095ecc0f464 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance -1 could not be found. May 07 22:04:17.768080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-29de82d8-632a-458d-8ea6-8095ecc0f464 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance -1 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:17.770198 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-29de82d8-632a-458d-8ea6-8095ecc0f464 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008183 May 07 22:04:17.771340 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2272/4506] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 22:04:17 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 07 22:04:17.781977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:17.782833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:17.790290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.790997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.791794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.792244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.872047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:17.880976 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee08eaf8-98ba-4f7f-8bfc-321669968ca8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1510 microversion: 2.1 time: 0.191751 May 07 22:04:17.881569 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2235/4507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:17 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:17.901467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:17.902323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:17.908788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.909427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:17.910421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:17.911036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.046216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:18.054630 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-857136d3-4320-4311-8aea-978baa8897e0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.276624 May 07 22:04:18.058462 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2273/4508] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:17 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:18.076676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:18.077529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:18.084601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.085267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.086206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.086864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.100336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:18.108095 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c9d2395-b4b1-4afd-b245-29a961c5f092 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.210492 May 07 22:04:18.112349 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2236/4509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:17 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:18.306986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:18.308327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:18.315714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.318094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.319097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.319680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.336252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:18.345541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f2bf759-fc32-4cbc-bf8a-8980f3879bf3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.273601 May 07 22:04:18.351380 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2274/4510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:18 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:18.367894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6587f70-32a6-489b-a8f2-ce06cc9eb496 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:18.382173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6587f70-32a6-489b-a8f2-ce06cc9eb496 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 46a1242f-f609-46cc-9b62-38c538a7f303] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:18.394533 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-c6587f70-32a6-489b-a8f2-ce06cc9eb496 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 46a1242f-f609-46cc-9b62-38c538a7f303 could not be found. May 07 22:04:18.395194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6587f70-32a6-489b-a8f2-ce06cc9eb496 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 46a1242f-f609-46cc-9b62-38c538a7f303 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:18.396004 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6587f70-32a6-489b-a8f2-ce06cc9eb496 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/46a1242f-f609-46cc-9b62-38c538a7f303/action" status: 404 len: 111 microversion: 2.1 time: 0.033178 May 07 22:04:18.396769 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2275/4511] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:18 2022] POST /compute/v2.1/servers/46a1242f-f609-46cc-9b62-38c538a7f303/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:04:18.427077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:18.428152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:18.446819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.447264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.448066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.448935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.529071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:18.538541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b7295c4-32b1-441e-85da-47469ad3d5f9 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.235555 May 07 22:04:18.539650 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2237/4512] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:18 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:18.657125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:18.665504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:18.680868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.681336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.682143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.682594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.717076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:18.726405 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f49caab-3a4f-4969-9a56-45753c9137da tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.314729 May 07 22:04:18.727709 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2276/4513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:18 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:18.744893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:18.745990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:18.754246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.755256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.756364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.757082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.938603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:18.953020 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cff527b5-8e2d-45a9-b15d-e9168b8c6d7c tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.300112 May 07 22:04:18.957518 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2238/4514] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:18 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:18.968799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:18.973387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:18.982269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:18.984461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.984938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:18.985773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:18.986273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.011308 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-49f99bde-3e54-403a-8e96-660915d6f5e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.270945 May 07 22:04:19.017626 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2277/4515] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:18 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:19.037887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b209b54f-f032-4da1-8f83-d31f165f3be7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:19.041362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b209b54f-f032-4da1-8f83-d31f165f3be7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: d40d42c2-60b9-4821-9ef2-fc0eee93183c] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.054938 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b209b54f-f032-4da1-8f83-d31f165f3be7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance d40d42c2-60b9-4821-9ef2-fc0eee93183c could not be found. May 07 22:04:19.058079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b209b54f-f032-4da1-8f83-d31f165f3be7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance d40d42c2-60b9-4821-9ef2-fc0eee93183c could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:19.060689 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b209b54f-f032-4da1-8f83-d31f165f3be7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/d40d42c2-60b9-4821-9ef2-fc0eee93183c/action" status: 404 len: 111 microversion: 2.1 time: 0.033568 May 07 22:04:19.061958 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2278/4516] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:19 2022] POST /compute/v2.1/servers/d40d42c2-60b9-4821-9ef2-fc0eee93183c/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:19.070318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:19.071405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.079548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.080471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.082218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.083549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.229096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:19.236825 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b50ea703-d991-4cc0-82f9-29fe8ebc1202 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1516 microversion: 2.1 time: 0.277740 May 07 22:04:19.237409 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2239/4517] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:18 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1516 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:19.242342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cdf8b6e5-d7d2-49c7-ab3d-feace41c4861 req-7f54d726-1649-4096-bec1-b4158d30d04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf519119-a1c9-4f1e-9d65-8f11441721a2", "name": "network-vif-plugged", "status": "completed", "tag": "53d2f822-2f8e-447c-9bcb-2e1cb411c60a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:19.250564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cdf8b6e5-d7d2-49c7-ab3d-feace41c4861 req-7f54d726-1649-4096-bec1-b4158d30d04f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.251278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cdf8b6e5-d7d2-49c7-ab3d-feace41c4861 req-7f54d726-1649-4096-bec1-b4158d30d04f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.264333 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cdf8b6e5-d7d2-49c7-ab3d-feace41c4861 req-7f54d726-1649-4096-bec1-b4158d30d04f service nova] Creating event network-vif-plugged:53d2f822-2f8e-447c-9bcb-2e1cb411c60a for instance cf519119-a1c9-4f1e-9d65-8f11441721a2 on nch2-master-1 May 07 22:04:19.271527 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cdf8b6e5-d7d2-49c7-ab3d-feace41c4861 req-7f54d726-1649-4096-bec1-b4158d30d04f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032603 May 07 22:04:19.275503 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2240/4518] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:19.292449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:19.293589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.300564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.301219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.302018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.302464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.361201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:19.372780 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f2c65d3c-82d1-45d6-9fec-5d9875d3c249 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.306880 May 07 22:04:19.373725 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2279/4519] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:19 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:19.394618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:19.395255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.401354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.401819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.402612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.403088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.639883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:19.648896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e0fe5fd2-754e-449c-9493-5b08fa57e2b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.371983 May 07 22:04:19.652088 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2241/4520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:19 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:19.657417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:19.658188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.670268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.670725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.671541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.671987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.684409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:19.695637 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a7913b6f-fa3b-48c6-b11c-109bcef3ad03 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.305422 May 07 22:04:19.706959 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2280/4521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:19 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:19.715739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b8b004c-fe9f-45b3-ac8b-437f4624b585 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:19.716353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b8b004c-fe9f-45b3-ac8b-437f4624b585 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: e7c347b0-d583-4f8a-8eeb-5a63e4f90755] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.741014 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-7b8b004c-fe9f-45b3-ac8b-437f4624b585 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance e7c347b0-d583-4f8a-8eeb-5a63e4f90755 could not be found. May 07 22:04:19.743374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b8b004c-fe9f-45b3-ac8b-437f4624b585 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance e7c347b0-d583-4f8a-8eeb-5a63e4f90755 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:19.745118 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b8b004c-fe9f-45b3-ac8b-437f4624b585 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/e7c347b0-d583-4f8a-8eeb-5a63e4f90755" status: 404 len: 111 microversion: 2.1 time: 0.033018 May 07 22:04:19.745906 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2281/4522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:19 2022] GET /compute/v2.1/servers/e7c347b0-d583-4f8a-8eeb-5a63e4f90755 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:19.755780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:19.756824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.766104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.767023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.767930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.768489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.870053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:19.884495 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-46086583-542e-44cd-a969-dbb5352bc37c tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.231067 May 07 22:04:19.885017 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2242/4523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:19 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:19.973946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:19.974676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:19.985202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.985609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:19.986650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:19.987380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.042975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:20.053715 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f85eb384-17c1-431b-940a-b84a5f22112d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.302678 May 07 22:04:20.055348 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2282/4524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:19 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:20.071508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:20.072608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:20.081335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.082291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.083374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.084052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.166739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:20.174485 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0bf0ec38-bd0a-400b-a151-f4dae60ad773 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1368 microversion: 2.1 time: 0.204821 May 07 22:04:20.175131 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2243/4525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:19 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:20.287259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:20.294685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9978c9d3-e587-41a8-98f6-066e505ebe99 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.227169 May 07 22:04:20.295297 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2283/4526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:20 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:20.349793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-49d20045-d8a1-4ab4-b0b7-358c12b62b07 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-531831592", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:20.351524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-49d20045-d8a1-4ab4-b0b7-358c12b62b07 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:20.352349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-49d20045-d8a1-4ab4-b0b7-358c12b62b07 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007017 May 07 22:04:20.353037 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2244/4527] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:20.361030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:20.361744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:20.370141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.370525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.371359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.371805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.551696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:20.559798 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-38bad6b7-968f-484b-9cc1-e3b21574dbcf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.202477 May 07 22:04:20.560579 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2284/4528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:20 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:20.577103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:20.577956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:20.586173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.586604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.587554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.588150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.666981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:20.667598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:20.673523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.673974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.674747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.675655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.813797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:20.822705 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec42c2b9-cdc2-4dd6-8f29-420d65adf204 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.249353 May 07 22:04:20.823577 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2245/4529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:20 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:20.835655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:20.841224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-126ba7c3-0a1b-4ec7-b391-03783bf32d90 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'create', calling method: .version_select at 0x7fc41ce48c10>, body: {"keypair": {"name": "tempest-keypair-1551805950"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:20.850300 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e8a6cb1f-aef2-41b0-a671-0526b189da5b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.187160 May 07 22:04:20.860899 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2285/4530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:20 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:20.877924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-126ba7c3-0a1b-4ec7-b391-03783bf32d90 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:20.885942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-126ba7c3-0a1b-4ec7-b391-03783bf32d90 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for user 4fb48e4d50184d2e97674324027d9ec0 and project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:20.901253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:20.902366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:20.908552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.909092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:20.910092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:20.910745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.022302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-126ba7c3-0a1b-4ec7-b391-03783bf32d90 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:21.027990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-126ba7c3-0a1b-4ec7-b391-03783bf32d90 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for user 4fb48e4d50184d2e97674324027d9ec0 and project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:21.045156 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-126ba7c3-0a1b-4ec7-b391-03783bf32d90 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.211475 May 07 22:04:21.045764 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2246/4531] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:04:20 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:21.051287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d98123b-2ae5-46f7-a6ce-01d79356a374 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166686267", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:21.052954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d98123b-2ae5-46f7-a6ce-01d79356a374 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:21.054211 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d98123b-2ae5-46f7-a6ce-01d79356a374 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.006823 May 07 22:04:21.055271 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2247/4532] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:21 2022] POST /compute/v2.1/servers => generated 133 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:21.059254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:21.063440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:21.065560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:21.067598 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e30564f1-8040-49c6-9997-91c46e4135bf tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.170195 May 07 22:04:21.068546 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2286/4533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:20 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:21.072838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.073485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.074691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.075429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.191854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:21.192913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:21.199461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.200019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.200900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.201441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.341114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:21.349559 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7abb5ba6-7729-4056-b22c-ac1ce877914d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1558 microversion: 2.1 time: 0.161818 May 07 22:04:21.350158 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2287/4534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:21 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:21.354952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-59dacf69-82a8-4360-addd-b58e3792a7ba req-03495bb3-26a4-4f49-abe9-92e4aead48f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8fdf88-13b9-439a-a4f4-b4dec75e47ec", "name": "network-vif-plugged", "status": "completed", "tag": "084c853e-2bdf-48de-b632-cb35deede3f7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:21.363850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-59dacf69-82a8-4360-addd-b58e3792a7ba req-03495bb3-26a4-4f49-abe9-92e4aead48f3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.364482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-59dacf69-82a8-4360-addd-b58e3792a7ba req-03495bb3-26a4-4f49-abe9-92e4aead48f3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.383265 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-59dacf69-82a8-4360-addd-b58e3792a7ba req-03495bb3-26a4-4f49-abe9-92e4aead48f3 service nova] Creating event network-vif-plugged:084c853e-2bdf-48de-b632-cb35deede3f7 for instance ef8fdf88-13b9-439a-a4f4-b4dec75e47ec on nch1-master-1 May 07 22:04:21.389565 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-59dacf69-82a8-4360-addd-b58e3792a7ba req-03495bb3-26a4-4f49-abe9-92e4aead48f3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038220 May 07 22:04:21.390663 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2288/4535] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:21.396552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c052727c-9fc7-4a23-8393-7254c525aa50 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:21.397133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c052727c-9fc7-4a23-8393-7254c525aa50 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:21.403554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c052727c-9fc7-4a23-8393-7254c525aa50 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.404503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c052727c-9fc7-4a23-8393-7254c525aa50 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.404788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c052727c-9fc7-4a23-8393-7254c525aa50 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.405231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c052727c-9fc7-4a23-8393-7254c525aa50 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.515542 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c052727c-9fc7-4a23-8393-7254c525aa50 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123572 May 07 22:04:21.516236 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2289/4536] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:04:21 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:21.690646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:21.709725 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-954ff81e-c9c9-424b-a2ce-8b8b7108e064 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.646807 May 07 22:04:21.710529 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2248/4537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:21 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:21.728844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:21.729384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:21.741783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.742599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.743649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.744840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.868851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:21.869635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:21.875851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.876307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:21.877086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:21.877527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:22.058515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:22.067329 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a523f546-f369-4584-9a23-2bb381ffc6c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.202448 May 07 22:04:22.067923 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2249/4538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:21 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:22.093638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:22.094727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:22.105789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:22.106405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:22.107920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:22.108523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:22.117743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:22.132690 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d77c25e3-122e-4cad-bc21-c48234322160 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.408357 May 07 22:04:22.134506 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2290/4539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:21 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:22.150319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b61ebfaa-7ce2-487c-bfb9-eef1639416dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:22.151140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b61ebfaa-7ce2-487c-bfb9-eef1639416dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: a271dc32-e93b-4567-ad7e-34da422c7229] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:22.156826 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b61ebfaa-7ce2-487c-bfb9-eef1639416dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance a271dc32-e93b-4567-ad7e-34da422c7229 could not be found. May 07 22:04:22.157671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b61ebfaa-7ce2-487c-bfb9-eef1639416dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance a271dc32-e93b-4567-ad7e-34da422c7229 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:22.158704 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b61ebfaa-7ce2-487c-bfb9-eef1639416dc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/a271dc32-e93b-4567-ad7e-34da422c7229/action" status: 404 len: 111 microversion: 2.1 time: 0.012764 May 07 22:04:22.163448 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2291/4540] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:22 2022] POST /compute/v2.1/servers/a271dc32-e93b-4567-ad7e-34da422c7229/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:22.168559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:22.169438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:22.183260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:22.184005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:22.185289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:22.185943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:22.376174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:22.385582 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b95e9ccf-36a6-44e3-9caf-230aebf624df tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1315 microversion: 2.1 time: 0.303722 May 07 22:04:22.386437 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2250/4541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:22 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:22.790031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:22.803144 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ae5a399-39e1-4ba1-8585-1a2f48d86238 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.638236 May 07 22:04:22.804193 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2292/4542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:22 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:22.822332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:22.823000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:22.829720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:22.830179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:22.831166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:22.831651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.041593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:23.051078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4b612ad8-82c6-4d8e-9295-8cae65e57e5c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.232170 May 07 22:04:23.051770 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2251/4543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:22 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:23.071680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5bbb3623-7454-4195-8f2c-bd3b851a9599 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:23.072727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5bbb3623-7454-4195-8f2c-bd3b851a9599 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:23.081473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bbb3623-7454-4195-8f2c-bd3b851a9599 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.082275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bbb3623-7454-4195-8f2c-bd3b851a9599 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.084013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bbb3623-7454-4195-8f2c-bd3b851a9599 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.084438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:23.085224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:23.085341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bbb3623-7454-4195-8f2c-bd3b851a9599 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.091707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.092395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.093383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.094036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.201506 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5bbb3623-7454-4195-8f2c-bd3b851a9599 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 202 len: 0 microversion: 2.1 time: 0.135779 May 07 22:04:23.204327 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2293/4544] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:23 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:04:23.213986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:23.214748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:23.221891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.223299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.224256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.224854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.311264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:23.320968 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e29a078e-33da-428e-9b01-4cfa27e397b0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.240273 May 07 22:04:23.326194 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2252/4545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:23 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:23.332241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-926138650", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2a2f1f2-e03e-4e0b-afec-6667bd4eb44b"}], "security_groups": [{"name": "tempest-securitygroup--228067637"}], "key_name": "tempest-keypair-1551805950", "user_data": "}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:23.444893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] validate_networks() for [('f2a2f1f2-e03e-4e0b-afec-6667bd4eb44b', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:04:23.583827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:23.594478 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0f06ad82-9d88-4393-a5cf-f397722dd363 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1511 microversion: 2.1 time: 0.387452 May 07 22:04:23.595340 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2294/4546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:23 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1511 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:23.608892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:23.609515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:23.616090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.616550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.617337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.617789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.828875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:23.837318 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91468c57-6867-4516-9716-ca9fa1beedba tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1465 microversion: 2.1 time: 0.232235 May 07 22:04:23.837999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2295/4547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:23 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1465 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:23.842994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f8e31cbb-2b6e-46dd-a315-703dee6c0614 req-c98c5a38-e0bb-4d66-b27a-10903edba93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf519119-a1c9-4f1e-9d65-8f11441721a2", "tag": "53d2f822-2f8e-447c-9bcb-2e1cb411c60a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:23.858120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f8e31cbb-2b6e-46dd-a315-703dee6c0614 req-c98c5a38-e0bb-4d66-b27a-10903edba93d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.858481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f8e31cbb-2b6e-46dd-a315-703dee6c0614 req-c98c5a38-e0bb-4d66-b27a-10903edba93d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.880243 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f8e31cbb-2b6e-46dd-a315-703dee6c0614 req-c98c5a38-e0bb-4d66-b27a-10903edba93d service nova] Creating event network-changed:53d2f822-2f8e-447c-9bcb-2e1cb411c60a for instance cf519119-a1c9-4f1e-9d65-8f11441721a2 on nch2-master-1 May 07 22:04:23.886207 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f8e31cbb-2b6e-46dd-a315-703dee6c0614 req-c98c5a38-e0bb-4d66-b27a-10903edba93d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046729 May 07 22:04:23.887332 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2296/4548] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:23.899303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:23.906592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:23.916584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.917696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.918669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:23.919329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:23.954260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:04:24.050146 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3929cea8-e51c-480b-8770-f0c07d75b93d tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 204 len: 0 microversion: 2.1 time: 0.160311 May 07 22:04:24.052186 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2297/4549] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:04:23 2022] DELETE /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:04:24.063851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:24.064803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:24.073145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.073994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.075712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.076381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.191556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:04:24.192098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:04:24.192449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:04:24.193068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:04:24.193510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:04:24.209208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.214861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.214861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.215085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.251310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:24.251871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:24.258372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Getting quotas for user 4fb48e4d50184d2e97674324027d9ec0 and project 8130c27f2b84434a8d6fa5032b67aa1e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:24.264511 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47b7003a-2094-4bdd-886f-e43942497a57 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1471 microversion: 2.1 time: 0.207294 May 07 22:04:24.267318 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2298/4550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:24 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:24.286275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:04:24.289408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:04:24.339159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:24.340193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:24.350016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.351018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.352264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.353443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.357075 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e1039ac6-4f9c-40ba-9231-5dafe1f1109f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.029090 May 07 22:04:24.365590 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2253/4551] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:04:24.397674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-41898bc3-d754-45ae-bee0-1cf7195771e0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:24.398504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-41898bc3-d754-45ae-bee0-1cf7195771e0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:24.588624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:24.602502 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0415615-9b78-4acd-b182-40759f04cb9c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.268203 May 07 22:04:24.603960 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2299/4552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:24 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:24.613647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:24.614531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:24.623776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.624521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.625944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.626749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.627372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-41898bc3-d754-45ae-bee0-1cf7195771e0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:24.635806 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-41898bc3-d754-45ae-bee0-1cf7195771e0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1245 microversion: 2.1 time: 0.268987 May 07 22:04:24.645567 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2254/4553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:24 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1245 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:24.801517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:24.814007 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ac3652a-c953-4fb7-8dc8-8207335fbbe0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1491 microversion: 2.1 time: 0.206283 May 07 22:04:24.826382 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2300/4554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:24 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1491 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:24.831557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:24.832123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:24.839430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.840406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.841482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.842163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.883377 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Cannot 'pause' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state paused May 07 22:04:24.884221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 409 to user: Cannot 'pause' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state paused {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:24.885309 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b574721-77f9-407b-89e9-345396641872 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 409 len: 143 microversion: 2.1 time: 0.057881 May 07 22:04:24.886432 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2255/4555] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:24 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 143 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 07 22:04:24.896544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7f99b942-c1b8-4732-aaff-294d29e919a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:24.897335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7f99b942-c1b8-4732-aaff-294d29e919a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:24.904483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f99b942-c1b8-4732-aaff-294d29e919a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.905022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f99b942-c1b8-4732-aaff-294d29e919a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:24.906013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f99b942-c1b8-4732-aaff-294d29e919a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:24.906431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f99b942-c1b8-4732-aaff-294d29e919a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.002552 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7f99b942-c1b8-4732-aaff-294d29e919a7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 202 len: 0 microversion: 2.1 time: 0.111087 May 07 22:04:25.003374 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2301/4556] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:24 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:04:25.012858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:25.013500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:25.023189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.023835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.024793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.025396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.258453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:25.268563 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-739a4297-7ac1-4ddb-955a-abf07aff2edd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1498 microversion: 2.1 time: 0.260336 May 07 22:04:25.272152 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2256/4557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:25 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:25.286451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:25.289553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:25.297027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.297580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.299537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.300246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.476354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:25.484360 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ccbfcb72-5293-4cbf-b22a-aadd44ffaa85 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1471 microversion: 2.1 time: 0.203524 May 07 22:04:25.484937 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2302/4558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:25 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:25.619917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:25.620948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:25.630360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.632074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.633271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.634488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.653671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:25.655273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:25.665311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.665856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.666585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:25.667241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:25.772368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:25.781688 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57e85bc1-461a-4ef8-b8bb-008ba974910c tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1297 microversion: 2.1 time: 0.132759 May 07 22:04:25.791652 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2303/4559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:25 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1297 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:26.067673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-91af1ea8-d29d-4ad5-bf40-536bee889c15 req-4999df51-92d4-4f72-a263-46d699fddd01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8fdf88-13b9-439a-a4f4-b4dec75e47ec", "name": "network-vif-deleted", "tag": "084c853e-2bdf-48de-b632-cb35deede3f7"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:26.077185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-91af1ea8-d29d-4ad5-bf40-536bee889c15 req-4999df51-92d4-4f72-a263-46d699fddd01 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.077885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-91af1ea8-d29d-4ad5-bf40-536bee889c15 req-4999df51-92d4-4f72-a263-46d699fddd01 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.090824 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-91af1ea8-d29d-4ad5-bf40-536bee889c15 req-4999df51-92d4-4f72-a263-46d699fddd01 service nova] Creating event network-vif-deleted:084c853e-2bdf-48de-b632-cb35deede3f7 for instance ef8fdf88-13b9-439a-a4f4-b4dec75e47ec on nch1-master-1 May 07 22:04:26.096125 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-91af1ea8-d29d-4ad5-bf40-536bee889c15 req-4999df51-92d4-4f72-a263-46d699fddd01 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 May 07 22:04:26.098388 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2304/4560] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:04:26.291582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:26.292214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:26.299430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.299891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.301269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.301715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.389447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:26.397227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bbcff812-525b-4177-9793-8f23756ead4f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.781322 May 07 22:04:26.398325 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2257/4561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:25 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:26.447259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:26.455015 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6cff1171-62d6-4855-8ffb-554f670656ee tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.168546 May 07 22:04:26.455590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2305/4562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:26 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:26.474107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:26.474794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:26.480806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.481269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.482054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.482530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.502849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:26.503914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:26.511378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.512065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.513393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.514000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.558289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.558762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.559275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lazy-loading 'fault' on Instance uuid ef8fdf88-13b9-439a-a4f4-b4dec75e47ec {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:04:26.602417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b18ec20bcd654015b37eb90758427e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f1e26eb0cc42eea75d5194838b50f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:26.609869 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c49b7549-4ab5-48e7-abcd-6f0d4003f547 tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 200 len: 1305 microversion: 2.1 time: 0.112098 May 07 22:04:26.610456 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2306/4563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:26 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:26.778352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:26.786789 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b443021-a73c-4f5c-9b8e-1d984152df93 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.317156 May 07 22:04:26.787608 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2258/4564] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:26 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:26.801085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:26.801881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:26.803810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:26.804997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:26.808870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.809713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.810782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.811363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.811755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.812220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.813192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.813646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.832882 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. May 07 22:04:26.834267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:26.835246 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84dc7069-dd09-457d-8ecb-ae5c5628e206 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee/action" status: 404 len: 111 microversion: 2.1 time: 0.036595 May 07 22:04:26.836112 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2259/4565] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:26 2022] POST /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:04:26.844828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:26.846306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:26.854270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.855005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.855944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:26.856539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:26.882473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:26.892444 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8ceac83-acfc-41e8-8178-f625b7097a15 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1303 microversion: 2.1 time: 0.098036 May 07 22:04:26.894908 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2307/4566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:26 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:27.098336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:27.106571 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3a9f8527-0c25-4a8c-b546-bc13c942e4c6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.266143 May 07 22:04:27.107549 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2260/4567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:26 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:27.124504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:27.125451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:27.132267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.133015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.134033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.134689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.415256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:27.415887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:27.423287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.423769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.424595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.425574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.427497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:27.442295 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44f03828-4c08-4586-b267-9892453555b3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.321606 May 07 22:04:27.443485 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2308/4568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:27 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:27.460544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f367bae6-f8ee-435c-bd59-8a84922d0b41 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:27.462636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f367bae6-f8ee-435c-bd59-8a84922d0b41 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: bf1f7d3f-0f4b-449a-979a-cd47cf702660] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:27.476440 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f367bae6-f8ee-435c-bd59-8a84922d0b41 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance bf1f7d3f-0f4b-449a-979a-cd47cf702660 could not be found. May 07 22:04:27.477454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f367bae6-f8ee-435c-bd59-8a84922d0b41 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance bf1f7d3f-0f4b-449a-979a-cd47cf702660 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:27.478898 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f367bae6-f8ee-435c-bd59-8a84922d0b41 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/bf1f7d3f-0f4b-449a-979a-cd47cf702660/action" status: 404 len: 111 microversion: 2.1 time: 0.024037 May 07 22:04:27.479928 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2309/4569] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:27 2022] POST /compute/v2.1/servers/bf1f7d3f-0f4b-449a-979a-cd47cf702660/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:27.492023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:27.492856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:27.506759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.508048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.509835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.510394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.736949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:27.739289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:27.745771 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff04e187-e93a-430d-a459-d34800d2b99c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.260181 May 07 22:04:27.747450 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2310/4570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:27 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:27.755073 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-37a51d35-0a1b-4167-b416-585018debc14 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.343786 May 07 22:04:27.765465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:27.765465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] [instance: ef8fdf88-13b9-439a-a4f4-b4dec75e47ec] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:27.765714 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2261/4571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:27 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:27.771607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:27.772891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:27.778383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.779317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.779684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.780128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.782139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.783565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.785313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.785923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.825937 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] HTTP exception thrown: Instance ef8fdf88-13b9-439a-a4f4-b4dec75e47ec could not be found. May 07 22:04:27.826562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] Returning 404 to user: Instance ef8fdf88-13b9-439a-a4f4-b4dec75e47ec could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:27.827509 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76f0bc6f-829b-4069-b20d-1d2e09dfc6ed tempest-VolumesNegativeTest-1084226632 tempest-VolumesNegativeTest-1084226632-project] 10.222.0.32 "GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec" status: 404 len: 111 microversion: 2.1 time: 0.079201 May 07 22:04:27.828083 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2311/4572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:27 2022] GET /compute/v2.1/servers/ef8fdf88-13b9-439a-a4f4-b4dec75e47ec => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:27.911033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:27.913172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:27.922410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.923122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.924150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:27.924883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:27.980045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:27.990091 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-21bcd985-5d34-46b9-8870-6b269aecd294 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.224975 May 07 22:04:27.990701 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2262/4573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:27 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:28.006679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:28.008258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:28.025452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.026941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.029417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.030104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.070319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. May 07 22:04:28.071553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:28.075318 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8fdd80c-e48f-4773-b529-2e8f3855f647 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee/action" status: 404 len: 111 microversion: 2.1 time: 0.070026 May 07 22:04:28.076082 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2263/4574] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:28 2022] POST /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:04:28.087014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:28.087951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:28.094302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.095049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.096036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.096666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.156421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:28.164423 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-771ecf42-c483-4ffc-9cdc-1e5c046b54c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1370 microversion: 2.1 time: 0.258349 May 07 22:04:28.173630 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2312/4575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:27 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:28.456962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:28.466420 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-609243bd-c710-470e-aad4-b6d1c73855a9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.385738 May 07 22:04:28.467374 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2264/4576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:28 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:28.487741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:28.488409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:28.496758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.497377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.498336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.499101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.686188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:28.707488 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b94def4a-6a7f-4371-9c84-fa1a5d2215e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.227141 May 07 22:04:28.708387 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2313/4577] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:28 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:28.723906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fdfc7bfe-a7b5-4857-8539-192a61fb8aa3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:28.725705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fdfc7bfe-a7b5-4857-8539-192a61fb8aa3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 99862b0a-25a8-4977-b3a3-1a95f88f0f84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:28.731776 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-fdfc7bfe-a7b5-4857-8539-192a61fb8aa3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 99862b0a-25a8-4977-b3a3-1a95f88f0f84 could not be found. May 07 22:04:28.732374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fdfc7bfe-a7b5-4857-8539-192a61fb8aa3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 99862b0a-25a8-4977-b3a3-1a95f88f0f84 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:28.733466 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fdfc7bfe-a7b5-4857-8539-192a61fb8aa3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/99862b0a-25a8-4977-b3a3-1a95f88f0f84/action" status: 404 len: 111 microversion: 2.1 time: 0.013765 May 07 22:04:28.734185 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2265/4578] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:28 2022] POST /compute/v2.1/servers/99862b0a-25a8-4977-b3a3-1a95f88f0f84/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:28.743006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:28.743648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:28.751336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.751960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.752915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.754075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.772709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:28.773498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:28.780394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.782422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.783523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.784356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.903634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:28.911893 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5afa7bfd-00df-43f2-997e-3789b9114601 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.172772 May 07 22:04:28.913211 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2314/4579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:28 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:28.932039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:28.932901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:28.945950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.946417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:28.947458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:28.948167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.127708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:29.135804 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a2db4b0-b4e7-47e5-9491-491337f51b90 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.208608 May 07 22:04:29.137419 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2315/4580] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:28 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:29.142554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-14d037b8-ae4b-4869-8b09-d886d9f45f5d req-3504e264-f611-495b-8ac7-cf02f84101c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df2668b-af6b-4323-a4a4-520fcae8e55e", "tag": "26735917-c705-4821-b89b-e6f718fdc166"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:29.151912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-14d037b8-ae4b-4869-8b09-d886d9f45f5d req-3504e264-f611-495b-8ac7-cf02f84101c9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.152424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-14d037b8-ae4b-4869-8b09-d886d9f45f5d req-3504e264-f611-495b-8ac7-cf02f84101c9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.166482 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-14d037b8-ae4b-4869-8b09-d886d9f45f5d req-3504e264-f611-495b-8ac7-cf02f84101c9 service nova] Creating event network-changed:26735917-c705-4821-b89b-e6f718fdc166 for instance 9df2668b-af6b-4323-a4a4-520fcae8e55e on nch2-master-1 May 07 22:04:29.173083 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-14d037b8-ae4b-4869-8b09-d886d9f45f5d req-3504e264-f611-495b-8ac7-cf02f84101c9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033997 May 07 22:04:29.176653 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2316/4581] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:29.185325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d0586b5d-9a40-4ad4-ac7a-d40f398b9cdc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:29.187108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d0586b5d-9a40-4ad4-ac7a-d40f398b9cdc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 5ddd775a-73c5-4740-8835-1dd0b5110b37] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:29.193907 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d0586b5d-9a40-4ad4-ac7a-d40f398b9cdc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 5ddd775a-73c5-4740-8835-1dd0b5110b37 could not be found. May 07 22:04:29.203151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d0586b5d-9a40-4ad4-ac7a-d40f398b9cdc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 5ddd775a-73c5-4740-8835-1dd0b5110b37 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:29.204243 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d0586b5d-9a40-4ad4-ac7a-d40f398b9cdc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/5ddd775a-73c5-4740-8835-1dd0b5110b37/action" status: 404 len: 111 microversion: 2.1 time: 0.025814 May 07 22:04:29.205287 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2317/4582] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:29 2022] POST /compute/v2.1/servers/5ddd775a-73c5-4740-8835-1dd0b5110b37/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:29.224015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:29.224015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:29.249036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.249570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.250436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.251199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.273054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:29.286499 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff0ecb47-9185-4700-a85e-dca3ed70843c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.517829 May 07 22:04:29.287205 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2266/4583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:28 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:29.296182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:29.298805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:29.312310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.313304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.316267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.318887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.507083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:29.520260 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8c5a8b2f-24fb-4b72-b794-d439ded6bad6 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1370 microversion: 2.1 time: 0.312712 May 07 22:04:29.521389 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2318/4584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:29 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:29.563120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:29.575545 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-22035ab8-ca09-40fd-9ce5-118b2f4e991d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.285016 May 07 22:04:29.583544 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2267/4585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:29 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:29.594546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:29.595240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:29.602344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.602977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.603786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.604238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.796220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:29.805554 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7489bf4e-391f-4a25-ac04-b7b5e146c44c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.214324 May 07 22:04:29.805554 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2319/4586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:29 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:29.822250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:29.823256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:29.830115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.830586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.832359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.832782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.857412 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Cannot 'restore' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active May 07 22:04:29.858150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 409 to user: Cannot 'restore' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:29.859191 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ba00488f-b46e-41d1-94f2-d057c7905cd9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 409 len: 145 microversion: 2.1 time: 0.040947 May 07 22:04:29.859934 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2268/4587] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:29 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 145 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:04:29.868126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:29.868949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:29.875234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.875691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:29.876472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:29.876923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.148035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:30.157877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94ebe896-e79c-4c28-9ef5-32d6c3f3f370 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.293672 May 07 22:04:30.158467 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2320/4588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:29 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:30.176316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:30.176978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:30.183632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.183883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.184956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.185405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.304297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:30.304936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:30.312672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.313182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.313990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.314594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.383538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:30.392826 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa52da9d-9347-4bb7-8026-0b4bfede7378 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.222368 May 07 22:04:30.393448 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2269/4589] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:30 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:30.409849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-006e86bd-80fc-47a1-b49d-549a4288a04c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:30.410501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-006e86bd-80fc-47a1-b49d-549a4288a04c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2e7463d3-2a16-4bab-a6a1-c5bc4ebe02c5] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:30.416920 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-006e86bd-80fc-47a1-b49d-549a4288a04c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 2e7463d3-2a16-4bab-a6a1-c5bc4ebe02c5 could not be found. May 07 22:04:30.417635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-006e86bd-80fc-47a1-b49d-549a4288a04c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 2e7463d3-2a16-4bab-a6a1-c5bc4ebe02c5 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:30.418986 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-006e86bd-80fc-47a1-b49d-549a4288a04c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/2e7463d3-2a16-4bab-a6a1-c5bc4ebe02c5/action" status: 404 len: 111 microversion: 2.1 time: 0.013473 May 07 22:04:30.419824 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2270/4590] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:30 2022] POST /compute/v2.1/servers/2e7463d3-2a16-4bab-a6a1-c5bc4ebe02c5/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:04:30.428573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:30.429466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:30.439411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.440076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.441594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.442051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.596447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:30.607865 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52ec196b-773b-4a76-afed-c0e5cf1b28dd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.183613 May 07 22:04:30.608796 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2271/4591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:30 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:30.621784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:30.622983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:30.630043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.630726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.632055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.632914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.881346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:30.892727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:30.894841 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-07dba1ce-b26d-444c-86f1-e9059a25c7d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1370 microversion: 2.1 time: 0.279758 May 07 22:04:30.895447 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2272/4592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:30 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1370 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:30.902631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:30.904332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:30.909202 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1a5ccf29-a8dd-40bd-96bf-1c6a737d52d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.609461 May 07 22:04:30.910981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2321/4593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:30 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:30.912718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.913333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:30.914939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:30.915538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.146966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:31.155631 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1dc96c44-3348-4a3f-8705-963170a51ce5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.258754 May 07 22:04:31.156558 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2273/4594] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:30 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:31.178655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:31.179308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:31.186630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.188035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.188855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.189312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.224324 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Cannot 'resume' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active May 07 22:04:31.225181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 409 to user: Cannot 'resume' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:31.226041 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-87532b87-bf35-46b2-abfe-939551f1df50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 409 len: 144 microversion: 2.1 time: 0.056719 May 07 22:04:31.227046 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2322/4595] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:31 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 144 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:04:31.236057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:31.236862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:31.245242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.245849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.246718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.247333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.479759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:31.489894 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-78508523-e9b5-4588-b87d-8474e4bc25b5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.258059 May 07 22:04:31.491116 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2274/4596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:31 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:31.513806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:31.515063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:31.525545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.526016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.526996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.527627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.749388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:31.758742 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-02a989ad-b8ca-49c7-94ed-ca884438dc43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.252552 May 07 22:04:31.759581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2323/4597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:31 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:31.813789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fb005fc4-9b3d-4953-9757-f2098b0c3aa6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "cd3974b0-b5b4-4267-bd42-3bc0d892b541"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:31.815241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fb005fc4-9b3d-4953-9757-f2098b0c3aa6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:31.816666 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fb005fc4-9b3d-4953-9757-f2098b0c3aa6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.007279 May 07 22:04:31.817212 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2275/4598] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:31 2022] POST /compute/v2.1/servers => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:04:31.825181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:31.825812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:31.832051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.832542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.833321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.833770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.913982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:31.914894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:31.922488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.922992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:31.923796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:31.924421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.007370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:32.014823 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-42d94d86-4431-4d7a-9a57-de2c22edea74 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.193511 May 07 22:04:32.015439 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2324/4599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:31 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:32.020352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:32.021168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:32.029292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.029745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.030520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.030989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.163164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:32.170714 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a472561-ee94-4448-8e79-8dbfb8c4b4c4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.154261 May 07 22:04:32.171537 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2325/4600] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:32 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:32.176448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:32.177065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:32.182879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.183286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.184061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.184782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.217607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:32.226521 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4216376f-bc1e-4fac-a49c-1cc1e417d793 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1370 microversion: 2.1 time: 0.318263 May 07 22:04:32.227224 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2276/4601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:31 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:32.333008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:32.344587 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e7257f56-f94f-4363-9d60-f4c379da9688 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.172212 May 07 22:04:32.345191 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2326/4602] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:32 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:32.365855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7140412e-86e5-4e66-908c-bdc26156a434 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:32.367043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7140412e-86e5-4e66-908c-bdc26156a434 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 8d2bf3d2-348d-4922-9fb5-1cd51e5a32d8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:32.375664 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7140412e-86e5-4e66-908c-bdc26156a434 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 8d2bf3d2-348d-4922-9fb5-1cd51e5a32d8 could not be found. May 07 22:04:32.376374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7140412e-86e5-4e66-908c-bdc26156a434 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 8d2bf3d2-348d-4922-9fb5-1cd51e5a32d8 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:04:32.377496 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7140412e-86e5-4e66-908c-bdc26156a434 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/8d2bf3d2-348d-4922-9fb5-1cd51e5a32d8/action" status: 404 len: 111 microversion: 2.1 time: 0.020157 May 07 22:04:32.378584 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2277/4603] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:32 2022] POST /compute/v2.1/servers/8d2bf3d2-348d-4922-9fb5-1cd51e5a32d8/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:04:32.387347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:32.388549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:32.395459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.395918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.396712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.397164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.551841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:32.561374 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea18724b-52ae-4e48-bb4a-9cac9475caaa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.178105 May 07 22:04:32.562417 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2327/4604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:32 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:32.578888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:32.579776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:32.587735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.588439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.589243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.590004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.877242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:32.892328 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7aa23af0-6d74-4603-b7b5-d93a08bc0775 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.317346 May 07 22:04:32.896286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2278/4605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:32 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:32.914475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:32.915078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:32.921287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.921756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.922572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:32.924183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:32.963142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lazy-loading 'flavor' on Instance uuid ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:04:33.191292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:33.192127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:33.205405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:33.206231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:33.208527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:33.208527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:33.281631 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0edb7f6d-be58-42c2-9f14-029bd99b7072 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 202 len: 0 microversion: 2.1 time: 0.371091 May 07 22:04:33.282419 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2328/4606] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:32 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:04:33.298910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:33.300838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:33.311546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:33.312156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:33.313708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:33.314313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:33.485577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:33.494445 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd080992-6e3d-44a9-92f6-2ccafcaaee33 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1370 microversion: 2.1 time: 0.210583 May 07 22:04:33.495257 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2329/4607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:33 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:33.499634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:33.500319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:33.507006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:33.507574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:33.508458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:33.508952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:33.590215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:33.598789 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bbf05366-406c-4045-b77b-38064c8cc1a2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.415383 May 07 22:04:33.599383 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2279/4608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:33 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:33.674080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:33.683634 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15db9e0a-0f08-426a-8c01-edc3f308b20a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.187498 May 07 22:04:33.684223 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2330/4609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:33 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:34.512096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:34.512721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:34.520496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:34.520963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:34.521754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:34.522204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:34.615864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:34.616710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:34.624193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:34.624736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:34.625595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:34.626154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:34.666253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:34.673827 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4bb0581d-29ee-48a2-bf8e-2e05517a28a7 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1370 microversion: 2.1 time: 0.165715 May 07 22:04:34.674445 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2280/4610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:34 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:34.700807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:34.701468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:34.707417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:34.707883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:34.708672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:34.709121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:34.863272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:34.875968 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c08994f-ad83-4d2f-b054-09be555a2dfa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.177908 May 07 22:04:34.887915 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2281/4611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:34 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:34.942175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-38e614d1-65b0-4c7f-ab23-2d3f88a5317d req-5a9f6c22-140b-42e5-aa44-616f48b3b566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df2668b-af6b-4323-a4a4-520fcae8e55e", "name": "network-vif-plugged", "status": "completed", "tag": "26735917-c705-4821-b89b-e6f718fdc166"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:34.950163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:34.951534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-38e614d1-65b0-4c7f-ab23-2d3f88a5317d req-5a9f6c22-140b-42e5-aa44-616f48b3b566 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:34.952254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-38e614d1-65b0-4c7f-ab23-2d3f88a5317d req-5a9f6c22-140b-42e5-aa44-616f48b3b566 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:34.958510 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63ac64f4-2cf6-4be9-be4f-86273c80fcea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.346332 May 07 22:04:34.959178 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2331/4612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:34 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:34.968711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-38e614d1-65b0-4c7f-ab23-2d3f88a5317d req-5a9f6c22-140b-42e5-aa44-616f48b3b566 service nova] Creating event network-vif-plugged:26735917-c705-4821-b89b-e6f718fdc166 for instance 9df2668b-af6b-4323-a4a4-520fcae8e55e on nch2-master-1 May 07 22:04:34.972323 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-38e614d1-65b0-4c7f-ab23-2d3f88a5317d req-5a9f6c22-140b-42e5-aa44-616f48b3b566 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034796 May 07 22:04:34.973343 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2282/4613] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:35.694400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:35.695491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:35.703422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:35.703883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:35.704695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:35.705132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:35.895612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:35.896593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:35.903179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:35.903725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:35.905154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:35.905688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:35.971190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:35.979248 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57561b01-3fe2-458d-ab43-2e060bf97eed tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1370 microversion: 2.1 time: 0.291705 May 07 22:04:35.979937 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2332/4614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:35 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:35.984711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:35.985589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:35.992027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:35.992495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:35.993287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:35.993737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:36.204032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:36.218441 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b3198c56-6403-44d2-be80-baf0991ccc82 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.328537 May 07 22:04:36.219365 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2283/4615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:35 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:36.552976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:36.563418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4330092-fc5e-4961-bdd9-bf566b956596 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1512 microversion: 2.1 time: 0.582270 May 07 22:04:36.564725 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2333/4616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:35 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1512 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:36.998846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:37.000191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:37.008126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.008597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.009452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.009899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.204927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:37.221277 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50b3e81a-48ce-49e1-91cf-8cd5579e96d0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1565 microversion: 2.1 time: 0.228690 May 07 22:04:37.222758 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2284/4617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:36 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1565 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:37.238572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f1d7a075-8b4d-44b5-a6b6-e8fa5f354749 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:37.239193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:37.239647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f1d7a075-8b4d-44b5-a6b6-e8fa5f354749 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:37.240113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:37.245764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1d7a075-8b4d-44b5-a6b6-e8fa5f354749 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.246219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1d7a075-8b4d-44b5-a6b6-e8fa5f354749 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.247033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1d7a075-8b4d-44b5-a6b6-e8fa5f354749 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.247469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1d7a075-8b4d-44b5-a6b6-e8fa5f354749 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.247972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.248509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.249583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.250137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.340882 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f1d7a075-8b4d-44b5-a6b6-e8fa5f354749 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106690 May 07 22:04:37.341505 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2285/4618] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:04:37 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:04:37.583294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:37.584883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:37.592340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.593081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.594088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.594726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.631053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:37.641194 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-38d77096-b96c-4f97-9966-9185e182416a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.405408 May 07 22:04:37.654544 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2334/4619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:37 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:37.881440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:37.896699 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e903cde-f945-4004-81ad-5e41986449fb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1489 microversion: 2.1 time: 0.318893 May 07 22:04:37.900087 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2286/4620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:37 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1489 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:37.914667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2b47856-197c-43d5-b70e-5d966218b105 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:37.916019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d2b47856-197c-43d5-b70e-5d966218b105 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:37.923152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2b47856-197c-43d5-b70e-5d966218b105 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.923621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2b47856-197c-43d5-b70e-5d966218b105 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.924592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2b47856-197c-43d5-b70e-5d966218b105 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:37.925732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2b47856-197c-43d5-b70e-5d966218b105 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:37.982048 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2b47856-197c-43d5-b70e-5d966218b105 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 200 len: 145 microversion: 2.1 time: 0.071182 May 07 22:04:37.986573 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2335/4621] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:37 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:37.997848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:37.998608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:38.011791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.012591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:38.013609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.015148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:38.245627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:38.261744 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c707b3a8-abef-46a1-a9a3-da8f83376e62 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.270858 May 07 22:04:38.263195 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2287/4622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:37 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:38.292811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:38.292811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:38.310164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.310545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:38.311391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.311844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:38.529813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:38.538518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09adb8d0-abe7-43df-9af2-c8681985a766 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.256029 May 07 22:04:38.539723 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2336/4623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:38 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:38.568515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:38.569630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:38.586307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.600333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:38.601566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.602834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:38.665939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:38.667478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:38.682763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.687062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:38.691297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:38.692189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:39.030996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:39.047404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:39.071516 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94145d05-c4b4-449c-b352-b2d9beb30443 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.518472 May 07 22:04:39.072049 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aeb9a949-c778-4816-8a9a-d8338fe96812 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.413054 May 07 22:04:39.073687 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2288/4624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:38 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:39.074430 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2337/4625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:38 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:39.087040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c6e5ade7-bfd7-425b-8ec5-11a6d68453cc req-b884cb9d-f9cd-4e16-bd5c-1151c0b107af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df2668b-af6b-4323-a4a4-520fcae8e55e", "tag": "26735917-c705-4821-b89b-e6f718fdc166"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:39.092393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:39.093206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:39.106460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:39.107136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c6e5ade7-bfd7-425b-8ec5-11a6d68453cc req-b884cb9d-f9cd-4e16-bd5c-1151c0b107af service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:39.108188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:39.108769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c6e5ade7-bfd7-425b-8ec5-11a6d68453cc req-b884cb9d-f9cd-4e16-bd5c-1151c0b107af service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:39.111661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:39.112156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:39.139081 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c6e5ade7-bfd7-425b-8ec5-11a6d68453cc req-b884cb9d-f9cd-4e16-bd5c-1151c0b107af service nova] Creating event network-changed:26735917-c705-4821-b89b-e6f718fdc166 for instance 9df2668b-af6b-4323-a4a4-520fcae8e55e on nch2-master-1 May 07 22:04:39.154955 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c6e5ade7-bfd7-425b-8ec5-11a6d68453cc req-b884cb9d-f9cd-4e16-bd5c-1151c0b107af service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077767 May 07 22:04:39.157324 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2289/4626] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:39.490452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:39.502349 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a76b8f6d-3ad6-4b21-8f4e-bb30b9a30695 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.414366 May 07 22:04:39.515019 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2338/4627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:39 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:39.708849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1952446709", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "33b52409-fae0-4935-b5d0-15acefaa0f3f"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:39.794015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] validate_networks() for [('33b52409-fae0-4935-b5d0-15acefaa0f3f', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:04:40.093207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:40.093845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:40.104213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:40.105109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:40.111003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:40.111734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:40.483368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:40.495671 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94ca8280-3f8c-46c8-9f96-c0248f2e7074 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.406519 May 07 22:04:40.496253 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2339/4628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:40 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:41.338490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:04:41.339239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:04:41.340565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:04:41.341168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:04:41.342001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:04:41.357134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:41.357754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:41.359047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:41.359667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:41.384646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:41.390559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for user 8cdc0c878f6e4e5da2a2848d63a02f0d and project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:41.404801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:04:41.407264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:04:41.495556 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c6eecae4-2168-4e8a-9b70-930bb92b4316 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801163 May 07 22:04:41.496499 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2290/4629] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:04:41.510470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cd87815f-19d9-4495-afdf-cd7a4d8bd9aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:41.513110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cd87815f-19d9-4495-afdf-cd7a4d8bd9aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:41.525197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:41.525848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:41.543195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:41.543662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:41.547033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:41.547498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:41.653701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cd87815f-19d9-4495-afdf-cd7a4d8bd9aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:41.673201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cd87815f-19d9-4495-afdf-cd7a4d8bd9aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1215 microversion: 2.1 time: 0.170290 May 07 22:04:41.673816 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2340/4630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:41 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:41.847212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:41.855079 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05e8b2dc-6f1f-4b6a-862f-3d4abd3b0524 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.344885 May 07 22:04:41.855677 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2291/4631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:41 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:42.694754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:42.696098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:42.716153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:42.716685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:42.717537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:42.717992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:42.872636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:42.873290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:42.882720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:42.890522 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b666b171-91f5-4582-beb5-43bdf4c9c1aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1267 microversion: 2.1 time: 0.203775 May 07 22:04:42.890731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:42.891143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:42.891951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:42.894977 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2341/4632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:42 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:42.904430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:43.297474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:43.306663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d001086-1da4-48c5-951d-8037094c6d11 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.438099 May 07 22:04:43.309696 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2292/4633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:42 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:43.791978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d46747be-ad45-4db9-ab45-25b3cb99bf48 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'create', calling method: .version_select at 0x7fc41c429160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1514341370"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:43.808309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d46747be-ad45-4db9-ab45-25b3cb99bf48 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:43.814274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d46747be-ad45-4db9-ab45-25b3cb99bf48 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:43.912386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:43.913610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:43.921322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:43.921994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:43.922976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:43.923571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:43.985869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d46747be-ad45-4db9-ab45-25b3cb99bf48 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:43.991974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:43.996478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-d46747be-ad45-4db9-ab45-25b3cb99bf48 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:44.003364 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-37e3b110-1b29-420c-ac68-a9ede864d58b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1273 microversion: 2.1 time: 0.094880 May 07 22:04:44.004206 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2293/4634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:43 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:44.023047 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d46747be-ad45-4db9-ab45-25b3cb99bf48 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.235407 May 07 22:04:44.024357 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2342/4635] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:04:43 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:44.329580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:44.330292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:44.350645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:44.351279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:44.352818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:44.353279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:44.756441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:44.766128 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-afcb1664-f297-4647-bad8-50edd4dea384 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.443236 May 07 22:04:44.767236 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2294/4636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:44 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:45.022632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:45.024415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:45.040326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:45.040837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:45.041674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:45.042137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:45.523032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:45.538564 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0ce99468-18de-49cf-8fde-d303f592e47f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1315 microversion: 2.1 time: 0.521111 May 07 22:04:45.540470 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2343/4637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:45 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:45.789210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:45.790634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:45.799183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:45.800588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:45.801608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:45.802260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:46.005759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:46.025386 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d933fb48-e21a-43c2-9d6c-daf9001beb65 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.242977 May 07 22:04:46.026518 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2295/4638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:45 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:46.138971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-386561039", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0124d628-0714-4eb8-b81f-1f5a4ced80cc"}], "key_name": "tempest-TestNetworkBasicOps-1514341370", "security_groups": [{"name": "tempest-secgroup-smoke-1294035409"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:46.419053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] validate_networks() for [('0124d628-0714-4eb8-b81f-1f5a4ced80cc', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:04:46.561978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:46.563249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:46.578406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:46.579242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:46.580262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:46.581633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:46.984976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:46.996617 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89a241ab-caf4-418e-9a2f-bfeb2e0c0e29 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1315 microversion: 2.1 time: 0.437933 May 07 22:04:47.009362 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2296/4639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:46 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:47.015061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c4848c4d-9c89-449b-9a4e-8a6e55ebd6c5 req-c7ce02c1-d534-4f1b-9436-519a50ad9f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efbfca97-f4f7-4462-aa1f-5b1936c45d96", "tag": "4c002f8a-6eee-4016-aa09-cc73c944ce61"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:47.025824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c4848c4d-9c89-449b-9a4e-8a6e55ebd6c5 req-c7ce02c1-d534-4f1b-9436-519a50ad9f8d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:47.026578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c4848c4d-9c89-449b-9a4e-8a6e55ebd6c5 req-c7ce02c1-d534-4f1b-9436-519a50ad9f8d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:47.041829 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c4848c4d-9c89-449b-9a4e-8a6e55ebd6c5 req-c7ce02c1-d534-4f1b-9436-519a50ad9f8d service nova] Creating event network-changed:4c002f8a-6eee-4016-aa09-cc73c944ce61 for instance efbfca97-f4f7-4462-aa1f-5b1936c45d96 on nch1-master-1 May 07 22:04:47.048359 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c4848c4d-9c89-449b-9a4e-8a6e55ebd6c5 req-c7ce02c1-d534-4f1b-9436-519a50ad9f8d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037400 May 07 22:04:47.052004 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2297/4640] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:47.057755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:47.058536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:47.065836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:47.066291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:47.067136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:47.067583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:47.186382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:04:47.186879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:04:47.187329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:04:47.187747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:04:47.188167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:04:47.198710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:47.203115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:47.204482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:47.205068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:47.227607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:04:47.233783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:04:47.247800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:04:47.250154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:04:47.303356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7efcaf5-1239-4c16-b11e-eecca0dfb949 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.168312 May 07 22:04:47.304614 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2344/4641] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:04:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:04:47.317512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d5d03206-7efa-450d-a5a0-9bcea7f6ac2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:47.318669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d5d03206-7efa-450d-a5a0-9bcea7f6ac2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:47.426143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5d03206-7efa-450d-a5a0-9bcea7f6ac2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:47.437557 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d5d03206-7efa-450d-a5a0-9bcea7f6ac2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1248 microversion: 2.1 time: 0.125683 May 07 22:04:47.439339 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2345/4642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:47 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1248 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:47.678803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:47.691349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-38c04e18-3f5c-4c81-a5df-956bf8b05e43 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.637627 May 07 22:04:47.692821 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2298/4643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:47 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:48.015923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:48.016543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:48.023287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:48.023746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:48.024550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:48.024992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:48.158348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:48.166697 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-13a8ce64-25ad-4000-8ea5-e18194a0ab50 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1315 microversion: 2.1 time: 0.154863 May 07 22:04:48.167531 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2346/4644] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:48 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:48.455934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:48.456713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:48.464261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:48.464721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:48.465528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:48.466044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:48.528502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:48.536840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d87cc0b0-403f-4fdb-9bfe-8ed749669c2e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1318 microversion: 2.1 time: 0.084937 May 07 22:04:48.537422 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2299/4645] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:48 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:48.708812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:48.709597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:48.728594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:48.729371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:48.730399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:48.731144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:48.990059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d6ba6450-7e3c-4921-aac9-02e5489e9873 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:48.990565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d6ba6450-7e3c-4921-aac9-02e5489e9873 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:48.998894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ba6450-7e3c-4921-aac9-02e5489e9873 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:48.999377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ba6450-7e3c-4921-aac9-02e5489e9873 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:49.000162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ba6450-7e3c-4921-aac9-02e5489e9873 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:49.000770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6ba6450-7e3c-4921-aac9-02e5489e9873 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:49.025355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d6ba6450-7e3c-4921-aac9-02e5489e9873 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/ips" status: 200 len: 145 microversion: 2.1 time: 0.039591 May 07 22:04:49.026229 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2300/4646] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:04:48 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:04:49.084863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:49.101444 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-878599d3-47ea-486f-ad8c-72e662bae3c0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.395063 May 07 22:04:49.102936 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2347/4647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:48 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:49.183913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:49.185075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:49.192339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:49.192969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:49.193941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:49.194527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:49.521015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:49.535893 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f631f4e5-f5cb-4121-b159-3a8ebaa06bbf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1315 microversion: 2.1 time: 0.355770 May 07 22:04:49.538729 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2301/4648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:49 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:49.555483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:49.556337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:49.567068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:49.567518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:49.568472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:49.569058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:49.876628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:49.885741 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-465f4341-7a3a-4459-8ec1-387dbbeb36ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1374 microversion: 2.1 time: 0.336092 May 07 22:04:49.886449 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2348/4649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:49 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1374 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:50.123144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:50.124687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:50.139423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.140589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.144472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.145165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.233622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c3f75606-36b1-4489-832b-43aad30292b0 req-9761f483-cc89-42e9-ba7c-c0cf7dba77f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d983a5-a676-4b82-8128-f4beb5bb1187", "tag": "dfc7202f-3529-456c-8635-c9d41180e0af"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:50.247056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c3f75606-36b1-4489-832b-43aad30292b0 req-9761f483-cc89-42e9-ba7c-c0cf7dba77f3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.247707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c3f75606-36b1-4489-832b-43aad30292b0 req-9761f483-cc89-42e9-ba7c-c0cf7dba77f3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.278731 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c3f75606-36b1-4489-832b-43aad30292b0 req-9761f483-cc89-42e9-ba7c-c0cf7dba77f3 service nova] Creating event network-changed:dfc7202f-3529-456c-8635-c9d41180e0af for instance 05d983a5-a676-4b82-8128-f4beb5bb1187 on nch2-master-1 May 07 22:04:50.286529 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c3f75606-36b1-4489-832b-43aad30292b0 req-9761f483-cc89-42e9-ba7c-c0cf7dba77f3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057273 May 07 22:04:50.288075 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2349/4650] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:50.454459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ef49c34-f888-43cb-a15e-57eecf8f227c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f2e1d36-a982-48b0-8bfb-72803eff465b"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:50.456289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ef49c34-f888-43cb-a15e-57eecf8f227c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:50.471617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ef49c34-f888-43cb-a15e-57eecf8f227c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.472092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ef49c34-f888-43cb-a15e-57eecf8f227c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.473313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ef49c34-f888-43cb-a15e-57eecf8f227c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.479305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ef49c34-f888-43cb-a15e-57eecf8f227c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.527109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:50.535893 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c6a47c41-f0f2-4238-9cd0-137ee4a32fe2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1533 microversion: 2.1 time: 0.420617 May 07 22:04:50.536737 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2302/4651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:50 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1533 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:50.556346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:50.561796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:50.574270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.574734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.577542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.578532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.778640 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ef49c34-f888-43cb-a15e-57eecf8f227c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327776 May 07 22:04:50.779891 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2350/4652] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:04:50 2022] POST /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:50.796379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:50.808189 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea7c6eb2-bd02-4f4a-b109-c62653c4ea15 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1315 microversion: 2.1 time: 0.256568 May 07 22:04:50.808955 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2303/4653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:50 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:50.906004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:50.910037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:50.926028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.929592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:50.931784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:50.934926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:51.185114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:51.202636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b201a41-e29d-43cf-a95a-7991d8955617 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1374 microversion: 2.1 time: 0.304062 May 07 22:04:51.203622 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2351/4654] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:50 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:51.554256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:51.555047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:51.562029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:51.562745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:51.563754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:51.564418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:51.726608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:51.735798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cafe512b-dac2-48f2-897f-e1d9507e04df tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1533 microversion: 2.1 time: 0.185963 May 07 22:04:51.736486 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2304/4655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:51 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1533 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:51.826272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:51.827086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:51.834719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:51.835218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:51.836008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:51.836474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:52.053323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:52.061849 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f587091e-95ef-4eb6-b49f-7b8b50d8212b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1315 microversion: 2.1 time: 0.239421 May 07 22:04:52.062437 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2352/4656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:51 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:52.151371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4b0f56aa-be4c-49bb-ab9a-c37b5f98a5d3 req-e96540c4-e78e-4d13-a834-9d2c52383e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbfca97-f4f7-4462-aa1f-5b1936c45d96", "name": "network-vif-plugged", "status": "completed", "tag": "4c002f8a-6eee-4016-aa09-cc73c944ce61"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:52.159549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4b0f56aa-be4c-49bb-ab9a-c37b5f98a5d3 req-e96540c4-e78e-4d13-a834-9d2c52383e6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:52.160008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4b0f56aa-be4c-49bb-ab9a-c37b5f98a5d3 req-e96540c4-e78e-4d13-a834-9d2c52383e6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:52.171581 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4b0f56aa-be4c-49bb-ab9a-c37b5f98a5d3 req-e96540c4-e78e-4d13-a834-9d2c52383e6d service nova] Creating event network-vif-plugged:4c002f8a-6eee-4016-aa09-cc73c944ce61 for instance efbfca97-f4f7-4462-aa1f-5b1936c45d96 on nch1-master-1 May 07 22:04:52.177999 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4b0f56aa-be4c-49bb-ab9a-c37b5f98a5d3 req-e96540c4-e78e-4d13-a834-9d2c52383e6d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029974 May 07 22:04:52.178548 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2305/4657] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:52.221875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:52.223015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:52.234381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:52.234868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:52.235659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:52.236102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:52.478021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:52.485815 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1f6230d-dc4a-4a3f-8f08-8ee2c02fc964 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1374 microversion: 2.1 time: 0.269840 May 07 22:04:52.486505 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2353/4658] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:52 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1374 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:52.753480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:52.754311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:52.761678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:52.762131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:52.763608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:52.763608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:53.038950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:53.049429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-766be8bd-0f4c-4896-a692-fb6c9996eed0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1533 microversion: 2.1 time: 0.300226 May 07 22:04:53.062059 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2306/4659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:52 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1533 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:53.083374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:53.085307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:53.096448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:53.097004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:53.097702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:53.098369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:53.343174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:53.352121 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a9e9b4ce-0674-4342-9ecf-6670fe44389d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1315 microversion: 2.1 time: 0.276009 May 07 22:04:53.352854 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2354/4660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:53 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:53.504446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:53.505471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:53.513224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:53.513888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:53.515560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:53.516473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:53.715594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:53.725894 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1891d041-1857-4765-8aa4-bccd344adc91 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1374 microversion: 2.1 time: 0.226230 May 07 22:04:53.731778 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2307/4661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:53 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1374 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:54.070426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:54.071758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:54.091282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.092581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.094147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.097149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.199128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-469f7985-f7a8-4276-92b2-ffd71656ec43 req-606f9a9d-3b77-48f5-b82d-361aef6c7247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6", "name": "network-vif-plugged", "status": "completed", "tag": "49671dbb-1f39-4903-a9e1-e283831ec748"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:54.223945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-469f7985-f7a8-4276-92b2-ffd71656ec43 req-606f9a9d-3b77-48f5-b82d-361aef6c7247 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.224655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-469f7985-f7a8-4276-92b2-ffd71656ec43 req-606f9a9d-3b77-48f5-b82d-361aef6c7247 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.242798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-469f7985-f7a8-4276-92b2-ffd71656ec43 req-606f9a9d-3b77-48f5-b82d-361aef6c7247 service nova] Creating event network-vif-plugged:49671dbb-1f39-4903-a9e1-e283831ec748 for instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 on nch2-master-1 May 07 22:04:54.250972 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-469f7985-f7a8-4276-92b2-ffd71656ec43 req-606f9a9d-3b77-48f5-b82d-361aef6c7247 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057195 May 07 22:04:54.252352 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2308/4662] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:54.291702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eb094fe6-4bfc-4f86-a3eb-e903d437df64 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:54.295232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eb094fe6-4bfc-4f86-a3eb-e903d437df64 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:54.305730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb094fe6-4bfc-4f86-a3eb-e903d437df64 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.309812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb094fe6-4bfc-4f86-a3eb-e903d437df64 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.311124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb094fe6-4bfc-4f86-a3eb-e903d437df64 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.311820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb094fe6-4bfc-4f86-a3eb-e903d437df64 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.357238 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eb094fe6-4bfc-4f86-a3eb-e903d437df64 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075427 May 07 22:04:54.363771 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2309/4663] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:04:54 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:54.369035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f376cb5-89e6-4168-9058-bc594ea5d9fc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:54.369736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0f376cb5-89e6-4168-9058-bc594ea5d9fc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:54.376403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f376cb5-89e6-4168-9058-bc594ea5d9fc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.377057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f376cb5-89e6-4168-9058-bc594ea5d9fc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.378224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f376cb5-89e6-4168-9058-bc594ea5d9fc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.378861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f376cb5-89e6-4168-9058-bc594ea5d9fc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.399647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:54.407754 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48411310-dc65-4390-8be8-6dc8699e960e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.342494 May 07 22:04:54.408345 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2355/4664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:54 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:54.413956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:54.414592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:54.421296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.421992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.423004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.423610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.437800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f376cb5-89e6-4168-9058-bc594ea5d9fc tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/2f2e1d36-a982-48b0-8bfb-72803eff465b" status: 200 len: 194 microversion: 2.1 time: 0.072688 May 07 22:04:54.450477 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2310/4665] 10.222.0.32 () {58 vars in 1412 bytes} [Sat May 7 22:04:54 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/2f2e1d36-a982-48b0-8bfb-72803eff465b => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:54.704665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:54.717177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2f3582a4-7121-42d7-8cf8-9f3249d5bde4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1502 microversion: 2.1 time: 0.306660 May 07 22:04:54.728331 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2356/4666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:54 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:54.753706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7fba812c-dedd-435f-bbbc-41c9a117eb41 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:54.755235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7fba812c-dedd-435f-bbbc-41c9a117eb41 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:54.759930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:54.760556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:54.772626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.773449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.773977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fba812c-dedd-435f-bbbc-41c9a117eb41 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.774450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fba812c-dedd-435f-bbbc-41c9a117eb41 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.774999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.775301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fba812c-dedd-435f-bbbc-41c9a117eb41 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:54.775811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fba812c-dedd-435f-bbbc-41c9a117eb41 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.775943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:54.894286 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7fba812c-dedd-435f-bbbc-41c9a117eb41 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.160611 May 07 22:04:54.895987 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2311/4667] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:54 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:04:55.426553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:55.427312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:55.447638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.448106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.448912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.449363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.603031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:55.616674 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-641da4f7-a3ff-4045-afc7-dfa2c8a60a60 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1374 microversion: 2.1 time: 0.859341 May 07 22:04:55.618709 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2357/4668] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:54 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1374 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:55.639341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22f91851-e55c-4794-b27e-3556d26619c7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:55.640182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-22f91851-e55c-4794-b27e-3556d26619c7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:55.648996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22f91851-e55c-4794-b27e-3556d26619c7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.649704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22f91851-e55c-4794-b27e-3556d26619c7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.650688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22f91851-e55c-4794-b27e-3556d26619c7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.651986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22f91851-e55c-4794-b27e-3556d26619c7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.675845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:55.689791 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-22f91851-e55c-4794-b27e-3556d26619c7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.068135 May 07 22:04:55.690634 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2358/4669] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 22:04:55 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27/os-server-password => generated 116 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:55.695024 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f6c8cb41-1c8d-4032-bfb3-d372482ed4e1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.273122 May 07 22:04:55.704251 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2312/4670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:55 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:55.906518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9e1875d-4457-45b2-a907-d340630e98e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:55.907560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d9e1875d-4457-45b2-a907-d340630e98e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:55.918473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e1875d-4457-45b2-a907-d340630e98e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.918981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e1875d-4457-45b2-a907-d340630e98e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.919822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e1875d-4457-45b2-a907-d340630e98e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.920275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9e1875d-4457-45b2-a907-d340630e98e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.932578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-82be985e-52f4-41c0-92fe-6c9d0364921e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:55.936811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-82be985e-52f4-41c0-92fe-6c9d0364921e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:55.951035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82be985e-52f4-41c0-92fe-6c9d0364921e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.952228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82be985e-52f4-41c0-92fe-6c9d0364921e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.953275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82be985e-52f4-41c0-92fe-6c9d0364921e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:55.962263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82be985e-52f4-41c0-92fe-6c9d0364921e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:55.970847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9e1875d-4457-45b2-a907-d340630e98e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.068657 May 07 22:04:55.974190 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2359/4671] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:55 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:04:56.356800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-82be985e-52f4-41c0-92fe-6c9d0364921e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "POST /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428202 May 07 22:04:56.363098 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2313/4672] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:04:55 2022] POST /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:04:56.636541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:56.638273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:56.653766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:56.656600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:56.657671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:56.663517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:56.727318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:56.728662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:56.754355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:56.755098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:56.756103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:56.756566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:56.998150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:57.001242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:57.017723 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a7184d5-b022-4128-8984-379c7534a09f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.294505 May 07 22:04:57.018985 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2314/4673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:56 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:57.020184 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-108e3e99-2ece-469e-bb22-e7f7c0ff4109 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1374 microversion: 2.1 time: 0.382584 May 07 22:04:57.021858 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2360/4674] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:56 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1374 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:57.029498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee1f5cbc-dfbf-47ed-8a7b-4e5932d20c78 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:57.030617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee1f5cbc-dfbf-47ed-8a7b-4e5932d20c78 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:57.037045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee1f5cbc-dfbf-47ed-8a7b-4e5932d20c78 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:57.039144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee1f5cbc-dfbf-47ed-8a7b-4e5932d20c78 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:57.040194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee1f5cbc-dfbf-47ed-8a7b-4e5932d20c78 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:57.040807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee1f5cbc-dfbf-47ed-8a7b-4e5932d20c78 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:57.103095 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee1f5cbc-dfbf-47ed-8a7b-4e5932d20c78 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.079695 May 07 22:04:57.104821 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2315/4675] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:57 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:04:57.253444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-98ebf8dd-e761-4a0d-a273-b7c3643a6b34 req-5304a548-87dc-4b9d-8153-e25a4d79db65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d983a5-a676-4b82-8128-f4beb5bb1187", "name": "network-vif-plugged", "status": "completed", "tag": "dfc7202f-3529-456c-8635-c9d41180e0af"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:57.268826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-98ebf8dd-e761-4a0d-a273-b7c3643a6b34 req-5304a548-87dc-4b9d-8153-e25a4d79db65 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:57.275590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-98ebf8dd-e761-4a0d-a273-b7c3643a6b34 req-5304a548-87dc-4b9d-8153-e25a4d79db65 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:57.298905 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-98ebf8dd-e761-4a0d-a273-b7c3643a6b34 req-5304a548-87dc-4b9d-8153-e25a4d79db65 service nova] Creating event network-vif-plugged:dfc7202f-3529-456c-8635-c9d41180e0af for instance 05d983a5-a676-4b82-8128-f4beb5bb1187 on nch2-master-1 May 07 22:04:57.313857 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-98ebf8dd-e761-4a0d-a273-b7c3643a6b34 req-5304a548-87dc-4b9d-8153-e25a4d79db65 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064657 May 07 22:04:57.315342 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2361/4676] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:04:58.049470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:58.050475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:58.052006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:58.052915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:58.070141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:58.071805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:58.072893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:58.073257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:58.074227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:58.075218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:58.076939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:58.077480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:58.334191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:58.349433 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a95b0d55-8970-4ad8-a04e-a8cee6bd0f69 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.317183 May 07 22:04:58.362990 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2316/4677] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:58 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:58.371541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-276d7b4e-891c-426b-8e88-d2df80ac2fca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:58.373300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-276d7b4e-891c-426b-8e88-d2df80ac2fca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:58.380910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-276d7b4e-891c-426b-8e88-d2df80ac2fca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:58.381707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-276d7b4e-891c-426b-8e88-d2df80ac2fca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:58.382820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-276d7b4e-891c-426b-8e88-d2df80ac2fca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:58.383525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-276d7b4e-891c-426b-8e88-d2df80ac2fca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:58.413352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:58.421691 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1220ff99-18a1-4440-b55d-b3dab93482ba tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1374 microversion: 2.1 time: 0.380822 May 07 22:04:58.424690 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2362/4678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:58 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1374 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:58.449455 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-276d7b4e-891c-426b-8e88-d2df80ac2fca tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.081679 May 07 22:04:58.451324 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2317/4679] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:58 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:04:59.368692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:59.369256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:59.376087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.376805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.378082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.378833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.440413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:59.441124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:59.459699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.460899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.462335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.463448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.644415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:59.654492 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d9a79f3-02ee-4771-ac15-4c806202fcfd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1547 microversion: 2.1 time: 0.218270 May 07 22:04:59.666246 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2318/4680] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:59 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1547 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:04:59.675528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:04:59.680743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51c8e44c-6754-4ec6-b646-bfca0e0d2430 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:04:59.681766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-51c8e44c-6754-4ec6-b646-bfca0e0d2430 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:59.690349 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ef191bc-2c1c-4a8b-8a10-c372b9ab3223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.325961 May 07 22:04:59.698813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c8e44c-6754-4ec6-b646-bfca0e0d2430 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.699280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c8e44c-6754-4ec6-b646-bfca0e0d2430 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.700073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c8e44c-6754-4ec6-b646-bfca0e0d2430 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.700738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51c8e44c-6754-4ec6-b646-bfca0e0d2430 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.705160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2363/4681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:59 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:04:59.718027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:59.718985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:59.726222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.726691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.727589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.728037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.785064 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51c8e44c-6754-4ec6-b646-bfca0e0d2430 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.118219 May 07 22:04:59.785990 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2319/4682] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:04:59 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:04:59.901385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b058dff-c1ba-4382-849c-b6e73fd63745 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:04:59.902725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b058dff-c1ba-4382-849c-b6e73fd63745 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:04:59.910539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b058dff-c1ba-4382-849c-b6e73fd63745 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.911204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b058dff-c1ba-4382-849c-b6e73fd63745 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.912867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b058dff-c1ba-4382-849c-b6e73fd63745 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:04:59.913631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b058dff-c1ba-4382-849c-b6e73fd63745 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:04:59.967450 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b058dff-c1ba-4382-849c-b6e73fd63745 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.070092 May 07 22:04:59.968077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2320/4683] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:04:59 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:05:00.061724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:00.079314 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a733d6e-3843-48fc-8f9e-6d23cfec99e3 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1547 microversion: 2.1 time: 0.370544 May 07 22:05:00.083995 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2364/4684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:04:59 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1547 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:00.117786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-810d81af-c18b-4c7a-9f5b-e25b1967c7e9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:00.118574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-810d81af-c18b-4c7a-9f5b-e25b1967c7e9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:00.137498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-810d81af-c18b-4c7a-9f5b-e25b1967c7e9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.137926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-810d81af-c18b-4c7a-9f5b-e25b1967c7e9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.138735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-810d81af-c18b-4c7a-9f5b-e25b1967c7e9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.139215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-810d81af-c18b-4c7a-9f5b-e25b1967c7e9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.202349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-810d81af-c18b-4c7a-9f5b-e25b1967c7e9 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/2f2e1d36-a982-48b0-8bfb-72803eff465b" status: 200 len: 194 microversion: 2.1 time: 0.089307 May 07 22:05:00.203418 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2321/4685] 10.222.0.32 () {58 vars in 1412 bytes} [Sat May 7 22:05:00 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/2f2e1d36-a982-48b0-8bfb-72803eff465b => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:00.212657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:00.213148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:00.226531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.226982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.227798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.228256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.363805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lazy-loading 'services' on Instance uuid 11df3809-8e5b-40d6-adb1-393c365f9a47 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:00.541613 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-37a8dc72-1198-414d-80b6-32a8c6e301ec tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/2f2e1d36-a982-48b0-8bfb-72803eff465b" status: 202 len: 0 microversion: 2.1 time: 0.332680 May 07 22:05:00.575513 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2365/4686] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:05:00 2022] DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/2f2e1d36-a982-48b0-8bfb-72803eff465b => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:00.712373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:00.713635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:00.723744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.731142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.732272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.732874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.797347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6fad26bc-c26c-4153-aa94-9e472818aace tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:00.798789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6fad26bc-c26c-4153-aa94-9e472818aace tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:00.824906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fad26bc-c26c-4153-aa94-9e472818aace tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.825603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fad26bc-c26c-4153-aa94-9e472818aace tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.827404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fad26bc-c26c-4153-aa94-9e472818aace tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:00.829571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fad26bc-c26c-4153-aa94-9e472818aace tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:00.874561 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6fad26bc-c26c-4153-aa94-9e472818aace tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.081447 May 07 22:05:00.875878 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2366/4687] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:00 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:01.508848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:01.516740 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-121e05e3-e79c-4bca-b6c1-2d4a2d990192 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.808408 May 07 22:05:01.523594 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2322/4688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:00 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:01.898991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7340248e-270e-4f58-a5ea-2760101f5ad5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:01.900338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7340248e-270e-4f58-a5ea-2760101f5ad5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:01.901892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87a2728a-f0fb-452c-af71-a62aceef527a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:01.903053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87a2728a-f0fb-452c-af71-a62aceef527a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:01.912877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87a2728a-f0fb-452c-af71-a62aceef527a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:01.913612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87a2728a-f0fb-452c-af71-a62aceef527a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:01.914582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87a2728a-f0fb-452c-af71-a62aceef527a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:01.915223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87a2728a-f0fb-452c-af71-a62aceef527a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:01.915415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7340248e-270e-4f58-a5ea-2760101f5ad5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:01.915908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7340248e-270e-4f58-a5ea-2760101f5ad5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:01.916718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7340248e-270e-4f58-a5ea-2760101f5ad5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:01.917174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7340248e-270e-4f58-a5ea-2760101f5ad5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:01.961537 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87a2728a-f0fb-452c-af71-a62aceef527a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8" status: 200 len: 194 microversion: 2.1 time: 0.063281 May 07 22:05:01.962188 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2323/4689] 10.222.0.32 () {58 vars in 1412 bytes} [Sat May 7 22:05:01 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:01.972393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:01.972919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:01.979922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:01.980663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:01.981474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:01.981926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:02.006642 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7340248e-270e-4f58-a5ea-2760101f5ad5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.123560 May 07 22:05:02.010128 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2367/4690] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:01 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:02.077614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lazy-loading 'services' on Instance uuid 11df3809-8e5b-40d6-adb1-393c365f9a47 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:02.182281 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c8833029-d2b2-4fe0-b043-da37b895081a tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8" status: 202 len: 0 microversion: 2.1 time: 0.213918 May 07 22:05:02.183630 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2324/4691] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:05:01 2022] DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments/8ca6cc52-9abb-42c9-b4b5-c2025d24f7f8 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:05:02.541708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:02.542393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:02.549651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:02.550665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:02.551711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:02.552373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:02.774866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:02.782974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d13a44c-2e92-4470-8a06-a3cd5c81bd96 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.246109 May 07 22:05:02.788135 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2368/4692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:02 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:03.031882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63f53fb3-869e-44fa-86eb-c74d74484e68 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:03.033112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63f53fb3-869e-44fa-86eb-c74d74484e68 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:03.052319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63f53fb3-869e-44fa-86eb-c74d74484e68 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.052781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63f53fb3-869e-44fa-86eb-c74d74484e68 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.053593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63f53fb3-869e-44fa-86eb-c74d74484e68 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.054035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63f53fb3-869e-44fa-86eb-c74d74484e68 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.119814 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63f53fb3-869e-44fa-86eb-c74d74484e68 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 0.105235 May 07 22:05:03.120969 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2325/4693] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:03 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:03.383744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94dd9021-c8a7-483b-8024-90b40041a9d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:03.384735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94dd9021-c8a7-483b-8024-90b40041a9d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:03.397704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94dd9021-c8a7-483b-8024-90b40041a9d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.398423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94dd9021-c8a7-483b-8024-90b40041a9d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.401542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94dd9021-c8a7-483b-8024-90b40041a9d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.402200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94dd9021-c8a7-483b-8024-90b40041a9d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.439356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94dd9021-c8a7-483b-8024-90b40041a9d0 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059772 May 07 22:05:03.441242 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2369/4694] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:05:03 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:03.565979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-13b7e1f4-a6cc-4ca3-9c9b-9ef5cae4b002 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:03.568111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-13b7e1f4-a6cc-4ca3-9c9b-9ef5cae4b002 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:03.576995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b7e1f4-a6cc-4ca3-9c9b-9ef5cae4b002 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.578176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b7e1f4-a6cc-4ca3-9c9b-9ef5cae4b002 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.579135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b7e1f4-a6cc-4ca3-9c9b-9ef5cae4b002 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.579841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-13b7e1f4-a6cc-4ca3-9c9b-9ef5cae4b002 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.621271 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-13b7e1f4-a6cc-4ca3-9c9b-9ef5cae4b002 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061242 May 07 22:05:03.622567 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2326/4695] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:05:03 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:03.704431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:03.705972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:03.717190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.717651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.720648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.721390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.772885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:05:03.804020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:03.804762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:03.825496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.825968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.826975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.827425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.902962 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-08abd54c-2a6c-4db7-b9f8-277059c3725e tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 204 len: 0 microversion: 2.1 time: 0.201744 May 07 22:05:03.905107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2370/4696] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:05:03 2022] DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:05:03.917438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:03.918518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:03.927274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.928115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:03.929413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:03.930052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:04.138819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:04.148095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6cabf729-dfd8-4560-891b-e407d869cfba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1673 microversion: 2.1 time: 0.238221 May 07 22:05:04.149119 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2371/4697] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:03 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1673 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:04.154458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-22b665a7-e554-4cb8-a69d-01ce5344e486 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:04.156023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-22b665a7-e554-4cb8-a69d-01ce5344e486 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:04.167387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22b665a7-e554-4cb8-a69d-01ce5344e486 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:04.167970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22b665a7-e554-4cb8-a69d-01ce5344e486 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:04.169038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22b665a7-e554-4cb8-a69d-01ce5344e486 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:04.169651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-22b665a7-e554-4cb8-a69d-01ce5344e486 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:04.280495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:04.293174 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71709963-f74d-4c23-b14f-cab81339eccf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.492990 May 07 22:05:04.302712 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2327/4698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:03 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:05.006685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-08fd274b-8214-45b3-bc92-942591d83ca7 req-71dc1263-46f2-4325-ad78-426e949901ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d983a5-a676-4b82-8128-f4beb5bb1187", "tag": "dfc7202f-3529-456c-8635-c9d41180e0af"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:05.032020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-08fd274b-8214-45b3-bc92-942591d83ca7 req-71dc1263-46f2-4325-ad78-426e949901ef service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:05.035200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-08fd274b-8214-45b3-bc92-942591d83ca7 req-71dc1263-46f2-4325-ad78-426e949901ef service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:05.058434 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-08fd274b-8214-45b3-bc92-942591d83ca7 req-71dc1263-46f2-4325-ad78-426e949901ef service nova] Creating event network-changed:dfc7202f-3529-456c-8635-c9d41180e0af for instance 05d983a5-a676-4b82-8128-f4beb5bb1187 on nch2-master-1 May 07 22:05:05.085370 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-08fd274b-8214-45b3-bc92-942591d83ca7 req-71dc1263-46f2-4325-ad78-426e949901ef service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080892 May 07 22:05:05.087271 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2328/4699] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:05:05.177668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:05.177668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:05.208398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:05.209309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:05.212873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:05.213334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:05.295727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-22b665a7-e554-4cb8-a69d-01ce5344e486 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 14 microversion: 2.1 time: 1.145191 May 07 22:05:05.299890 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2372/4700] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:04 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 14 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:05.332337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:05.333147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:05.352444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:05.352967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:05.353823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:05.354275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:05.490213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:05.506296 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3226c45a-e111-4500-a271-c2a8181bc77c tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1673 microversion: 2.1 time: 0.344079 May 07 22:05:05.507495 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2329/4701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:05 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1673 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:05.683577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:05.696858 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5e69d4f-3e0c-482c-8168-c3a4993b6d0c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.380115 May 07 22:05:05.697768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2373/4702] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:05 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:06.310821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4dceb1f-5ba3-4cec-9189-0a68010a1028 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:06.312363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d4dceb1f-5ba3-4cec-9189-0a68010a1028 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:06.328876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dceb1f-5ba3-4cec-9189-0a68010a1028 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.329704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dceb1f-5ba3-4cec-9189-0a68010a1028 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.332754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dceb1f-5ba3-4cec-9189-0a68010a1028 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.333494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dceb1f-5ba3-4cec-9189-0a68010a1028 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.413412 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d4dceb1f-5ba3-4cec-9189-0a68010a1028 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action" status: 200 len: 8208 microversion: 2.1 time: 0.109018 May 07 22:05:06.422076 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2330/4703] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:06 2022] POST /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96/action => generated 8208 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:06.424361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:06.425120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:06.449606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.450341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.451376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.451810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.524674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:06.526275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:06.544607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.545337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.546157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.546613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.694737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:06.703488 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8114955f-cd72-4a67-be1d-5b1c2ec81957 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1673 microversion: 2.1 time: 0.182954 May 07 22:05:06.704296 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2331/4704] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:06 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:06.716046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:06.716774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:06.723685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.724236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.725103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:06.725650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:06.866107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:06.873924 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fe81ba4e-fd08-4e2e-87ac-51eec4d1439e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1528 microversion: 2.1 time: 0.164426 May 07 22:05:06.874506 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2332/4705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:06 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1528 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:07.004797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:07.012572 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6f5e24d7-4d1a-46a9-833f-a0c9828517aa tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.592144 May 07 22:05:07.013152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2374/4706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:06 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:07.031690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:07.032323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:07.038399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.038932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.039725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.040186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.195494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:07.210861 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b8ab272-c7f4-4363-9583-67c0432cd183 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.182937 May 07 22:05:07.223686 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2333/4707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:07 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:07.228839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:07.229656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:07.237996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.238547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.239697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.240228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.513498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:07.526399 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ec2291a-0d32-400d-ba52-95c3abe4b8d6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.300688 May 07 22:05:07.527993 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2375/4708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:07 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:07.543331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:07.544063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:07.551082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.551554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.552347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.552984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.636939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-84a69f3a-236a-432a-b134-9dd741c0a0f0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:07.637540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-84a69f3a-236a-432a-b134-9dd741c0a0f0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:07.644105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84a69f3a-236a-432a-b134-9dd741c0a0f0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.644664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84a69f3a-236a-432a-b134-9dd741c0a0f0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.645638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84a69f3a-236a-432a-b134-9dd741c0a0f0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.646240 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84a69f3a-236a-432a-b134-9dd741c0a0f0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.691090 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-84a69f3a-236a-432a-b134-9dd741c0a0f0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/ips" status: 200 len: 150 microversion: 2.1 time: 0.057934 May 07 22:05:07.701152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2376/4709] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:05:07 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:05:07.722030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:07.722880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:07.732526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.735220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.737721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.738184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.847995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ea5d144165a4e129de242905439e951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5c5d849ea4fc59d5c4fc58b31530f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:07.877661 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1818229f-d1ea-4270-baed-6fff7f305b47 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 200 len: 1605 microversion: 2.1 time: 0.159945 May 07 22:05:07.890952 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2377/4710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:07 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 1605 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:07.893178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d9f57998-8c4e-4bc2-98d8-08a978134d80 req-b11e46d4-6a44-44d2-9112-5c91792e4f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11df3809-8e5b-40d6-adb1-393c365f9a47", "name": "network-vif-deleted", "tag": "050be740-f219-402b-99ff-07b3f4f82b98"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:07.907967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d9f57998-8c4e-4bc2-98d8-08a978134d80 req-b11e46d4-6a44-44d2-9112-5c91792e4f36 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.909191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d9f57998-8c4e-4bc2-98d8-08a978134d80 req-b11e46d4-6a44-44d2-9112-5c91792e4f36 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.929881 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d9f57998-8c4e-4bc2-98d8-08a978134d80 req-b11e46d4-6a44-44d2-9112-5c91792e4f36 service nova] Creating event network-vif-deleted:050be740-f219-402b-99ff-07b3f4f82b98 for instance 11df3809-8e5b-40d6-adb1-393c365f9a47 on nch1-master-1 May 07 22:05:07.942170 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d9f57998-8c4e-4bc2-98d8-08a978134d80 req-b11e46d4-6a44-44d2-9112-5c91792e4f36 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058306 May 07 22:05:07.943273 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2378/4711] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:07.949292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:07.950081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:07.966079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.966762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:07.967742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:07.971842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.054451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:08.084046 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29305e88-06d2-4dce-941c-d0fde5c7d022 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.532804 May 07 22:05:08.086222 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2334/4712] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:07 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:08.102879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:08.103945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:08.114581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.115483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.116704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.117337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.189221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Locking {{(pid=136681) lock /opt/stack/nova/nova/compute/api.py:4700}} May 07 22:05:08.265764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:08.276251 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a88599af-c5ac-4bf2-b5d5-ecdcfcb0c4b7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1510 microversion: 2.1 time: 0.331470 May 07 22:05:08.280661 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2379/4713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:07 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:08.331349 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4aa7f575-dabe-4b94-8da3-a8d0ceab8cb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.233940 May 07 22:05:08.334839 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2335/4714] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:08 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:05:08.340519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:08.341614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:08.354219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.355015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.356136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.356997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.629619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:08.654144 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d990ac7f-21ac-4c30-b5a5-f6bde446f847 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.317529 May 07 22:05:08.659062 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2380/4715] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:08 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:08.675714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-93acdd1b-586f-4fae-907a-247105c3d4f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:08.694130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93acdd1b-586f-4fae-907a-247105c3d4f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.694597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-93acdd1b-586f-4fae-907a-247105c3d4f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.731075 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-93acdd1b-586f-4fae-907a-247105c3d4f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] HTTP exception thrown: Instance 4996f091-2316-4100-b272-d2af7738b4ac is locked May 07 22:05:08.731727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-93acdd1b-586f-4fae-907a-247105c3d4f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Returning 409 to user: Instance 4996f091-2316-4100-b272-d2af7738b4ac is locked {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:08.732603 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-93acdd1b-586f-4fae-907a-247105c3d4f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 409 len: 107 microversion: 2.1 time: 0.063861 May 07 22:05:08.733710 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2336/4716] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:08 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 107 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:05:08.742594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:08.743529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:08.756211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.757211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.759394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.760737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.808425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Unlocking {{(pid=136682) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 07 22:05:08.903218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:08.907961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:08.924983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.926133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.927722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.928594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.937645 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd174f08-e531-4b94-b465-a48e4513d38a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.198286 May 07 22:05:08.940065 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2381/4717] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:08 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:08.954451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f041d59-a780-43de-b45f-940ce36aa19f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:08.956410 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] HTTP exception thrown: Instance 11df3809-8e5b-40d6-adb1-393c365f9a47 could not be found. May 07 22:05:08.957720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Returning 404 to user: Instance 11df3809-8e5b-40d6-adb1-393c365f9a47 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:08.959583 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8fd72865-adb3-47ad-8677-e2983166cff5 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 404 len: 111 microversion: 2.1 time: 0.063735 May 07 22:05:08.960615 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2337/4718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:08 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:05:08.963759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f041d59-a780-43de-b45f-940ce36aa19f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:08.964541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f041d59-a780-43de-b45f-940ce36aa19f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:08.971943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c31f4856-9da1-44b5-bd3a-c495b39cd0ba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '.version_select at 0x7fc41ce789d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:08.991254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f041d59-a780-43de-b45f-940ce36aa19f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:05:08.993793 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c31f4856-9da1-44b5-bd3a-c495b39cd0ba tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027021224" status: 202 len: 0 microversion: 2.1 time: 0.026100 May 07 22:05:08.994466 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2338/4719] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:05:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027021224 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:09.070856 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f041d59-a780-43de-b45f-940ce36aa19f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.124855 May 07 22:05:09.075119 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2382/4720] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:08 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:05:09.082908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:09.084860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:09.094656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:09.095147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:09.096776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:09.097895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:09.298312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:09.299168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:09.313478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:09.313946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:09.315290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:09.315580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:09.384033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:09.397108 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b31ee7ef-3c74-440b-b0b3-bb07c7e2bece tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.320224 May 07 22:05:09.398043 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2339/4721] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:09 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:09.403509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-662663a1-c307-444a-a5e7-3ec468495da0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bcc482f-be0e-4aa0-8871-ca6d63dad8d7"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:09.406184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-662663a1-c307-444a-a5e7-3ec468495da0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:09.416878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-662663a1-c307-444a-a5e7-3ec468495da0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:09.417604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-662663a1-c307-444a-a5e7-3ec468495da0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:09.418278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-662663a1-c307-444a-a5e7-3ec468495da0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:09.418734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-662663a1-c307-444a-a5e7-3ec468495da0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:09.552562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:09.560661 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a4037e5-1385-41eb-850e-9df770a9a697 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1510 microversion: 2.1 time: 0.267877 May 07 22:05:09.565332 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2383/4722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:09 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:10.416702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:10.417393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:10.424537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:10.424998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:10.425784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:10.426229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:10.633616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:10.641122 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-213b9497-9b58-417a-aadb-4e9e8fc12171 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.228281 May 07 22:05:10.641709 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2384/4723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:10 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:10.646332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:10.646987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:10.652893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:10.653362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:10.654141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:10.654594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:10.850451 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-662663a1-c307-444a-a5e7-3ec468495da0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.450891 May 07 22:05:10.852669 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2340/4724] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:05:09 2022] POST /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments => generated 194 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:10.884265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:10.894541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7cdeca37-167d-4991-bfca-c013f75ac27c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1510 microversion: 2.1 time: 0.251763 May 07 22:05:10.905952 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2385/4725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:10 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:11.195435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2cae10f9-c20c-4f48-b8ed-65c7ac78f6aa req-c4e87161-2cec-406c-b8b8-b320bd10fcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6", "name": "network-vif-unplugged", "status": "completed", "tag": "49671dbb-1f39-4903-a9e1-e283831ec748"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:11.212704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2cae10f9-c20c-4f48-b8ed-65c7ac78f6aa req-c4e87161-2cec-406c-b8b8-b320bd10fcdc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:11.213723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2cae10f9-c20c-4f48-b8ed-65c7ac78f6aa req-c4e87161-2cec-406c-b8b8-b320bd10fcdc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:11.231383 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2cae10f9-c20c-4f48-b8ed-65c7ac78f6aa req-c4e87161-2cec-406c-b8b8-b320bd10fcdc service nova] Creating event network-vif-unplugged:49671dbb-1f39-4903-a9e1-e283831ec748 for instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 on nch2-master-1 May 07 22:05:11.241829 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2cae10f9-c20c-4f48-b8ed-65c7ac78f6aa req-c4e87161-2cec-406c-b8b8-b320bd10fcdc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052739 May 07 22:05:11.243161 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2341/4726] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:11.660916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:11.661614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:11.671127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:11.671595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:11.672391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:11.672836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:11.914950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:11.916843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:11.917622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:11.927367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:11.927895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:11.928695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:11.929145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:11.929543 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-807c046f-6b31-4d0d-b33c-0d73ea8be0c3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.274742 May 07 22:05:11.945748 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2386/4727] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:11 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:12.115472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:12.123347 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-369ea3dc-fffd-400d-ba9a-d293696af8e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1453 microversion: 2.1 time: 0.215563 May 07 22:05:12.123936 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2342/4728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:11 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:12.140089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:12.140723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:12.147395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.147861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.148647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.149099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.212525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:12.213073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:12.220035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.220570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.221430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.221950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.235594 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] HTTP exception thrown: Instance 11df3809-8e5b-40d6-adb1-393c365f9a47 could not be found. May 07 22:05:12.236744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Returning 404 to user: Instance 11df3809-8e5b-40d6-adb1-393c365f9a47 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:12.237596 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0dcfd916-d138-4149-871b-cf5366e7cdd6 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 404 len: 111 microversion: 2.1 time: 0.029085 May 07 22:05:12.238160 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2343/4729] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:05:12 2022] DELETE /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:05:12.245818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:12.246446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 11df3809-8e5b-40d6-adb1-393c365f9a47] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:12.253032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.253489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.254363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.254839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.268772 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] HTTP exception thrown: Instance 11df3809-8e5b-40d6-adb1-393c365f9a47 could not be found. May 07 22:05:12.269402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Returning 404 to user: Instance 11df3809-8e5b-40d6-adb1-393c365f9a47 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:12.271008 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-82281092-20be-4134-95c5-3e7458486169 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47" status: 404 len: 111 microversion: 2.1 time: 0.028226 May 07 22:05:12.272472 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2344/4730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:12 2022] GET /compute/v2.1/servers/11df3809-8e5b-40d6-adb1-393c365f9a47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:12.360750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:12.371601 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4c407350-c3a8-4ca0-b42b-cd56b9666a77 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1453 microversion: 2.1 time: 0.235266 May 07 22:05:12.372896 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2387/4731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:12 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:12.420136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:12.420695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:12.428880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.429346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.430746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.431343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.457889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lazy-loading 'flavor' on Instance uuid ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:12.471324 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Cannot 'shelve' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state shelved_offloaded May 07 22:05:12.472489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 409 to user: Cannot 'shelve' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state shelved_offloaded {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:12.473137 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5cca4ea9-8b52-45d8-85fe-cc52cafb95f4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 409 len: 155 microversion: 2.1 time: 0.057407 May 07 22:05:12.473733 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2345/4732] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:12 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 155 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:05:12.482448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ad039ee0-677d-468e-a2b4-08dcb2578572 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:12.483085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ad039ee0-677d-468e-a2b4-08dcb2578572 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:12.490102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad039ee0-677d-468e-a2b4-08dcb2578572 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.490462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad039ee0-677d-468e-a2b4-08dcb2578572 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.491311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad039ee0-677d-468e-a2b4-08dcb2578572 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.491744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ad039ee0-677d-468e-a2b4-08dcb2578572 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.598051 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ad039ee0-677d-468e-a2b4-08dcb2578572 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 202 len: 0 microversion: 2.1 time: 0.119368 May 07 22:05:12.599400 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2388/4733] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:12 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:12.611083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:12.612928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:12.626820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.632549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.633417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.633875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.860089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:12.871149 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3d7dc072-2f82-41c2-9fc2-19b78cbffefb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1461 microversion: 2.1 time: 0.267021 May 07 22:05:12.880713 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2346/4734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:12 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1461 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:12.947888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:12.948585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:12.963712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.964097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:12.964889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:12.965332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:13.257955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:13.265392 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-676f4c1b-be7f-4b90-ae62-643861f2bbc9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.321614 May 07 22:05:13.266427 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2389/4735] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:12 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:13.626044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:13.630345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:13.640427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:13.642316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:13.643982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:13.645296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:13.669952 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] HTTP exception thrown: Instance 95f9d622-1591-4442-9da0-167bdb326758 could not be found. May 07 22:05:13.670894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Returning 404 to user: Instance 95f9d622-1591-4442-9da0-167bdb326758 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:13.671763 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3104f286-4c85-456a-8f78-2915de1d8aa2 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "DELETE /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 404 len: 111 microversion: 2.1 time: 0.057435 May 07 22:05:13.672333 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2347/4736] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:05:13 2022] DELETE /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:05:13.681315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:13.682094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] [instance: 95f9d622-1591-4442-9da0-167bdb326758] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:13.693476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:13.694162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:13.695278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:13.695889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:13.713569 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] HTTP exception thrown: Instance 95f9d622-1591-4442-9da0-167bdb326758 could not be found. May 07 22:05:13.714415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] Returning 404 to user: Instance 95f9d622-1591-4442-9da0-167bdb326758 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:13.715493 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0cf0b57-ae76-4b67-8e02-82590464ae62 tempest-AttachVolumeTestJSON-808075378 tempest-AttachVolumeTestJSON-808075378-project] 10.222.0.32 "GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758" status: 404 len: 111 microversion: 2.1 time: 0.038453 May 07 22:05:13.716723 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2390/4737] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:13 2022] GET /compute/v2.1/servers/95f9d622-1591-4442-9da0-167bdb326758 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:13.888290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:13.889047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:13.896078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:13.896620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:13.897477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:13.898042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.044103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:14.052378 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c0013c5-349a-4ef1-9ff6-6ffd46bb70ea tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.168211 May 07 22:05:14.053258 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2348/4738] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:13 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:14.190377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bcc482f-be0e-4aa0-8871-ca6d63dad8d7"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:14.191787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:14.199028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.199868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.200674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.201123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.282264 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Invalid volume: volume 6bcc482f-be0e-4aa0-8871-ca6d63dad8d7 is already attached to instances: cf519119-a1c9-4f1e-9d65-8f11441721a2 May 07 22:05:14.283752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 400 to user: Invalid volume: volume 6bcc482f-be0e-4aa0-8871-ca6d63dad8d7 is already attached to instances: cf519119-a1c9-4f1e-9d65-8f11441721a2 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:14.284731 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5614ec18-7593-4290-9e37-3a42f0cb1958 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098411 May 07 22:05:14.285195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:14.285527 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2391/4739] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:05:14 2022] POST /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:05:14.285991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:14.293401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.294343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.295148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.295686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.356672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:14.357257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:14.364578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.365136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.366613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.367160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.437058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:14.445519 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6623bf61-a0a6-4c09-8b55-0496d185fcdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.166271 May 07 22:05:14.446106 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2349/4740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:14 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:14.464529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lazy-loading 'services' on Instance uuid cf519119-a1c9-4f1e-9d65-8f11441721a2 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:14.539279 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc311666-4d84-4519-8d52-a8ef396f82b1 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments/6bcc482f-be0e-4aa0-8871-ca6d63dad8d7" status: 202 len: 0 microversion: 2.1 time: 0.187988 May 07 22:05:14.539876 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2392/4741] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:05:14 2022] DELETE /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments/6bcc482f-be0e-4aa0-8871-ca6d63dad8d7 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:14.549848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-42eaa775-68d1-420b-bbd3-5ebf9061d672 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:14.550931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-42eaa775-68d1-420b-bbd3-5ebf9061d672 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:14.558569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42eaa775-68d1-420b-bbd3-5ebf9061d672 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.559445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42eaa775-68d1-420b-bbd3-5ebf9061d672 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.560343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42eaa775-68d1-420b-bbd3-5ebf9061d672 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:14.560931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42eaa775-68d1-420b-bbd3-5ebf9061d672 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:14.594913 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-42eaa775-68d1-420b-bbd3-5ebf9061d672 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050565 May 07 22:05:14.596067 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2350/4742] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:05:14 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:15.071159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:15.071520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:15.077882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.078340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.079144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.079587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.463157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:15.463692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:15.472273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.472743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.473692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.474047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.621927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:15.631767 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94de5431-d8bb-4c44-ad70-d3ac89779924 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.172338 May 07 22:05:15.632382 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2351/4743] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:15 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:15.637488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a68e9d76-2101-4970-a4bb-a3fb4652a6a6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:15.638812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a68e9d76-2101-4970-a4bb-a3fb4652a6a6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:15.645598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a68e9d76-2101-4970-a4bb-a3fb4652a6a6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.646065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a68e9d76-2101-4970-a4bb-a3fb4652a6a6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.646883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a68e9d76-2101-4970-a4bb-a3fb4652a6a6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.647339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a68e9d76-2101-4970-a4bb-a3fb4652a6a6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.676501 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a68e9d76-2101-4970-a4bb-a3fb4652a6a6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043046 May 07 22:05:15.677592 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2352/4744] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:05:15 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:15.736084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:15.736739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:15.747156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.747681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.748544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.748998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.777307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:05:15.867727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:15.875260 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8410529c-fa0a-4e57-a037-ddcdaabad5ae tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.808554 May 07 22:05:15.875856 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2393/4745] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:15 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:15.897306 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e80fa38e-60d1-4b48-b031-fd081ac85398 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 204 len: 0 microversion: 2.1 time: 0.164984 May 07 22:05:15.898544 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2353/4746] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:05:15 2022] DELETE /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:05:15.906517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:15.907255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:15.913992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.914536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:15.915436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:15.915959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:16.198166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:16.221324 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c73e088e-d954-40ca-a264-d28b844d3e35 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1683 microversion: 2.1 time: 0.318238 May 07 22:05:16.223093 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2394/4747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:15 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1683 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:16.322252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-48a2548d-1d2f-491d-85ef-ee7b656f91c3 req-7b3bd8d8-3d47-45f7-bc27-3ef4f321a258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6", "tag": "49671dbb-1f39-4903-a9e1-e283831ec748"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:16.335507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-48a2548d-1d2f-491d-85ef-ee7b656f91c3 req-7b3bd8d8-3d47-45f7-bc27-3ef4f321a258 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:16.336350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-48a2548d-1d2f-491d-85ef-ee7b656f91c3 req-7b3bd8d8-3d47-45f7-bc27-3ef4f321a258 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:16.350296 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-48a2548d-1d2f-491d-85ef-ee7b656f91c3 req-7b3bd8d8-3d47-45f7-bc27-3ef4f321a258 service nova] Creating event network-changed:49671dbb-1f39-4903-a9e1-e283831ec748 for instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 on nch1-master-1 May 07 22:05:16.356802 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-48a2548d-1d2f-491d-85ef-ee7b656f91c3 req-7b3bd8d8-3d47-45f7-bc27-3ef4f321a258 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041642 May 07 22:05:16.358158 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2354/4748] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:16.651571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:16.652626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:16.665333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:16.681930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:16.687234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:16.690146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:16.900646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:16.901928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:16.910902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:16.911870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:16.913319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:16.914175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:17.022445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:17.033824 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b2ced579-e592-4285-a53d-e7fb59a311eb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.387249 May 07 22:05:17.034639 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2395/4749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:16 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:17.142518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:17.150434 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec3cde5e-2f9f-4613-8900-45f6b599fc21 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.260875 May 07 22:05:17.151265 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2355/4750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:16 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:17.245225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:17.246368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:17.256350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:17.256900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:17.257907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:17.258528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:17.480867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:17.492190 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb61249a-7473-478d-a771-3a26bc319522 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1683 microversion: 2.1 time: 0.251036 May 07 22:05:17.501676 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2396/4751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:17 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1683 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:18.052103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:18.053051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:18.081754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:18.084795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:18.088703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:18.089395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:18.169033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:18.170336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:18.205051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:18.215787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:18.216990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:18.217656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:18.572579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:18.580633 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-041afa14-0c1f-4e68-baa6-b70ee0f339d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.416076 May 07 22:05:18.581229 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2397/4752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:18 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:18.594349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:18.598713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:18.616884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:18.624505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:18.627345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:18.627983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:18.941674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:18.956440 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31d7b2bf-8c6d-41a9-af78-990d3942e937 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.909894 May 07 22:05:18.969216 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2356/4753] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:18 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:19.248936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:19.259140 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9abe467a-ea9b-4dc7-8c22-9fb543b5758a tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1683 microversion: 2.1 time: 0.672943 May 07 22:05:19.263414 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2398/4754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:18 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1683 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:19.598953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:19.599653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:19.613315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:19.616351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:19.617502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:19.617968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:19.977222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:19.978079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:19.994831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:19.995593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:19.996674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:19.997473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:20.088622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:20.100224 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0a7abe6e-c80a-475f-bd59-2e067890cb4d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.506074 May 07 22:05:20.100854 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2357/4755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:19 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:20.281005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:20.281849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:20.291735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:20.297486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:20.299320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:20.304252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:20.457859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:20.471507 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b497a8fc-9964-4b36-ab19-54f9e2509ef2 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 200 len: 1615 microversion: 2.1 time: 0.192000 May 07 22:05:20.482923 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2358/4756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:20 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 1615 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:20.508204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bef26bef-cd82-4ed9-8ffa-1efc21d18bc1 req-f16e2c88-5382-4bfc-bb15-1e87f57e429f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf519119-a1c9-4f1e-9d65-8f11441721a2", "name": "network-vif-deleted", "tag": "53d2f822-2f8e-447c-9bcb-2e1cb411c60a"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:20.538475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bef26bef-cd82-4ed9-8ffa-1efc21d18bc1 req-f16e2c88-5382-4bfc-bb15-1e87f57e429f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:20.539461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bef26bef-cd82-4ed9-8ffa-1efc21d18bc1 req-f16e2c88-5382-4bfc-bb15-1e87f57e429f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:20.580480 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bef26bef-cd82-4ed9-8ffa-1efc21d18bc1 req-f16e2c88-5382-4bfc-bb15-1e87f57e429f service nova] Creating event network-vif-deleted:53d2f822-2f8e-447c-9bcb-2e1cb411c60a for instance cf519119-a1c9-4f1e-9d65-8f11441721a2 on nch2-master-1 May 07 22:05:20.600059 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bef26bef-cd82-4ed9-8ffa-1efc21d18bc1 req-f16e2c88-5382-4bfc-bb15-1e87f57e429f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091330 May 07 22:05:20.609417 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2359/4757] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:20.628019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:20.636883 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb071826-87fb-4a86-9026-05063e68eac0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.663653 May 07 22:05:20.639627 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2399/4758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:19 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:21.120080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:21.121082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:21.138175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:21.139006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:21.141153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:21.142206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:21.488942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:21.489572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:21.503715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:21.504323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:21.505121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:21.505560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:21.538197 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance cf519119-a1c9-4f1e-9d65-8f11441721a2 could not be found. May 07 22:05:21.540268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance cf519119-a1c9-4f1e-9d65-8f11441721a2 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:21.545561 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a12d0cf7-ec4c-4740-87ac-212df3da159b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 404 len: 111 microversion: 2.1 time: 0.060691 May 07 22:05:21.549927 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2400/4759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:21 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:05:21.558922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-17eb5dd7-3ba8-4f0d-b1f7-9d381a5bfae6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '.version_select at 0x7fc41c3b4040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:21.598239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-17eb5dd7-3ba8-4f0d-b1f7-9d381a5bfae6 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721414158" status: 202 len: 0 microversion: 2.1 time: 0.045091 May 07 22:05:21.599880 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2401/4760] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721414158 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:21.657363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:21.658221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:21.676075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:21.676732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:21.680037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:21.683300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:21.987345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:21.997319 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6174caa-df44-4401-9241-02cb9aa277f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1656 microversion: 2.1 time: 0.345302 May 07 22:05:22.000957 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2402/4761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:21 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1656 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:22.033462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb99c4bd-01e2-4513-8bc6-ef015cbea929 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:22.061438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb99c4bd-01e2-4513-8bc6-ef015cbea929 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:22.065114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb99c4bd-01e2-4513-8bc6-ef015cbea929 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:22.112503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb99c4bd-01e2-4513-8bc6-ef015cbea929 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Going to try to start instance {{(pid=136682) start /opt/stack/nova/nova/compute/api.py:2730}} May 07 22:05:22.236406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb99c4bd-01e2-4513-8bc6-ef015cbea929 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.223979 May 07 22:05:22.237097 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2403/4762] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:22 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:22.262115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:22.266208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:22.285979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:22.287066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:22.291975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:22.292579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:22.482076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:22.493159 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5a9a2f9-c57b-4ab0-8834-0e50fbdacde7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 1.377486 May 07 22:05:22.496314 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2360/4763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:21 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:22.803100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:22.811668 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e2d20bc3-d784-41b2-bde5-66b4027aac63 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1665 microversion: 2.1 time: 0.570100 May 07 22:05:22.816841 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2404/4764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:22 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1665 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:23.364983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b298e55-9878-472c-840b-ba9d1f962584 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: .version_select at 0x7fc41ce783a0>, body: {"keypair": {"name": "tempest-keypair-473813015"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:23.401580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0b298e55-9878-472c-840b-ba9d1f962584 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:05:23.413731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0b298e55-9878-472c-840b-ba9d1f962584 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:05:23.518269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:23.518269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:23.534165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:23.534629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:23.535476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:23.535915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:23.844095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:23.853772 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-54d2b32e-7828-47c6-836f-1c0036607f29 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.345045 May 07 22:05:23.857564 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2405/4765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:23 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:23.876523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:23.878014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:23.895196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:23.895976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:23.903900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:23.904584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:24.199676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0b298e55-9878-472c-840b-ba9d1f962584 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:05:24.207136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0b298e55-9878-472c-840b-ba9d1f962584 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:05:24.248104 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b298e55-9878-472c-840b-ba9d1f962584 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.887276 May 07 22:05:24.248890 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2361/4766] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:05:23 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:24.301248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:24.317863 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fba15c68-305c-4d71-9f10-6ab1e3a2b9f2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1665 microversion: 2.1 time: 0.455115 May 07 22:05:24.330965 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2406/4767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:23 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1665 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:24.383459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e9d1081-b754-4242-b922-45b2e326d390 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f1602a-c13f-4f22-870b-54705d29081f"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:24.385157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e9d1081-b754-4242-b922-45b2e326d390 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:24.400452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e9d1081-b754-4242-b922-45b2e326d390 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:24.403208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e9d1081-b754-4242-b922-45b2e326d390 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:24.405917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e9d1081-b754-4242-b922-45b2e326d390 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:24.406407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e9d1081-b754-4242-b922-45b2e326d390 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:24.860934 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e9d1081-b754-4242-b922-45b2e326d390 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483127 May 07 22:05:24.866638 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2362/4768] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:05:24 2022] POST /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:24.874059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:24.875268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:24.908995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:24.909506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:24.911138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:24.911734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:25.302448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:25.340274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:25.340274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:25.355026 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8303f93f-80e2-46ff-92e2-3a417c1aab97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.479946 May 07 22:05:25.368139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:25.368474 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2407/4769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:24 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:25.369708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:25.370541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:25.378181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:26.093989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:26.113711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27992a53-c697-46a9-a89c-632d3648ff54 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1665 microversion: 2.1 time: 0.774347 May 07 22:05:26.116241 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2363/4770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:25 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1665 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:26.383366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:26.388873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:26.425608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:26.426684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:26.447643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:26.448184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:27.134764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:27.136024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:27.151431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:27.151431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:27.151431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:27.151431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:27.196613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:27.206246 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-009a39e1-957d-49f2-a5a5-11e89a9197c4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.837538 May 07 22:05:27.216731 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2408/4771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:26 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:27.551191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:27.560450 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ac1c3f4-5eec-4fa1-b0d0-8b4d480e4fdf tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.429580 May 07 22:05:27.561396 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2364/4772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:27 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:27.580965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:27.582845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:27.593188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:27.593989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:27.595834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:27.596490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:27.849381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:27.858440 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-029caa99-6312-4822-970e-d6e8a044dbdb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.284066 May 07 22:05:27.861701 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2409/4773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:27 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:27.877780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:27.879703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:27.895173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:27.895692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:27.896438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:27.897049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:27.933376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1869272410", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f64cbfbe-feaa-48dc-9089-9445aa1eaa5a"}], "security_groups": [{"name": "tempest-securitygroup--1546292431"}], "key_name": "tempest-keypair-473813015", "user_data": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:27.975248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Unlocking {{(pid=136681) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 07 22:05:28.053035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] validate_networks() for [('f64cbfbe-feaa-48dc-9089-9445aa1eaa5a', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:05:28.083649 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27b99395-f002-4e03-8840-c2d813bac237 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.208569 May 07 22:05:28.085658 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2365/4774] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:27 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:28.100897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:28.101918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:28.112527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.112998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.114044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.114509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.448233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:28.459098 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94da0c7a-e723-4a68-a23b-3102f59097bd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.361404 May 07 22:05:28.459802 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2366/4775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:28 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:28.472341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c8ec3f3-b984-4090-8ba2-75398de09c02 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:28.473831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c8ec3f3-b984-4090-8ba2-75398de09c02 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:28.481033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8ec3f3-b984-4090-8ba2-75398de09c02 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.481754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8ec3f3-b984-4090-8ba2-75398de09c02 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.483056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8ec3f3-b984-4090-8ba2-75398de09c02 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.483726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8ec3f3-b984-4090-8ba2-75398de09c02 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.540500 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c8ec3f3-b984-4090-8ba2-75398de09c02 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187/action" status: 200 len: 24535 microversion: 2.1 time: 0.078606 May 07 22:05:28.542124 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2367/4776] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:28 2022] POST /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187/action => generated 24535 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:05:28.547708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:28.549284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:28.557297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.558023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.559463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.560069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.567654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:05:28.568329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:05:28.568982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:05:28.570204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:05:28.570914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:05:28.588802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.589379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.590116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.590558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.611424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:05:28.617353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Getting quotas for user 887054d178de43b18a472fed2297659d and project 57990769f50b412194a108cdd627a767. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:05:28.630186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:05:28.632702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:05:28.682179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91504f4d-98e9-47b3-8095-c887612bf392 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.753362 May 07 22:05:28.683144 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2410/4777] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:05:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:05:28.688790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:28.690233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:28.697546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.698184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.699151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.699771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.736734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lazy-loading 'flavor' on Instance uuid 9df2668b-af6b-4323-a4a4-520fcae8e55e {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:28.829388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:28.837642 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa656b62-d24a-4165-bb87-4e149880da4c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.293971 May 07 22:05:28.841558 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2368/4778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:28 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:28.853248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:28.853941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:28.864553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.865124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.866297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:28.866387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:28.973856 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41741dbc-f5db-485c-9c52-640854745453 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/action" status: 200 len: 32 microversion: 2.1 time: 0.285631 May 07 22:05:28.974973 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2411/4779] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:28 2022] POST /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:05:28.987272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ca130ad-4768-444c-a0e1-164d074d3f49 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:28.989217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ca130ad-4768-444c-a0e1-164d074d3f49 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:29.034653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:29.044626 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-557a781b-2cb7-4d08-bfa1-bdb4577ece16 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.200225 May 07 22:05:29.045663 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2369/4780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:28 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:29.055241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:29.056230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:29.080267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.083663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.084824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.085327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.143614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ca130ad-4768-444c-a0e1-164d074d3f49 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:29.150377 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ca130ad-4768-444c-a0e1-164d074d3f49 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1241 microversion: 2.1 time: 0.171061 May 07 22:05:29.161036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2412/4781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:28 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:29.166633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:29.167436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:29.191540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.192172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.193100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.193687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.395412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:29.406325 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5980dfbb-3005-4912-9e77-a963ef31778d tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.358771 May 07 22:05:29.408284 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2370/4782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:29 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:29.490617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:29.500854 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7d2642c5-d472-4a74-8a01-d6ea34e17601 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.338468 May 07 22:05:29.502829 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2413/4783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:29 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:29.529657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8a388d3f-cb2f-4850-9c52-4fe1132be76c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:29.530899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8a388d3f-cb2f-4850-9c52-4fe1132be76c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:29.542283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a388d3f-cb2f-4850-9c52-4fe1132be76c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.542762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a388d3f-cb2f-4850-9c52-4fe1132be76c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.544795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a388d3f-cb2f-4850-9c52-4fe1132be76c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.545781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8a388d3f-cb2f-4850-9c52-4fe1132be76c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.666198 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8a388d3f-cb2f-4850-9c52-4fe1132be76c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.151052 May 07 22:05:29.669941 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2371/4784] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:29 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:29.677422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:29.682029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:29.699414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.704483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.706920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.707589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.864567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:29.865857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:29.879743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.880550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.882095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:29.883668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:29.915017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:29.946064 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-43371239-bba3-4277-be66-9269b75275f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1674 microversion: 2.1 time: 0.255566 May 07 22:05:29.947534 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2414/4785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:29 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:30.178720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:30.179590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:30.189088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:30.189663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:30.190567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:30.191256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:30.198105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:30.208401 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-99f42587-61fb-4c5d-ac05-86f6773cb4b2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.356493 May 07 22:05:30.209696 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2372/4786] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:29 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:30.285804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:30.294978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fff55d96-6b18-448d-acc0-c0f8edd813dd tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1299 microversion: 2.1 time: 0.120490 May 07 22:05:30.296212 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2415/4787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:30 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:30.426101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:30.426735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:30.436745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:30.437416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:30.438224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:30.439541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:30.680945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:30.690358 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b99461d7-3610-4a15-83b3-3612843c65e5 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.268409 May 07 22:05:30.691284 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2373/4788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:30 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:30.965534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:30.966259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:30.973270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:30.973900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:30.974990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:30.975706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.191514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:31.207815 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-daf08dcb-fda9-4e19-909d-892fe7e70f00 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1654 microversion: 2.1 time: 0.246372 May 07 22:05:31.209943 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2416/4789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:30 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1654 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:31.227957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:31.228750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:31.229456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a8df7277-0829-40b0-92e4-c32b474aa7b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:31.230052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a8df7277-0829-40b0-92e4-c32b474aa7b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:31.241439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8df7277-0829-40b0-92e4-c32b474aa7b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.241909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8df7277-0829-40b0-92e4-c32b474aa7b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.248427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.249034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.249985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.252382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.253984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8df7277-0829-40b0-92e4-c32b474aa7b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.254631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a8df7277-0829-40b0-92e4-c32b474aa7b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.388189 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a8df7277-0829-40b0-92e4-c32b474aa7b9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.162206 May 07 22:05:31.389454 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2417/4790] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:31 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:31.399116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:31.400249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:31.410376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.411702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.412844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.413557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.602478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:31.613161 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e93c28e1-6bcd-46d7-805c-cbbf77bcaab9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.219886 May 07 22:05:31.617071 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2418/4791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:31 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:31.622656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:31.625812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:31.634110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.634909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.635879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.636764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.705902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:31.717153 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84d2e353-fd7b-4369-9715-c445d1da0f55 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.493650 May 07 22:05:31.729937 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2374/4792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:31 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:31.741578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:31.743023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:31.756202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.760457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.761424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:31.761973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:31.817562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:31.826439 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ac5c98b7-9392-44da-982e-ed01acefa327 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1661 microversion: 2.1 time: 0.207757 May 07 22:05:31.827862 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2419/4793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:31 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1661 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:32.031230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:32.053487 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-deea0142-d776-405d-b69f-84bd82729bf2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.321217 May 07 22:05:32.054450 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2375/4794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:31 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:32.320979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c75061a9-c149-4bdf-ad7d-51c0d272059c req-e020c42a-b48a-47e7-a230-97d447a074c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae59656-69ab-4136-adeb-885957bc32fb", "tag": "c846280a-8147-4e8c-bb8f-73673321d454"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:32.367394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c75061a9-c149-4bdf-ad7d-51c0d272059c req-e020c42a-b48a-47e7-a230-97d447a074c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.369471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c75061a9-c149-4bdf-ad7d-51c0d272059c req-e020c42a-b48a-47e7-a230-97d447a074c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.393013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c75061a9-c149-4bdf-ad7d-51c0d272059c req-e020c42a-b48a-47e7-a230-97d447a074c3 service nova] Creating event network-changed:c846280a-8147-4e8c-bb8f-73673321d454 for instance aae59656-69ab-4136-adeb-885957bc32fb on nch2-master-1 May 07 22:05:32.400809 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c75061a9-c149-4bdf-ad7d-51c0d272059c req-e020c42a-b48a-47e7-a230-97d447a074c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083482 May 07 22:05:32.402354 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2420/4795] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:32.535009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a62d4812-bf1e-4b94-8315-160f41cb5000 req-ca5430b7-b9e4-4c56-a342-fe20dafa7f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6", "name": "network-vif-plugged", "status": "completed", "tag": "49671dbb-1f39-4903-a9e1-e283831ec748"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:32.549721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a62d4812-bf1e-4b94-8315-160f41cb5000 req-ca5430b7-b9e4-4c56-a342-fe20dafa7f3f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.550176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a62d4812-bf1e-4b94-8315-160f41cb5000 req-ca5430b7-b9e4-4c56-a342-fe20dafa7f3f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.577926 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a62d4812-bf1e-4b94-8315-160f41cb5000 req-ca5430b7-b9e4-4c56-a342-fe20dafa7f3f service nova] Creating event network-vif-plugged:49671dbb-1f39-4903-a9e1-e283831ec748 for instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 on nch1-master-1 May 07 22:05:32.597073 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a62d4812-bf1e-4b94-8315-160f41cb5000 req-ca5430b7-b9e4-4c56-a342-fe20dafa7f3f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066790 May 07 22:05:32.598003 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2376/4796] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:05:32.632553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:32.633314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:32.644879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.645370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.648982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.650024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.738168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:32.739540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:32.752651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.753729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.754801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.755568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.918677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:32.931184 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-687e2d7c-a265-46d5-985b-1c508e116ed8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.302933 May 07 22:05:32.932571 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2421/4797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:32 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:32.951134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:32.952289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:32.961486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.962152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.963314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:32.964068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:32.981841 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:32.990007 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-36e73366-5900-4172-b0c2-10cc4ce44fe4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.257444 May 07 22:05:32.990593 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2377/4798] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:32 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:33.072737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:33.073721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:33.080835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.081595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.082612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.083199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.281925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:33.297506 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-022f4612-7678-4dc4-90d8-04c4d7a22722 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.351263 May 07 22:05:33.298052 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2422/4799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:32 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:33.316797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:33.317620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:33.324390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.324979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.325641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.326262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.502683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:33.510835 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bfea0f12-57fc-4bed-8cd9-26161db68802 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.198277 May 07 22:05:33.511968 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2423/4800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:33 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:33.531666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:33.533082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:33.539945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.540308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.541222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.541674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.693516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:33.701531 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-36aeb861-6bca-4c3c-b0c1-49ebc3e9e09e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.173897 May 07 22:05:33.702259 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2424/4801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:33 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:33.725128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:33.725847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:33.732903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.733636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.734626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.735123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.783504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:33.793099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12498163-9d0f-4437-ab8b-8791b79985fd tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.725761 May 07 22:05:33.793809 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2378/4802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:33 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:33.949391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:33.951038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:33.958900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.959523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:33.961007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:33.962125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.053389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:34.064817 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-576a6531-c676-4342-abaa-15ba57050b88 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.345277 May 07 22:05:34.066723 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2425/4803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:33 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:34.071828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:34.072677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:34.086458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.087317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.088317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.089081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.150973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:34.161086 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-86c18b70-38b6-4f2e-8077-83e6af6ef5b8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.214279 May 07 22:05:34.164781 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2379/4804] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:33 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:34.170337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:34.171013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:34.177863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.178339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.179158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.179611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.374536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:34.382167 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7038e0e9-b575-4dce-ab67-8012d273299d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1519 microversion: 2.1 time: 0.314023 May 07 22:05:34.382747 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2426/4805] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:34 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1519 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:34.396053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:34.406731 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d02bde9d-72cb-4533-bb07-fbb75ad2423a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.240369 May 07 22:05:34.408805 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2380/4806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:34 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:34.425522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:34.426204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:34.432694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.433355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.434555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.435261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.810185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:34.810894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:34.826213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.826909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:34.827779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:34.828278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.066094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:35.075586 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-229c0366-d16d-4331-93c3-52731fb169a1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.270097 May 07 22:05:35.076190 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2381/4807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:34 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:35.135218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:35.144889 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03e810c8-a87d-4453-92c6-99365d905547 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.724020 May 07 22:05:35.146708 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2427/4808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:34 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:35.181081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:35.181972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:35.190332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.192187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.193221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.193829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.399260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:35.400048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:35.410739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.411230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.412026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.412481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.479809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:35.487785 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80cdc8c2-200f-4bc0-84da-3dfb4c46b966 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.311846 May 07 22:05:35.488376 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2382/4809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:35 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:35.608116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:35.617979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ed049ace-0df8-4cd2-be8f-b1420e4044b1 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.222767 May 07 22:05:35.618555 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2428/4810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:35 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:35.634501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:35.635181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:35.641245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.642420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.643242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.643843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.798966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:35.810665 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cf7b0b7b-ae88-4bb4-b5e8-2ec1e437bf2d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.179632 May 07 22:05:35.811365 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2383/4811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:35 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:35.837571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:35.838588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:35.845961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.846626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:35.848020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:35.848618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.071508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:36.080157 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-75d8af62-076f-4e0a-80a9-ebf3c0464297 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.251450 May 07 22:05:36.090954 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2429/4812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:35 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:36.093255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:36.093993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.103545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.104011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.104809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.105259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.106642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8bfc5524-a7c0-49bd-a1ae-6853626f38e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:36.114094 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8bfc5524-a7c0-49bd-a1ae-6853626f38e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 11bd3fd2-dcd5-4549-898d-f8f954759f9f has no mapping to a cell. May 07 22:05:36.115467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8bfc5524-a7c0-49bd-a1ae-6853626f38e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 11bd3fd2-dcd5-4549-898d-f8f954759f9f has no mapping to a cell. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:36.117261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8bfc5524-a7c0-49bd-a1ae-6853626f38e6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/11bd3fd2-dcd5-4549-898d-f8f954759f9f/action" status: 404 len: 117 microversion: 2.1 time: 0.016538 May 07 22:05:36.120927 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2430/4813] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:36 2022] POST /compute/v2.1/servers/11bd3fd2-dcd5-4549-898d-f8f954759f9f/action => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:36.130800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:36.131896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.144356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.145358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.147752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.149237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.304992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:36.314665 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d28f03b1-ae43-4eaf-a427-9509c298b9a4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.191077 May 07 22:05:36.315496 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2431/4814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:36 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:36.333602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:36.334461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.340890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.341593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.342795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.343247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.365170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:36.374103 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2066cf22-f2bf-4a8b-953a-89254314bfdc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.284366 May 07 22:05:36.375245 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2384/4815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:36 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:36.505409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:36.506219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.512884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.517216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.520211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.520859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.530596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:36.542355 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e940dd71-f1a9-4efb-bc73-54e72c31bddd tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.213312 May 07 22:05:36.543947 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2432/4816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:36 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:36.559904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5355500-2194-4541-9d68-3f5273371c97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:36.560698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b5355500-2194-4541-9d68-3f5273371c97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 5762e28c-5f8e-4e9e-a137-28fd3d4d8ab5] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.566688 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b5355500-2194-4541-9d68-3f5273371c97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 5762e28c-5f8e-4e9e-a137-28fd3d4d8ab5 could not be found. May 07 22:05:36.567096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5355500-2194-4541-9d68-3f5273371c97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 5762e28c-5f8e-4e9e-a137-28fd3d4d8ab5 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:36.568623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5355500-2194-4541-9d68-3f5273371c97 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/5762e28c-5f8e-4e9e-a137-28fd3d4d8ab5/action" status: 404 len: 111 microversion: 2.1 time: 0.012774 May 07 22:05:36.573043 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2433/4817] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:36 2022] POST /compute/v2.1/servers/5762e28c-5f8e-4e9e-a137-28fd3d4d8ab5/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:05:36.578512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:36.579356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.586600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.587276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.588255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.588700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.727740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:36.737285 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a781eaa-dab3-454c-ae1a-d13eccd09aa9 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.163021 May 07 22:05:36.738080 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2434/4818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:36 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:36.755662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:36.757204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.757944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:36.764727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.765504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.766549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.767019 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8ec2692f-d5a5-4a3c-be69-43d96f5d3de4 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.266132 May 07 22:05:36.767572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:36.767960 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2385/4819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:36 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:36.948625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:36.967740 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1b8f5244-7950-4711-837c-da3a37d7c8aa tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.216351 May 07 22:05:36.968532 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2435/4820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:36 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:36.987000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:36.988431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:36.997959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:36.998746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.000040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:37.000935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.031591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lazy-loading 'flavor' on Instance uuid ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:37.129630 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a040f67c-a92d-4ae0-8689-c402c7ca53e2 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 202 len: 0 microversion: 2.1 time: 0.148065 May 07 22:05:37.134882 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2386/4821] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:36 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:37.152072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:37.155034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:37.164964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:37.165559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.166246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:37.166700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.394395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:37.395388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:37.403514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:37.404195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.405570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:37.406221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.520859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:37.528618 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ab13f52-3b2e-42ba-bc3d-c6816ca65f5a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1514 microversion: 2.1 time: 0.387627 May 07 22:05:37.538124 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2436/4822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:37 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:37.591952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:37.600789 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-352a73e9-5d2b-4636-bd83-b36486611f19 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.212062 May 07 22:05:37.611372 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2387/4823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:37 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:37.785819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:37.786756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:37.795611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:37.796928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.799728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:37.800383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:37.986135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:37.993727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a86f7e8d-709b-4601-aa0a-3037a83c1896 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.212903 May 07 22:05:37.994396 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2437/4824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:37 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:38.545901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:38.547535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:38.559221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.559919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:38.561899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.564079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:38.617438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:38.618310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:38.627334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.627795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:38.628628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.629234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:38.798721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:38.809351 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-304c20a0-87d3-41e7-adae-bd5dfc9374c4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.195599 May 07 22:05:38.810073 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2438/4825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:38 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:38.828749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:38.838022 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3df1c99b-f83e-4d10-8f28-944f154fd2e5 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1497 microversion: 2.1 time: 0.296482 May 07 22:05:38.838705 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2388/4826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:38 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1497 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:38.859129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:38.859129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:38.862576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.863090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:38.864042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.864652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:38.898544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lazy-loading 'flavor' on Instance uuid ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:38.915142 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Cannot 'suspend' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state suspended May 07 22:05:38.916999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 409 to user: Cannot 'suspend' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state suspended {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:38.918496 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-859a8eee-14ca-4b54-bff1-76a892d79e52 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 409 len: 148 microversion: 2.1 time: 0.067919 May 07 22:05:38.919295 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2439/4827] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:38 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 148 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:05:38.928071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f2c3dec0-8d77-4b45-845d-09f766739223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:38.928565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f2c3dec0-8d77-4b45-845d-09f766739223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:38.935852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2c3dec0-8d77-4b45-845d-09f766739223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.936503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2c3dec0-8d77-4b45-845d-09f766739223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:38.937435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2c3dec0-8d77-4b45-845d-09f766739223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:38.938140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2c3dec0-8d77-4b45-845d-09f766739223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.012294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:39.014120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:39.019355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f2c3dec0-8d77-4b45-845d-09f766739223 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 202 len: 0 microversion: 2.1 time: 0.095152 May 07 22:05:39.021927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:39.022579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.023314 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2389/4828] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:38 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:39.024244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:39.024951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.029533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:39.029682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:39.044109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:39.044576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.045423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:39.045872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.293968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:39.313518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e059336e-6107-4bcd-a40b-95e06c5aa18d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1503 microversion: 2.1 time: 0.288841 May 07 22:05:39.314329 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2390/4829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:39 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:39.400262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:39.422073 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fbf8ddf3-cf99-4de4-90e3-bf6a7713cc4f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.414411 May 07 22:05:39.422896 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2440/4830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:39 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:39.443659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f6250474-03d8-4f8c-a0b1-53cfad1fce25 req-f986659a-f8a4-49ea-90fb-a1c0c53fa6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae59656-69ab-4136-adeb-885957bc32fb", "name": "network-vif-plugged", "status": "completed", "tag": "c846280a-8147-4e8c-bb8f-73673321d454"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:39.452718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f6250474-03d8-4f8c-a0b1-53cfad1fce25 req-f986659a-f8a4-49ea-90fb-a1c0c53fa6fc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:39.453179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f6250474-03d8-4f8c-a0b1-53cfad1fce25 req-f986659a-f8a4-49ea-90fb-a1c0c53fa6fc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.483930 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f6250474-03d8-4f8c-a0b1-53cfad1fce25 req-f986659a-f8a4-49ea-90fb-a1c0c53fa6fc service nova] Creating event network-vif-plugged:c846280a-8147-4e8c-bb8f-73673321d454 for instance aae59656-69ab-4136-adeb-885957bc32fb on nch2-master-1 May 07 22:05:39.500098 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f6250474-03d8-4f8c-a0b1-53cfad1fce25 req-f986659a-f8a4-49ea-90fb-a1c0c53fa6fc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062162 May 07 22:05:39.502296 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2391/4831] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:05:39.828774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:39.830536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:39.837817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:39.838595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.839619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:39.840283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:39.996569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:40.005395 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c59718d6-0972-4f0b-8e7f-92b6a2453ea1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.181211 May 07 22:05:40.006086 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2441/4832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:39 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:40.332705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:40.333416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:40.340627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:40.341081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:40.341852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:40.342291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:40.442505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:40.443355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:40.449960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:40.452586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:40.453549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:40.454170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:40.525312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:40.535921 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a242a0f-c2aa-4bc2-b670-999737dfbae0 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1503 microversion: 2.1 time: 0.207398 May 07 22:05:40.536756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2392/4833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:40 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:40.643585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:40.651707 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2f2c9dfc-e533-49d4-8f99-b6c846c5445d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1367 microversion: 2.1 time: 0.215675 May 07 22:05:40.652824 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2442/4834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:40 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:41.024823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:41.025457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:41.037269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.037663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.038497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.039044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.181596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:41.190619 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2c74841c-d1d7-4766-a16e-76b95797db8a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.170750 May 07 22:05:41.191278 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2393/4835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:41 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:41.556920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:41.558765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:41.567393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.573312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.575891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.578623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.670412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:41.672525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:41.680827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.682233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.683541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.684225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.833803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:41.842148 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0f90db7f-83a9-4f10-b6ad-116b335cf12d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.290975 May 07 22:05:41.848503 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2443/4836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:41 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:41.866296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:41.867132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:41.873426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.874015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.879109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:41.879786 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:41.964198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:41.976666 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9e93e20f-4993-4279-af2a-aaf362ffb0e8 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1557 microversion: 2.1 time: 0.311492 May 07 22:05:41.977540 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2394/4837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:41 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1557 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:42.001183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b30aa04-a283-4af7-8ec8-6c62cea5a92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:42.001962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5b30aa04-a283-4af7-8ec8-6c62cea5a92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:42.020292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b30aa04-a283-4af7-8ec8-6c62cea5a92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.021259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b30aa04-a283-4af7-8ec8-6c62cea5a92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.022344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b30aa04-a283-4af7-8ec8-6c62cea5a92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.023848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b30aa04-a283-4af7-8ec8-6c62cea5a92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.054304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:42.070197 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-465720fe-5eb8-4244-8734-d302fa2dda80 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.208648 May 07 22:05:42.071961 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2444/4838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:41 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:42.096175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-583b39d8-ff5b-4bdd-aaf2-b6923ad83b8a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:42.097192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-583b39d8-ff5b-4bdd-aaf2-b6923ad83b8a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: c8595ed7-ba6a-4bf1-b244-c75f5008f90d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:42.104852 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-583b39d8-ff5b-4bdd-aaf2-b6923ad83b8a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance c8595ed7-ba6a-4bf1-b244-c75f5008f90d could not be found. May 07 22:05:42.106092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-583b39d8-ff5b-4bdd-aaf2-b6923ad83b8a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance c8595ed7-ba6a-4bf1-b244-c75f5008f90d could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:42.107495 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-583b39d8-ff5b-4bdd-aaf2-b6923ad83b8a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/c8595ed7-ba6a-4bf1-b244-c75f5008f90d/action" status: 404 len: 111 microversion: 2.1 time: 0.017744 May 07 22:05:42.108663 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2445/4839] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:42 2022] POST /compute/v2.1/servers/c8595ed7-ba6a-4bf1-b244-c75f5008f90d/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:42.118037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:42.119601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:42.131551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.132637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.133934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.134847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.283712 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b30aa04-a283-4af7-8ec8-6c62cea5a92d tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.293894 May 07 22:05:42.289771 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2395/4840] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:05:41 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-interface => generated 284 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:05:42.290848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:42.291678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:42.305534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.306213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.307238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.307876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.589168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:42.598485 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b55e603-5baf-453b-b1cd-98f44df43e43 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1736 microversion: 2.1 time: 0.312407 May 07 22:05:42.599548 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2396/4841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:42 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1736 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:42.601835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:42.609486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-08e89659-ccf9-4a91-b1fb-0449cb64b92e tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.496692 May 07 22:05:42.611216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2446/4842] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:42 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:42.628909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:42.629522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:42.636599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.637063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.637884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.638404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.896638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:42.907530 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-701e3d76-e20f-418f-9e6d-6bb85876b0bf tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.281552 May 07 22:05:42.908433 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2397/4843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:42 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:42.925231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:42.926053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:42.932552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.933008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.934068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.934519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.959237 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Cannot 'unpause' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active May 07 22:05:42.960136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 409 to user: Cannot 'unpause' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:42.960997 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9967f68c-fe90-4f76-ad36-5d72e3656a40 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 409 len: 145 microversion: 2.1 time: 0.040622 May 07 22:05:42.961557 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2447/4844] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:42 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 145 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:05:42.970267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:42.970921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:42.977127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.977778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:42.978570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:42.979045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:43.300098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:43.315914 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d1552f51-7b53-4a59-88f7-09a28cfeb218 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.342209 May 07 22:05:43.323250 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2398/4845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:42 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:43.340566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:43.341442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:43.348168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:43.348629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:43.349627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:43.350079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:43.616738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:43.617596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:43.628156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:43.629329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:43.630417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:43.631239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.021337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:44.032524 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce6c297e-0984-4179-a044-d7f9442f6f60 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1716 microversion: 2.1 time: 0.419465 May 07 22:05:44.035752 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2399/4846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:43 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1716 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:44.137481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:44.177682 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6cb7d59-428c-4798-b841-2cf46bc3eeb7 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.835994 May 07 22:05:44.178873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:44.179564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:44.181735 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2448/4847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:43 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:44.194379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0708e10e-e755-47f4-8a6b-d8e689606b8b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:44.194682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.195088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0708e10e-e755-47f4-8a6b-d8e689606b8b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 1db24c4b-7e5a-4bc3-b12e-32c292628e9f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:44.195833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.197134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.197730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.217865 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0708e10e-e755-47f4-8a6b-d8e689606b8b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 1db24c4b-7e5a-4bc3-b12e-32c292628e9f could not be found. May 07 22:05:44.218487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0708e10e-e755-47f4-8a6b-d8e689606b8b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 1db24c4b-7e5a-4bc3-b12e-32c292628e9f could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:44.219381 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0708e10e-e755-47f4-8a6b-d8e689606b8b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/1db24c4b-7e5a-4bc3-b12e-32c292628e9f/action" status: 404 len: 111 microversion: 2.1 time: 0.029353 May 07 22:05:44.223448 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2449/4848] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:44 2022] POST /compute/v2.1/servers/1db24c4b-7e5a-4bc3-b12e-32c292628e9f/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:44.229029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:44.229661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:44.241373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.241835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.242688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.243117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.348353 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Cannot 'detach_volume' instance 9df2668b-af6b-4323-a4a4-520fcae8e55e while it is in vm_state rescued May 07 22:05:44.348979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 409 to user: Cannot 'detach_volume' instance 9df2668b-af6b-4323-a4a4-520fcae8e55e while it is in vm_state rescued {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:44.351136 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-da5151b5-3a48-458c-95e4-3c9e32d063f3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments/c1f1602a-c13f-4f22-870b-54705d29081f" status: 409 len: 152 microversion: 2.1 time: 0.175416 May 07 22:05:44.352611 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2400/4849] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:05:44 2022] DELETE /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments/c1f1602a-c13f-4f22-870b-54705d29081f => generated 152 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:05:44.377112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5bec2ef-8e07-464e-8333-8bf09f592da8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:44.379757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a5bec2ef-8e07-464e-8333-8bf09f592da8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:44.395680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5bec2ef-8e07-464e-8333-8bf09f592da8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.396146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5bec2ef-8e07-464e-8333-8bf09f592da8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.396949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5bec2ef-8e07-464e-8333-8bf09f592da8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.397395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5bec2ef-8e07-464e-8333-8bf09f592da8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.522605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5bec2ef-8e07-464e-8333-8bf09f592da8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/action" status: 202 len: 0 microversion: 2.1 time: 0.165214 May 07 22:05:44.528243 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2401/4850] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:44 2022] POST /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:05:44.536356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ae018265-26db-4461-9e9e-9b3c7277b7c6 req-026284da-430a-4ce5-8098-3416fc8e9789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae59656-69ab-4136-adeb-885957bc32fb", "tag": "c846280a-8147-4e8c-bb8f-73673321d454"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:44.548519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ae018265-26db-4461-9e9e-9b3c7277b7c6 req-026284da-430a-4ce5-8098-3416fc8e9789 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.551608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ae018265-26db-4461-9e9e-9b3c7277b7c6 req-026284da-430a-4ce5-8098-3416fc8e9789 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.575915 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ae018265-26db-4461-9e9e-9b3c7277b7c6 req-026284da-430a-4ce5-8098-3416fc8e9789 service nova] Creating event network-changed:c846280a-8147-4e8c-bb8f-73673321d454 for instance aae59656-69ab-4136-adeb-885957bc32fb on nch2-master-1 May 07 22:05:44.585842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ae018265-26db-4461-9e9e-9b3c7277b7c6 req-026284da-430a-4ce5-8098-3416fc8e9789 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054527 May 07 22:05:44.587104 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2402/4851] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:44.597682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:44.599797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:44.609688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.610639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.611958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.612527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.672595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:44.681069 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff1dc99d-8ea5-4f6a-969b-8b683f5b273f tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.456316 May 07 22:05:44.690932 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2450/4852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:44 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:44.702904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:44.704457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:44.715249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.716120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.717821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:44.720752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:44.980274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:44.995655 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-daca0d98-9540-4672-be0c-0db9192046b6 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.296303 May 07 22:05:44.996957 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2451/4853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:44 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:45.012995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:45.013868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:45.020815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.021495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.023673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.024540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.074361 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Cannot 'unshelve' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active May 07 22:05:45.076629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 409 to user: Cannot 'unshelve' instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 while it is in vm_state active {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:45.077888 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-736a66ee-d3ba-40b0-980b-21bd221c6c50 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action" status: 409 len: 146 microversion: 2.1 time: 0.068924 May 07 22:05:45.084964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2452/4854] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:05:45 2022] POST /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6/action => generated 146 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 07 22:05:45.092445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:45.094142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:45.103722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.105345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.106330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.108357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.124934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:45.139460 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be8a6f26-fc65-480f-a794-280b46837db4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1724 microversion: 2.1 time: 0.550925 May 07 22:05:45.140064 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2403/4855] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:44 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1724 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:45.371241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:45.382221 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04a6bdc7-3b72-4bd4-95ab-076338963386 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.294660 May 07 22:05:45.383472 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2453/4856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:45 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:45.401103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:45.402256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:45.416578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.418988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.420600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.424142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.623410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aa4086f7-e095-4972-a30d-17eb2208eada tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'create', calling method: .version_select at 0x7fc40fca89d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-947053967"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:45.640507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-aa4086f7-e095-4972-a30d-17eb2208eada tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:05:45.647057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-aa4086f7-e095-4972-a30d-17eb2208eada tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:05:45.830417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:45.843951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9add5ad1-6809-4a12-a9d4-9e60bcc7848a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.447912 May 07 22:05:45.845497 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2404/4857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:45 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:45.861151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e8046bc3-c9da-4bd7-883a-2547d5fc4bdb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1740763442_updated"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:45.862373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e8046bc3-c9da-4bd7-883a-2547d5fc4bdb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2a9eb835-0e7e-445f-b46a-c724df9e269c] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:45.870656 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e8046bc3-c9da-4bd7-883a-2547d5fc4bdb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 2a9eb835-0e7e-445f-b46a-c724df9e269c could not be found. May 07 22:05:45.872063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e8046bc3-c9da-4bd7-883a-2547d5fc4bdb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 2a9eb835-0e7e-445f-b46a-c724df9e269c could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:45.872926 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e8046bc3-c9da-4bd7-883a-2547d5fc4bdb tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "PUT /compute/v2.1/servers/2a9eb835-0e7e-445f-b46a-c724df9e269c" status: 404 len: 111 microversion: 2.1 time: 0.016317 May 07 22:05:45.873530 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2405/4858] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 22:05:45 2022] PUT /compute/v2.1/servers/2a9eb835-0e7e-445f-b46a-c724df9e269c => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:45.881901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:45.890865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:45.921191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.929076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.930036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:45.930711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:45.939377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-aa4086f7-e095-4972-a30d-17eb2208eada tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:05:45.946880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-aa4086f7-e095-4972-a30d-17eb2208eada tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:05:45.964444 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aa4086f7-e095-4972-a30d-17eb2208eada tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.346497 May 07 22:05:45.971149 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2454/4859] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:05:45 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:46.160610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:46.162610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:46.175779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:46.176569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:46.181184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:46.182309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:46.336898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:46.350600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-812c03a0-7947-4f80-baf7-97289020dea4 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.472374 May 07 22:05:46.351245 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2406/4860] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:45 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:46.373779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:46.374462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:46.390070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:46.391617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:46.392454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:46.392909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:46.594219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:46.604703 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-834e2779-7c6b-4451-ba34-628e355f3319 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1724 microversion: 2.1 time: 0.449802 May 07 22:05:46.616427 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2455/4861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:46 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1724 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:46.952958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:46.966099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6c44f0fe-2550-4894-812a-98a7c11ab6ab tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.599267 May 07 22:05:46.967226 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2407/4862] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:46 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:46.984680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3cded9c7-9ec7-4a84-9fba-f6a1db57682a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:46.986488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3cded9c7-9ec7-4a84-9fba-f6a1db57682a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:46.987606 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3cded9c7-9ec7-4a84-9fba-f6a1db57682a tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "PUT /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 400 len: 619 microversion: 2.1 time: 0.007039 May 07 22:05:46.988715 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2456/4863] 10.222.0.32 () {60 vars in 1256 bytes} [Sat May 7 22:05:46 2022] PUT /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:05:46.998761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:46.999540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:47.006817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:47.007546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:47.009575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:47.010187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:47.320407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:47.333655 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-952bb40e-df4d-4440-8e15-4853b007975c tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.340405 May 07 22:05:47.334260 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2408/4864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:46 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:47.353118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:47.353745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:47.364052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:47.364882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:47.365881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:47.366487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:47.625536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:47.625536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:47.639059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:47.639666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:47.642972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:47.643547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:48.186848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:48.194727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-50d5ac01-a523-4e08-ac84-d6e6ab0b32ff tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.846263 May 07 22:05:48.196097 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2457/4865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:47 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:48.223102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d212476c-7a2d-42d1-9db7-a2efddc8c54d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:48.226544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d212476c-7a2d-42d1-9db7-a2efddc8c54d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:48.227694 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d212476c-7a2d-42d1-9db7-a2efddc8c54d tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "PUT /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 400 len: 108 microversion: 2.1 time: 0.014291 May 07 22:05:48.232979 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2458/4866] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 22:05:48 2022] PUT /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:05:48.255381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:48.256350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:48.270363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:48.276508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:48.278323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:48.280048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:48.346732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:48.375845 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6e0d40a4-9779-447b-ba84-e7c6ca75b0f8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1724 microversion: 2.1 time: 0.753528 May 07 22:05:48.380770 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2409/4867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:47 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1724 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:48.633315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:48.656724 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3dc34477-07b1-4f59-84ea-c798f661a3d3 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1506 microversion: 2.1 time: 0.420913 May 07 22:05:48.658326 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2459/4868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:48 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1506 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:48.742469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1994607790", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "92fb32be-a7e7-4bc8-b8a6-5ec911c8daec"}], "key_name": "tempest-TestNetworkBasicOps-947053967", "security_groups": [{"name": "tempest-secgroup-smoke-1137902148"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:49.065335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] validate_networks() for [('92fb32be-a7e7-4bc8-b8a6-5ec911c8daec', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:05:49.397668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:49.399047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:49.410303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:49.410854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:49.416141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:49.416612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:49.714358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:49.724041 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-11fb51b6-6d09-43c6-b3fb-3bebaa1d50bc tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1730 microversion: 2.1 time: 0.329537 May 07 22:05:49.725092 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2460/4869] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:49 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:49.742887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-99d9a1ef-0d07-4cc8-a604-d7494adf53ae tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:49.743598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-99d9a1ef-0d07-4cc8-a604-d7494adf53ae tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:49.754588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d9a1ef-0d07-4cc8-a604-d7494adf53ae tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:49.755412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d9a1ef-0d07-4cc8-a604-d7494adf53ae tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:49.756559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d9a1ef-0d07-4cc8-a604-d7494adf53ae tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:49.757064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d9a1ef-0d07-4cc8-a604-d7494adf53ae tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:49.813921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:05:49.814584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:05:49.815320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:05:49.815840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:05:49.816359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:05:49.827117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:49.827978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:49.829444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:49.831889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:49.875628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:05:49.883967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:05:49.902273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:05:49.905622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:05:49.924400 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-99d9a1ef-0d07-4cc8-a604-d7494adf53ae tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186007 May 07 22:05:49.925012 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2461/4870] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:05:49 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:05:49.999336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a5cb2a5-016f-48f3-9a42-84a00cebc28c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.260705 May 07 22:05:50.011606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57a3d6e8-3b8a-4c3d-9667-1ae6ab60ac81 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:50.012392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57a3d6e8-3b8a-4c3d-9667-1ae6ab60ac81 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:50.019183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2410/4871] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:05:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:05:50.255771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57a3d6e8-3b8a-4c3d-9667-1ae6ab60ac81 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:50.264064 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57a3d6e8-3b8a-4c3d-9667-1ae6ab60ac81 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1248 microversion: 2.1 time: 0.256316 May 07 22:05:50.267328 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2462/4872] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:50 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1248 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:51.136803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:51.139065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:51.168472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.171038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.173436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.175303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.219792 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. May 07 22:05:51.223409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:51.224301 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-35ad4f69-ccb1-4de0-8e86-ab893b17d1cc tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 404 len: 111 microversion: 2.1 time: 0.102290 May 07 22:05:51.235930 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2411/4873] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:05:51 2022] DELETE /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:51.240249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:51.241436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: 2f8493ed-ecbc-4c5d-b60d-da501dd918ee] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:51.263040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.263825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.265195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.265799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.286921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:51.287626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:51.300961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.302053 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. May 07 22:05:51.302716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance 2f8493ed-ecbc-4c5d-b60d-da501dd918ee could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:51.306017 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8358a959-52c1-4b2c-a6a7-d8d44ab5e301 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee" status: 404 len: 111 microversion: 2.1 time: 0.070035 May 07 22:05:51.309839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.310453 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2463/4874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:51 2022] GET /compute/v2.1/servers/2f8493ed-ecbc-4c5d-b60d-da501dd918ee => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:51.318071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.319350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.327582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:51.328103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:51.341362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.341827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.343649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.345001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.404781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:05:51.454663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:51.464244 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-42fa15a1-8282-437b-af0b-e1ae3b9bfd7b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1300 microversion: 2.1 time: 0.183351 May 07 22:05:51.465374 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2412/4875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:51 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:51.553699 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f2ed6c15-a022-4644-99a8-4c28718da86b tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 204 len: 0 microversion: 2.1 time: 0.241079 May 07 22:05:51.554349 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2464/4876] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:05:51 2022] DELETE /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:05:51.563937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:51.564682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:51.576435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.599459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.602327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:51.604087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:51.899411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:51.910629 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79e4803e-44c5-4ebc-af54-ffa0c177db32 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.350382 May 07 22:05:51.911805 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2413/4877] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:51 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:52.221102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-11ade5dd-aef2-4a3b-8c2e-b57e298d0251 req-c82d8bc8-22f4-4c09-b73f-ca9e58926e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df2668b-af6b-4323-a4a4-520fcae8e55e", "tag": "26735917-c705-4821-b89b-e6f718fdc166"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:52.238845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-11ade5dd-aef2-4a3b-8c2e-b57e298d0251 req-c82d8bc8-22f4-4c09-b73f-ca9e58926e43 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:52.241330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-11ade5dd-aef2-4a3b-8c2e-b57e298d0251 req-c82d8bc8-22f4-4c09-b73f-ca9e58926e43 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:52.260459 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-11ade5dd-aef2-4a3b-8c2e-b57e298d0251 req-c82d8bc8-22f4-4c09-b73f-ca9e58926e43 service nova] Creating event network-changed:26735917-c705-4821-b89b-e6f718fdc166 for instance 9df2668b-af6b-4323-a4a4-520fcae8e55e on nch2-master-1 May 07 22:05:52.269402 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-11ade5dd-aef2-4a3b-8c2e-b57e298d0251 req-c82d8bc8-22f4-4c09-b73f-ca9e58926e43 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062362 May 07 22:05:52.270511 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2465/4878] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:52.490491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:52.491754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:52.500073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:52.501847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:52.502932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:52.503595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:52.614488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:52.622608 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4cc24d8-c632-4874-9143-75e6cec2b19a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1308 microversion: 2.1 time: 0.144132 May 07 22:05:52.626716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2414/4879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:52 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:52.928278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:52.929309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:52.939268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:52.942548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:52.943659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:52.944106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:53.643921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:53.644562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:53.659092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:53.661552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:53.662753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:53.664673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:53.757045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:53.762427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:53.770096 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed3f8ccd-b48c-47fa-90e6-effd63a52318 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1306 microversion: 2.1 time: 0.130221 May 07 22:05:53.773587 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2415/4880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:53 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1306 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:05:53.774972 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67070f98-47d4-4ee3-92ab-28ee0a736644 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1512 microversion: 2.1 time: 0.851120 May 07 22:05:53.776930 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2466/4881] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:52 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1512 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:54.295772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-52741c6a-e32d-419b-9606-16457cc82673 req-5ccdaa32-21ab-4d30-bd01-308801f38083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df2668b-af6b-4323-a4a4-520fcae8e55e", "tag": "26735917-c705-4821-b89b-e6f718fdc166"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:54.306209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-52741c6a-e32d-419b-9606-16457cc82673 req-5ccdaa32-21ab-4d30-bd01-308801f38083 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:54.306996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-52741c6a-e32d-419b-9606-16457cc82673 req-5ccdaa32-21ab-4d30-bd01-308801f38083 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:54.319024 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-52741c6a-e32d-419b-9606-16457cc82673 req-5ccdaa32-21ab-4d30-bd01-308801f38083 service nova] Creating event network-changed:26735917-c705-4821-b89b-e6f718fdc166 for instance 9df2668b-af6b-4323-a4a4-520fcae8e55e on nch2-master-1 May 07 22:05:54.326345 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-52741c6a-e32d-419b-9606-16457cc82673 req-5ccdaa32-21ab-4d30-bd01-308801f38083 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034092 May 07 22:05:54.326965 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2416/4882] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:54.789339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:54.797012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:54.798703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:54.799540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:54.820071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:54.820424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:54.821516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:54.822045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:54.824022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:54.824857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:54.825100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:54.825824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:54.881071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:54.881874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:54.882544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lazy-loading 'fault' on Instance uuid ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:05:54.983517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6abaee58e2540e090b6f53b6f6ef587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:54.992382 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fb3c9f6-1ec0-4088-b4b8-96cb1cfd5641 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 200 len: 1306 microversion: 2.1 time: 0.199912 May 07 22:05:55.002796 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2417/4883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:54 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:55.275016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:55.284724 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f005c9d-8f8f-45c6-b312-c26a909e279a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.500018 May 07 22:05:55.301765 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2467/4884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:54 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:56.012321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:56.013942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] [instance: ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:56.039119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:56.039899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:56.040737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:56.041193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:56.080598 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] HTTP exception thrown: Instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 could not be found. May 07 22:05:56.081426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] Returning 404 to user: Instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:05:56.082599 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e7048876-9ee2-4330-b244-f2d614791e39 tempest-ServersNegativeTestJSON-282814339 tempest-ServersNegativeTestJSON-282814339-project] 10.222.0.32 "GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6" status: 404 len: 111 microversion: 2.1 time: 0.074931 May 07 22:05:56.083315 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2418/4885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:56 2022] GET /compute/v2.1/servers/ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:05:56.305403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:56.306903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:56.321751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:56.322390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:56.324751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:56.325188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:56.385394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4f14b6f4-bee3-42a5-ad77-1ffcc92042d4 req-5fd98077-a2b8-40b0-8661-15aa5ecb1156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6", "name": "network-vif-deleted", "tag": "49671dbb-1f39-4903-a9e1-e283831ec748"}, {"name": "network-changed", "server_uuid": "d67c9a54-a13e-4b6a-9db5-7bf57397edbb", "tag": "589e4dcc-4385-4a17-8792-2bf6dcbf7136"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:05:56.396469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4f14b6f4-bee3-42a5-ad77-1ffcc92042d4 req-5fd98077-a2b8-40b0-8661-15aa5ecb1156 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:56.399610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4f14b6f4-bee3-42a5-ad77-1ffcc92042d4 req-5fd98077-a2b8-40b0-8661-15aa5ecb1156 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:56.425679 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4f14b6f4-bee3-42a5-ad77-1ffcc92042d4 req-5fd98077-a2b8-40b0-8661-15aa5ecb1156 service nova] Creating event network-vif-deleted:49671dbb-1f39-4903-a9e1-e283831ec748 for instance ca4bc3b4-d00f-4bb1-9a10-c434dde6caf6 on nch1-master-1 May 07 22:05:56.426561 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4f14b6f4-bee3-42a5-ad77-1ffcc92042d4 req-5fd98077-a2b8-40b0-8661-15aa5ecb1156 service nova] Creating event network-changed:589e4dcc-4385-4a17-8792-2bf6dcbf7136 for instance d67c9a54-a13e-4b6a-9db5-7bf57397edbb on nch1-master-1 May 07 22:05:56.434285 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4f14b6f4-bee3-42a5-ad77-1ffcc92042d4 req-5fd98077-a2b8-40b0-8661-15aa5ecb1156 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053466 May 07 22:05:56.435988 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2419/4886] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:05:56.649491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:56.664897 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-191880c2-e071-4379-b545-152126d6e888 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.362218 May 07 22:05:56.666510 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2468/4887] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:56 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:57.684632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:57.685943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:57.693159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:57.693895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:57.694980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:57.696002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:58.187631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:58.197415 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.519207 May 07 22:05:58.198284 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2420/4888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:57 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:59.215975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:59.217162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:05:59.229057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:59.250309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:59.252104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:05:59.255403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:05:59.604838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:05:59.620563 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c3e0b5ad-b7f7-46e7-b689-6f54130eb366 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.408627 May 07 22:05:59.632739 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2469/4889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:05:59 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:05:59.888650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:05:59.890183 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b89491bb-5ce7-4bf1-a01e-62c05de624ef tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001865 May 07 22:05:59.890527 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2421/4890] 10.222.0.32 () {56 vars in 885 bytes} [Sat May 7 22:05:59 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 07 22:06:00.638833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:00.639533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:00.667937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:00.682042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:00.683614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:00.684834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:00.923750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:00.933538 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-06171ca9-e8c3-4a0d-9080-3c449ecd49bf tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.298943 May 07 22:06:00.934419 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2470/4891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:00 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:01.777543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fa5aba5-8561-46ff-b2a0-c055a74f5ed3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:01.779425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fa5aba5-8561-46ff-b2a0-c055a74f5ed3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:01.823885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fa5aba5-8561-46ff-b2a0-c055a74f5ed3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:01.826417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fa5aba5-8561-46ff-b2a0-c055a74f5ed3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:01.829194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fa5aba5-8561-46ff-b2a0-c055a74f5ed3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:01.833090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fa5aba5-8561-46ff-b2a0-c055a74f5ed3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:01.951320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:01.952114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:01.974410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:01.976830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:01.979755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:01.981667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:02.014684 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fa5aba5-8561-46ff-b2a0-c055a74f5ed3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.244021 May 07 22:06:02.016643 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2422/4892] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:06:01 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:06:02.031022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:02.035100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:02.054677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:02.056556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:02.059638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:02.061650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:02.300145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:02.308525 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8890dac3-f217-44f5-9ef2-09a6b695b21e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.361214 May 07 22:06:02.319768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2471/4893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:01 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:02.498549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:02.510596 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6322d69c-010f-45f2-8aff-f5271c3e8d59 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1671 microversion: 2.1 time: 0.486088 May 07 22:06:02.511272 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2423/4894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:02 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1671 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:03.141482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd438f86-133d-4d17-b5bf-b6a133c3087c tempest-ExtensionsTest-1687163743 tempest-ExtensionsTest-1687163743-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:03.143827 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd438f86-133d-4d17-b5bf-b6a133c3087c tempest-ExtensionsTest-1687163743 tempest-ExtensionsTest-1687163743-project] 10.222.0.32 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.275996 May 07 22:06:03.145466 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2472/4895] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 22:06:02 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:03.156695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3d65e34-25f9-4b8c-abea-1eab9d24abd0 tempest-ExtensionsTest-1687163743 tempest-ExtensionsTest-1687163743-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:03.160230 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3d65e34-25f9-4b8c-abea-1eab9d24abd0 tempest-ExtensionsTest-1687163743 tempest-ExtensionsTest-1687163743-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.009705 May 07 22:06:03.162123 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2424/4896] 10.222.0.32 () {58 vars in 1133 bytes} [Sat May 7 22:06:03 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:06:03.336301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:03.336952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:03.358491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:03.359137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:03.364482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:03.364879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:03.529967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:03.531032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:03.547779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:03.548398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:03.549708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:03.551176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:03.804947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:03.839774 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2da67b60-2509-46ab-bf1d-0c19fa411ea6 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.507252 May 07 22:06:03.841277 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2473/4897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:03 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:04.011297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:04.044800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f88bd859-f1c5-4732-896b-ef474aded2fd tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1671 microversion: 2.1 time: 0.518186 May 07 22:06:04.047562 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2425/4898] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:03 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1671 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:04.718650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6b47b789-97a8-455b-b750-06e6ac8b9dec req-cb2ecefe-9de7-4229-b2dd-d3eae9dfb3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67c9a54-a13e-4b6a-9db5-7bf57397edbb", "name": "network-vif-plugged", "status": "completed", "tag": "589e4dcc-4385-4a17-8792-2bf6dcbf7136"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:04.731830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6b47b789-97a8-455b-b750-06e6ac8b9dec req-cb2ecefe-9de7-4229-b2dd-d3eae9dfb3e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:04.733379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6b47b789-97a8-455b-b750-06e6ac8b9dec req-cb2ecefe-9de7-4229-b2dd-d3eae9dfb3e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:04.765254 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6b47b789-97a8-455b-b750-06e6ac8b9dec req-cb2ecefe-9de7-4229-b2dd-d3eae9dfb3e1 service nova] Creating event network-vif-plugged:589e4dcc-4385-4a17-8792-2bf6dcbf7136 for instance d67c9a54-a13e-4b6a-9db5-7bf57397edbb on nch1-master-1 May 07 22:06:04.780619 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6b47b789-97a8-455b-b750-06e6ac8b9dec req-cb2ecefe-9de7-4229-b2dd-d3eae9dfb3e1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067167 May 07 22:06:04.781255 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2474/4899] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:04.857705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:04.858490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:04.873992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:04.874631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:04.880576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:04.881345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:05.065205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:05.067713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:05.088012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:05.090039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:05.094429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:05.095180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:05.137493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:05.149445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1c8d3c76-8058-4e93-ab8d-c6375a9dece8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.295794 May 07 22:06:05.154072 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2426/4900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:04 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:05.477028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:05.495505 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c57ee64-358f-4ff4-ace1-0a29f0f64da8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.434274 May 07 22:06:05.497367 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2475/4901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:05 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:06.167525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:06.168169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:06.190225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:06.190710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:06.204446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:06.204715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:06.555993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:06.567025 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0f8dcc68-d6af-4d32-baae-53e1c0b87d6c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1374 microversion: 2.1 time: 0.404534 May 07 22:06:06.567616 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2427/4902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:06 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1374 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:07.585447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:07.586070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:07.595798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:07.596274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:07.597283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:07.597891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:07.837694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:07.857534 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-926fb6a8-8199-4412-bc9b-4405a4686c58 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1546 microversion: 2.1 time: 0.276430 May 07 22:06:07.859146 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2476/4903] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:07 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1546 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:07.878100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:07.887220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:07.894519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:07.895278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:07.896264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:07.896922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:08.071895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:08.083005 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c1b5daf-d014-4136-a694-821d2ab4552f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1546 microversion: 2.1 time: 0.211895 May 07 22:06:08.085509 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2428/4904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:07 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1546 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:11.086127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] Calling method '.version_select at 0x7fc40fc61040>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:11.088853 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:11.088853 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:06:11.091186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:11.092048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:11.123775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:11.124498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:11.135807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:11.136614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:11.144419 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-845fc454-5040-4d40-b8f5-528fc8cdc1f5 tempest-PortsAdminExtendedAttrsTestJSON-1265889352 tempest-PortsAdminExtendedAttrsTestJSON-1265889352-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.456937 May 07 22:06:11.145799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2477/4905] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 22:06:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:06:19.387509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d402ed03-50ec-4747-9552-ae5ca6246e58 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:19.388059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d402ed03-50ec-4747-9552-ae5ca6246e58 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:19.398732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d402ed03-50ec-4747-9552-ae5ca6246e58 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:19.399286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d402ed03-50ec-4747-9552-ae5ca6246e58 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:19.400017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d402ed03-50ec-4747-9552-ae5ca6246e58 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:19.400773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d402ed03-50ec-4747-9552-ae5ca6246e58 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:19.433730 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d402ed03-50ec-4747-9552-ae5ca6246e58 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/ips" status: 200 len: 150 microversion: 2.1 time: 0.418904 May 07 22:06:19.434282 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2429/4906] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:06:19 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/ips => generated 150 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:20.820519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5918e1f8-56b4-47a0-9fdb-561562c08263"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:20.824709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:20.830569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:20.831077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:20.831883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:20.832336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:21.098037 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-25b0c769-5bf3-4cb0-8a6c-f65de33d7638 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "POST /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281268 May 07 22:06:21.098679 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2478/4907] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:06:20 2022] POST /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:22.583769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:22.584274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:22.592076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:22.592721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:22.594302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:22.594993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:22.706268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lazy-loading 'services' on Instance uuid 9df2668b-af6b-4323-a4a4-520fcae8e55e {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:06:22.822225 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1c1fd8e3-7462-4b2e-ba74-080312c7aa39 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments/c1f1602a-c13f-4f22-870b-54705d29081f" status: 202 len: 0 microversion: 2.1 time: 0.242172 May 07 22:06:22.823432 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2430/4908] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:06:22 2022] DELETE /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments/c1f1602a-c13f-4f22-870b-54705d29081f => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:06:22.839191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5a7e1c86-eb64-4dd0-9c03-cb0e59df93e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:22.840437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5a7e1c86-eb64-4dd0-9c03-cb0e59df93e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:22.849704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a7e1c86-eb64-4dd0-9c03-cb0e59df93e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:22.850172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a7e1c86-eb64-4dd0-9c03-cb0e59df93e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:22.851004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a7e1c86-eb64-4dd0-9c03-cb0e59df93e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:22.851451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a7e1c86-eb64-4dd0-9c03-cb0e59df93e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:22.902809 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5a7e1c86-eb64-4dd0-9c03-cb0e59df93e3 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073140 May 07 22:06:22.903751 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2479/4909] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:22 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:23.922446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aac9ee63-84f4-4d01-bb93-873491597690 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:23.924344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aac9ee63-84f4-4d01-bb93-873491597690 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:23.932280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aac9ee63-84f4-4d01-bb93-873491597690 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:23.933289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aac9ee63-84f4-4d01-bb93-873491597690 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:23.934479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aac9ee63-84f4-4d01-bb93-873491597690 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:23.936165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aac9ee63-84f4-4d01-bb93-873491597690 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:23.975378 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aac9ee63-84f4-4d01-bb93-873491597690 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063390 May 07 22:06:23.975973 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2431/4910] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:23 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:24.553958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:24.554510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:24.561569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:24.562276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:24.563249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:24.563853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:24.677355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lazy-loading 'services' on Instance uuid aae59656-69ab-4136-adeb-885957bc32fb {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:06:24.776560 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d459c60-38bf-4b34-beca-c81b98658fb5 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments/5918e1f8-56b4-47a0-9fdb-561562c08263" status: 202 len: 0 microversion: 2.1 time: 0.226527 May 07 22:06:24.777341 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2480/4911] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:06:24 2022] DELETE /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments/5918e1f8-56b4-47a0-9fdb-561562c08263 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:06:24.786432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4bb6e1b-f090-4679-a15b-82094603e698 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:24.787406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d4bb6e1b-f090-4679-a15b-82094603e698 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:24.793648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4bb6e1b-f090-4679-a15b-82094603e698 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:24.794121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4bb6e1b-f090-4679-a15b-82094603e698 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:24.795090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4bb6e1b-f090-4679-a15b-82094603e698 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:24.795528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4bb6e1b-f090-4679-a15b-82094603e698 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:24.839476 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d4bb6e1b-f090-4679-a15b-82094603e698 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057553 May 07 22:06:24.846206 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2432/4912] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:24 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:24.987356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af8cd410-593f-4f57-b649-9988b7d28822 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:24.988383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af8cd410-593f-4f57-b649-9988b7d28822 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:24.995301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8cd410-593f-4f57-b649-9988b7d28822 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:24.995939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8cd410-593f-4f57-b649-9988b7d28822 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:24.996872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8cd410-593f-4f57-b649-9988b7d28822 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:24.997465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af8cd410-593f-4f57-b649-9988b7d28822 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.030457 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af8cd410-593f-4f57-b649-9988b7d28822 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047304 May 07 22:06:25.032061 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2481/4913] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:24 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 07 22:06:25.106948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:25.107978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:25.115162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.115611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.116593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.117129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.145663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Cannot 'reboot' instance 7872598a-70de-4e95-af09-8b55fd257508 while it is in vm_state rescued May 07 22:06:25.146271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 409 to user: Cannot 'reboot' instance 7872598a-70de-4e95-af09-8b55fd257508 while it is in vm_state rescued {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:25.147155 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec2ce31c-e714-4b2f-9d45-7f4c851c958a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508/action" status: 409 len: 145 microversion: 2.1 time: 0.044361 May 07 22:06:25.147922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2433/4914] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:06:25 2022] POST /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508/action => generated 145 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:06:25.157722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:25.159742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:25.166494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.167002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.167789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.168385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.195544 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Cannot 'rebuild' instance 7872598a-70de-4e95-af09-8b55fd257508 while it is in vm_state rescued May 07 22:06:25.196365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 409 to user: Cannot 'rebuild' instance 7872598a-70de-4e95-af09-8b55fd257508 while it is in vm_state rescued {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:25.197379 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8cca7df2-47b4-4e2f-b91c-0bb1ac4f1e9e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "POST /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508/action" status: 409 len: 146 microversion: 2.1 time: 0.044245 May 07 22:06:25.198414 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2482/4915] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:06:25 2022] POST /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508/action => generated 146 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 07 22:06:25.208518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:25.209191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:25.216518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.217377 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.219053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.220849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.247046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:06:25.336411 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-387a66f1-9862-473a-aea5-d93cdf54993f tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 204 len: 0 microversion: 2.1 time: 0.131727 May 07 22:06:25.339964 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2434/4916] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:25 2022] DELETE /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:06:25.348944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:25.352093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:25.359065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.359839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.360911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.361544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.623072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:25.632440 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9f789cb-1601-4569-a588-de6c44cadff2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1690 microversion: 2.1 time: 0.288033 May 07 22:06:25.633602 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2483/4917] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:25 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1690 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:25.852366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97b7e026-8094-4ff9-9adf-05e1908a2653 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:25.853682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97b7e026-8094-4ff9-9adf-05e1908a2653 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:25.863319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97b7e026-8094-4ff9-9adf-05e1908a2653 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.864034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97b7e026-8094-4ff9-9adf-05e1908a2653 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.865009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97b7e026-8094-4ff9-9adf-05e1908a2653 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:25.865461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97b7e026-8094-4ff9-9adf-05e1908a2653 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:25.905931 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97b7e026-8094-4ff9-9adf-05e1908a2653 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057911 May 07 22:06:25.906961 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2435/4918] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:25 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:26.651308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:26.653406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:26.661321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:26.662106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:26.663262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:26.663927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:26.923356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c119c9c8-5796-4e18-877a-7f26ae108612 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:26.925817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c119c9c8-5796-4e18-877a-7f26ae108612 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:26.942019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119c9c8-5796-4e18-877a-7f26ae108612 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:26.942759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119c9c8-5796-4e18-877a-7f26ae108612 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:26.943393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:26.943756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119c9c8-5796-4e18-877a-7f26ae108612 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:26.944428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c119c9c8-5796-4e18-877a-7f26ae108612 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:26.952035 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-94e21ea5-d951-417f-a047-e1b2ac092454 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1690 microversion: 2.1 time: 0.304796 May 07 22:06:26.957612 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2484/4919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:26 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1690 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:26.990182 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c119c9c8-5796-4e18-877a-7f26ae108612 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075552 May 07 22:06:26.990802 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2436/4920] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:26 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:27.981225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:27.985392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:28.002390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-645520ea-2634-46b6-adad-d2b18f46320b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:28.003596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-645520ea-2634-46b6-adad-d2b18f46320b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:28.016394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-645520ea-2634-46b6-adad-d2b18f46320b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:28.016861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-645520ea-2634-46b6-adad-d2b18f46320b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:28.017661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-645520ea-2634-46b6-adad-d2b18f46320b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:28.018108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-645520ea-2634-46b6-adad-d2b18f46320b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:28.018365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:28.020877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:28.022650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:28.026131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:28.061347 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-645520ea-2634-46b6-adad-d2b18f46320b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063411 May 07 22:06:28.066314 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2437/4921] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:27 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:06:28.359193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:28.367745 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f92c6a31-34c1-4977-b121-6971525f0e02 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1690 microversion: 2.1 time: 0.393930 May 07 22:06:28.368647 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2485/4922] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:27 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1690 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:29.073986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-28fa1807-b2bd-409a-b15a-bd14bc2d3140 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:29.075032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-28fa1807-b2bd-409a-b15a-bd14bc2d3140 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:29.083886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28fa1807-b2bd-409a-b15a-bd14bc2d3140 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.084357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28fa1807-b2bd-409a-b15a-bd14bc2d3140 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.085163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28fa1807-b2bd-409a-b15a-bd14bc2d3140 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.085614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28fa1807-b2bd-409a-b15a-bd14bc2d3140 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.142763 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-28fa1807-b2bd-409a-b15a-bd14bc2d3140 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073740 May 07 22:06:29.145534 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2438/4923] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:06:29 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:06:29.214217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:29.214906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:29.221987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.222795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.223865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.224530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.254316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:06:29.356188 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-955eccf3-6452-4af6-9872-c41987dffd4e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 204 len: 0 microversion: 2.1 time: 0.146136 May 07 22:06:29.357711 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2486/4924] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:29 2022] DELETE /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:06:29.366170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:29.366952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:29.373395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.373891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.375588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.376213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.386024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:29.386753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:29.397789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.398367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.399727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:29.400286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:29.564739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:29.572530 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b0ae09f-cb1a-4316-856c-81fdf9edf0e8 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1690 microversion: 2.1 time: 0.190707 May 07 22:06:29.573112 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2487/4925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:29 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:29.892775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:29.915764 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-339fd7d4-74dc-4ac7-a76e-fe3ff3aade9b tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1682 microversion: 2.1 time: 0.549626 May 07 22:06:29.917149 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2439/4926] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:29 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1682 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:30.539792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3e268c0e-6f7d-434d-b6a6-bef61816c809 req-519a0a56-1a26-47a2-80bc-9c1060f9bc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df2668b-af6b-4323-a4a4-520fcae8e55e", "name": "network-vif-deleted", "tag": "26735917-c705-4821-b89b-e6f718fdc166"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:30.558168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e268c0e-6f7d-434d-b6a6-bef61816c809 req-519a0a56-1a26-47a2-80bc-9c1060f9bc8a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:30.560461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e268c0e-6f7d-434d-b6a6-bef61816c809 req-519a0a56-1a26-47a2-80bc-9c1060f9bc8a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:30.593682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:30.594363 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3e268c0e-6f7d-434d-b6a6-bef61816c809 req-519a0a56-1a26-47a2-80bc-9c1060f9bc8a service nova] Creating event network-vif-deleted:26735917-c705-4821-b89b-e6f718fdc166 for instance 9df2668b-af6b-4323-a4a4-520fcae8e55e on nch2-master-1 May 07 22:06:30.594489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:30.607398 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3e268c0e-6f7d-434d-b6a6-bef61816c809 req-519a0a56-1a26-47a2-80bc-9c1060f9bc8a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071172 May 07 22:06:30.615466 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2488/4927] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:30.622956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:30.629055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:30.632984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:30.635772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:30.805893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:30.821677 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a1b118b9-9471-4dae-9d32-17db97041989 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 200 len: 1330 microversion: 2.1 time: 0.229917 May 07 22:06:30.833566 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2440/4928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:30 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 1330 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:30.936598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:30.938223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:30.946807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:30.947608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:30.948778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:30.949402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:31.303916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:31.313527 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-953419b0-75cf-4e59-8dfb-c469a3eb9505 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1682 microversion: 2.1 time: 0.382951 May 07 22:06:31.317729 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2489/4929] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:30 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1682 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:31.841818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:31.845429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 9df2668b-af6b-4323-a4a4-520fcae8e55e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:31.857360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:31.858808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:31.860246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:31.861060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:31.901148 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Instance 9df2668b-af6b-4323-a4a4-520fcae8e55e could not be found. May 07 22:06:31.903900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 404 to user: Instance 9df2668b-af6b-4323-a4a4-520fcae8e55e could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:31.905063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-18c186e2-a555-421f-8ab9-549835c9dfe4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e" status: 404 len: 111 microversion: 2.1 time: 0.068175 May 07 22:06:31.906745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2441/4930] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:31 2022] GET /compute/v2.1/servers/9df2668b-af6b-4323-a4a4-520fcae8e55e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:31.915672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52b930d5-162f-4efa-bda0-8e34006908b2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '.version_select at 0x7fc40fd34b80>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:31.943664 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52b930d5-162f-4efa-bda0-8e34006908b2 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551805950" status: 202 len: 0 microversion: 2.1 time: 0.031173 May 07 22:06:31.947589 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2490/4931] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:06:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551805950 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:06:32.336679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:32.337506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:32.354488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:32.356654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:32.357738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:32.359000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:33.011356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:33.028521 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7d5c3254-5376-49b8-ac13-74c29020ece7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1682 microversion: 2.1 time: 0.694139 May 07 22:06:33.031755 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2442/4932] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:32 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1682 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:34.049507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:34.050704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:34.067031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:34.067982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:34.069109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:34.070158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:34.190462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:34.206743 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f614fc0f-422e-4bf3-b55b-3118da5fb874 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1614 microversion: 2.1 time: 0.161597 May 07 22:06:34.208117 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2491/4933] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:34 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1614 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:34.883043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-01d9c1c3-a8d5-43f1-b319-bcaca2324353 req-f18e1976-50a4-4822-a374-ed90775ec04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae59656-69ab-4136-adeb-885957bc32fb", "name": "network-vif-deleted", "tag": "c846280a-8147-4e8c-bb8f-73673321d454"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:34.915146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-01d9c1c3-a8d5-43f1-b319-bcaca2324353 req-f18e1976-50a4-4822-a374-ed90775ec04e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:34.926265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-01d9c1c3-a8d5-43f1-b319-bcaca2324353 req-f18e1976-50a4-4822-a374-ed90775ec04e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:34.947264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-01d9c1c3-a8d5-43f1-b319-bcaca2324353 req-f18e1976-50a4-4822-a374-ed90775ec04e service nova] Creating event network-vif-deleted:c846280a-8147-4e8c-bb8f-73673321d454 for instance aae59656-69ab-4136-adeb-885957bc32fb on nch2-master-1 May 07 22:06:34.956047 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-01d9c1c3-a8d5-43f1-b319-bcaca2324353 req-f18e1976-50a4-4822-a374-ed90775ec04e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079937 May 07 22:06:34.958224 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2443/4934] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:35.225650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:35.226883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:35.237576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:35.238203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:35.247152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:35.247723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:35.347527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:35.348069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:35.362625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lazy-loading 'fault' on Instance uuid aae59656-69ab-4136-adeb-885957bc32fb {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:06:35.441983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '887054d178de43b18a472fed2297659d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57990769f50b412194a108cdd627a767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:35.454725 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e31a5146-53fa-4cb6-964c-9397a86b6dc9 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 200 len: 1331 microversion: 2.1 time: 0.233654 May 07 22:06:35.456037 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2492/4935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:35 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 1331 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:36.221677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:36.223021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:36.234387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.235090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.236069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.236510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.276749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:06:36.474525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:36.476889 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1833a2b0-85e8-472e-99eb-53228052dbe1 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 204 len: 0 microversion: 2.1 time: 0.260206 May 07 22:06:36.477702 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2444/4936] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:36 2022] DELETE /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:06:36.479469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:36.486790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:36.493506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:36.495138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.499778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.501087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.501732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.511691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.514721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.521970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.521970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.528976 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance aae59656-69ab-4136-adeb-885957bc32fb could not be found. May 07 22:06:36.530016 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance aae59656-69ab-4136-adeb-885957bc32fb could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:36.531882 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b6ca1c7-d507-40b7-9df7-6917422b7bb7 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 404 len: 111 microversion: 2.1 time: 0.062502 May 07 22:06:36.532795 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2493/4937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:36 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:06:36.550853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:36.551932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:36.560561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.561411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.562507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.563802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.568898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:06:36.692523 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-28678ecb-9840-4ab0-a4d3-e0ff3cab87e8 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 204 len: 0 microversion: 2.1 time: 0.210044 May 07 22:06:36.693714 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2445/4938] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:36 2022] DELETE /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:06:36.700766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32855d38-add4-41df-a10f-c35229432604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '.version_select at 0x7fc41caad670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:36.748669 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-32855d38-add4-41df-a10f-c35229432604 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473813015" status: 202 len: 0 microversion: 2.1 time: 0.053105 May 07 22:06:36.749601 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2446/4939] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 22:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473813015 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:06:36.775934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:36.775934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:36.794468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.794994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:36.797017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:36.797477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:37.066674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:37.075785 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c8ff09ff-ecf2-4ab3-a3d5-9c833dc054bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1552 microversion: 2.1 time: 0.323782 May 07 22:06:37.087428 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2447/4940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:36 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1552 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:37.319005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:37.330429 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90006a30-546b-461d-802a-690f8d614ca0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1508 microversion: 2.1 time: 0.796347 May 07 22:06:37.336394 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2494/4941] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:36 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1508 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:38.099813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:38.102223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:38.116552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.119492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:38.122327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.122825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:38.553452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:38.554289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:38.567098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.567571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:38.568387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.568845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:38.730943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:38.742615 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ed5fe85-e241-44f3-953a-90400455cf8b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1552 microversion: 2.1 time: 0.652336 May 07 22:06:38.743376 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2495/4942] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:38 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1552 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:38.755796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:38.759644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:38.777932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.778407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:38.779239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.779704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:38.927215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:38.935080 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ce630f5-a0af-4d21-b44a-fea017be43f7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 1.093053 May 07 22:06:38.935677 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2448/4943] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:37 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:38.964925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:38.971673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:38.981529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.983010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:38.986845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:38.987579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.196751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:39.208040 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-322ad022-15c1-4eb6-9d69-9d0b517ebd3e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1508 microversion: 2.1 time: 0.462845 May 07 22:06:39.208927 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2496/4944] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:38 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1508 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:39.215767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:39.216659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:39.226761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.227642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.228750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.229474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.277106 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance aae59656-69ab-4136-adeb-885957bc32fb could not be found. May 07 22:06:39.288391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance aae59656-69ab-4136-adeb-885957bc32fb could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:39.289662 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cadaac1a-83f6-4c1f-ae2c-9d630a8ad384 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 404 len: 111 microversion: 2.1 time: 0.079580 May 07 22:06:39.292315 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2497/4945] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:39 2022] DELETE /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:39.300430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:39.307838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:39.309666 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d31bb665-3ee6-418c-ab08-b4ea366846ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.355181 May 07 22:06:39.313588 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2449/4946] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:38 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:39.313742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: aae59656-69ab-4136-adeb-885957bc32fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:39.332084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.335461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.336365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.338696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:39.339928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:39.341147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.351765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.352235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.353036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.353494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.378831 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance aae59656-69ab-4136-adeb-885957bc32fb could not be found. May 07 22:06:39.384912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance aae59656-69ab-4136-adeb-885957bc32fb could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:39.387949 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04838535-91cb-474a-ae3f-5a723a2c340f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb" status: 404 len: 111 microversion: 2.1 time: 0.090634 May 07 22:06:39.394356 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2498/4947] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:39 2022] GET /compute/v2.1/servers/aae59656-69ab-4136-adeb-885957bc32fb => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:39.615128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:39.629436 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-534c53cb-0851-495c-b075-5d6772523ab6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.302590 May 07 22:06:39.630405 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2450/4948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:39 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:39.648915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:39.649864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:39.656060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.656758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.657500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.658155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.761909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:39.762951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:39.770687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.771546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.772549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:39.773201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:39.977157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:39.989912 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ca2e5a25-fcd4-4e57-aed8-1ad11dd237b0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1552 microversion: 2.1 time: 0.232770 May 07 22:06:39.994019 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2451/4949] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:39 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1552 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:40.225681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:40.226720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:40.234360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.235071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.236229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.236764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.243963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:40.259649 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1c99819-1c9d-4d66-b112-7f4be9c92e28 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.617390 May 07 22:06:40.260803 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2499/4950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:39 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:40.320032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1557624056", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "33b52409-fae0-4935-b5d0-15acefaa0f3f"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:40.387137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] validate_networks() for [('33b52409-fae0-4935-b5d0-15acefaa0f3f', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:06:40.509483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:40.518609 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b10d1cb9-a9ed-4fc6-b116-44befb994f9a tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1508 microversion: 2.1 time: 0.296935 May 07 22:06:40.519516 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2452/4951] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:40 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:40.585530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:40.587024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:40.597010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.598859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.600144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.600969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.617482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance cf519119-a1c9-4f1e-9d65-8f11441721a2 could not be found. May 07 22:06:40.618853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance cf519119-a1c9-4f1e-9d65-8f11441721a2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:40.619969 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a6e34109-0b92-4458-acbd-a5cf6cd163c0 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 404 len: 111 microversion: 2.1 time: 0.040220 May 07 22:06:40.621199 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2453/4952] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:40 2022] DELETE /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:40.630716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:40.632261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: cf519119-a1c9-4f1e-9d65-8f11441721a2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:40.641066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.642144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.643771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.644511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.664573 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance cf519119-a1c9-4f1e-9d65-8f11441721a2 could not be found. May 07 22:06:40.665948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance cf519119-a1c9-4f1e-9d65-8f11441721a2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:40.667310 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a88c9479-0ab7-4af0-812a-25dbac4b0802 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2" status: 404 len: 111 microversion: 2.1 time: 0.041472 May 07 22:06:40.668293 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2454/4953] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:40 2022] GET /compute/v2.1/servers/cf519119-a1c9-4f1e-9d65-8f11441721a2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:40.680054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:40.681053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:40.710068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.710748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.715461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.716833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.744732 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 could not be found. May 07 22:06:40.745294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:40.746535 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-411b948c-6753-4028-91a4-fc26017f9c77 tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 404 len: 111 microversion: 2.1 time: 0.072662 May 07 22:06:40.747196 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2455/4954] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:40 2022] DELETE /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:40.758429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:40.759136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: fac24695-8d11-4a29-bf87-a5c11bd5c2e6] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:40.765541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.768000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.768000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:40.768000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:40.782889 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 could not be found. May 07 22:06:40.783557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance fac24695-8d11-4a29-bf87-a5c11bd5c2e6 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:40.784420 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b9e44c33-72f8-4b20-b6f0-9ceba19d437f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6" status: 404 len: 111 microversion: 2.1 time: 0.032450 May 07 22:06:40.785335 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2456/4955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:40 2022] GET /compute/v2.1/servers/fac24695-8d11-4a29-bf87-a5c11bd5c2e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:06:41.014985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:41.018437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:41.026677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:41.027512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:41.028657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:41.029465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:41.410909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:41.436395 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-211ee5a9-2cac-4b43-b650-b90503430c4a tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1552 microversion: 2.1 time: 0.427633 May 07 22:06:41.438848 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2457/4956] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:41 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1552 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:41.536415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:41.537170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:41.547616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:41.548081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:41.548882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:41.549338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:41.625842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:41.634905 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d04e50cb-86b6-4531-bab6-0e77ee59add4 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 200 len: 1466 microversion: 2.1 time: 0.102472 May 07 22:06:41.644251 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2458/4957] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:41 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 1466 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:41.871821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-df3287a1-5213-4d6f-b140-930a56f1dc40 req-a463c5e5-5db1-4473-9e5f-01b1f2b8be48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7872598a-70de-4e95-af09-8b55fd257508", "name": "network-vif-deleted", "tag": "127ac58f-e629-45c6-b98f-fcf671fde77b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:41.884438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-df3287a1-5213-4d6f-b140-930a56f1dc40 req-a463c5e5-5db1-4473-9e5f-01b1f2b8be48 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:41.885068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-df3287a1-5213-4d6f-b140-930a56f1dc40 req-a463c5e5-5db1-4473-9e5f-01b1f2b8be48 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:41.921546 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-df3287a1-5213-4d6f-b140-930a56f1dc40 req-a463c5e5-5db1-4473-9e5f-01b1f2b8be48 service nova] Creating event network-vif-deleted:127ac58f-e629-45c6-b98f-fcf671fde77b for instance 7872598a-70de-4e95-af09-8b55fd257508 on nch1-master-1 May 07 22:06:41.937977 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-df3287a1-5213-4d6f-b140-930a56f1dc40 req-a463c5e5-5db1-4473-9e5f-01b1f2b8be48 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068618 May 07 22:06:41.939077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2459/4958] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:06:42.041958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:42.043332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:42.051205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.051954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.053407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.054027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.084239 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 could not be found. May 07 22:06:42.088945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:42.090137 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3bc1d7c9-5de1-425b-b4c2-a2f1e026898e tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 404 len: 111 microversion: 2.1 time: 0.060142 May 07 22:06:42.095321 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2460/4959] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:42 2022] DELETE /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:42.102547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:06:42.103593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:06:42.104314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:06:42.104998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:06:42.105842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:06:42.127006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:42.127663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] [instance: 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:42.132842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.137079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.138164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.140460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.142401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.151609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.152996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.153613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.186084 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] HTTP exception thrown: Instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 could not be found. May 07 22:06:42.187493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] Returning 404 to user: Instance 8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:42.189402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:06:42.189793 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3fbd2f06-5725-4ed4-a4fa-a4f9ff57cc8f tempest-AttachVolumeNegativeTest-835916675 tempest-AttachVolumeNegativeTest-835916675-project] 10.222.0.32 "GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949" status: 404 len: 111 microversion: 2.1 time: 0.092927 May 07 22:06:42.190762 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2461/4960] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:42 2022] GET /compute/v2.1/servers/8141d2fb-0f50-41fb-bce0-7a6c7f7fc949 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:42.196272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for user 8cdc0c878f6e4e5da2a2848d63a02f0d and project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:06:42.215068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:06:42.217885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:06:42.306280 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-827d9aca-a336-4c39-881e-02d141f4cb9d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.989822 May 07 22:06:42.313366 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2500/4961] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:06:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:06:42.332396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5d3b32c-7fb3-4907-887b-0b2893edd3f3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:42.334436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5d3b32c-7fb3-4907-887b-0b2893edd3f3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:42.461792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:42.464336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:42.492526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.492526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.492526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.492526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.547575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.548343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.549001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lazy-loading 'fault' on Instance uuid d67c9a54-a13e-4b6a-9db5-7bf57397edbb {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:06:42.639019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5d3b32c-7fb3-4907-887b-0b2893edd3f3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:42.650697 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5d3b32c-7fb3-4907-887b-0b2893edd3f3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1215 microversion: 2.1 time: 0.330667 May 07 22:06:42.654946 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2462/4962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:42 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:42.674230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:42.675822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 7872598a-70de-4e95-af09-8b55fd257508] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:42.695807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.698362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.700088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.703118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.741623 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Instance 7872598a-70de-4e95-af09-8b55fd257508 could not be found. May 07 22:06:42.743650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 404 to user: Instance 7872598a-70de-4e95-af09-8b55fd257508 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:42.744518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bde8a77-7783-4773-8ef4-218e0a628273 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508" status: 404 len: 111 microversion: 2.1 time: 0.086552 May 07 22:06:42.751006 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2463/4963] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:42 2022] GET /compute/v2.1/servers/7872598a-70de-4e95-af09-8b55fd257508 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:42.759534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:42.762027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:42.774278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:42.775014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.775646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.776898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:42.777798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:42.787286 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-05f79902-8271-49d8-87ee-ca0e14d08b21 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 200 len: 1338 microversion: 2.1 time: 0.336070 May 07 22:06:42.788981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2501/4964] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:42 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 1338 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:42.856875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:06:43.059350 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97465628-7986-401a-89e8-45e85f5c830e tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "DELETE /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 204 len: 0 microversion: 2.1 time: 0.303881 May 07 22:06:43.060944 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2464/4965] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:42 2022] DELETE /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:06:43.075649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:43.076463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:43.083914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:43.084714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:43.085780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:43.086359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:43.507125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:43.516514 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-75c86e3a-e1a2-4f69-90e7-2060228bb079 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.450249 May 07 22:06:43.517475 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2502/4966] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:43 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:43.673188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:43.673969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:43.681121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:43.681864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:43.683182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:43.683851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:43.798462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:43.809928 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f380c907-d8e0-49d1-b0bd-0376f62e4a2c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1211 microversion: 2.1 time: 0.141715 May 07 22:06:43.820167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:43.820167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: d67c9a54-a13e-4b6a-9db5-7bf57397edbb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:43.820973 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2465/4967] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:43 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:43.862708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:43.863256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:43.864064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:43.864566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:43.885580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] HTTP exception thrown: Instance d67c9a54-a13e-4b6a-9db5-7bf57397edbb could not be found. May 07 22:06:43.886118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Returning 404 to user: Instance d67c9a54-a13e-4b6a-9db5-7bf57397edbb could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:43.887329 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-937be5cb-d5ae-4ae5-92fe-746a3049ce62 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb" status: 404 len: 111 microversion: 2.1 time: 0.077303 May 07 22:06:43.888359 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2503/4968] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:43 2022] GET /compute/v2.1/servers/d67c9a54-a13e-4b6a-9db5-7bf57397edbb => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:06:44.539662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:44.541233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:44.553260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:44.555081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:44.556532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:44.558156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:44.705154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-044199c0-a6b3-4a01-b8b3-10476f6ed2df req-d56f93e8-8e15-4ada-a6eb-b7a6cce3895f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67c9a54-a13e-4b6a-9db5-7bf57397edbb", "name": "network-vif-deleted", "tag": "589e4dcc-4385-4a17-8792-2bf6dcbf7136"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:44.722737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-044199c0-a6b3-4a01-b8b3-10476f6ed2df req-d56f93e8-8e15-4ada-a6eb-b7a6cce3895f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:44.723215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-044199c0-a6b3-4a01-b8b3-10476f6ed2df req-d56f93e8-8e15-4ada-a6eb-b7a6cce3895f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:44.744020 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-044199c0-a6b3-4a01-b8b3-10476f6ed2df req-d56f93e8-8e15-4ada-a6eb-b7a6cce3895f service nova] Creating event network-vif-deleted:589e4dcc-4385-4a17-8792-2bf6dcbf7136 for instance d67c9a54-a13e-4b6a-9db5-7bf57397edbb on nch1-master-1 May 07 22:06:44.755536 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-044199c0-a6b3-4a01-b8b3-10476f6ed2df req-d56f93e8-8e15-4ada-a6eb-b7a6cce3895f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258998 May 07 22:06:44.759819 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2466/4969] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:44.829459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:44.830709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:44.837780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:44.838559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:44.839649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:44.840369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:45.053721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:45.065335 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fae0262-6534-459e-94b5-c271978085d1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1273 microversion: 2.1 time: 0.241091 May 07 22:06:45.066261 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2467/4970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:44 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:45.235354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:45.248752 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8f976213-4e5b-4ae4-8a5a-81aa83a81ab0 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.713470 May 07 22:06:45.259438 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2504/4971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:44 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:45.449975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71e5413a-b8fb-4584-b26b-e424294e8221 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '.version_select at 0x7fc40fcd8ee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:45.485181 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71e5413a-b8fb-4584-b26b-e424294e8221 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-947053967" status: 202 len: 0 microversion: 2.1 time: 0.041129 May 07 22:06:45.486314 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2468/4972] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 22:06:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-947053967 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:06:46.087892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:46.088512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:46.110535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:46.115343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:46.116249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:46.116737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:46.258569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:46.266995 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b40525f0-059f-4f67-80ac-a8cc8c9cc2cb tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1273 microversion: 2.1 time: 0.183263 May 07 22:06:46.267586 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2505/4973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:46 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:46.268872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:46.269500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:46.283261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:46.283717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:46.284503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:46.284946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:47.168933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:47.189380 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5860dc04-5a7d-473d-bf59-eeab61c21c70 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1522 microversion: 2.1 time: 0.925665 May 07 22:06:47.193009 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2469/4974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:46 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1522 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:47.285379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:47.285934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:47.296526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:47.297127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:47.297983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:47.298438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:48.245189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-037a490b-0945-4758-bd91-b2d47267585e req-435c4472-7491-4690-9b1d-e562c8f1d576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e381dd-9f23-442c-80d2-8623a85c3e50", "name": "network-vif-deleted", "tag": "8c6248c5-d242-4598-8d78-5b4023298e63"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:48.258704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-037a490b-0945-4758-bd91-b2d47267585e req-435c4472-7491-4690-9b1d-e562c8f1d576 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:48.259506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-037a490b-0945-4758-bd91-b2d47267585e req-435c4472-7491-4690-9b1d-e562c8f1d576 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:48.277248 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-037a490b-0945-4758-bd91-b2d47267585e req-435c4472-7491-4690-9b1d-e562c8f1d576 service nova] Creating event network-vif-deleted:8c6248c5-d242-4598-8d78-5b4023298e63 for instance 96e381dd-9f23-442c-80d2-8623a85c3e50 on nch2-master-1 May 07 22:06:48.289834 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-037a490b-0945-4758-bd91-b2d47267585e req-435c4472-7491-4690-9b1d-e562c8f1d576 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271643 May 07 22:06:48.291281 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2470/4975] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:48.301310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:48.307728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:48.324058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:48.325457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:48.328207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:48.328714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:48.392366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:48.398832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:48.399446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lazy-loading 'fault' on Instance uuid 96e381dd-9f23-442c-80d2-8623a85c3e50 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:06:48.516236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb48e4d50184d2e97674324027d9ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8130c27f2b84434a8d6fa5032b67aa1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:48.532865 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e1bcf174-0b7a-437b-b645-d4d554854383 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 200 len: 1312 microversion: 2.1 time: 0.237751 May 07 22:06:48.535868 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2471/4976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:48 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:48.934094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:48.948206 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-edce596e-018f-4154-be7c-d81d1839c166 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 1.666247 May 07 22:06:48.950022 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2506/4977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:47 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:49.553856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:49.556166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] [instance: 96e381dd-9f23-442c-80d2-8623a85c3e50] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:49.572453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:49.575194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:49.577493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:49.581643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:49.615275 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] HTTP exception thrown: Instance 96e381dd-9f23-442c-80d2-8623a85c3e50 could not be found. May 07 22:06:49.616350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] Returning 404 to user: Instance 96e381dd-9f23-442c-80d2-8623a85c3e50 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:49.617413 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-92c2cacc-af97-4cba-98bf-396619d6ba36 tempest-ServerRescueNegativeTestJSON-1146234554 tempest-ServerRescueNegativeTestJSON-1146234554-project] 10.222.0.32 "GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50" status: 404 len: 111 microversion: 2.1 time: 0.068259 May 07 22:06:49.618660 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2472/4978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:49 2022] GET /compute/v2.1/servers/96e381dd-9f23-442c-80d2-8623a85c3e50 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:06:49.966352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:49.967067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:49.984304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:49.984752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:49.985560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:49.986076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:50.726347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:50.738680 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f2b7cdc-359a-4ebc-8252-dcbd1e51b258 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 0.776100 May 07 22:06:50.739312 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2507/4979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:49 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:51.756154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:51.757805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:51.765094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:51.765831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:51.766990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:51.767732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:52.261991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:52.270446 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-496b21b5-0d3f-4143-bf19-d58031e62d6c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 0.518366 May 07 22:06:52.275000 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2473/4980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:51 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:52.374507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-de59d6f4-edb6-4653-adbc-45149f21f992 req-f6655eab-9574-4427-92e2-005fbd7ee06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0131044-3724-490e-88e0-5fca28fe6ee3", "tag": "2e65b025-887f-40c7-9d7c-68a722d64bc2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:52.399782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-de59d6f4-edb6-4653-adbc-45149f21f992 req-f6655eab-9574-4427-92e2-005fbd7ee06f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:52.402555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-de59d6f4-edb6-4653-adbc-45149f21f992 req-f6655eab-9574-4427-92e2-005fbd7ee06f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:52.426694 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-de59d6f4-edb6-4653-adbc-45149f21f992 req-f6655eab-9574-4427-92e2-005fbd7ee06f service nova] Creating event network-changed:2e65b025-887f-40c7-9d7c-68a722d64bc2 for instance c0131044-3724-490e-88e0-5fca28fe6ee3 on nch1-master-1 May 07 22:06:52.433914 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-de59d6f4-edb6-4653-adbc-45149f21f992 req-f6655eab-9574-4427-92e2-005fbd7ee06f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063725 May 07 22:06:52.434536 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2508/4981] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:53.293576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:53.294925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:53.302100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:53.303205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:53.304128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:53.304781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:53.997027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:54.006423 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-09ea8436-21c2-4ebc-a916-b032fccdb041 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 0.718116 May 07 22:06:54.007313 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2474/4982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:53 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:54.542706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:54.543335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:54.562228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1a6d5b89-803d-431c-897a-d6a987773efb req-7c69cad3-ccea-4144-8ce1-8e30ff621cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d983a5-a676-4b82-8128-f4beb5bb1187", "tag": "dfc7202f-3529-456c-8635-c9d41180e0af"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:54.569696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:54.570166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:54.571473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:54.571473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:54.598391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1a6d5b89-803d-431c-897a-d6a987773efb req-7c69cad3-ccea-4144-8ce1-8e30ff621cce service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:54.599058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1a6d5b89-803d-431c-897a-d6a987773efb req-7c69cad3-ccea-4144-8ce1-8e30ff621cce service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:54.618966 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1a6d5b89-803d-431c-897a-d6a987773efb req-7c69cad3-ccea-4144-8ce1-8e30ff621cce service nova] Creating event network-changed:dfc7202f-3529-456c-8635-c9d41180e0af for instance 05d983a5-a676-4b82-8128-f4beb5bb1187 on nch2-master-1 May 07 22:06:54.632562 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1a6d5b89-803d-431c-897a-d6a987773efb req-7c69cad3-ccea-4144-8ce1-8e30ff621cce service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074741 May 07 22:06:54.635008 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2475/4983] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:06:54.659929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:06:54.847262 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-74ebf21b-d9f7-4152-89b1-f47b9ab69f20 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "DELETE /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 204 len: 0 microversion: 2.1 time: 0.308712 May 07 22:06:54.848441 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2509/4984] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:06:54 2022] DELETE /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:06:54.857464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:54.858482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:54.870805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:54.871514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:54.872490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:54.873085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:55.024996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:55.025946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:55.034724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:55.038097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:55.039255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:55.039850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:55.380800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:55.388422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-967bd29f-2175-4f5d-8124-b6a27b192ba0 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1672 microversion: 2.1 time: 0.535149 May 07 22:06:55.389012 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2476/4985] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:54 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1672 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:55.647715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:55.664473 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb58dbfb-52c9-496b-8ba5-7e364f9c09da tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 0.643005 May 07 22:06:55.664473 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2510/4986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:55 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:56.417089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:56.421913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:56.448411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:56.449020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:56.450737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:56.451355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:56.681811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:56.682540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:56.695079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:56.695544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:56.696743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:56.698195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:57.314632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:57.326422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-825165ba-effa-4f48-90fc-29ea4b0650dc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1672 microversion: 2.1 time: 0.924561 May 07 22:06:57.327640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:57.327800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2477/4987] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:56 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1672 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:57.343105 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea7a4f73-b5a2-4c8a-8661-26c87379c860 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 0.664796 May 07 22:06:57.344153 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2511/4988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:56 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:58.345299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:58.346990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:58.367872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:58.368558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:58.378282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:58.378970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:58.379924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:58.380378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:58.406713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:58.407463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:58.410573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:58.416742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:58.559149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:58.572420 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4db43bb0-8fc0-40ea-8902-397b84a26460 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 200 len: 1333 microversion: 2.1 time: 0.229588 May 07 22:06:58.575822 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2478/4989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:58 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 1333 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:06:58.591529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e1d594a5-c99b-47d8-b1ea-540e62e7d79b req-5b4e259d-ad64-49f9-ac34-f47870a9b0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d983a5-a676-4b82-8128-f4beb5bb1187", "name": "network-vif-deleted", "tag": "dfc7202f-3529-456c-8635-c9d41180e0af"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:58.614625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e1d594a5-c99b-47d8-b1ea-540e62e7d79b req-5b4e259d-ad64-49f9-ac34-f47870a9b0ea service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:58.615884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e1d594a5-c99b-47d8-b1ea-540e62e7d79b req-5b4e259d-ad64-49f9-ac34-f47870a9b0ea service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:58.650924 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e1d594a5-c99b-47d8-b1ea-540e62e7d79b req-5b4e259d-ad64-49f9-ac34-f47870a9b0ea service nova] Creating event network-vif-deleted:dfc7202f-3529-456c-8635-c9d41180e0af for instance 05d983a5-a676-4b82-8128-f4beb5bb1187 on nch2-master-1 May 07 22:06:58.665280 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e1d594a5-c99b-47d8-b1ea-540e62e7d79b req-5b4e259d-ad64-49f9-ac34-f47870a9b0ea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085119 May 07 22:06:58.675475 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2479/4990] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:06:59.436551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:06:59.445504 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a5bead3-100c-46a4-930f-c598ef371d55 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 1.084571 May 07 22:06:59.455190 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2512/4991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:58 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:06:59.592399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:06:59.593498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: 05d983a5-a676-4b82-8128-f4beb5bb1187] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:06:59.602393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:59.603064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:59.604358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:59.605148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:59.631750 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] HTTP exception thrown: Instance 05d983a5-a676-4b82-8128-f4beb5bb1187 could not be found. May 07 22:06:59.632520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Returning 404 to user: Instance 05d983a5-a676-4b82-8128-f4beb5bb1187 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:06:59.633720 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1d498755-e35a-4948-b728-7599f500cd9f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187" status: 404 len: 111 microversion: 2.1 time: 0.045336 May 07 22:06:59.634602 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2513/4992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:06:59 2022] GET /compute/v2.1/servers/05d983a5-a676-4b82-8128-f4beb5bb1187 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:06:59.660634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-91a117c1-abb8-4092-8ce0-253c3a7e8cd5 req-3e959e30-a815-4627-8128-838799def7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0131044-3724-490e-88e0-5fca28fe6ee3", "name": "network-vif-plugged", "status": "completed", "tag": "2e65b025-887f-40c7-9d7c-68a722d64bc2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:06:59.681899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-91a117c1-abb8-4092-8ce0-253c3a7e8cd5 req-3e959e30-a815-4627-8128-838799def7e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:06:59.684186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-91a117c1-abb8-4092-8ce0-253c3a7e8cd5 req-3e959e30-a815-4627-8128-838799def7e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:06:59.735642 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-91a117c1-abb8-4092-8ce0-253c3a7e8cd5 req-3e959e30-a815-4627-8128-838799def7e1 service nova] Creating event network-vif-plugged:2e65b025-887f-40c7-9d7c-68a722d64bc2 for instance c0131044-3724-490e-88e0-5fca28fe6ee3 on nch1-master-1 May 07 22:06:59.745167 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-91a117c1-abb8-4092-8ce0-253c3a7e8cd5 req-3e959e30-a815-4627-8128-838799def7e1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.451818 May 07 22:06:59.748166 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2480/4993] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:07:00.309368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5e56aab-16cf-41a0-ac4c-a46691b284fe tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '.version_select at 0x7fc40fcb3d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:00.350403 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5e56aab-16cf-41a0-ac4c-a46691b284fe tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1514341370" status: 202 len: 0 microversion: 2.1 time: 0.045615 May 07 22:07:00.351663 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2514/4994] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 22:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1514341370 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:07:00.475810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:00.476812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:00.487793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:00.488277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:00.489222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:00.489668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:00.874212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:00.886241 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2d0aff13-e769-4dc0-a2e6-563cf8352090 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1315 microversion: 2.1 time: 0.413405 May 07 22:07:00.887168 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2481/4995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:00 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:01.906600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:01.907981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:01.917693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:01.918898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:01.920025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:01.920685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:02.113276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:02.126565 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5715aaf0-6f9d-4b0a-9740-0386ae2f788c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1502 microversion: 2.1 time: 0.225814 May 07 22:07:02.127804 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2515/4996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:01 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:02.144528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:02.145114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:02.152063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:02.152709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:02.153674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:02.154266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:02.909560 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.network.security_group_api [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Removing security group 2c335e02-4871-4a34-8e92-8c24a11b7b47 from port 2e65b025-887f-40c7-9d7c-68a722d64bc2 May 07 22:07:03.370898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-68a4b2b7-9e55-4689-aaa1-d53dc4c0ea4b tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Calling method '.version_select at 0x7fc4225cf8b0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:03.660976 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-68a4b2b7-9e55-4689-aaa1-d53dc4c0ea4b tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69/defaults" status: 200 len: 371 microversion: 2.1 time: 0.649593 May 07 22:07:03.662088 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2516/4997] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 22:07:03 2022] GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69/defaults => generated 371 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:07:03.674897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f10a90c-3835-443e-8e0f-c3c3b4831913 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Calling method '.version_select at 0x7fc40fc4a5e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:03.775056 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9352d43-7be9-48bc-b992-660863fe9703 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3/action" status: 202 len: 0 microversion: 2.1 time: 1.634311 May 07 22:07:03.775764 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2482/4998] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:07:02 2022] POST /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3/action => generated 0 bytes in 1636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:07:03.784878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:03.785588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:03.798821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:03.800986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:03.802304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:03.803753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:04.205899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:04.225445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a106b04-07d5-4bd0-a6fe-4204c1ae22e7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1460 microversion: 2.1 time: 0.444932 May 07 22:07:04.235452 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2483/4999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:03 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1460 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:04.247642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f1ff8cb4-5a8e-4769-9ba7-1d8088fd0773 req-e466c8ea-b8bb-4652-af0b-69305e8dc32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0131044-3724-490e-88e0-5fca28fe6ee3", "tag": "2e65b025-887f-40c7-9d7c-68a722d64bc2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:04.288552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f1ff8cb4-5a8e-4769-9ba7-1d8088fd0773 req-e466c8ea-b8bb-4652-af0b-69305e8dc32c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:04.291390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f1ff8cb4-5a8e-4769-9ba7-1d8088fd0773 req-e466c8ea-b8bb-4652-af0b-69305e8dc32c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:04.319685 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f1ff8cb4-5a8e-4769-9ba7-1d8088fd0773 req-e466c8ea-b8bb-4652-af0b-69305e8dc32c service nova] Creating event network-changed:2e65b025-887f-40c7-9d7c-68a722d64bc2 for instance c0131044-3724-490e-88e0-5fca28fe6ee3 on nch1-master-1 May 07 22:07:04.331422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f1ff8cb4-5a8e-4769-9ba7-1d8088fd0773 req-e466c8ea-b8bb-4652-af0b-69305e8dc32c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087285 May 07 22:07:04.334876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2484/5000] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:04.348738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:04.353392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:04.368319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:04.369069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:04.370049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:04.373132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:04.440399 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f10a90c-3835-443e-8e0f-c3c3b4831913 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69" status: 200 len: 371 microversion: 2.1 time: 0.771284 May 07 22:07:04.442693 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2517/5001] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:07:03 2022] GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69 => generated 371 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:04.470038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6d75726-e0dd-4419-92a3-dbcaa702c204 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Calling method '.version_select at 0x7fc40fc7f550>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:04.801194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:04.818195 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e43dfcea-5c1c-4c06-af94-4504d4ab7ea7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.478919 May 07 22:07:04.823711 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2485/5002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:04 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:04.847417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:04.848627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:04.883757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:04.885233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:04.890698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:04.891561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:05.127465 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6d75726-e0dd-4419-92a3-dbcaa702c204 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69/defaults" status: 200 len: 371 microversion: 2.1 time: 0.668652 May 07 22:07:05.136671 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2518/5003] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 22:07:04 2022] GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69/defaults => generated 371 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:05.142448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92817f9a-554f-4c58-9b9c-8bc09e0366cf tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Calling method '.version_select at 0x7fc40fc7e4c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:05.494311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:05.502788 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-92edbcf1-794a-4612-baa6-39f5df95e74e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.660571 May 07 22:07:05.507766 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2486/5004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:04 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:07:05.524947 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92817f9a-554f-4c58-9b9c-8bc09e0366cf tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69" status: 200 len: 371 microversion: 2.1 time: 0.379179 May 07 22:07:05.526711 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2519/5005] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:07:05 2022] GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69 => generated 371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:05.528072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:05.528718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:05.537778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6dd2dd2f-b55f-4173-a3a2-6b21c1e5257a tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Calling method '.version_select at 0x7fc40fc01430>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:05.543067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:05.543537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:05.544354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:05.545159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:05.867006 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6dd2dd2f-b55f-4173-a3a2-6b21c1e5257a tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69?user_id=30dc046a307a4cb28d9dbffdbade05a5" status: 200 len: 371 microversion: 2.1 time: 0.333156 May 07 22:07:05.867793 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2520/5006] 10.222.0.32 () {58 vars in 1322 bytes} [Sat May 7 22:07:05 2022] GET /compute/v2.1/os-quota-sets/fa44fb7b4b2a45638e1af606b5199f69?user_id=30dc046a307a4cb28d9dbffdbade05a5 => generated 371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:06.731019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:06.745584 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3999640-bac3-454b-ac20-9f9ea5c5b2d0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 1.221405 May 07 22:07:06.746539 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2487/5007] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:05 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:06.775532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:06.776232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:06.789874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:06.791389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:06.794496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:06.796029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:07.160623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:07.181148 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4cae19d8-ba00-4844-808c-5654e8aed352 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.413298 May 07 22:07:07.182684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2521/5008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:06 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:07.348955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1396806621", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "33b52409-fae0-4935-b5d0-15acefaa0f3f"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:07.455505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] validate_networks() for [('33b52409-fae0-4935-b5d0-15acefaa0f3f', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:07:08.718933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:07:08.719572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:07:08.719834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:07:08.720253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:07:08.720673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:07:08.733692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:08.734170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:08.735025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:08.735474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:08.755091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:07:08.760880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Getting quotas for user 8cdc0c878f6e4e5da2a2848d63a02f0d and project 759c66c34f414c19b2109393738ef639. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:07:08.775347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:07:08.778140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:07:08.878293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4a9a308c-97b5-4536-8579-587959348874 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.533898 May 07 22:07:08.878999 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2488/5009] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:07:08.889771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1557f1a8-3268-40bd-8126-90a6764f278b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:08.890422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1557f1a8-3268-40bd-8126-90a6764f278b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:09.026722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1557f1a8-3268-40bd-8126-90a6764f278b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:09.035159 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1557f1a8-3268-40bd-8126-90a6764f278b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1215 microversion: 2.1 time: 0.148308 May 07 22:07:09.035783 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2522/5010] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:08 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:10.015884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Action: 'create', calling method: .version_select at 0x7fc40fc10dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1396280169", "metadata": {"Type": "work"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:10.053036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:10.053654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:10.068222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:10.068691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:10.071068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:10.073195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:10.316574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:10.330951 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2e0d2895-3767-4ad8-8b60-589ac0060a94 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1267 microversion: 2.1 time: 0.282797 May 07 22:07:10.342929 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2523/5011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:10 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:07:10.569738 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2d35e4f4-79d1-4f52-9f48-b95d015f6497 tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.971610 May 07 22:07:10.570490 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2489/5012] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:07:09 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 973 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 07 22:07:10.582949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2906db5a-207f-4238-af76-10b0b3130dff tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Calling method '.version_select at 0x7fc40fc01f70>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:10.671703 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2906db5a-207f-4238-af76-10b0b3130dff tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740" status: 200 len: 346 microversion: 2.1 time: 0.092609 May 07 22:07:10.672293 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2524/5013] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:10 2022] GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:11.353649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:11.354997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:11.378620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:11.380163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:11.381133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:11.381812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:11.571872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:11.584138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2b118550-9803-4930-a03b-32dbd303707a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1273 microversion: 2.1 time: 0.237321 May 07 22:07:11.585459 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2490/5014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:11 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:11.686804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-db3406d7-f903-4f6d-8a57-8c9e5c4613a5 tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Calling method '.version_select at 0x7fc40fc4adc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:11.769733 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-db3406d7-f903-4f6d-8a57-8c9e5c4613a5 tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740" status: 200 len: 347 microversion: 2.1 time: 0.089497 May 07 22:07:11.770535 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2525/5015] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:11 2022] GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 => generated 347 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:11.782441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6ae8dce1-745d-4fce-8396-7e50083e769f tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Calling method '.version_select at 0x7fc40fc10a60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:11.843475 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6ae8dce1-745d-4fce-8396-7e50083e769f tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740" status: 200 len: 347 microversion: 2.1 time: 0.065650 May 07 22:07:11.844077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2491/5016] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:11 2022] GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 => generated 347 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:11.856552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88e44926-ca88-4966-bc5c-54dc47049b8d tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Calling method '.version_select at 0x7fc41ccf7d30>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:11.963269 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88e44926-ca88-4966-bc5c-54dc47049b8d tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740" status: 202 len: 0 microversion: 2.1 time: 0.110415 May 07 22:07:11.964654 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2526/5017] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:07:11 2022] DELETE /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:07:11.974014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c19f23f4-fad6-4c31-a39d-58a05231ed40 tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Calling method '.version_select at 0x7fc40fc56af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:12.059483 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c19f23f4-fad6-4c31-a39d-58a05231ed40 tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740" status: 200 len: 346 microversion: 2.1 time: 0.090292 May 07 22:07:12.061598 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2492/5018] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:11 2022] GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 => generated 346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:12.607728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:12.608819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:12.618546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:12.619678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:12.621299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:12.622097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:12.756501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:12.770262 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-deee2364-8c49-4f92-a230-26e34acf1e4a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1273 microversion: 2.1 time: 0.170322 May 07 22:07:12.771733 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2527/5019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:12 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:13.073214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6cf7f265-6315-41f6-89df-36bc103922bb tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Calling method '.version_select at 0x7fc41c2cb5e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:13.136373 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6cf7f265-6315-41f6-89df-36bc103922bb tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] HTTP exception thrown: Volume 5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 could not be found. May 07 22:07:13.137180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6cf7f265-6315-41f6-89df-36bc103922bb tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] Returning 404 to user: Volume 5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:07:13.138056 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6cf7f265-6315-41f6-89df-36bc103922bb tempest-VolumesGetTestJSON-1264326149 tempest-VolumesGetTestJSON-1264326149-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740" status: 404 len: 109 microversion: 2.1 time: 0.069237 May 07 22:07:13.138963 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2493/5020] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:13 2022] GET /compute/v2.1/os-volumes/5dfedd9d-bf6d-4f5a-85e3-88d4f4089740 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:07:13.791054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:13.794724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:13.806630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:13.807696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:13.808848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:13.813619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:14.113067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:14.122505 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5849486e-bc3d-4810-975c-bccd25be4e20 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1315 microversion: 2.1 time: 0.335797 May 07 22:07:14.126689 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2528/5021] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:13 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:15.143272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:15.144095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:15.162095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:15.162706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:15.163663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:15.164624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:15.859698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:15.875646 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2052f27c-550e-4973-b39d-253f6ab58b0e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1315 microversion: 2.1 time: 0.732805 May 07 22:07:15.878488 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2494/5022] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:15 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:16.254340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-410cd784-0d92-4a93-b9c6-b72d372d87a8 req-4b68420f-b476-4548-baa0-69f01e7f9c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d24fe6-4b53-4000-97a9-53c80f13ac5f", "tag": "f1c7d1d5-631c-4b90-9f11-73edbb1fc62b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:16.268908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-410cd784-0d92-4a93-b9c6-b72d372d87a8 req-4b68420f-b476-4548-baa0-69f01e7f9c30 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:16.269359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-410cd784-0d92-4a93-b9c6-b72d372d87a8 req-4b68420f-b476-4548-baa0-69f01e7f9c30 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:16.300257 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-410cd784-0d92-4a93-b9c6-b72d372d87a8 req-4b68420f-b476-4548-baa0-69f01e7f9c30 service nova] Creating event network-changed:f1c7d1d5-631c-4b90-9f11-73edbb1fc62b for instance e9d24fe6-4b53-4000-97a9-53c80f13ac5f on nch2-master-1 May 07 22:07:16.321924 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-410cd784-0d92-4a93-b9c6-b72d372d87a8 req-4b68420f-b476-4548-baa0-69f01e7f9c30 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071135 May 07 22:07:16.325992 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2529/5023] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:16.895168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:16.895815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:16.908984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:16.909365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:16.910176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:16.910629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:17.324401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:17.340518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5568f3d5-4f60-4b27-ae0d-14268c020701 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1315 microversion: 2.1 time: 0.449175 May 07 22:07:17.344199 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2495/5024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:16 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:17.511845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e6be1bb-10bb-4a88-a995-a0b7a9784709 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fc6c5e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:17.687905 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8e6be1bb-10bb-4a88-a995-a0b7a9784709 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/afe5cc01-8331-432e-bba2-58a01d7c8178" status: 200 len: 343 microversion: 2.1 time: 0.181087 May 07 22:07:17.688589 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2530/5025] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:17 2022] GET /compute/v2.1/os-volumes/afe5cc01-8331-432e-bba2-58a01d7c8178 => generated 343 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:18.362162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:18.362847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:18.379923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:18.380399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:18.389671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:18.389671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:19.339527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:19.350551 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-67289315-dac5-4774-a7d4-986e6f3c196d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1315 microversion: 2.1 time: 0.994250 May 07 22:07:19.360205 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2496/5026] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:18 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1315 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:19.548166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-56054e1b-dd73-439d-abb2-c01924becd2a tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fc7fca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:19.706704 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-56054e1b-dd73-439d-abb2-c01924becd2a tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/994abfac-15ec-409e-816d-ca7441f8f8d8" status: 200 len: 344 microversion: 2.1 time: 0.184456 May 07 22:07:19.707339 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2531/5027] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:19 2022] GET /compute/v2.1/os-volumes/994abfac-15ec-409e-816d-ca7441f8f8d8 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:20.367829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:20.368683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:20.391480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:20.401296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:20.402494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:20.403189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:20.901851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:20.913158 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d9387360-ebee-4bb5-aeab-412805d8b68e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1315 microversion: 2.1 time: 0.549840 May 07 22:07:20.913759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2497/5028] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:20 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:21.365374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00f34e39-fc06-4fa7-aec5-0e641dc8016b tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fc7f1f0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:21.441088 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00f34e39-fc06-4fa7-aec5-0e641dc8016b tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab" status: 200 len: 343 microversion: 2.1 time: 0.079276 May 07 22:07:21.441688 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2532/5029] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:21 2022] GET /compute/v2.1/os-volumes/84e7a4f5-5a3a-4c8c-8c06-3be2f34259ab => generated 343 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:21.454251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dd94267f-45fc-4412-9a90-31f0b513c33f tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fc19820>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:21.580799 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dd94267f-45fc-4412-9a90-31f0b513c33f tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.130848 May 07 22:07:21.581983 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2498/5030] 10.222.0.32 () {58 vars in 1133 bytes} [Sat May 7 22:07:21 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:21.594170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-430824cc-3142-467e-bc03-34ca395961b0 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fc12ca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:21.884937 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-430824cc-3142-467e-bc03-34ca395961b0 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.294081 May 07 22:07:21.901607 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2533/5031] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 22:07:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:21.912194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c7178b27-e49c-4ebe-ae7a-da21666accb6 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc41c229af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:21.938613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:21.945780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:21.970877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:21.972470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:21.977460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:21.978664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:22.167773 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c7178b27-e49c-4ebe-ae7a-da21666accb6 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.264923 May 07 22:07:22.168572 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2499/5032] 10.222.0.32 () {58 vars in 1133 bytes} [Sat May 7 22:07:21 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:22.182597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51063c9c-873f-4166-a4db-f536e3d246fc tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fc0c160>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:22.402892 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51063c9c-873f-4166-a4db-f536e3d246fc tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.225533 May 07 22:07:22.404426 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2500/5033] 10.222.0.32 () {58 vars in 1166 bytes} [Sat May 7 22:07:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:22.409425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6f2d5599-3b91-4a8d-85fc-fd4263679094 req-e761b721-0267-44c6-bbf8-7a02ba0e1a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d24fe6-4b53-4000-97a9-53c80f13ac5f", "name": "network-vif-plugged", "status": "completed", "tag": "f1c7d1d5-631c-4b90-9f11-73edbb1fc62b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:22.430713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6f2d5599-3b91-4a8d-85fc-fd4263679094 req-e761b721-0267-44c6-bbf8-7a02ba0e1a0e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:22.431471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6f2d5599-3b91-4a8d-85fc-fd4263679094 req-e761b721-0267-44c6-bbf8-7a02ba0e1a0e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:22.446911 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6f2d5599-3b91-4a8d-85fc-fd4263679094 req-e761b721-0267-44c6-bbf8-7a02ba0e1a0e service nova] Creating event network-vif-plugged:f1c7d1d5-631c-4b90-9f11-73edbb1fc62b for instance e9d24fe6-4b53-4000-97a9-53c80f13ac5f on nch2-master-1 May 07 22:07:22.484532 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6f2d5599-3b91-4a8d-85fc-fd4263679094 req-e761b721-0267-44c6-bbf8-7a02ba0e1a0e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078346 May 07 22:07:22.485144 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2501/5034] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:22.504449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-800a890b-3c0b-4d19-a63f-64881f0e886c tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc41c39f310>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:22.633026 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-800a890b-3c0b-4d19-a63f-64881f0e886c tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.146582 May 07 22:07:22.646305 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2502/5035] 10.222.0.32 () {58 vars in 1169 bytes} [Sat May 7 22:07:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:22.656966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b738c7b7-8a1f-44e3-b2a3-99e97263c574 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fcd8f70>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:22.717985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:22.741659 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d9cb8a3d-3e25-4e94-958b-15cffee0f47a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1315 microversion: 2.1 time: 0.810785 May 07 22:07:22.743260 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2534/5036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:21 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:07:22.822140 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b738c7b7-8a1f-44e3-b2a3-99e97263c574 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.173109 May 07 22:07:22.830037 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2503/5037] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 22:07:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:22.836393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0878091d-c979-4c48-a0d6-48a9b983f8c1 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc40fc6ce50>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:22.945149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0878091d-c979-4c48-a0d6-48a9b983f8c1 tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.114311 May 07 22:07:22.945771 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2535/5038] 10.222.0.32 () {58 vars in 1187 bytes} [Sat May 7 22:07:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:22.959882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-73da1b8c-1f3a-474a-9f8e-9646d806216e tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] Calling method '.version_select at 0x7fc41c35d790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:23.080047 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-73da1b8c-1f3a-474a-9f8e-9646d806216e tempest-VolumesTestJSON-1716948367 tempest-VolumesTestJSON-1716948367-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.124214 May 07 22:07:23.081037 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2504/5039] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 22:07:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:23.758746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:23.759973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:23.777872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:23.781546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:23.783828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:23.787725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:24.189221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:24.197176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-280f93ba-17aa-4a52-a20c-8f79a1819763 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1315 microversion: 2.1 time: 0.442369 May 07 22:07:24.202141 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2536/5040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:23 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:24.649059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-74c6c992-18ee-4137-8c1b-bfb1d255d176 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'create', calling method: .version_select at 0x7fc41cc57670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1016777914"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:24.681568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-74c6c992-18ee-4137-8c1b-bfb1d255d176 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:07:24.690133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-74c6c992-18ee-4137-8c1b-bfb1d255d176 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:07:25.149804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-74c6c992-18ee-4137-8c1b-bfb1d255d176 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:07:25.162035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-74c6c992-18ee-4137-8c1b-bfb1d255d176 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:07:25.193204 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-74c6c992-18ee-4137-8c1b-bfb1d255d176 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.548407 May 07 22:07:25.195228 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2505/5041] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:07:24 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:25.220627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:25.222293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:25.238324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:25.239480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:25.243687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:25.244821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:25.712288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:25.725454 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-711f083a-6414-4087-984e-caca8329656c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1503 microversion: 2.1 time: 0.505397 May 07 22:07:25.738748 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2537/5042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:25 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1503 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:25.746864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d90145f-2e50-499a-9d23-287dfb0114af tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:25.748265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d90145f-2e50-499a-9d23-287dfb0114af tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:25.778476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d90145f-2e50-499a-9d23-287dfb0114af tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:25.780801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d90145f-2e50-499a-9d23-287dfb0114af tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:25.787504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d90145f-2e50-499a-9d23-287dfb0114af tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:25.789807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d90145f-2e50-499a-9d23-287dfb0114af tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:26.059488 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d90145f-2e50-499a-9d23-287dfb0114af tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f/action" status: 202 len: 0 microversion: 2.1 time: 0.318921 May 07 22:07:26.063418 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2506/5043] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:07:25 2022] POST /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:07:26.072035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:26.073002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:26.104710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:26.105181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:26.111712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:26.113156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:26.576993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:26.586387 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b56a5f45-ae9d-416e-9527-bcdfb24d7f2d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1508 microversion: 2.1 time: 0.519748 May 07 22:07:26.587310 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2538/5044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:26 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:27.606159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:27.607850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:27.628892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:27.630861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:27.632299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:27.633054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:28.164621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:28.189515 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-091a1824-f184-44df-8f21-a648b512134a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1488 microversion: 2.1 time: 0.588452 May 07 22:07:28.202535 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2507/5045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:27 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1488 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:28.208542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:28.209203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:28.225469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:28.230756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:28.231839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:28.236998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:28.294522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lazy-loading 'flavor' on Instance uuid e9d24fe6-4b53-4000-97a9-53c80f13ac5f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:07:28.965700 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bb820667-dd48-42b4-b9b2-a18cd6c1ed61 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f/action" status: 202 len: 0 microversion: 2.1 time: 0.762049 May 07 22:07:28.978786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:28.984856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:29.006059 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2539/5046] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:07:28 2022] POST /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:07:29.006298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:29.008831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:29.010641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:29.013525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:29.393457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:29.406287 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db09d51d-aeba-488e-bcc9-bc7154da713c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1494 microversion: 2.1 time: 0.434810 May 07 22:07:29.407490 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2508/5047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:28 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1494 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:07:29.669717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1291240740", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "897b8e60-57e6-49f6-8500-632ca34fccf7"}], "key_name": "tempest-TestNetworkBasicOps-1016777914", "security_groups": [{"name": "tempest-secgroup-smoke-176921141"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:29.892548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] validate_networks() for [('897b8e60-57e6-49f6-8500-632ca34fccf7', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:07:30.432886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:30.434312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:30.444645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:30.446440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:30.448060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:30.448709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:30.650354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:30.662662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d2338105-e665-4a90-8a48-440354254032 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1515 microversion: 2.1 time: 0.233576 May 07 22:07:30.664234 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2509/5048] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:30 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:31.003660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:07:31.004243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:07:31.004624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:07:31.005047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:07:31.005539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:07:31.023777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:31.024289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:31.025327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:31.025782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:31.077138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for project 0c313e966d334c26afa43b480ab20fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:07:31.086936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Getting quotas for user 96077bbd65b9449a8b679c2ebb35bdd6 and project 0c313e966d334c26afa43b480ab20fb0. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:07:31.118839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:07:31.123542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:07:31.239779 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4fc9882-b725-433b-b74b-754d74b93787 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.575690 May 07 22:07:31.248094 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2540/5049] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:07:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:07:31.265334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52f0aacf-6331-44c7-ac61-d5a10a32d6fc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:31.265979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-52f0aacf-6331-44c7-ac61-d5a10a32d6fc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:31.363990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52f0aacf-6331-44c7-ac61-d5a10a32d6fc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:31.378747 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52f0aacf-6331-44c7-ac61-d5a10a32d6fc tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1249 microversion: 2.1 time: 0.116879 May 07 22:07:31.390946 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2510/5050] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:31 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:31.681369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:31.682249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:31.701899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:31.702416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:31.717834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:31.727040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:32.397618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:32.398310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:32.422645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:32.423397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:32.425351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:32.428681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:32.704398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:32.721705 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a4f73800-29c4-4bdd-924d-3c185e39c923 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1245 microversion: 2.1 time: 0.328840 May 07 22:07:32.723952 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2511/5051] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:32 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1245 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:07:32.941487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:32.952413 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1bf79368-6092-4d3c-a981-670adb81c3bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 1.274446 May 07 22:07:32.955548 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2541/5052] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:31 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:33.738795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:33.739379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:33.757384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:33.759831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:33.760824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:33.761282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:33.972152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:33.974158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:33.992267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:33.994491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:33.996563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:33.997299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:34.068047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:34.081387 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c9ed123b-15c5-49ac-b175-4cc7f5fa0b2f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1307 microversion: 2.1 time: 0.345266 May 07 22:07:34.093116 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2512/5053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:33 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1307 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:34.100063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6843f6d5-0ad4-4ddb-bc2a-da280e0dec11 req-a43493a1-7fd7-44b7-853e-b43e3abef18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d24fe6-4b53-4000-97a9-53c80f13ac5f", "name": "network-vif-plugged", "status": "completed", "tag": "f1c7d1d5-631c-4b90-9f11-73edbb1fc62b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:34.118661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6843f6d5-0ad4-4ddb-bc2a-da280e0dec11 req-a43493a1-7fd7-44b7-853e-b43e3abef18e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:34.125450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6843f6d5-0ad4-4ddb-bc2a-da280e0dec11 req-a43493a1-7fd7-44b7-853e-b43e3abef18e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:34.168133 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6843f6d5-0ad4-4ddb-bc2a-da280e0dec11 req-a43493a1-7fd7-44b7-853e-b43e3abef18e service nova] Creating event network-vif-plugged:f1c7d1d5-631c-4b90-9f11-73edbb1fc62b for instance e9d24fe6-4b53-4000-97a9-53c80f13ac5f on nch2-master-1 May 07 22:07:34.174251 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6843f6d5-0ad4-4ddb-bc2a-da280e0dec11 req-a43493a1-7fd7-44b7-853e-b43e3abef18e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078891 May 07 22:07:34.175133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2513/5054] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:34.498300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:34.510143 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef835a22-73e4-499d-8e66-da6975c64839 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.542521 May 07 22:07:34.515218 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2542/5055] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:33 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:35.099017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:35.099752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:35.111266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:35.112265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:35.112514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:35.113143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:35.533053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:35.534921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:35.558711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:35.562679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:35.565897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:35.566398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:35.715112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:35.732066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8fea7a09-d212-483b-b684-d1166c1b1d3d tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1374 microversion: 2.1 time: 0.631102 May 07 22:07:35.732795 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2514/5056] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:35 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1374 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:36.666320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:36.681360 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-802e3647-4cc7-46cc-89fb-661f03fa3dfc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 1.153359 May 07 22:07:36.682230 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2543/5057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:35 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:36.753271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:36.754032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:36.773475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:36.774352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:36.775634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:36.778064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:37.201118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:37.211387 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aaf41952-89b1-4248-b7c6-d466046ce95c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1374 microversion: 2.1 time: 0.461760 May 07 22:07:37.214653 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2515/5058] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:36 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1374 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:37.273211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a7ac0b69-598f-4dc8-be3d-0228528493d5 req-76a2c327-494e-451b-b3bd-8488df8dfb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03ed073-40c4-4a7f-aeed-e5ca8f6de50b", "tag": "9f6cb74d-fe46-4c94-9688-bd96403fb562"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:37.285885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a7ac0b69-598f-4dc8-be3d-0228528493d5 req-76a2c327-494e-451b-b3bd-8488df8dfb2e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:37.286347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a7ac0b69-598f-4dc8-be3d-0228528493d5 req-76a2c327-494e-451b-b3bd-8488df8dfb2e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:37.321946 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a7ac0b69-598f-4dc8-be3d-0228528493d5 req-76a2c327-494e-451b-b3bd-8488df8dfb2e service nova] Creating event network-changed:9f6cb74d-fe46-4c94-9688-bd96403fb562 for instance f03ed073-40c4-4a7f-aeed-e5ca8f6de50b on nch2-master-1 May 07 22:07:37.337610 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a7ac0b69-598f-4dc8-be3d-0228528493d5 req-76a2c327-494e-451b-b3bd-8488df8dfb2e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067625 May 07 22:07:37.338398 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2544/5059] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:37.703167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:37.704238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:37.725432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:37.726296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:37.730243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:37.730901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:38.231511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:38.232715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:38.274085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:38.275347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:38.283318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:38.283900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:38.334066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:38.349068 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54b17c3b-4dfb-42cb-a27a-f4516cc43363 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.651585 May 07 22:07:38.349700 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2516/5060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:37 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:38.974859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:38.984289 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-54115d4b-81c3-41c8-b709-a7fc76e51a75 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1374 microversion: 2.1 time: 0.758205 May 07 22:07:38.996188 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2545/5061] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:38 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1374 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:39.367237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:39.368269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:39.388793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:39.393432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:39.395600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:39.399076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:40.014276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:40.015206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:40.038304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:40.039218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:40.045228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:40.048044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:40.364288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:40.372900 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-079cab49-0004-47b0-8a4e-543d1558a5a5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 1.010914 May 07 22:07:40.378060 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2517/5062] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:39 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:40.646763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:40.657928 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e55d3063-bda2-4d67-a8bb-53bce9f9e16b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1374 microversion: 2.1 time: 0.649250 May 07 22:07:40.658504 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2546/5063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:40 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1374 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:41.391617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:41.392064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:41.410216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:41.416361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:41.417366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:41.417823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:41.678970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:41.680306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:41.699684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:41.702964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:41.707030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:41.707818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:41.813946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:41.832331 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f455056b-7840-4ca0-acb6-7cdbc70bcb3c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.446009 May 07 22:07:41.834205 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2518/5064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:41 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:42.193724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:42.203023 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21bb07ca-22cf-4b0d-b88f-e26d7e5ad0e5 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1374 microversion: 2.1 time: 0.530641 May 07 22:07:42.213370 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2547/5065] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:41 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1374 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:42.854106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:42.856051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:42.881567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:42.882308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:42.883653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:42.884724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:43.214635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:43.226866 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-badf86de-572c-44a8-9b7b-f91fafbef1fc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.379294 May 07 22:07:43.232142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:43.233542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:43.238059 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2519/5066] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:42 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:43.248236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:43.249032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:43.250340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:43.252960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:43.662305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:43.688051 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7939d5c5-8abf-41bc-98a7-23e7273dc7bd tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1374 microversion: 2.1 time: 0.462404 May 07 22:07:43.690000 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2548/5067] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:43 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1374 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:07:43.938343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5a7befc6-8690-46b4-ba96-dcec08f40486 req-743bd065-881d-4826-8575-836ce1b2c909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03ed073-40c4-4a7f-aeed-e5ca8f6de50b", "name": "network-vif-plugged", "status": "completed", "tag": "9f6cb74d-fe46-4c94-9688-bd96403fb562"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:43.960097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5a7befc6-8690-46b4-ba96-dcec08f40486 req-743bd065-881d-4826-8575-836ce1b2c909 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:43.962648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5a7befc6-8690-46b4-ba96-dcec08f40486 req-743bd065-881d-4826-8575-836ce1b2c909 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:43.987440 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5a7befc6-8690-46b4-ba96-dcec08f40486 req-743bd065-881d-4826-8575-836ce1b2c909 service nova] Creating event network-vif-plugged:9f6cb74d-fe46-4c94-9688-bd96403fb562 for instance f03ed073-40c4-4a7f-aeed-e5ca8f6de50b on nch2-master-1 May 07 22:07:43.998573 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5a7befc6-8690-46b4-ba96-dcec08f40486 req-743bd065-881d-4826-8575-836ce1b2c909 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065675 May 07 22:07:44.001774 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2520/5068] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:44.245498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:44.246141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:44.258717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:44.259429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:44.260812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:44.262706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:44.457579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:44.468536 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0dae8415-e0c5-442c-8bac-c70f67fa82f8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.227526 May 07 22:07:44.474964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2549/5069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:44 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:44.707869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:44.708598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:44.721048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:44.722851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:44.723896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:44.724617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:44.968621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:44.977379 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2cd8173c-d01a-4b64-8431-3661337c4ce1 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1374 microversion: 2.1 time: 0.274363 May 07 22:07:45.003674 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2521/5070] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:44 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:45.495701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:45.496876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:45.510234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:45.511114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:45.515139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:45.515975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:45.895671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:45.911434 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-175311de-c527-4cbd-b38f-8ced43f5df5a tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.426746 May 07 22:07:45.923580 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2550/5071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:45 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:46.009587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:46.010213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:46.026542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:46.031773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:46.036696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:46.038870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:46.334850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:46.347082 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9fbf83b7-87c3-41af-813a-6e9ee184f569 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1544 microversion: 2.1 time: 0.343364 May 07 22:07:46.349727 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2522/5072] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:46 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1544 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:46.365913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:46.367174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:46.374114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:46.374569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:46.375575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:46.376322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:46.565113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:46.574097 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d0debebb-7c26-4923-b882-e7053874c66f tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1544 microversion: 2.1 time: 0.211982 May 07 22:07:46.577748 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2551/5073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:46 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1544 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:46.932027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:46.933059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:46.944527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:46.949784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:46.951475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:46.952134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:47.218981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:47.241092 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-919da66d-6dec-45c9-97aa-47ca3768503b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.313062 May 07 22:07:47.245736 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2523/5074] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:46 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:48.263239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:48.264737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:48.284696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:48.285456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:48.286840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:48.288190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:48.712834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:48.726462 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07b9896d-0a94-4530-a4b8-335a756a5ae8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.468987 May 07 22:07:48.739222 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2552/5075] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:48 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:49.529120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2cf7bf4f-171d-412c-98ec-863a57c58c15 req-3f152d67-f0ab-4b34-ab3c-ef2eaf8936d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03ed073-40c4-4a7f-aeed-e5ca8f6de50b", "tag": "9f6cb74d-fe46-4c94-9688-bd96403fb562"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:49.556916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2cf7bf4f-171d-412c-98ec-863a57c58c15 req-3f152d67-f0ab-4b34-ab3c-ef2eaf8936d9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:49.559406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2cf7bf4f-171d-412c-98ec-863a57c58c15 req-3f152d67-f0ab-4b34-ab3c-ef2eaf8936d9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:49.589802 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2cf7bf4f-171d-412c-98ec-863a57c58c15 req-3f152d67-f0ab-4b34-ab3c-ef2eaf8936d9 service nova] Creating event network-changed:9f6cb74d-fe46-4c94-9688-bd96403fb562 for instance f03ed073-40c4-4a7f-aeed-e5ca8f6de50b on nch2-master-1 May 07 22:07:49.602419 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2cf7bf4f-171d-412c-98ec-863a57c58c15 req-3f152d67-f0ab-4b34-ab3c-ef2eaf8936d9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078426 May 07 22:07:49.610094 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2524/5076] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:07:49.744184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:49.744828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:49.763968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:49.766289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:49.769468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:49.771403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:50.043173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:50.052979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-041cd8b3-2fe1-4cb8-9406-9d7a2720316d tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.312994 May 07 22:07:50.053581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2553/5077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:49 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:51.073899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:51.076109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:51.084133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:51.085622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:51.088920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:51.089598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:51.407521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:51.425908 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-81d14efe-f039-4075-b0cd-adb396cd5c4b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.359998 May 07 22:07:51.433902 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2525/5078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:51 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:52.459848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:52.461704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:52.470730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:52.471922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:52.473370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:52.474047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:52.637547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:52.649570 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab5d1006-a64b-4d36-a31b-a591e37b153b tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.203549 May 07 22:07:52.650906 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2554/5079] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:52 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:53.670219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:53.679301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:53.691663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:53.692216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:53.693100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:53.693619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:53.939404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:53.957856 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-497123c8-103b-4809-95ea-005f912283a0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.292247 May 07 22:07:53.960183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2526/5080] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:53 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:54.982194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:54.982841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:54.994501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:54.994988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:54.995782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:54.996227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:55.355115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:55.370018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1d58093e-e8b8-42b9-8a11-90dc8591bbb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1507 microversion: 2.1 time: 0.390540 May 07 22:07:55.372039 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2555/5081] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:54 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:56.389789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:56.390686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:56.400215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:56.400676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:56.401481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:56.401928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:56.666623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:56.675264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2dd1a8bc-a8fd-4289-b1d5-b381da062bcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 200 len: 1510 microversion: 2.1 time: 0.289954 May 07 22:07:56.680161 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2527/5082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:56 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:56.696968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:56.697586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:56.720172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:56.722002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:56.724553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:56.725244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:56.972078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:56.981652 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7daf877a-2493-49d6-9abd-68a0edd1bcb0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.288662 May 07 22:07:56.992752 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2556/5083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:56 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:57.003403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:57.004255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:57.019255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:57.019818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:57.020924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:57.023077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:57.281808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:57.298213 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4324255e-a3c5-4599-8680-f1c3de9acdae tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.299760 May 07 22:07:57.304541 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2528/5084] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:56 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:57.315359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:57.316232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:57.323009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:57.326665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:57.330056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:57.330759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:57.589262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:57.599583 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8f97df9f-941e-4514-93e6-7b00fd304ff1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.288203 May 07 22:07:57.604260 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2557/5085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:57 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:57.620880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:57.621662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:57.630728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:57.631219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:57.632026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:57.632475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:57.739186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d51ea988-79e4-44c6-a3a6-6abad262a6f1 req-151ad5ac-9439-4e47-965d-69dda8f1ad2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d24fe6-4b53-4000-97a9-53c80f13ac5f", "name": "network-vif-unplugged", "status": "completed", "tag": "f1c7d1d5-631c-4b90-9f11-73edbb1fc62b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:57.756379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d51ea988-79e4-44c6-a3a6-6abad262a6f1 req-151ad5ac-9439-4e47-965d-69dda8f1ad2a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:57.756841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d51ea988-79e4-44c6-a3a6-6abad262a6f1 req-151ad5ac-9439-4e47-965d-69dda8f1ad2a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:57.791520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.compute.server_external_events [req-d51ea988-79e4-44c6-a3a6-6abad262a6f1 req-151ad5ac-9439-4e47-965d-69dda8f1ad2a service nova] Unable to find a host for instance e9d24fe6-4b53-4000-97a9-53c80f13ac5f. Dropping event network-vif-unplugged {{(pid=136682) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 07 22:07:57.792648 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d51ea988-79e4-44c6-a3a6-6abad262a6f1 req-151ad5ac-9439-4e47-965d-69dda8f1ad2a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058582 May 07 22:07:57.794271 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2558/5086] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 07 22:07:57.958611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:57.977165 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1113e6a4-ab5b-4222-b90d-f02ed3bba5b7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.361170 May 07 22:07:57.979584 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2529/5087] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:57 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:07:57.996349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7f1917a-1801-45cd-a83f-70382264b7ce tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:07:58.007140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7f1917a-1801-45cd-a83f-70382264b7ce tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:58.009652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7f1917a-1801-45cd-a83f-70382264b7ce tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:58.068930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7f1917a-1801-45cd-a83f-70382264b7ce tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:07:58.150501 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7f1917a-1801-45cd-a83f-70382264b7ce tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.157916 May 07 22:07:58.159600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:58.160231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:58.167844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:58.168327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:58.169590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2559/5088] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:07:57 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:07:58.183407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:58.186473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:58.468421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:58.480006 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54860564-301d-46cb-8b22-e354c9b52d57 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.324354 May 07 22:07:58.490280 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2530/5089] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:58 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:07:59.498824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:07:59.499544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:07:59.514731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:59.515503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:59.516472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:07:59.517081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:07:59.809794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:07:59.819798 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-adc6711e-ca7c-45a6-9a7d-7539da64d025 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.325637 May 07 22:07:59.821035 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2560/5090] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:59 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:00.840848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:00.841785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:00.858633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:00.859776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:00.864945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:00.867665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:01.183284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:01.206255 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-00c23840-4afd-4cb4-bf7d-7d0abe2c47e2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.370918 May 07 22:08:01.208211 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2531/5091] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:00 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:02.230388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:02.231784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:02.258944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:02.259641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:02.261393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:02.262454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:02.587499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:02.597571 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f2993a95-48bf-43d5-b7a9-6a57067320e4 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.375610 May 07 22:08:02.601577 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2561/5092] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:02 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:03.618503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:03.619984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:03.629914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:03.630631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:03.631845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:03.632514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:03.849508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:03.863586 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aba103ba-6d08-42cf-a0c1-0377779cd4e0 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.249748 May 07 22:08:03.867473 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2532/5093] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:03 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:04.885402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:04.886027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:04.903322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:04.911559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:04.913073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:04.913547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:05.291162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:05.311674 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da399e3f-1100-49f7-963d-b4f42af96535 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.430286 May 07 22:08:05.313478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2562/5094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:04 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:06.333604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:06.334382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:06.356053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:06.356869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:06.357901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:06.358508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:06.565562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:06.578920 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3521362a-d6f7-4b38-a055-b51d49540367 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.249708 May 07 22:08:06.580402 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2533/5095] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:06 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:07.600349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:07.601801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:07.610125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:07.610856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:07.611825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:07.612423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:08.050120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:08.065225 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-58d5264f-a68b-480b-8d9b-701934689a76 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1679 microversion: 2.1 time: 0.471519 May 07 22:08:08.066115 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2563/5096] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:07 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1679 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:09.084383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:09.084950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:09.100437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:09.101152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:09.102115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:09.102736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:09.409243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:09.421123 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-25d3144f-5a3a-4cf5-bf5d-c84eec9feb64 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1656 microversion: 2.1 time: 0.340815 May 07 22:08:09.425787 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2534/5097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:09 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1656 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:09.443290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3337ac49-4ed0-496d-a2a2-b89555186117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:09.455783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3337ac49-4ed0-496d-a2a2-b89555186117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:09.456275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3337ac49-4ed0-496d-a2a2-b89555186117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:09.504956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3337ac49-4ed0-496d-a2a2-b89555186117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Going to try to start instance {{(pid=136682) start /opt/stack/nova/nova/compute/api.py:2730}} May 07 22:08:09.574833 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3337ac49-4ed0-496d-a2a2-b89555186117 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.134848 May 07 22:08:09.576409 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2564/5098] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:08:09 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:08:09.584877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:09.586003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:09.596358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:09.597071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:09.598306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:09.598747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:09.952045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:09.977985 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-feb6d4ca-d17d-4288-9d6a-7e00724d8fd8 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1665 microversion: 2.1 time: 0.397206 May 07 22:08:09.983269 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2535/5099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:09 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1665 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:10.999745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:11.002387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:11.022927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:11.023414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:11.024199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:11.026870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:11.257778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:11.265632 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d5a7053-ca24-4e3f-abc0-9db9876eb610 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1665 microversion: 2.1 time: 0.274064 May 07 22:08:11.266216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2565/5100] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:10 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1665 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:12.049360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d1bfd21-d624-4b7d-8491-fbe64074c12c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:12.053667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d1bfd21-d624-4b7d-8491-fbe64074c12c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:12.074917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1bfd21-d624-4b7d-8491-fbe64074c12c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:12.075379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1bfd21-d624-4b7d-8491-fbe64074c12c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:12.078856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1bfd21-d624-4b7d-8491-fbe64074c12c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:12.079487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d1bfd21-d624-4b7d-8491-fbe64074c12c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:12.188147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d1bfd21-d624-4b7d-8491-fbe64074c12c tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b/action" status: 200 len: 24568 microversion: 2.1 time: 0.145314 May 07 22:08:12.190691 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2536/5101] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:08:12 2022] POST /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b/action => generated 24568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:08:12.285699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:12.287375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:12.301609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:12.302077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:12.305672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:12.306415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:12.712314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:12.722944 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef01fc82-b5ca-4f6f-a6a5-a288fb07541f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.442589 May 07 22:08:12.733902 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2566/5102] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:12 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:12.753702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:12.755269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:12.769681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:12.787218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:12.788094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:12.788557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:13.167531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:13.180464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79a069b0-d247-4eee-be5a-86737b4a77ea tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.432173 May 07 22:08:13.214113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:13.216040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:13.224163 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2537/5103] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:12 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:13.232234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:13.236139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:13.237448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:13.237913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:13.575622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:13.590532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c649c40b-e335-4f98-a48e-7ff756a35c1c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.380660 May 07 22:08:13.592702 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2567/5104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:13 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:13.610560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:13.611709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:13.623295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:13.625044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:13.626975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:13.628818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:14.348972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:14.361641 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f6634a5-c7af-4c4d-9b26-4ea1be492f1e tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.757300 May 07 22:08:14.363850 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2538/5105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:13 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:14.382241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:14.382896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:14.394165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:14.394640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:14.395482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:14.395932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:14.676425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:14.688266 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6cfffb72-2716-49e4-bf70-07821d919148 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.310336 May 07 22:08:14.705856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:14.706411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:14.717478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2568/5106] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:14 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:14.721898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:14.722545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:14.723541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:14.724143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:14.767027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lazy-loading 'flavor' on Instance uuid 4996f091-2316-4100-b272-d2af7738b4ac {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:08:14.894404 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a0f29430-3696-45c1-99e0-3f589a8187e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.190480 May 07 22:08:14.897741 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2539/5107] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:08:14 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:08:14.905138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:14.905792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:14.916873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:14.918892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:14.920864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:14.922292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:15.223889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:15.240607 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1062cb2e-36ea-4928-a6bc-d0f0320667bc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1677 microversion: 2.1 time: 0.339605 May 07 22:08:15.241297 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2569/5108] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:14 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1677 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:16.263408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:16.264133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:16.278109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:16.278575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:16.279406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:16.279854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:16.557768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:16.567426 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f8fa93bc-c536-4a8a-81cc-afd10f672c13 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1660 microversion: 2.1 time: 0.309277 May 07 22:08:16.572926 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2540/5109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:16 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1660 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:16.598359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ce65ed5-63d7-4eac-a6e7-a478dacb0120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:16.599043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ce65ed5-63d7-4eac-a6e7-a478dacb0120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:16.608725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ce65ed5-63d7-4eac-a6e7-a478dacb0120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:16.609785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ce65ed5-63d7-4eac-a6e7-a478dacb0120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:16.610910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ce65ed5-63d7-4eac-a6e7-a478dacb0120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:16.612112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ce65ed5-63d7-4eac-a6e7-a478dacb0120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:16.750347 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ce65ed5-63d7-4eac-a6e7-a478dacb0120 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action" status: 202 len: 0 microversion: 2.1 time: 0.157905 May 07 22:08:16.751637 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2570/5110] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:08:16 2022] POST /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:08:16.759485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:16.760437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:16.768136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:16.768929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:16.769966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:16.770737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:17.191431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:17.199227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eed36ade-8ed6-46f9-ba66-2718694fee8f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1666 microversion: 2.1 time: 0.443620 May 07 22:08:17.203370 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2541/5111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:16 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1666 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:08:18.219195 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:18.219913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:18.238346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:18.239038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:18.240054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:18.243395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:18.665645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:18.679710 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c73e69b0-f0e0-470c-9c5e-8f0041c7c6f5 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1666 microversion: 2.1 time: 0.463640 May 07 22:08:18.681491 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2571/5112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:18 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1666 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:18.875273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-10b10c1e-5b66-4bda-8410-e1c7ac3d8f6e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:18.876569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-10b10c1e-5b66-4bda-8410-e1c7ac3d8f6e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:18.889539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10b10c1e-5b66-4bda-8410-e1c7ac3d8f6e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:18.891901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10b10c1e-5b66-4bda-8410-e1c7ac3d8f6e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:18.892726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10b10c1e-5b66-4bda-8410-e1c7ac3d8f6e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:18.893178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-10b10c1e-5b66-4bda-8410-e1c7ac3d8f6e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:18.974900 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-10b10c1e-5b66-4bda-8410-e1c7ac3d8f6e tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "POST /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b/action" status: 200 len: 32640 microversion: 2.1 time: 0.104167 May 07 22:08:18.992974 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2542/5113] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:08:18 2022] POST /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b/action => generated 32640 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:08:19.708101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:19.708795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:19.728468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:19.729518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:19.733592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:19.734099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:20.037841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:20.045798 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c736242-3ca4-4fe2-9083-017c9eab9fd6 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.344305 May 07 22:08:20.046391 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2572/5114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:19 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:20.067659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:20.068927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:20.096637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:20.097363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:20.107915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:20.108628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:20.750587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:20.766356 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b576eb77-efdd-482e-8696-3974ac4dab66 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1669 microversion: 2.1 time: 0.703741 May 07 22:08:20.792217 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2543/5115] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:20 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1669 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:20.800524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:20.801042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:20.809492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:20.809963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:20.810861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:20.811255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:20.902993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:08:20.921764 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Working on deleting snapshot 72983ace-b890-4fa2-8187-6dffbfdb16f9 from shelved instance... May 07 22:08:22.371922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:22.372540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:22.400269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:22.401139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:22.403126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:22.404354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:22.511158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:08:22.838192 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94984f56-c340-4022-aa0b-57c103c31957 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 204 len: 0 microversion: 2.1 time: 0.483736 May 07 22:08:22.839143 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2544/5116] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:08:22 2022] DELETE /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:08:22.851648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-db594668-a044-45b0-bff5-934981bb1f3a req-c94d9359-3cf5-4fc4-9ebd-1c071672ad1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03ed073-40c4-4a7f-aeed-e5ca8f6de50b", "tag": "9f6cb74d-fe46-4c94-9688-bd96403fb562"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:22.911315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-db594668-a044-45b0-bff5-934981bb1f3a req-c94d9359-3cf5-4fc4-9ebd-1c071672ad1e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:22.920178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-db594668-a044-45b0-bff5-934981bb1f3a req-c94d9359-3cf5-4fc4-9ebd-1c071672ad1e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:22.959721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-db594668-a044-45b0-bff5-934981bb1f3a req-c94d9359-3cf5-4fc4-9ebd-1c071672ad1e service nova] Creating event network-changed:9f6cb74d-fe46-4c94-9688-bd96403fb562 for instance f03ed073-40c4-4a7f-aeed-e5ca8f6de50b on nch2-master-1 May 07 22:08:22.968593 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-db594668-a044-45b0-bff5-934981bb1f3a req-c94d9359-3cf5-4fc4-9ebd-1c071672ad1e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127678 May 07 22:08:22.972755 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2545/5117] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:22.991490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:23.001225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:23.031849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:23.035335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:23.036421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:23.039659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:23.261330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Doing local delete in cell 6aeab614-f3b8-4d04-8f8a-0ac34a04d05f(cell1) {{(pid=136682) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 07 22:08:23.262121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:23.262544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:23.263014 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 07 22:08:23.303281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] deallocate_for_instance() {{(pid=136682) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 07 22:08:23.472201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:23.481692 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d9c90798-3995-4374-a0d9-6c35f3043539 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1669 microversion: 2.1 time: 0.506736 May 07 22:08:23.494213 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2546/5118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:22 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1669 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:24.500435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:24.501987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:24.510317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:24.511926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:24.513279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:24.513942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:24.783299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Updating instance_info_cache with network_info: [] {{(pid=136682) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 07 22:08:25.487699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:25.516876 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-91553bc6-2a16-4e65-a985-37f6a959d598 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1669 microversion: 2.1 time: 1.020868 May 07 22:08:25.531982 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2547/5119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:24 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1669 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:25.546267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e740ce54-759e-4e1c-b6f8-5916936f56d6 req-f5e7891d-2186-4b1b-bcc2-31b4e9206983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d24fe6-4b53-4000-97a9-53c80f13ac5f", "name": "network-vif-deleted", "tag": "f1c7d1d5-631c-4b90-9f11-73edbb1fc62b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:25.556829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e740ce54-759e-4e1c-b6f8-5916936f56d6 req-f5e7891d-2186-4b1b-bcc2-31b4e9206983 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:25.557730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e740ce54-759e-4e1c-b6f8-5916936f56d6 req-f5e7891d-2186-4b1b-bcc2-31b4e9206983 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:25.585981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.compute.server_external_events [req-e740ce54-759e-4e1c-b6f8-5916936f56d6 req-f5e7891d-2186-4b1b-bcc2-31b4e9206983 service nova] Unable to find a host for instance e9d24fe6-4b53-4000-97a9-53c80f13ac5f. Dropping event network-vif-deleted {{(pid=136681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 07 22:08:25.587267 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e740ce54-759e-4e1c-b6f8-5916936f56d6 req-f5e7891d-2186-4b1b-bcc2-31b4e9206983 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053394 May 07 22:08:25.588573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2548/5120] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 07 22:08:25.806389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-85a762eb-8023-4dbe-97bd-2a744bbec3a9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 204 len: 0 microversion: 2.1 time: 5.009047 May 07 22:08:25.807856 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2573/5121] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:08:20 2022] DELETE /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 0 bytes in 5012 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:08:25.835017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:25.836020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: e9d24fe6-4b53-4000-97a9-53c80f13ac5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:25.849601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:25.851096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:25.852174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:25.852788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:25.875021 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] HTTP exception thrown: Instance e9d24fe6-4b53-4000-97a9-53c80f13ac5f could not be found. May 07 22:08:25.875952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Returning 404 to user: Instance e9d24fe6-4b53-4000-97a9-53c80f13ac5f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:08:25.877736 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-07aae6c6-79aa-4dc1-b8a1-8347d324b8b1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f" status: 404 len: 111 microversion: 2.1 time: 0.057860 May 07 22:08:25.881104 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2549/5122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:25 2022] GET /compute/v2.1/servers/e9d24fe6-4b53-4000-97a9-53c80f13ac5f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:08:25.890396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:25.890950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:25.898151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:25.898612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:25.900924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:25.904820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:25.945103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:08:26.086591 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-127fb836-600a-4ce8-a649-a2e9562e8042 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 204 len: 0 microversion: 2.1 time: 0.199688 May 07 22:08:26.088499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2574/5123] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:08:25 2022] DELETE /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:08:26.102499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:26.103204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:26.115412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:26.115992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:26.119122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:26.120950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:26.411068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:26.441019 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3739737-b5d2-4fb7-b23a-62211496b4b2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1466 microversion: 2.1 time: 0.346933 May 07 22:08:26.466980 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2550/5124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:26 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1466 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:26.540762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:26.541953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:26.565011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:26.566099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:26.567287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:26.568279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:26.772151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96077bbd65b9449a8b679c2ebb35bdd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c313e966d334c26afa43b480ab20fb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:26.790323 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d877adac-db39-436a-83c4-c55ca4fe4f50 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 200 len: 1602 microversion: 2.1 time: 0.256000 May 07 22:08:26.791512 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2575/5125] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:26 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 1602 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:26.894478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-52480cc0-4784-4f98-a362-8b52d7f5fe97 req-c8880612-fa4e-4820-be6d-819d3fcddd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03ed073-40c4-4a7f-aeed-e5ca8f6de50b", "name": "network-vif-deleted", "tag": "9f6cb74d-fe46-4c94-9688-bd96403fb562"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:26.924744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-52480cc0-4784-4f98-a362-8b52d7f5fe97 req-c8880612-fa4e-4820-be6d-819d3fcddd2a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:26.935165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-52480cc0-4784-4f98-a362-8b52d7f5fe97 req-c8880612-fa4e-4820-be6d-819d3fcddd2a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:26.990838 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-52480cc0-4784-4f98-a362-8b52d7f5fe97 req-c8880612-fa4e-4820-be6d-819d3fcddd2a service nova] Creating event network-vif-deleted:9f6cb74d-fe46-4c94-9688-bd96403fb562 for instance f03ed073-40c4-4a7f-aeed-e5ca8f6de50b on nch2-master-1 May 07 22:08:27.001271 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-52480cc0-4784-4f98-a362-8b52d7f5fe97 req-c8880612-fa4e-4820-be6d-819d3fcddd2a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114731 May 07 22:08:27.010042 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2551/5126] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:27.462228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:27.463716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:27.479171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:27.481574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:27.484824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:27.485743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:27.813061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:27.813826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] [instance: f03ed073-40c4-4a7f-aeed-e5ca8f6de50b] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:27.833674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:27.833674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:27.834256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:27.835176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:27.906027 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] HTTP exception thrown: Instance f03ed073-40c4-4a7f-aeed-e5ca8f6de50b could not be found. May 07 22:08:27.907741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Returning 404 to user: Instance f03ed073-40c4-4a7f-aeed-e5ca8f6de50b could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:08:27.915600 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85cf5135-7aa9-4809-959a-2385ae961a74 tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b" status: 404 len: 111 microversion: 2.1 time: 0.110300 May 07 22:08:27.917219 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2552/5127] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:27 2022] GET /compute/v2.1/servers/f03ed073-40c4-4a7f-aeed-e5ca8f6de50b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:08:28.390814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c03bc45-4d20-46cc-b4cd-09553d5ed11b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] Calling method '.version_select at 0x7fc41ca843a0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:28.454520 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c03bc45-4d20-46cc-b4cd-09553d5ed11b tempest-TestNetworkBasicOps-1898203269 tempest-TestNetworkBasicOps-1898203269-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1016777914" status: 202 len: 0 microversion: 2.1 time: 0.068299 May 07 22:08:28.460559 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2553/5128] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 22:08:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1016777914 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:08:28.703977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:28.717239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1957d84c-5707-4da8-b5e0-0e83ee3b1900 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1466 microversion: 2.1 time: 1.257968 May 07 22:08:28.718215 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2576/5129] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:27 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1466 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:29.736601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:29.737366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:29.748975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:29.749525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:29.750335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:29.750879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:30.074199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:30.086122 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b3b5680-6d9d-412c-9e16-251017402286 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 200 len: 1466 microversion: 2.1 time: 0.350962 May 07 22:08:30.095536 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2554/5130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:29 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 1466 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:30.103259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c9e5bc2e-8790-46fa-bc3b-236cdb35148d req-905d9d8e-4bc5-4596-a8dd-e1524e3f16da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0131044-3724-490e-88e0-5fca28fe6ee3", "name": "network-vif-deleted", "tag": "2e65b025-887f-40c7-9d7c-68a722d64bc2"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:30.149529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c9e5bc2e-8790-46fa-bc3b-236cdb35148d req-905d9d8e-4bc5-4596-a8dd-e1524e3f16da service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:30.152212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c9e5bc2e-8790-46fa-bc3b-236cdb35148d req-905d9d8e-4bc5-4596-a8dd-e1524e3f16da service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:30.196264 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c9e5bc2e-8790-46fa-bc3b-236cdb35148d req-905d9d8e-4bc5-4596-a8dd-e1524e3f16da service nova] Creating event network-vif-deleted:2e65b025-887f-40c7-9d7c-68a722d64bc2 for instance c0131044-3724-490e-88e0-5fca28fe6ee3 on nch1-master-1 May 07 22:08:30.219541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c9e5bc2e-8790-46fa-bc3b-236cdb35148d req-905d9d8e-4bc5-4596-a8dd-e1524e3f16da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119685 May 07 22:08:30.221249 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2577/5131] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:31.110665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:31.111414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: c0131044-3724-490e-88e0-5fca28fe6ee3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:31.130864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:31.130864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:31.131664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:31.132113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:31.172726 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] HTTP exception thrown: Instance c0131044-3724-490e-88e0-5fca28fe6ee3 could not be found. May 07 22:08:31.173421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Returning 404 to user: Instance c0131044-3724-490e-88e0-5fca28fe6ee3 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:08:31.174352 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4ff639c1-a82e-4172-ab71-7b3a52e2adf3 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3" status: 404 len: 111 microversion: 2.1 time: 0.070478 May 07 22:08:31.174964 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2555/5132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:31 2022] GET /compute/v2.1/servers/c0131044-3724-490e-88e0-5fca28fe6ee3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:08:31.185750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:31.187286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:31.205315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:31.205821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:31.206626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:31.210132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:31.293367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:08:31.556809 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3dd4a8f3-910c-4a8f-a180-3da4da2266d7 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 204 len: 0 microversion: 2.1 time: 0.376475 May 07 22:08:31.557930 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2578/5133] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:08:31 2022] DELETE /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:08:31.568183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:31.568856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:31.584612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:31.585066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:31.591080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:31.593341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:31.893182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:31.906503 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a24dd99b-6c94-4191-b44a-ee88381cc0ac tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1508 microversion: 2.1 time: 0.344022 May 07 22:08:31.907515 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2556/5134] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:31 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1508 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:32.930198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:32.931800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:32.952427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:32.957217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:32.958101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:32.959372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:33.781556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:33.791698 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-311b9c43-fa2c-4fb3-8e67-c1b195e638f1 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1508 microversion: 2.1 time: 0.869194 May 07 22:08:33.796588 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2579/5135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:32 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1508 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:34.595369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-679b1899-0228-45c8-816f-cf88586cc4d9 req-058c6978-a0e5-4acf-b97b-2e219f202b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efbfca97-f4f7-4462-aa1f-5b1936c45d96", "name": "network-vif-deleted", "tag": "4c002f8a-6eee-4016-aa09-cc73c944ce61"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:34.633335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-679b1899-0228-45c8-816f-cf88586cc4d9 req-058c6978-a0e5-4acf-b97b-2e219f202b1a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:34.635362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-679b1899-0228-45c8-816f-cf88586cc4d9 req-058c6978-a0e5-4acf-b97b-2e219f202b1a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:34.677293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-679b1899-0228-45c8-816f-cf88586cc4d9 req-058c6978-a0e5-4acf-b97b-2e219f202b1a service nova] Creating event network-vif-deleted:4c002f8a-6eee-4016-aa09-cc73c944ce61 for instance efbfca97-f4f7-4462-aa1f-5b1936c45d96 on nch1-master-1 May 07 22:08:34.688043 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-679b1899-0228-45c8-816f-cf88586cc4d9 req-058c6978-a0e5-4acf-b97b-2e219f202b1a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107577 May 07 22:08:34.690256 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2557/5136] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:34.810858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:34.811949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:34.841505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:34.842942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:34.846738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:34.848059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:35.050740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:35.051290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:35.055183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lazy-loading 'fault' on Instance uuid efbfca97-f4f7-4462-aa1f-5b1936c45d96 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:08:35.126349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:35.144326 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d34c9923-c37c-4e0a-8bcb-5a65ac4afa56 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 200 len: 1305 microversion: 2.1 time: 0.339110 May 07 22:08:35.148048 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2580/5137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:34 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 1305 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:36.165901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:36.168120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: efbfca97-f4f7-4462-aa1f-5b1936c45d96] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:36.179978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:36.183686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:36.184845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:36.185576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:36.216654 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] HTTP exception thrown: Instance efbfca97-f4f7-4462-aa1f-5b1936c45d96 could not be found. May 07 22:08:36.217689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Returning 404 to user: Instance efbfca97-f4f7-4462-aa1f-5b1936c45d96 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:08:36.219178 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-399f41d2-f061-4d95-8c47-97c3b4af27e9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96" status: 404 len: 111 microversion: 2.1 time: 0.057491 May 07 22:08:36.222148 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2558/5138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:36 2022] GET /compute/v2.1/servers/efbfca97-f4f7-4462-aa1f-5b1936c45d96 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:08:36.231142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:36.231687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:36.246706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:36.247199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:36.248032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:36.248456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:36.329133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:08:36.517737 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c4d3d94d-2ae5-450c-98bb-b9a8fec11f77 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 204 len: 0 microversion: 2.1 time: 0.289016 May 07 22:08:36.521213 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2581/5139] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:08:36 2022] DELETE /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:08:36.534135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:36.534925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:36.546820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:36.547491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:36.549800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:36.550479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:37.008476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-266361277", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:37.142558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] validate_networks() for None {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:08:37.526043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:37.553071 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a69857ea-ae9b-441b-899c-65ce87103803 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1495 microversion: 2.1 time: 1.021984 May 07 22:08:37.556468 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2559/5140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:36 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1495 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:38.297083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:08:38.298115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:08:38.298891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:08:38.300044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:08:38.301981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:08:38.324436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:38.324906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:38.325732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:38.330491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:38.376599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Getting quotas for project e2bec96bf83d4fb296cbb8aeb28d576e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:08:38.385446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Getting quotas for user 38e6d754538146aea01b0f51c8e2cc2f and project e2bec96bf83d4fb296cbb8aeb28d576e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:08:38.428057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:08:38.442128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:08:38.579116 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4609ad54-0257-4df4-99b7-6c75beb95ad6 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575790 May 07 22:08:38.580144 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2582/5141] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:08:38.584776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:38.586460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:38.619551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:38.620015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:38.625323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90b9e201-abc4-486b-a0bf-77beeb7d5056 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:38.625968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-90b9e201-abc4-486b-a0bf-77beeb7d5056 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:38.631197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:38.631670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:38.897045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-90b9e201-abc4-486b-a0bf-77beeb7d5056 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:38.990036 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90b9e201-abc4-486b-a0bf-77beeb7d5056 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1213 microversion: 2.1 time: 0.379578 May 07 22:08:38.997684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2583/5142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:38 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1213 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:39.301263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c37862c1-84eb-45b0-b8ae-44ba27037418 req-80823548-90a3-4d45-9702-fcb7923af886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61d59b-e750-459a-a73a-0376bdf5ca51", "name": "network-vif-deleted", "tag": "21b489d6-f673-44e1-848f-8bbe1b3aef5c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:39.352841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c37862c1-84eb-45b0-b8ae-44ba27037418 req-80823548-90a3-4d45-9702-fcb7923af886 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:39.353481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c37862c1-84eb-45b0-b8ae-44ba27037418 req-80823548-90a3-4d45-9702-fcb7923af886 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:39.381411 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c37862c1-84eb-45b0-b8ae-44ba27037418 req-80823548-90a3-4d45-9702-fcb7923af886 service nova] Creating event network-vif-deleted:21b489d6-f673-44e1-848f-8bbe1b3aef5c for instance ba61d59b-e750-459a-a73a-0376bdf5ca51 on nch1-master-1 May 07 22:08:39.396225 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c37862c1-84eb-45b0-b8ae-44ba27037418 req-80823548-90a3-4d45-9702-fcb7923af886 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100162 May 07 22:08:39.396799 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2584/5143] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:08:39.461600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:39.473531 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-77267ba7-5484-496f-ad49-e9788a7e39ad tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1495 microversion: 2.1 time: 0.903245 May 07 22:08:39.474801 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2560/5144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:38 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1495 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:40.016954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:40.018448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:40.044675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:40.047450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:40.049596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:40.050651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:40.499035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:40.499994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:40.529201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:40.532346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:40.534476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:40.537284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:40.681660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:40.684784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:40.685754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lazy-loading 'fault' on Instance uuid ba61d59b-e750-459a-a73a-0376bdf5ca51 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:08:40.844892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:40.853576 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fc49ea4c-24a2-4505-b74e-4297554b685c tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 200 len: 1305 microversion: 2.1 time: 0.366016 May 07 22:08:40.854417 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2561/5145] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:40 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 1305 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:40.859063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:40.867471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-979e4592-f104-4190-9029-e69e82a08af4 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1265 microversion: 2.1 time: 0.859812 May 07 22:08:40.868412 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2585/5146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:40 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1265 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:41.598561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1356595263", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "75e42e23-8e74-41bd-9a60-3536f620fe26"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:41.674239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] validate_networks() for [('75e42e23-8e74-41bd-9a60-3536f620fe26', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:08:41.875748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:41.878981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: ba61d59b-e750-459a-a73a-0376bdf5ca51] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:41.891020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:41.891730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:41.893418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:41.894268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:41.923502 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] HTTP exception thrown: Instance ba61d59b-e750-459a-a73a-0376bdf5ca51 could not be found. May 07 22:08:41.925491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Returning 404 to user: Instance ba61d59b-e750-459a-a73a-0376bdf5ca51 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:08:41.927684 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f12a3418-98d9-4396-8a7f-9480df04abcc tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51" status: 404 len: 111 microversion: 2.1 time: 0.059406 May 07 22:08:41.928972 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2586/5147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:41 2022] GET /compute/v2.1/servers/ba61d59b-e750-459a-a73a-0376bdf5ca51 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:08:41.939867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:41.941624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:41.951433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:41.952370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:41.953832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:41.954648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:42.092030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:42.109536 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-30a0e086-27cb-4c50-9ad8-68986ee2ca07 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1271 microversion: 2.1 time: 0.177155 May 07 22:08:42.111493 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2587/5148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:41 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:42.125507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:42.129900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:42.137296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:42.138111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:42.139789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:42.140404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:42.184256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:08:42.317365 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4c845d87-f805-4c31-a6c4-0a228f7fb00f tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 204 len: 0 microversion: 2.1 time: 0.201601 May 07 22:08:42.318301 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2588/5149] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:08:42 2022] DELETE /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:08:42.327246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:42.328209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:42.336132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:42.336844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:42.337869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:42.338588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:42.770826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:42.780492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ec16e6ea-4162-4a4f-9710-41ad928810c2 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1675 microversion: 2.1 time: 0.457786 May 07 22:08:42.784079 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2589/5150] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:42 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1675 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:08:43.133809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:43.135222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:43.160036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:43.160805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:43.162182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:43.162838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:43.285646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:43.294127 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6725cded-0d16-4739-a363-2050625b0178 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1271 microversion: 2.1 time: 0.167497 May 07 22:08:43.304352 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2590/5151] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:43 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:43.322573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:08:43.323182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:08:43.325151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:08:43.325808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:08:43.326548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:08:43.343573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:43.344420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:43.345473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:43.346684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:43.367095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Getting quotas for project 72be56c2d4a54014a8f741c451fe014e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:08:43.373441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Getting quotas for user 97ef9a3039534d90ba9d268970cbe9d4 and project 72be56c2d4a54014a8f741c451fe014e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:08:43.387978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:08:43.390545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:08:43.443352 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-599a78eb-faac-4a35-bf4d-9c56ca4e51d1 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.849119 May 07 22:08:43.444531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2562/5152] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:08:43.456699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04e5791f-cc49-4e20-9a87-e4e34f0ad2d3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:43.457625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04e5791f-cc49-4e20-9a87-e4e34f0ad2d3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:43.531162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-04e5791f-cc49-4e20-9a87-e4e34f0ad2d3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:43.539233 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04e5791f-cc49-4e20-9a87-e4e34f0ad2d3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1219 microversion: 2.1 time: 0.088094 May 07 22:08:43.539820 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2591/5153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:43 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:08:43.801461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:43.802192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:43.840262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:43.842342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:43.846194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:43.847539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:44.314397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:44.315342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:44.339985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:44.342641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:44.345363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:44.346651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:44.483610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:44.525652 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee693d16-fb09-4535-bbba-50617adf0073 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1675 microversion: 2.1 time: 0.724048 May 07 22:08:44.539166 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2563/5154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:43 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1675 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:44.566331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:44.567146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:44.594827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:44.599200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:44.599924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:44.603341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:44.812152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:44.842679 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2eca6222-94c4-46ce-afbc-099ef2fada88 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1215 microversion: 2.1 time: 0.284004 May 07 22:08:44.844238 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2564/5155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:44 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:08:45.469363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:45.482537 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb5d59c4-f482-479a-a786-0e7eeeb744fc tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1313 microversion: 2.1 time: 1.170754 May 07 22:08:45.483871 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2592/5156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:44 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1313 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:08:45.550405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:45.552644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:45.562218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:45.563544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:45.564710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:45.565451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:45.731173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:45.749226 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c878793-a363-4906-8a9d-c1184025d671 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1607 microversion: 2.1 time: 0.203216 May 07 22:08:45.751616 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2565/5157] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:45 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1607 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:45.867031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:45.868132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:45.894705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:45.901932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:45.904188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:45.904686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:46.095742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:46.105593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-61cfc9c1-2515-4bf4-b230-75184cef6dcc tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Action: 'create', calling method: .version_select at 0x7fc40fc7c310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1681466864"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:46.123240 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b308114-572c-49fa-a55a-75a7994b90b5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1277 microversion: 2.1 time: 0.259318 May 07 22:08:46.127272 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2566/5158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:45 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:46.146760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-61cfc9c1-2515-4bf4-b230-75184cef6dcc tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:08:46.154401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-61cfc9c1-2515-4bf4-b230-75184cef6dcc tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for user d090d094c44c44519dcd3e98de4fc2ff and project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:08:46.516398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-61cfc9c1-2515-4bf4-b230-75184cef6dcc tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:08:46.518235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:46.521472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:46.541044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:46.543354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:46.543524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-61cfc9c1-2515-4bf4-b230-75184cef6dcc tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for user d090d094c44c44519dcd3e98de4fc2ff and project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:08:46.545273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:46.547367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:46.567648 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-61cfc9c1-2515-4bf4-b230-75184cef6dcc tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.789900 May 07 22:08:46.575651 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2593/5159] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:08:45 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:46.590018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8f4b8c20-99fc-436e-a222-0c847aaff904 req-cc43f460-98ed-4107-8052-5768aca80fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce1ca65-a12b-4ded-9af1-3b2575026f57", "tag": "0862d286-4492-4f74-bef8-f163ad30d582"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:46.611480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8f4b8c20-99fc-436e-a222-0c847aaff904 req-cc43f460-98ed-4107-8052-5768aca80fee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:46.612126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8f4b8c20-99fc-436e-a222-0c847aaff904 req-cc43f460-98ed-4107-8052-5768aca80fee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:46.627634 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8f4b8c20-99fc-436e-a222-0c847aaff904 req-cc43f460-98ed-4107-8052-5768aca80fee service nova] Creating event network-changed:0862d286-4492-4f74-bef8-f163ad30d582 for instance 1ce1ca65-a12b-4ded-9af1-3b2575026f57 on nch2-master-1 May 07 22:08:46.632703 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8f4b8c20-99fc-436e-a222-0c847aaff904 req-cc43f460-98ed-4107-8052-5768aca80fee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055603 May 07 22:08:46.633732 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2594/5160] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:46.775182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:46.778647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:46.801800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:46.802457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:46.803467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:46.804073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:47.054679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdc0c878f6e4e5da2a2848d63a02f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759c66c34f414c19b2109393738ef639', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:47.064039 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c26df191-8761-4080-90fb-fb79575c2d92 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 200 len: 1607 microversion: 2.1 time: 0.299236 May 07 22:08:47.064634 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2595/5161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:46 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 1607 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:47.143671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:47.144285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:47.151886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:47.152345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:47.153322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:47.153942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:47.201796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:47.221783 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-19c670cd-1aef-44fc-8d1c-2593bf7206e7 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1313 microversion: 2.1 time: 0.726649 May 07 22:08:47.229183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2567/5162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:46 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1313 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:47.332402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:47.342738 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a9c52b9-b509-430f-b333-26fd5de1584f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1277 microversion: 2.1 time: 0.202793 May 07 22:08:47.343378 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2596/5163] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:47 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:08:47.530477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d63f2fde-163d-46b8-8755-50ef6c2a26d3 req-2645b083-01e3-4b90-9e6d-22523b5ac340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4996f091-2316-4100-b272-d2af7738b4ac", "name": "network-vif-deleted", "tag": "1d78a47c-1b52-4c8f-ad8e-184b9192eee5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:47.539362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d63f2fde-163d-46b8-8755-50ef6c2a26d3 req-2645b083-01e3-4b90-9e6d-22523b5ac340 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:47.540064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d63f2fde-163d-46b8-8755-50ef6c2a26d3 req-2645b083-01e3-4b90-9e6d-22523b5ac340 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:47.557201 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d63f2fde-163d-46b8-8755-50ef6c2a26d3 req-2645b083-01e3-4b90-9e6d-22523b5ac340 service nova] Creating event network-vif-deleted:1d78a47c-1b52-4c8f-ad8e-184b9192eee5 for instance 4996f091-2316-4100-b272-d2af7738b4ac on nch1-master-1 May 07 22:08:47.564455 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d63f2fde-163d-46b8-8755-50ef6c2a26d3 req-2645b083-01e3-4b90-9e6d-22523b5ac340 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 May 07 22:08:47.565685 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2568/5164] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:48.083531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:48.084156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] [instance: 4996f091-2316-4100-b272-d2af7738b4ac] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:48.097524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:48.099487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:48.102076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:48.103629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:48.133744 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] HTTP exception thrown: Instance 4996f091-2316-4100-b272-d2af7738b4ac could not be found. May 07 22:08:48.134377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Returning 404 to user: Instance 4996f091-2316-4100-b272-d2af7738b4ac could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:08:48.138838 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0516c815-b460-4350-a05f-bb4c90efb2c9 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac" status: 404 len: 111 microversion: 2.1 time: 0.057263 May 07 22:08:48.139889 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2597/5165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:48 2022] GET /compute/v2.1/servers/4996f091-2316-4100-b272-d2af7738b4ac => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:08:48.149695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-74a76eeb-1d64-4ec3-aae4-1cba0e3cb933 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] Calling method '.version_select at 0x7fc40fcd8670>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:48.192845 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-74a76eeb-1d64-4ec3-aae4-1cba0e3cb933 tempest-ServerActionsTestJSON-784133923 tempest-ServerActionsTestJSON-784133923-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99976929" status: 202 len: 0 microversion: 2.1 time: 0.048274 May 07 22:08:48.195470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2569/5166] 10.222.0.32 () {58 vars in 1214 bytes} [Sat May 7 22:08:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99976929 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:08:48.248296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:48.248972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:48.256465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:48.256933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:48.257735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:48.258187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:48.363647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:48.364622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:48.381750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:48.382410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:48.383269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:48.385143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:48.540024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:48.561646 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0304c25c-a476-4136-826e-6330670e1680 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1277 microversion: 2.1 time: 0.205096 May 07 22:08:48.563345 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2570/5167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:48 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:48.690803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:48.739916 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f003cae6-ef1f-4811-9a9c-fdd106fb04db tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1313 microversion: 2.1 time: 0.497911 May 07 22:08:48.742062 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2598/5168] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:48 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:49.583051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:49.584338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:49.591745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:49.592458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:49.593425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:49.594040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:49.758165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:49.759438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:49.781972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:49.783533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:49.792474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:49.792940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:50.074395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:50.085400 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-05b5404f-e327-4162-b7e4-fdd8c6935dba tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1313 microversion: 2.1 time: 0.331499 May 07 22:08:50.088155 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2599/5169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:49 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:50.417920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c6b56cb1-e7c7-4602-bb3f-63f5b086f6fb req-e7b4ec61-018f-4723-99a3-80fc466d279f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ed5da6-ab19-4f8c-a82a-c988e23edcc0", "tag": "337a2b26-27a2-4595-abbc-54e51b93680f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:50.436043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c6b56cb1-e7c7-4602-bb3f-63f5b086f6fb req-e7b4ec61-018f-4723-99a3-80fc466d279f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:50.438158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c6b56cb1-e7c7-4602-bb3f-63f5b086f6fb req-e7b4ec61-018f-4723-99a3-80fc466d279f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:50.479734 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c6b56cb1-e7c7-4602-bb3f-63f5b086f6fb req-e7b4ec61-018f-4723-99a3-80fc466d279f service nova] Creating event network-changed:337a2b26-27a2-4595-abbc-54e51b93680f for instance a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 on nch1-master-1 May 07 22:08:50.492413 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c6b56cb1-e7c7-4602-bb3f-63f5b086f6fb req-e7b4ec61-018f-4723-99a3-80fc466d279f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078609 May 07 22:08:50.493223 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2600/5170] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:08:50.638040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:50.652639 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9dfcd4dd-11ce-41ba-afa2-76e63ce235c2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1319 microversion: 2.1 time: 1.073103 May 07 22:08:50.653454 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2571/5171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:49 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1319 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:51.104547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:51.105884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:51.113392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:51.114116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:51.115116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:51.115557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:51.306596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:51.315685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e3470d8-5df1-4b9d-be87-df3710d4d15a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1313 microversion: 2.1 time: 0.215607 May 07 22:08:51.316320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2601/5172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:51 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:51.671368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:51.672472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:51.702257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:51.702984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:51.704763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:51.707372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:52.076819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3463b755-203d-4dd7-a87c-678cb5c3fcf1 req-00dd7b64-9b6e-453d-a436-bb0b49c021dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce1ca65-a12b-4ded-9af1-3b2575026f57", "name": "network-vif-plugged", "status": "completed", "tag": "0862d286-4492-4f74-bef8-f163ad30d582"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:52.095391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3463b755-203d-4dd7-a87c-678cb5c3fcf1 req-00dd7b64-9b6e-453d-a436-bb0b49c021dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:52.098349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3463b755-203d-4dd7-a87c-678cb5c3fcf1 req-00dd7b64-9b6e-453d-a436-bb0b49c021dc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:52.125956 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3463b755-203d-4dd7-a87c-678cb5c3fcf1 req-00dd7b64-9b6e-453d-a436-bb0b49c021dc service nova] Creating event network-vif-plugged:0862d286-4492-4f74-bef8-f163ad30d582 for instance 1ce1ca65-a12b-4ded-9af1-3b2575026f57 on nch2-master-1 May 07 22:08:52.137900 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3463b755-203d-4dd7-a87c-678cb5c3fcf1 req-00dd7b64-9b6e-453d-a436-bb0b49c021dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066723 May 07 22:08:52.139139 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2602/5173] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:52.180790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:52.193102 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8eeab5b7-9477-41b0-a35c-011906992e3c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1319 microversion: 2.1 time: 0.527173 May 07 22:08:52.194885 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2572/5174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:51 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:52.333203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:52.333890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:52.340698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:52.340911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:52.342090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:52.342698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:52.797451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:52.813157 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-89f7e213-6d4e-472b-b589-6038549f302a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1313 microversion: 2.1 time: 0.483539 May 07 22:08:52.814811 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2603/5175] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:52 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:53.216400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:53.217649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:53.231359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:53.233757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:53.234577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:53.235047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:53.716400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:53.728860 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d4dddbc4-702d-4164-9d02-6b76b3b55bdc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1319 microversion: 2.1 time: 0.516903 May 07 22:08:53.731676 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2573/5176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:53 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:53.843212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:53.844009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:53.858806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:53.859446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:53.860369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:53.861066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:54.341089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:54.359035 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bdce2907-d930-4dd7-b1cf-41ac9590ddcf tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1463 microversion: 2.1 time: 0.521250 May 07 22:08:54.361972 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2604/5177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:53 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1463 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:54.382008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeca4df0-304c-4201-9f83-f45ab5b82bd9", "device": "/dev/sdb"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:54.384015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:54.404450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:54.429160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:54.442074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:54.443897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:54.749360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:54.751004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:54.761128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:54.762129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:54.763125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:54.763676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:55.082618 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-29db8738-6c6c-40c3-9351-fd5518ad2fa9 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "POST /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705417 May 07 22:08:55.083629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2574/5178] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:08:54 2022] POST /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57/os-volume_attachments => generated 194 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:08:55.669109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:55.683530 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3804b0d7-88c2-4740-8be4-2b9408135df2 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1319 microversion: 2.1 time: 0.939038 May 07 22:08:55.687408 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2605/5179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:54 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1319 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:56.705280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:56.706575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:56.728835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:56.730159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:56.731220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:56.737043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:57.387700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:57.402738 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b897e7a5-ef6d-4730-9831-d4060653cf62 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1319 microversion: 2.1 time: 0.696440 May 07 22:08:57.406292 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2575/5180] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:56 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1319 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:08:57.878810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ab888217-3a79-43fd-bb06-dfa835e8373a req-d98f2baa-027c-406a-8103-ff4c481578c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed5da6-ab19-4f8c-a82a-c988e23edcc0", "name": "network-vif-plugged", "status": "completed", "tag": "337a2b26-27a2-4595-abbc-54e51b93680f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:08:57.894434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ab888217-3a79-43fd-bb06-dfa835e8373a req-d98f2baa-027c-406a-8103-ff4c481578c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:57.896847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ab888217-3a79-43fd-bb06-dfa835e8373a req-d98f2baa-027c-406a-8103-ff4c481578c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:57.920332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ab888217-3a79-43fd-bb06-dfa835e8373a req-d98f2baa-027c-406a-8103-ff4c481578c3 service nova] Creating event network-vif-plugged:337a2b26-27a2-4595-abbc-54e51b93680f for instance a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 on nch1-master-1 May 07 22:08:57.927953 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ab888217-3a79-43fd-bb06-dfa835e8373a req-d98f2baa-027c-406a-8103-ff4c481578c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053165 May 07 22:08:57.929229 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2606/5181] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:08:58.422686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:58.424660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:58.441594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:58.442469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:58.443534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:58.444628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:58.807790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:08:58.816058 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-11036ffd-d310-4ed9-b3d1-e114951dde59 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1319 microversion: 2.1 time: 0.397255 May 07 22:08:58.819199 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2576/5182] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:58 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:08:59.740114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:59.741650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:59.773914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:59.774729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:59.776833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:59.782526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:59.836084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:08:59.836495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:08:59.837255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:08:59.848850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:59.855883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:08:59.857715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:08:59.858403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:00.005422 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04e788a6-ef20-4a64-bb71-1f74050af1d7 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 204 len: 0 microversion: 2.1 time: 0.668837 May 07 22:09:00.009217 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2607/5183] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:08:59 2022] DELETE /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:09:00.015763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:00.016495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:00.035873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:00.042144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:00.043641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:00.056311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:00.719864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:00.739415 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e85c8ca2-cb32-4b08-89d2-0fe09812a762 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1508 microversion: 2.1 time: 0.907055 May 07 22:09:00.741157 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2577/5184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:08:59 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1508 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:00.953745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:00.961730 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aacd5aca-0f2a-46b7-beaf-52c5d6e7adb2 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1731 microversion: 2.1 time: 0.950771 May 07 22:09:00.967302 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2608/5185] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:00 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1731 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:01.983956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:01.984634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:02.006729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:02.011146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:02.012301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:02.015396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:03.621034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:03.637128 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d792e84-a601-4b22-9469-f591c055b169 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1731 microversion: 2.1 time: 1.656934 May 07 22:09:03.645345 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2578/5186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:01 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1731 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:04.668675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:04.679257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:04.703538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:04.704460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:04.708096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:04.708763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:05.427369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75dd9e1d-41d8-4373-81eb-a9b8cb88a957", "device": "/dev/sdb"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:05.428698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:05.453139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:05.456794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:05.459917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:05.460464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:05.535830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:05.550323 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4988077d-38df-4101-9b3e-f3ae4050dabd tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1731 microversion: 2.1 time: 0.885115 May 07 22:09:05.553285 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2609/5187] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:04 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1731 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:05.570366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1364257693-access_point-651764999", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "308d6916-e830-4389-a582-d32af758375c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1681466864", "security_groups": [{"name": "tempest-secgroup_access--1476489"}, {"name": "tempest-secgroup_general--1161275537"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:05.929514 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b40c0114-2e31-4b4b-a75e-91d9777d16d8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "POST /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506488 May 07 22:09:05.936333 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2579/5188] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:09:05 2022] POST /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:09:06.106676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] validate_networks() for [('308d6916-e830-4389-a582-d32af758375c', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:09:06.571454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:06.573957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:06.593031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:06.593489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:06.597470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:06.597937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:06.844624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:06.861066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2048d1a7-a737-4bca-9cd2-af76e0261ec1 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1664 microversion: 2.1 time: 0.294160 May 07 22:09:06.862094 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2580/5189] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:06 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1664 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:07.533702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-b0b95c41-2705-49fa-b00f-b2cd0f355831 req-ecbb260e-02aa-488b-98d6-26250ec860e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b682b3c1-0ca9-4806-8100-908917473b27", "name": "network-vif-deleted", "tag": "ebd70047-1a0a-49d6-a707-647dac8e19a2"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:07.552032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b0b95c41-2705-49fa-b00f-b2cd0f355831 req-ecbb260e-02aa-488b-98d6-26250ec860e2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:07.552654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b0b95c41-2705-49fa-b00f-b2cd0f355831 req-ecbb260e-02aa-488b-98d6-26250ec860e2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:07.616462 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-b0b95c41-2705-49fa-b00f-b2cd0f355831 req-ecbb260e-02aa-488b-98d6-26250ec860e2 service nova] Creating event network-vif-deleted:ebd70047-1a0a-49d6-a707-647dac8e19a2 for instance b682b3c1-0ca9-4806-8100-908917473b27 on nch2-master-1 May 07 22:09:07.629559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-b0b95c41-2705-49fa-b00f-b2cd0f355831 req-ecbb260e-02aa-488b-98d6-26250ec860e2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099571 May 07 22:09:07.640902 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2581/5190] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:09:07.653819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:07.659266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:07.693314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:07.694615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:07.695597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:07.697404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:07.913802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lazy-loading 'services' on Instance uuid 1ce1ca65-a12b-4ded-9af1-3b2575026f57 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:09:08.046734 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d45f2ff-22a2-42b3-b649-e4f1f711ec80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57/os-volume_attachments/aeca4df0-304c-4201-9f83-f45ab5b82bd9" status: 202 len: 0 microversion: 2.1 time: 0.403736 May 07 22:09:08.048357 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2582/5191] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:09:07 2022] DELETE /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57/os-volume_attachments/aeca4df0-304c-4201-9f83-f45ab5b82bd9 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:09:08.077759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:08.081034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:08.111461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:08.112805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:08.124238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:08.125787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:08.288209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:08.290192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:08.302795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lazy-loading 'fault' on Instance uuid b682b3c1-0ca9-4806-8100-908917473b27 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:09:08.547756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cd1a3e3a02a4a7889ad46c94fbe8e4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:08.560101 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7dcbdd8a-3fba-4361-a757-0a3368bebbde tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 200 len: 1388 microversion: 2.1 time: 0.510267 May 07 22:09:08.567661 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2583/5192] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:08 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 1388 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:08.619629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:09:08.620799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:09:08.621468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:09:08.622142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:09:08.623509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:09:08.641338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:08.644586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:08.649445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:08.650480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:08.701323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:09:08.708109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for user d090d094c44c44519dcd3e98de4fc2ff and project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:09:08.726058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:09:08.728709 ncdv-master-1 devstack@n-api.service[136682]: WARNING nova.utils [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1364257693-access_point-651764999 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1364257693-ac May 07 22:09:08.729629 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:09:08.827542 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-24637f9d-cb19-4475-af6c-734a273a6fb2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 455 microversion: 2.1 time: 3.272802 May 07 22:09:08.828380 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2610/5193] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:09:05 2022] POST /compute/v2.1/servers => generated 455 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:09:08.840996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b136eb62-cc1b-41d3-a0c4-d641d22f2edd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:08.841692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b136eb62-cc1b-41d3-a0c4-d641d22f2edd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:09.265575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b136eb62-cc1b-41d3-a0c4-d641d22f2edd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:09.273541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b136eb62-cc1b-41d3-a0c4-d641d22f2edd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1294 microversion: 2.1 time: 0.438848 May 07 22:09:09.296101 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2584/5194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:08 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1294 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:09.372144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:09.372850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:09.396286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:09.397233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:09.397665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:09.398098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:09.492963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:09:09.585472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:09.587232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:09.612380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:09.614441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:09.621096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:09.621566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:09.654453 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c8cdc0f-d2a5-425b-a0b3-df93dd260a80 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 204 len: 0 microversion: 2.1 time: 0.293450 May 07 22:09:09.656353 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2611/5195] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:09:09 2022] DELETE /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:09:09.667042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:09.668771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:09.677537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:09.678512 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] HTTP exception thrown: Instance b682b3c1-0ca9-4806-8100-908917473b27 could not be found. May 07 22:09:09.683490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Returning 404 to user: Instance b682b3c1-0ca9-4806-8100-908917473b27 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:09:09.684296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:09.686319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:09.686652 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a771936-c25c-458b-b963-e65fd47da76e tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 404 len: 111 microversion: 2.1 time: 0.104085 May 07 22:09:09.689183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2585/5196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:09 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:09:09.692533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:10.304079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:10.305737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:10.320954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:10.323817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:10.326409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:10.328253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:10.592492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:10.609266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-464961e8-442a-46ae-9a5f-de84cf9ed461 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1290 microversion: 2.1 time: 0.309399 May 07 22:09:10.610113 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2586/5197] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:10 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1290 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:10.734491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:10.739288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:10.740018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:10.746091 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f13a594-dabd-44e1-b58b-88d173530314 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1469 microversion: 2.1 time: 1.085000 May 07 22:09:10.748488 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2612/5198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:09 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1469 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:10.758265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:10.759104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:10.760154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:10.761576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:10.795548 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] HTTP exception thrown: Instance b682b3c1-0ca9-4806-8100-908917473b27 could not be found. May 07 22:09:10.796245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Returning 404 to user: Instance b682b3c1-0ca9-4806-8100-908917473b27 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:09:10.797336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89a0721b-83ab-411a-ad8e-4157094e5a9c tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 404 len: 111 microversion: 2.1 time: 0.062754 May 07 22:09:10.798101 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2587/5199] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:09:10 2022] DELETE /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:09:10.807680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:10.808403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] [instance: b682b3c1-0ca9-4806-8100-908917473b27] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:10.817294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:10.817761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:10.819119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:10.819774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:10.850337 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] HTTP exception thrown: Instance b682b3c1-0ca9-4806-8100-908917473b27 could not be found. May 07 22:09:10.853372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Returning 404 to user: Instance b682b3c1-0ca9-4806-8100-908917473b27 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:09:10.856135 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8f37c1fd-a98e-4cba-b851-0321d6fb6654 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27" status: 404 len: 111 microversion: 2.1 time: 0.053381 May 07 22:09:10.858475 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2613/5200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:10 2022] GET /compute/v2.1/servers/b682b3c1-0ca9-4806-8100-908917473b27 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:09:11.570507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-278ef6e9-f3b4-492e-b728-0cdddc5e0df6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] Calling method '.version_select at 0x7fc40fc19b80>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:11.629069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:11.629723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:11.642127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:11.647448 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-278ef6e9-f3b4-492e-b728-0cdddc5e0df6 tempest-TestServerBasicOps-694273908 tempest-TestServerBasicOps-694273908-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1293994012" status: 202 len: 0 microversion: 2.1 time: 0.079015 May 07 22:09:11.651210 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2588/5201] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 22:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1293994012 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:09:11.651647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:11.654171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:11.654804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:11.765784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:11.766482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:11.780434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:11.780911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:11.781723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:11.782179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:12.089331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:12.103177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-697fcf69-c4d0-4c6b-8c32-0469e3a4c9e0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1352 microversion: 2.1 time: 0.479175 May 07 22:09:12.116634 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2614/5202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:11 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1352 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:12.295188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:12.303180 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9e105aa0-7db5-4eb8-aee7-f11ba91d69b0 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1469 microversion: 2.1 time: 0.541772 May 07 22:09:12.313800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2589/5203] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:11 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1469 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:13.126023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:13.126648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:13.141405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:13.146376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:13.148688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:13.150152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:13.234223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-8c66354d-3a5e-417c-95b4-9d3a24062a39 req-22eba983-6425-408e-9cc2-e1b9e5320df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce1ca65-a12b-4ded-9af1-3b2575026f57", "name": "network-vif-deleted", "tag": "0862d286-4492-4f74-bef8-f163ad30d582"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:13.267308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8c66354d-3a5e-417c-95b4-9d3a24062a39 req-22eba983-6425-408e-9cc2-e1b9e5320df2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:13.268208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8c66354d-3a5e-417c-95b4-9d3a24062a39 req-22eba983-6425-408e-9cc2-e1b9e5320df2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:13.307379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:13.319963 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8511f58e-b9bc-456e-92f4-3c72b677d53e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1352 microversion: 2.1 time: 0.200944 May 07 22:09:13.332690 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2615/5204] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:13 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:13.339922 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-8c66354d-3a5e-417c-95b4-9d3a24062a39 req-22eba983-6425-408e-9cc2-e1b9e5320df2 service nova] Creating event network-vif-deleted:0862d286-4492-4f74-bef8-f163ad30d582 for instance 1ce1ca65-a12b-4ded-9af1-3b2575026f57 on nch2-master-1 May 07 22:09:13.348884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:13.349931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:13.370475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:13.371337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:13.372199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:13.374233 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-8c66354d-3a5e-417c-95b4-9d3a24062a39 req-22eba983-6425-408e-9cc2-e1b9e5320df2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143566 May 07 22:09:13.376297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:13.380485 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2590/5205] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:09:13.566202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38e6d754538146aea01b0f51c8e2cc2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:13.593780 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a8a74c3-150a-4bd0-acbf-b275e969393a tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 200 len: 1298 microversion: 2.1 time: 0.255805 May 07 22:09:13.594675 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2616/5206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:13 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 1298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:14.339113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:14.340482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:14.348402 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:14.348863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:14.349977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:14.350588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:14.614290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:14.615157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] [instance: 1ce1ca65-a12b-4ded-9af1-3b2575026f57] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:14.629241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:14.630463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:14.634217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:14.635173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:14.666400 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] HTTP exception thrown: Instance 1ce1ca65-a12b-4ded-9af1-3b2575026f57 could not be found. May 07 22:09:14.667053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] Returning 404 to user: Instance 1ce1ca65-a12b-4ded-9af1-3b2575026f57 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:09:14.669581 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b380011-7194-4f87-a93e-6d8bb04dd508 tempest-VolumesBackupsTest-1817505426 tempest-VolumesBackupsTest-1817505426-project] 10.222.0.32 "GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57" status: 404 len: 111 microversion: 2.1 time: 0.060386 May 07 22:09:14.672001 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2617/5207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:14 2022] GET /compute/v2.1/servers/1ce1ca65-a12b-4ded-9af1-3b2575026f57 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:09:14.724593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:14.739818 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eb42ec24-7fed-4292-b7b2-78da29109bbd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1352 microversion: 2.1 time: 0.402665 May 07 22:09:14.743716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2591/5208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:14 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1352 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:15.764974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:15.766398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:15.791720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:15.792868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:15.796527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:15.797780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:16.723942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:16.738353 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c0ebb275-26f2-4328-952e-7c6077564052 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1469 microversion: 2.1 time: 0.976248 May 07 22:09:16.742293 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2618/5209] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:15 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1469 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:17.000168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1963677225", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "3ca09c63-acf5-4235-8b54-9ba115eec351"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:17.118178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] validate_networks() for [('3ca09c63-acf5-4235-8b54-9ba115eec351', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:09:17.768212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:17.768839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:17.803526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:17.803990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:17.809129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:17.815566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:18.539243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:18.544369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:09:18.544816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:09:18.545270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:09:18.545861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:09:18.546462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:09:18.551115 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb2d17e9-5806-465c-aa24-17ec838ee895 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1469 microversion: 2.1 time: 0.795927 May 07 22:09:18.551982 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2619/5210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:17 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1469 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:18.565284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-883f7be9-5eb9-4a5f-9a19-bbf71f217498 req-de62eeb8-8e68-4160-aeaf-19597aa3b2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c1a630-bf3c-43b9-8367-4ad0368a202f", "tag": "ed17c686-5176-4e6b-9642-9888fb0132ac"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:18.566527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:18.567095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:18.569388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:18.570010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:18.597622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-883f7be9-5eb9-4a5f-9a19-bbf71f217498 req-de62eeb8-8e68-4160-aeaf-19597aa3b2ea service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:18.598346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-883f7be9-5eb9-4a5f-9a19-bbf71f217498 req-de62eeb8-8e68-4160-aeaf-19597aa3b2ea service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:18.617389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Getting quotas for project 03ab9fa8c41f4e18b0d6c1fb4e8af126. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:09:18.623670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Getting quotas for user c0d2b3c89b6f42f789022f3b43353029 and project 03ab9fa8c41f4e18b0d6c1fb4e8af126. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:09:18.635850 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-883f7be9-5eb9-4a5f-9a19-bbf71f217498 req-de62eeb8-8e68-4160-aeaf-19597aa3b2ea service nova] Creating event network-changed:ed17c686-5176-4e6b-9642-9888fb0132ac for instance 58c1a630-bf3c-43b9-8367-4ad0368a202f on nch1-master-1 May 07 22:09:18.648332 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-883f7be9-5eb9-4a5f-9a19-bbf71f217498 req-de62eeb8-8e68-4160-aeaf-19597aa3b2ea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094789 May 07 22:09:18.649307 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2620/5211] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:09:18.653751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:09:18.656342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:09:18.776707 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-712d7947-503a-41ad-a457-3e6612c3658e tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.334944 May 07 22:09:18.778854 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2592/5212] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:09:18.791897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e6297eaa-aeb2-40c5-abe7-436e8762ecd7 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:18.793342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e6297eaa-aeb2-40c5-abe7-436e8762ecd7 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:19.034649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e6297eaa-aeb2-40c5-abe7-436e8762ecd7 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:19.053813 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e6297eaa-aeb2-40c5-abe7-436e8762ecd7 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1216 microversion: 2.1 time: 0.270111 May 07 22:09:19.058578 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2621/5213] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:18 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1216 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:19.572204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:19.573611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:19.589056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:19.589905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:19.592962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:19.593956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:19.975107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:19.989624 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31f48c87-64cf-47f4-b010-12c992201fe7 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1469 microversion: 2.1 time: 0.424128 May 07 22:09:19.998930 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2593/5214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:19 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:20.075888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:20.076352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:20.101065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:20.102906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:20.110941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:20.112962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:20.304328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:20.314122 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e19fdad1-4546-4277-972e-0d8ed5a104c2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1268 microversion: 2.1 time: 0.243656 May 07 22:09:20.329621 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2622/5215] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:20 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:21.016948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:21.018452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:21.031457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:21.040209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:21.042356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:21.044525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:21.348075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:21.349373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:21.362138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:21.362627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:21.363446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:21.363907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:21.512034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:21.521608 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f423e119-8f69-450a-a24a-93eb49d74ac2 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1274 microversion: 2.1 time: 0.176221 May 07 22:09:21.533147 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2623/5216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:21 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:22.221930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:22.231813 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4739efff-6b48-4807-86bb-dff83298ba04 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1469 microversion: 2.1 time: 1.218659 May 07 22:09:22.234145 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2594/5217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:21 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1469 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:22.549826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:22.550516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:22.563994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:22.564106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:22.564962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:22.565385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:22.865790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:22.881272 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-501994e5-3bc6-473d-9311-b796c1c8defa tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1274 microversion: 2.1 time: 0.336825 May 07 22:09:22.882657 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2624/5218] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:22 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1274 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:23.251804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:23.252989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:23.267712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:23.280749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:23.292398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:23.293352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:23.900416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:23.901192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:23.922668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:23.923220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:23.927991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:23.928525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:24.175892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:24.187848 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71909c78-4b42-4f75-a979-609736945410 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1469 microversion: 2.1 time: 0.941744 May 07 22:09:24.188827 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2595/5219] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:23 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1469 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:24.559756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-88fdedeb-196c-4696-bf90-3886b9828ef9 req-3f2ec7f7-c9dd-43ea-a992-310e8b2f0ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c1a630-bf3c-43b9-8367-4ad0368a202f", "name": "network-vif-plugged", "status": "completed", "tag": "ed17c686-5176-4e6b-9642-9888fb0132ac"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:24.571713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:24.574919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-88fdedeb-196c-4696-bf90-3886b9828ef9 req-3f2ec7f7-c9dd-43ea-a992-310e8b2f0ed0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:24.576739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-88fdedeb-196c-4696-bf90-3886b9828ef9 req-3f2ec7f7-c9dd-43ea-a992-310e8b2f0ed0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:24.583485 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52cba02c-632e-409d-b26f-d7ddd87a1773 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1316 microversion: 2.1 time: 0.688226 May 07 22:09:24.584474 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2625/5220] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:23 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:24.601018 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-88fdedeb-196c-4696-bf90-3886b9828ef9 req-3f2ec7f7-c9dd-43ea-a992-310e8b2f0ed0 service nova] Creating event network-vif-plugged:ed17c686-5176-4e6b-9642-9888fb0132ac for instance 58c1a630-bf3c-43b9-8367-4ad0368a202f on nch1-master-1 May 07 22:09:24.611285 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-88fdedeb-196c-4696-bf90-3886b9828ef9 req-3f2ec7f7-c9dd-43ea-a992-310e8b2f0ed0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056357 May 07 22:09:24.618290 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2596/5221] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:09:25.205620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:25.206251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:25.226347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:25.226984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:25.228529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:25.228972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:25.605542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:25.606786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:25.616254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:25.616731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:25.618242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:25.623834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:25.961774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:25.971768 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7bee67e2-fae8-43e3-843b-0856cd8c6402 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1469 microversion: 2.1 time: 0.769881 May 07 22:09:25.973007 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2626/5222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:25 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1469 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:26.458802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:26.481340 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80cf2003-07f7-4d3f-a7f9-14dbb00f47a0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1316 microversion: 2.1 time: 0.883865 May 07 22:09:26.482321 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2597/5223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:25 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1316 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:26.646812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b014fcbb-3bae-462f-bac3-c010d716b4c7 req-19499520-fba2-4c02-9f74-e8f9768db85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd2f7a1-bd76-4e3d-9517-638ffb3255fb", "tag": "7f716d06-e63d-4571-99d1-0117847bcaeb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:26.720427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b014fcbb-3bae-462f-bac3-c010d716b4c7 req-19499520-fba2-4c02-9f74-e8f9768db85e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:26.725405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b014fcbb-3bae-462f-bac3-c010d716b4c7 req-19499520-fba2-4c02-9f74-e8f9768db85e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:26.755684 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b014fcbb-3bae-462f-bac3-c010d716b4c7 req-19499520-fba2-4c02-9f74-e8f9768db85e service nova] Creating event network-changed:7f716d06-e63d-4571-99d1-0117847bcaeb for instance 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb on nch2-master-1 May 07 22:09:26.782274 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b014fcbb-3bae-462f-bac3-c010d716b4c7 req-19499520-fba2-4c02-9f74-e8f9768db85e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135132 May 07 22:09:26.784839 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2627/5224] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:09:26.990581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:26.991275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:27.005104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:27.005794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:27.006584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:27.007208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:27.501274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:27.503125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:27.530941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:27.531920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:27.533089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:27.534157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:27.869076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:27.879320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7faa2aa5-707d-4604-851a-68e6c4fba6a6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1641 microversion: 2.1 time: 0.892705 May 07 22:09:27.880629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2598/5225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:26 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1641 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:27.908872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:27.917494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:27.931898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:27.932756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:27.933864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:27.934790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:28.308442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:28.318415 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c9e1f3a8-ccad-4beb-83ef-013aa3476919 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1316 microversion: 2.1 time: 0.821427 May 07 22:09:28.319385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2628/5226] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:27 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1316 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:28.456195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:28.472158 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ab2613ea-8f7d-4d51-b530-5293df916b19 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1641 microversion: 2.1 time: 0.575698 May 07 22:09:28.476053 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2599/5227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:27 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1641 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:28.492046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d58bf692-1a40-4929-a64c-fce439b2a6b5 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:28.492663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d58bf692-1a40-4929-a64c-fce439b2a6b5 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:28.519032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d58bf692-1a40-4929-a64c-fce439b2a6b5 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:28.520291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d58bf692-1a40-4929-a64c-fce439b2a6b5 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:28.521343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d58bf692-1a40-4929-a64c-fce439b2a6b5 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:28.522706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d58bf692-1a40-4929-a64c-fce439b2a6b5 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:29.337536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:29.338182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:29.360353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:29.360977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:29.361830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:29.362283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:29.573601 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d58bf692-1a40-4929-a64c-fce439b2a6b5 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1792 microversion: 2.1 time: 1.085158 May 07 22:09:29.585929 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2629/5228] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:28 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1792 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:30.070355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:30.089702 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-975bcc39-78c0-4f82-8ee5-3915e8405686 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1316 microversion: 2.1 time: 0.753743 May 07 22:09:30.095999 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2600/5229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:29 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1316 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:31.107651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:31.108283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:31.120632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:31.121453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:31.123086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:31.123827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:31.441311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:31.449781 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-547152e1-bc84-4ed3-80c3-e0f0533b941c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1316 microversion: 2.1 time: 0.347369 May 07 22:09:31.451376 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2630/5230] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:31 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:09:32.469155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:32.470878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:32.481965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:32.482969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:32.485407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:32.486599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:32.580636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-093c2380-1ad6-4f9e-88f5-ea6c82e3905c req-293776e1-8a58-487c-b78b-84a63f9d43d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd2f7a1-bd76-4e3d-9517-638ffb3255fb", "name": "network-vif-plugged", "status": "completed", "tag": "7f716d06-e63d-4571-99d1-0117847bcaeb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:32.597802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-093c2380-1ad6-4f9e-88f5-ea6c82e3905c req-293776e1-8a58-487c-b78b-84a63f9d43d0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:32.598557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-093c2380-1ad6-4f9e-88f5-ea6c82e3905c req-293776e1-8a58-487c-b78b-84a63f9d43d0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:32.631368 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-093c2380-1ad6-4f9e-88f5-ea6c82e3905c req-293776e1-8a58-487c-b78b-84a63f9d43d0 service nova] Creating event network-vif-plugged:7f716d06-e63d-4571-99d1-0117847bcaeb for instance 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb on nch2-master-1 May 07 22:09:32.644791 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-093c2380-1ad6-4f9e-88f5-ea6c82e3905c req-293776e1-8a58-487c-b78b-84a63f9d43d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068449 May 07 22:09:32.647079 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2631/5231] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:09:33.057156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:33.083082 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e57b2061-ddbc-4629-8be7-0d1ad2dcff96 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1316 microversion: 2.1 time: 0.618826 May 07 22:09:33.086011 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2601/5232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:32 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:34.102427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:34.103467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:34.114440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:34.120177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:34.121841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:34.122472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:35.293429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:35.306748 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-201f0b65-4801-413b-afe1-58985ea7006c tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1316 microversion: 2.1 time: 1.209331 May 07 22:09:35.307378 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2632/5233] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:34 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1316 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:36.328577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:36.330056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:36.345787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:36.347403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:36.350740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:36.352001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.036326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:37.051205 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-422715b2-d850-40c7-bd51-c5d1b69fa9e0 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1504 microversion: 2.1 time: 0.730880 May 07 22:09:37.052087 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2602/5234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:36 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1504 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:37.073483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-947a002b-8175-4408-af1a-5f5eddcd300d tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:37.074853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-947a002b-8175-4408-af1a-5f5eddcd300d tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:37.085899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947a002b-8175-4408-af1a-5f5eddcd300d tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.086368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947a002b-8175-4408-af1a-5f5eddcd300d tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.087303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947a002b-8175-4408-af1a-5f5eddcd300d tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.087800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-947a002b-8175-4408-af1a-5f5eddcd300d tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.333550 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-947a002b-8175-4408-af1a-5f5eddcd300d tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.264024 May 07 22:09:37.334194 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2633/5235] 10.222.0.32 () {58 vars in 1295 bytes} [Sat May 7 22:09:37 2022] DELETE /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb/os-server-password => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:09:37.359636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bdc458a4-53e6-4fd9-a51b-26e34fd699b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:37.361985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bdc458a4-53e6-4fd9-a51b-26e34fd699b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:37.406261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdc458a4-53e6-4fd9-a51b-26e34fd699b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.408629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdc458a4-53e6-4fd9-a51b-26e34fd699b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.412935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdc458a4-53e6-4fd9-a51b-26e34fd699b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.413764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdc458a4-53e6-4fd9-a51b-26e34fd699b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.485991 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bdc458a4-53e6-4fd9-a51b-26e34fd699b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.143078 May 07 22:09:37.503514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:37.503977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:37.515562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.516020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.520749 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2603/5236] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 22:09:37 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb/os-server-password => generated 16 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:09:37.524726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.525959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.625320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:09:37.867190 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c2c51c9-f401-4f1b-9a2d-56a5fe11b9b9 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 204 len: 0 microversion: 2.1 time: 0.374305 May 07 22:09:37.880151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:37.880779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:37.887989 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2634/5237] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:09:37 2022] DELETE /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:09:37.907823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.909955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:37.912541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:37.913882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:38.262239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-612c1b44-1a66-4512-b5bd-21787ae42a35 req-38df99ea-05a2-4504-bbbe-fc96dc3bacb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c1a630-bf3c-43b9-8367-4ad0368a202f", "tag": "ed17c686-5176-4e6b-9642-9888fb0132ac"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:38.309261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-612c1b44-1a66-4512-b5bd-21787ae42a35 req-38df99ea-05a2-4504-bbbe-fc96dc3bacb6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:38.310061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-612c1b44-1a66-4512-b5bd-21787ae42a35 req-38df99ea-05a2-4504-bbbe-fc96dc3bacb6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:38.374125 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-612c1b44-1a66-4512-b5bd-21787ae42a35 req-38df99ea-05a2-4504-bbbe-fc96dc3bacb6 service nova] Creating event network-changed:ed17c686-5176-4e6b-9642-9888fb0132ac for instance 58c1a630-bf3c-43b9-8367-4ad0368a202f on nch1-master-1 May 07 22:09:38.421564 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-612c1b44-1a66-4512-b5bd-21787ae42a35 req-38df99ea-05a2-4504-bbbe-fc96dc3bacb6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167235 May 07 22:09:38.422541 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2635/5238] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:09:38.980847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:39.006691 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6c86e97-c25a-4f8a-be60-ad613a3f2005 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1510 microversion: 2.1 time: 1.127190 May 07 22:09:39.007787 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2604/5239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:37 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1510 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:40.031597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:40.032949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:40.049722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:40.051925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:40.053039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:40.056053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:41.881975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0d2b3c89b6f42f789022f3b43353029', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:41.891468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a115833e-2630-4c3b-ae14-f61d7f7cac74 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 200 len: 1510 microversion: 2.1 time: 1.864796 May 07 22:09:41.909156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2636/5240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:40 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 1510 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:09:42.027983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-935d06a9-aa55-4437-9410-b1d5269b5b3a req-ae226416-82d9-4e6a-bfd8-57ef9cf37f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd2f7a1-bd76-4e3d-9517-638ffb3255fb", "name": "network-vif-deleted", "tag": "7f716d06-e63d-4571-99d1-0117847bcaeb"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:42.036345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-935d06a9-aa55-4437-9410-b1d5269b5b3a req-ae226416-82d9-4e6a-bfd8-57ef9cf37f5e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:42.036799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-935d06a9-aa55-4437-9410-b1d5269b5b3a req-ae226416-82d9-4e6a-bfd8-57ef9cf37f5e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:42.050309 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-935d06a9-aa55-4437-9410-b1d5269b5b3a req-ae226416-82d9-4e6a-bfd8-57ef9cf37f5e service nova] Creating event network-vif-deleted:7f716d06-e63d-4571-99d1-0117847bcaeb for instance 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb on nch2-master-1 May 07 22:09:42.057438 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-935d06a9-aa55-4437-9410-b1d5269b5b3a req-ae226416-82d9-4e6a-bfd8-57ef9cf37f5e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034082 May 07 22:09:42.058045 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2605/5241] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:09:42.920337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:42.920972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] [instance: 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:42.930023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:42.932505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:42.933540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:42.934084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:42.955602 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] HTTP exception thrown: Instance 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb could not be found. May 07 22:09:42.956526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] Returning 404 to user: Instance 2dd2f7a1-bd76-4e3d-9517-638ffb3255fb could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:09:42.957792 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de0aafb8-9d16-456e-a602-0c1627fa7b90 tempest-ServerPasswordTestJSON-1543479840 tempest-ServerPasswordTestJSON-1543479840-project] 10.222.0.32 "GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb" status: 404 len: 111 microversion: 2.1 time: 0.041739 May 07 22:09:42.959691 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2637/5242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:09:42 2022] GET /compute/v2.1/servers/2dd2f7a1-bd76-4e3d-9517-638ffb3255fb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:09:47.574924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-980522915", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": "none"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:47.695332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:09:47.695759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:09:47.696779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:09:47.699783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:09:47.703328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:09:47.749181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:47.749642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:47.750457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:47.750926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:47.832715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Getting quotas for project fb0d2331b1674fe797c71f474a68e096. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:09:47.845815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Getting quotas for user a512b2753f924a1fb873e97cd3cd322c and project fb0d2331b1674fe797c71f474a68e096. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:09:47.875469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:09:47.878056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 5de254c4-9ef2-4c81-ae96-63159f2eca16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:09:47.938032 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd0df207-5f03-4b6c-a0aa-8d765651361a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.123835 May 07 22:09:47.939148 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2606/5243] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 22:09:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 22:09:47.950922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6fa280b-631a-4d18-9fcb-9f2a5eb1d756 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:47.952430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6fa280b-631a-4d18-9fcb-9f2a5eb1d756 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 5de254c4-9ef2-4c81-ae96-63159f2eca16] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:48.666558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6fa280b-631a-4d18-9fcb-9f2a5eb1d756 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:48.688628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6fa280b-631a-4d18-9fcb-9f2a5eb1d756 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:48.691009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6fa280b-631a-4d18-9fcb-9f2a5eb1d756 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:48.692590 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6fa280b-631a-4d18-9fcb-9f2a5eb1d756 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16" status: 200 len: 1277 microversion: 2.47 time: 0.747031 May 07 22:09:48.693694 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2638/5244] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:47 2022] GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16 => generated 1277 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:48.886202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-526598417", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": "none"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:48.998326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:09:49.000533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:09:49.001233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:09:49.011509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:09:49.012244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:09:49.022166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:49.022959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:49.036067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:49.036873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:49.066451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Getting quotas for project fb0d2331b1674fe797c71f474a68e096. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:09:49.087918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Getting quotas for user a512b2753f924a1fb873e97cd3cd322c and project fb0d2331b1674fe797c71f474a68e096. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:09:49.104300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:09:49.107010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:09:49.287285 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89b6d0ee-8b55-4b05-a5e5-32799fe3d221 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.403958 May 07 22:09:49.289102 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2607/5245] 10.222.0.32 () {62 vars in 1187 bytes} [Sat May 7 22:09:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 07 22:09:49.302306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3bb3ce54-a497-418b-a702-3bfbdbb86930 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:49.303907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3bb3ce54-a497-418b-a702-3bfbdbb86930 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:49.387695 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3bb3ce54-a497-418b-a702-3bfbdbb86930 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "PUT /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 991 microversion: 2.47 time: 0.091591 May 07 22:09:49.404672 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2639/5246] 10.222.0.32 () {62 vars in 1296 bytes} [Sat May 7 22:09:49 2022] PUT /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:09:49.411190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-763b483c-bc9d-4c41-af78-6f1a31bd2533 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:49.411823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-763b483c-bc9d-4c41-af78-6f1a31bd2533 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:49.694066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-763b483c-bc9d-4c41-af78-6f1a31bd2533 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:49.723606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-763b483c-bc9d-4c41-af78-6f1a31bd2533 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:49.737156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-763b483c-bc9d-4c41-af78-6f1a31bd2533 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:49.751043 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-763b483c-bc9d-4c41-af78-6f1a31bd2533 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1277 microversion: 2.47 time: 0.344524 May 07 22:09:49.765646 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2608/5247] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:49 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1277 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:50.784851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:50.785464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:50.804691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:50.807527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:50.809795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:50.810507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:51.099485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:51.108077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:51.113542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:51.116834 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-567c316e-f61d-476f-a82c-5c09062031c8 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1281 microversion: 2.47 time: 0.339121 May 07 22:09:51.117465 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2640/5248] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:50 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:52.138223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:52.139040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:52.159702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:52.160480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:52.161976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:52.163182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:52.420699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:52.454373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:52.457589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:52.461422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d42f35a-5979-405f-87e4-4c8874be3d25 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1337 microversion: 2.47 time: 0.328429 May 07 22:09:52.465752 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2609/5249] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:52 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1337 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:53.487965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:53.488802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:53.496863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:53.498260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:53.501536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:53.502575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:54.206623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:54.223676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:54.226753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:54.228879 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-18cf60ef-62b0-49c3-9ae9-0320a61e25e3 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1335 microversion: 2.47 time: 0.747930 May 07 22:09:54.241156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2641/5250] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:53 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1335 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:55.249937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:55.250753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:55.270595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:55.272234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:55.276892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:55.277674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:55.432158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:55.451277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:55.455409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:55.468566 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-efe438c6-c524-4fc1-bd93-7b14acde3568 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1335 microversion: 2.47 time: 0.223560 May 07 22:09:55.470020 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2610/5251] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:55 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1335 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:56.491041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:56.492471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:56.515689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:56.516670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:56.518819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:56.520026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:56.654522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:56.666720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:56.669049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:56.672588 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93902293-8bfb-4c85-bdd4-f2e5d64cbef7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1356 microversion: 2.47 time: 0.187408 May 07 22:09:56.675792 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2642/5252] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:56 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:56.699278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:09:56.701478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:56.710731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:56.712176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:56.714106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:56.714798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:56.897135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:09:56.897466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:09:56.898126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:09:56.899454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:09:56.908765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:09:57.010690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:57.024799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:57.025788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:57.027500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:57.027953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:57.095844 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5473967e-96fe-4d29-be35-5a4bd4e62052 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "POST /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3/action" status: 202 len: 1078 microversion: 2.47 time: 0.403254 May 07 22:09:57.096818 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2611/5253] 10.222.0.32 () {62 vars in 1318 bytes} [Sat May 7 22:09:56 2022] POST /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3/action => generated 1078 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 07 22:09:57.117908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:57.120521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:57.128790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:57.130604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:57.131765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:57.133737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:57.330788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:57.341929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:57.346914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:57.350250 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ebf2f2f9-9fee-409a-81fc-ce6eb6979911 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.237646 May 07 22:09:57.352187 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2643/5254] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:57 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:58.371027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:58.371814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:58.388947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:58.389411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:58.400670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:58.401711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:58.631610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:58.653632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:58.661613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:09:58.664550 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4a8f21b3-d6d9-4788-886a-e884714f4960 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.298569 May 07 22:09:58.667293 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2612/5255] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:58 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:09:59.698118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:09:59.699524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:09:59.717003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:59.720672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:09:59.721624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:09:59.722089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:00.129114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:00.160825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:00.162615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:00.167516 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c74e0a7a-85e9-435a-94ba-667fcfd4c714 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.476101 May 07 22:10:00.169922 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2644/5256] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:09:59 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:01.189058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:01.191057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:01.225373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:01.231414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:01.235905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:01.238320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:01.476682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:01.489294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:01.491393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:01.502829 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-16955fe9-ae02-4575-9172-9f3128fb7a8a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.312166 May 07 22:10:01.515346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2613/5257] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:01 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:02.535951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:02.536677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:02.549412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:02.551498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:02.552555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:02.555612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:02.847446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:02.863776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:02.865844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:02.872907 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8f790377-c106-4321-acaf-bc3c97d5a068 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.339331 May 07 22:10:02.874350 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2645/5258] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:02 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:03.901089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:03.902714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:03.918960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:03.919863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:03.920919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:03.921847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:04.163190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:04.172132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:04.174584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:04.181637 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-62e8c398-0439-4683-b5a3-aaa80bd0e03b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.285498 May 07 22:10:04.193167 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2614/5259] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:03 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:05.200310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:05.201598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:05.208130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:05.208810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:05.209768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:05.210390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:05.509188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:05.523351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:05.525457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:05.526676 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14e6c8ad-5a53-4fa5-8942-788f90e9338a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.330459 May 07 22:10:05.527281 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2646/5260] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:05 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:06.546828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:06.547611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:06.555689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:06.556815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:06.558304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:06.559566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:06.746741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:06.758803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:06.760980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:06.762411 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2a859744-8ad8-47ae-9da9-344dcadb1a72 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.220047 May 07 22:10:06.763724 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2615/5261] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:06 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:07.781798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:07.783539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:07.803838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:07.816569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:07.824411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:07.825264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:08.225743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:08.246055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:08.250611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:08.252462 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-02b82168-d246-4171-9753-fd0d21097d64 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.474882 May 07 22:10:08.254044 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2647/5262] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:07 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:09.272326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:09.273166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:09.289951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:09.294262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:09.296104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:09.298059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:09.556862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:09.569609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:09.572596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:09.576685 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b669fff5-1c12-4de8-a87c-f35a7fe797e4 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.308962 May 07 22:10:09.590488 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2616/5263] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:09 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:10.621185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:10.621837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:10.634477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:10.641731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:10.650789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:10.652278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:11.579075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:11.607199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:11.612361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:11.616475 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9eea2cc1-3f17-4bb7-a20a-59a27854e953 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 1.022443 May 07 22:10:11.624899 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2648/5264] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:10 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:12.637562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:12.639124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:12.679687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:12.680800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:12.688810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:12.690196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:13.718393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:13.731080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:13.737857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:13.739382 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cb22a2e7-0fee-4154-9682-4d9e2b2c7b47 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 1.106902 May 07 22:10:13.747686 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2617/5265] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:12 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:14.765359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:14.766807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:14.781787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:14.782637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:14.783717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:14.784384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:15.068429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:15.091393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:15.094102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:15.110044 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b9090b62-af34-461d-a2a9-38772009448a tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.340999 May 07 22:10:15.122152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2649/5266] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:14 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:16.134035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:16.135045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:16.156749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:16.157443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:16.165071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:16.165710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:16.464646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1559286977", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "53cb28c4-547f-45c6-af6b-4da71054c830"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1681466864", "security_groups": []}, "os:scheduler_hints": {"different_host": ["58c1a630-bf3c-43b9-8367-4ad0368a202f"]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:16.484073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:16.499589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:16.504757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:16.511176 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ec865804-62fb-45d8-a889-853f6c797402 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.382768 May 07 22:10:16.512685 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2618/5267] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:16 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:16.624005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] validate_networks() for [('53cb28c4-547f-45c6-af6b-4da71054c830', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:10:17.537374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:17.538853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:17.554439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:17.558173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:17.559431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:17.561028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:18.391894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:18.409000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:18.415706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:18.418284 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e34a2ec5-cb86-4c16-bd68-6c747c6618a7 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.892195 May 07 22:10:18.422212 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2619/5268] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:17 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:10:19.121259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:10:19.121727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:10:19.122151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:10:19.122566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:10:19.123010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:10:19.140388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:19.146596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:19.152835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:19.153760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:19.244641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:10:19.265362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Getting quotas for user d090d094c44c44519dcd3e98de4fc2ff and project 79ad2ea0f3a34003bb7a3f8ff81c58e4. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:10:19.321766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:10:19.327886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:10:19.442501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:19.443172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:19.463316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:19.464087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:19.465397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:19.466012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:19.484641 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-698f158d-a9ac-4a92-a981-00ac5749a25d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.036913 May 07 22:10:19.494295 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2650/5269] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:10:16 2022] POST /compute/v2.1/servers => generated 361 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:10:19.519598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-66bad8fa-cd30-43fd-865a-304f199f9e12 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:19.525444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-66bad8fa-cd30-43fd-865a-304f199f9e12 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:19.777209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-66bad8fa-cd30-43fd-865a-304f199f9e12 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:19.778161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:19.783870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-66bad8fa-cd30-43fd-865a-304f199f9e12 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1242 microversion: 2.1 time: 0.288167 May 07 22:10:19.784451 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2651/5270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:19 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1242 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:19.791407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:19.793442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:19.813146 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eb35af54-09a8-4ac7-9a4a-b1b55fd07d93 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.375671 May 07 22:10:19.822620 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2620/5271] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:19 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:10:20.803739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:20.805323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:20.828370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:20.828886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:20.830192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:20.830660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:20.840546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:20.842479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:20.876777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:20.880671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:20.881746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:20.884890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:20.957623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:20.969801 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-096e6525-7068-4298-8a9b-ec8a0916ad00 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1294 microversion: 2.1 time: 0.171001 May 07 22:10:20.973551 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2652/5272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:20 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1294 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:21.369231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:21.385204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:21.391320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:21.393464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3026f4bc-bab7-4d72-81d0-78b5a5bcc196 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.556827 May 07 22:10:21.399338 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2621/5273] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:20 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:21.991384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:21.992052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:22.007339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:22.009363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:22.012622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:22.013079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:22.193627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:22.214441 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a06e5ee-2011-4c9b-91f0-cb2b1a452ad4 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.221941 May 07 22:10:22.216473 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2653/5274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:21 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:22.417878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:22.431728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:22.437757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:22.438209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:22.439344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:22.440007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:22.951476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:22.959719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:22.961304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:22.962523 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88d642cc-8cd8-4710-a453-871628dbbd04 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.549278 May 07 22:10:22.974974 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2622/5275] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:22 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:23.238483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:23.240166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:23.252119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:23.253305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:23.254325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:23.255052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:23.509407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:23.523643 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-17664de9-d4a7-4340-9710-6f971b37ee5d tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.293215 May 07 22:10:23.536253 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2654/5276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:23 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:23.994424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:23.995206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:24.012898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:24.013424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:24.014181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:24.014676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:24.189727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:24.202952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:24.204907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:24.209232 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ad9e744-383b-411d-8bdc-8b34ce60131e tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1365 microversion: 2.47 time: 0.219456 May 07 22:10:24.212077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2623/5277] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:23 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:24.544019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:24.544725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:24.552234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:24.568198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:24.571277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:24.572601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:24.763159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:24.788440 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2922d6f8-6812-4ea0-a39f-9c8062824b96 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.249451 May 07 22:10:24.802674 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2655/5278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:24 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:25.235712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:25.237135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:25.251295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:25.254692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:25.260979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:25.262706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:25.684611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:25.695612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:25.697078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:25.699058 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dc26afe3-e1ef-45ff-a620-1aa69cce4c48 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1371 microversion: 2.47 time: 0.472618 May 07 22:10:25.700150 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2624/5279] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:25 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:10:25.817135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:25.817860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:25.827299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:25.828595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:25.829708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:25.830479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:26.015560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:26.033886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0cc2740e-c423-4cb9-9cb1-ba9e549b8b9b tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.225331 May 07 22:10:26.035362 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2656/5280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:25 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:26.723077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:26.727235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:26.762264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:26.762726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:26.763551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:26.763997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:26.980695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:26.999037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:27.010144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:27.013683 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a7656ebc-103b-48d1-88a0-e807e12b1634 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1371 microversion: 2.47 time: 0.298466 May 07 22:10:27.033076 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2625/5281] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:26 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:10:27.056604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:27.057889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:27.082353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:27.082857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:27.086101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:27.087553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:27.748275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:27.759575 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55ebe377-c685-40dd-bda3-d9a090b008b0 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.708282 May 07 22:10:27.761383 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2657/5282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:27 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:28.038269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:28.039834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:28.048115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.048885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.050070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.051023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.246228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:28.270376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:28.274263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:28.276124 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e809de41-1996-45fa-a420-57568088d752 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1356 microversion: 2.47 time: 0.242148 May 07 22:10:28.278897 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2626/5283] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:28 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1356 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:28.297219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:28.302689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:28.305869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Searching by: {'deleted': False, 'project_id': 'fb0d2331b1674fe797c71f474a68e096'} {{(pid=136682) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:10:28.314637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.315705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.316750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.317428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.525176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-148bc657-d1ea-451a-827e-c9e751d45b21 req-c48e94c9-91b5-4c3b-a807-2622f826e62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac6afa1-a9f5-4cb2-8f02-d226525d4d7a", "tag": "429e9b64-85ba-43d6-87ae-d9b11f433f43"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:28.561001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-148bc657-d1ea-451a-827e-c9e751d45b21 req-c48e94c9-91b5-4c3b-a807-2622f826e62f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.562986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-148bc657-d1ea-451a-827e-c9e751d45b21 req-c48e94c9-91b5-4c3b-a807-2622f826e62f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.567351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.multi_cell_list [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136682) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:10:28.587566 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-148bc657-d1ea-451a-827e-c9e751d45b21 req-c48e94c9-91b5-4c3b-a807-2622f826e62f service nova] Creating event network-changed:429e9b64-85ba-43d6-87ae-d9b11f433f43 for instance bac6afa1-a9f5-4cb2-8f02-d226525d4d7a on nch2-master-1 May 07 22:10:28.598710 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-148bc657-d1ea-451a-827e-c9e751d45b21 req-c48e94c9-91b5-4c3b-a807-2622f826e62f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083703 May 07 22:10:28.602820 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2627/5284] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:10:28.786869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:28.787925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:28.796881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:28.805709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.806171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.808414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.808887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.809101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.809792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.828162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:28.830185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:28.916562 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d810b6d1-686f-4cbd-8064-04359b0c6265 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.624549 May 07 22:10:28.917283 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2658/5285] 10.222.0.32 () {60 vars in 1186 bytes} [Sat May 7 22:10:28 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:28.952126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:28.953222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:28.973903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.974558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:28.975490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:28.976512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:29.030317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:10:29.327327 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-897620b4-9bf1-4848-b441-6155fd4835f0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "DELETE /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 204 len: 0 microversion: 2.47 time: 0.384035 May 07 22:10:29.336394 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2659/5286] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:10:28 2022] DELETE /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 22:10:29.355672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:29.356668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:29.371722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:29.376315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:29.380041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:29.381120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:29.383921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:29.426068 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48214e15-f1b5-4c25-b0c8-5d780af29b80 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.645143 May 07 22:10:29.434476 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2628/5287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:28 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:10:29.693980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:29.715385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:29.718630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:29.720244 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-79f101d9-ed61-4d42-9a96-aab0602a9e9f tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1362 microversion: 2.47 time: 0.379384 May 07 22:10:29.721019 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2660/5288] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:29 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:30.449974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:30.451610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:30.463358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:30.471840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:30.473788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:30.474518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:30.743338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:30.748511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:30.777068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:30.777893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:30.779190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:30.780045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:30.861612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:30.887110 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-871a5108-01ed-4e8b-a35b-db4230e207bd tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.431491 May 07 22:10:30.901438 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2629/5289] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:30 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:31.026010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:31.070534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:31.079711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:31.083718 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ac1953e-0783-42c7-9750-cfd4412e910c tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1362 microversion: 2.47 time: 0.346466 May 07 22:10:31.088127 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2661/5290] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:30 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:31.905617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:31.906368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:31.917894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:31.919149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:31.923182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:31.927912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:32.108938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:32.111152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:32.121149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:32.125414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:32.134599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:32.135260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:32.189300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:32.206783 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6415aa6f-475f-4734-afc5-c9ff5de1766e tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.305362 May 07 22:10:32.217115 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2630/5291] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:31 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:32.270271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:32.284573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:32.286430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:32.287697 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c94f47d-9ff7-4380-965b-37a33cfaa44b tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 200 len: 1362 microversion: 2.47 time: 0.183857 May 07 22:10:32.288302 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2662/5292] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:32 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 07 22:10:33.234006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:33.235558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:33.254097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.254764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.257591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.258530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.307735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:33.317118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:33.325597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.329335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.330397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.331051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.357406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] HTTP exception thrown: Instance 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 could not be found. May 07 22:10:33.360385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Returning 404 to user: Instance 36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:10:33.361274 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04591543-c69d-4230-b3fc-61461a18d490 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3" status: 404 len: 111 microversion: 2.47 time: 0.058400 May 07 22:10:33.373570 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2663/5293] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:33 2022] GET /compute/v2.1/servers/36fed9e6-d8a9-4070-8850-3fb37dbaf8a3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 07 22:10:33.379601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:33.381080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 5de254c4-9ef2-4c81-ae96-63159f2eca16] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:33.390163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.390974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.391958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.392582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.431336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 5de254c4-9ef2-4c81-ae96-63159f2eca16] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:10:33.561782 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ed682ee-1257-464e-ad31-a1eb49db2130 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16" status: 204 len: 0 microversion: 2.47 time: 0.186454 May 07 22:10:33.563877 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2664/5294] 10.222.0.32 () {60 vars in 1279 bytes} [Sat May 7 22:10:33 2022] DELETE /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 07 22:10:33.575448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:33.576576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 5de254c4-9ef2-4c81-ae96-63159f2eca16] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:33.588412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.589003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.590224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:33.590674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:33.678574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:33.686653 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-890972e8-9e22-4147-865b-5f7e167e54d6 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.456785 May 07 22:10:33.687277 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2631/5295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:33 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:33.719992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:33.732517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:33.734226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:33.735721 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb2100b8-ea7e-4bfe-b5b5-2e9640741c77 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16" status: 200 len: 1362 microversion: 2.47 time: 0.167110 May 07 22:10:33.736594 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2665/5296] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:33 2022] GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:10:34.703751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:34.704467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:34.712099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:34.712559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:34.719233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:34.719701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:34.756133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:34.757426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 5de254c4-9ef2-4c81-ae96-63159f2eca16] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:34.766625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:34.767289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:34.768338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:34.769604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:34.927443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:34.944778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:34.947096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a512b2753f924a1fb873e97cd3cd322c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0d2331b1674fe797c71f474a68e096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:34.950041 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5806c94c-a68e-4cfa-a095-9160522bf2c0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16" status: 200 len: 1362 microversion: 2.47 time: 0.199372 May 07 22:10:34.951126 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2666/5297] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:34 2022] GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 07 22:10:34.972337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:34.983757 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7242ff75-8023-4fa7-951b-7a8db91887e2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.284090 May 07 22:10:34.985260 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2632/5298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:34 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:35.969624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:35.970256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] [instance: 5de254c4-9ef2-4c81-ae96-63159f2eca16] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:35.982845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:35.983568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:35.984380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:35.984835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:36.006517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:36.010854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:36.032409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:36.033416 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] HTTP exception thrown: Instance 5de254c4-9ef2-4c81-ae96-63159f2eca16 could not be found. May 07 22:10:36.034269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:36.035529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] Returning 404 to user: Instance 5de254c4-9ef2-4c81-ae96-63159f2eca16 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:10:36.036485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:36.039286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:36.043569 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21ccc601-cb7d-4eeb-9f6c-0357c08618e0 tempest-ServerShowV247Test-1080228328 tempest-ServerShowV247Test-1080228328-project] 10.222.0.32 "GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16" status: 404 len: 111 microversion: 2.47 time: 0.072961 May 07 22:10:36.044872 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2667/5299] 10.222.0.32 () {60 vars in 1276 bytes} [Sat May 7 22:10:35 2022] GET /compute/v2.1/servers/5de254c4-9ef2-4c81-ae96-63159f2eca16 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 07 22:10:36.161092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:36.172885 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e74168d9-fa09-4219-805b-8b7d1e16d691 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.174924 May 07 22:10:36.174525 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2633/5300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:35 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:10:37.191959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:37.193270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:37.207017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:37.207552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:37.208291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:37.219080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:37.278211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2089d4b7-c30f-4701-b743-d88f4fae21ef req-f5ed8520-fa63-493b-992b-2cdefa762a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac6afa1-a9f5-4cb2-8f02-d226525d4d7a", "name": "network-vif-plugged", "status": "completed", "tag": "429e9b64-85ba-43d6-87ae-d9b11f433f43"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:37.312786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2089d4b7-c30f-4701-b743-d88f4fae21ef req-f5ed8520-fa63-493b-992b-2cdefa762a9b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:37.316459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2089d4b7-c30f-4701-b743-d88f4fae21ef req-f5ed8520-fa63-493b-992b-2cdefa762a9b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:37.349328 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2089d4b7-c30f-4701-b743-d88f4fae21ef req-f5ed8520-fa63-493b-992b-2cdefa762a9b service nova] Creating event network-vif-plugged:429e9b64-85ba-43d6-87ae-d9b11f433f43 for instance bac6afa1-a9f5-4cb2-8f02-d226525d4d7a on nch2-master-1 May 07 22:10:37.358529 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2089d4b7-c30f-4701-b743-d88f4fae21ef req-f5ed8520-fa63-493b-992b-2cdefa762a9b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083880 May 07 22:10:37.361142 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2634/5301] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:10:37.627519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:37.660475 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae3a6008-6edc-4a05-a64a-b8c431eefd43 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1300 microversion: 2.1 time: 0.474137 May 07 22:10:37.661702 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2668/5302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:37 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1300 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:38.688041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:38.688921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:38.711221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:38.712038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:38.713096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:38.714358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:39.281869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:39.311801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b00785a5-5f6b-407b-a0b2-d228173de146 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1473 microversion: 2.1 time: 0.635444 May 07 22:10:39.315048 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2635/5303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:38 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1473 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:39.332345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:39.333177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:39.348281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:39.348603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:39.350403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:39.361087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:39.883192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:39.895386 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6d1ffdb3-5c6f-489a-95be-a910100002a2 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1473 microversion: 2.1 time: 0.567070 May 07 22:10:39.896248 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2669/5304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:39 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1473 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:39.923262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a375a73-2dcc-4a9a-bb9b-917e2a53c265 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:39.924478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a375a73-2dcc-4a9a-bb9b-917e2a53c265 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:39.974284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a375a73-2dcc-4a9a-bb9b-917e2a53c265 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:39.980108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a375a73-2dcc-4a9a-bb9b-917e2a53c265 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:39.982626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a375a73-2dcc-4a9a-bb9b-917e2a53c265 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:39.988580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a375a73-2dcc-4a9a-bb9b-917e2a53c265 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:40.310757 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a375a73-2dcc-4a9a-bb9b-917e2a53c265 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1624 microversion: 2.1 time: 0.396955 May 07 22:10:40.311460 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2636/5305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:39 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1624 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:40.333386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a9a66645-210a-48cf-a1a8-7b75167e0622 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:40.334437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a9a66645-210a-48cf-a1a8-7b75167e0622 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:40.372251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9a66645-210a-48cf-a1a8-7b75167e0622 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:40.373075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9a66645-210a-48cf-a1a8-7b75167e0622 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:40.373784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9a66645-210a-48cf-a1a8-7b75167e0622 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:40.374239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9a66645-210a-48cf-a1a8-7b75167e0622 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:41.049484 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a9a66645-210a-48cf-a1a8-7b75167e0622 tempest-TestSecurityGroupsBasicOps-724098100 tempest-TestSecurityGroupsBasicOps-724098100-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1910 microversion: 2.1 time: 0.724014 May 07 22:10:41.050501 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2670/5306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:40 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1910 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:41.218173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:41.222608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:41.238484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:41.243602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:41.246258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:41.250719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:41.356178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:10:41.554473 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9710d42a-1df7-422a-b5cb-6c86026f2b14 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 204 len: 0 microversion: 2.1 time: 0.360593 May 07 22:10:41.556675 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2637/5307] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:10:41 2022] DELETE /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:10:41.565321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:41.566792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:41.590154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:41.590934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:41.592049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:41.592693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:41.832221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:41.849340 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-783f045b-94ff-401d-ae38-1f57e16fbd4c tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1479 microversion: 2.1 time: 0.288282 May 07 22:10:41.849943 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2671/5308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:41 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1479 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:42.882516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:42.882516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:42.912658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:42.913664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:42.917642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:42.918169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:43.138165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1514132854", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "ebdf594d-504a-44e8-89b9-e74774287749"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:43.208710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:10:43.454983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:43.465262 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5508828f-d987-4051-b9b0-2209c920751a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1479 microversion: 2.1 time: 0.599202 May 07 22:10:43.466184 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2638/5309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:42 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1479 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:44.121072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:10:44.122352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:10:44.123482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:10:44.124299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:10:44.125028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:10:44.147132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:44.149147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:44.150320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:44.151272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:44.177833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:10:44.187742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:10:44.224365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:10:44.229528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:10:44.307114 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1fec4b8-b443-4e35-b697-022951a4f3d7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310765 May 07 22:10:44.307796 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2672/5310] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:10:44.321198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9863683a-3680-4065-8811-00c884bdcb60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:44.322477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9863683a-3680-4065-8811-00c884bdcb60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:44.409043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c1b764f6-d789-4267-b744-05566f4beca2 req-001c3610-971e-485e-b726-357b3a893ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac6afa1-a9f5-4cb2-8f02-d226525d4d7a", "name": "network-vif-deleted", "tag": "429e9b64-85ba-43d6-87ae-d9b11f433f43"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:44.463759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c1b764f6-d789-4267-b744-05566f4beca2 req-001c3610-971e-485e-b726-357b3a893ea9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:44.464229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c1b764f6-d789-4267-b744-05566f4beca2 req-001c3610-971e-485e-b726-357b3a893ea9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:44.496668 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c1b764f6-d789-4267-b744-05566f4beca2 req-001c3610-971e-485e-b726-357b3a893ea9 service nova] Creating event network-vif-deleted:429e9b64-85ba-43d6-87ae-d9b11f433f43 for instance bac6afa1-a9f5-4cb2-8f02-d226525d4d7a on nch2-master-1 May 07 22:10:44.514915 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c1b764f6-d789-4267-b744-05566f4beca2 req-001c3610-971e-485e-b726-357b3a893ea9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129570 May 07 22:10:44.515813 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2673/5311] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:10:44.521864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9863683a-3680-4065-8811-00c884bdcb60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:44.540171 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9863683a-3680-4065-8811-00c884bdcb60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1193 microversion: 2.1 time: 0.220467 May 07 22:10:44.540171 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2639/5312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:44 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1193 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:44.552242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:44.553345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:44.560918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:44.561578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:44.562618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:44.563264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:44.602909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:44.603699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:44.604545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lazy-loading 'fault' on Instance uuid bac6afa1-a9f5-4cb2-8f02-d226525d4d7a {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:10:44.807249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:44.820009 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d09fdac9-f91c-4af2-9b3d-2ccd90271270 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 200 len: 1332 microversion: 2.1 time: 0.300167 May 07 22:10:44.835041 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2674/5313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:44 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 1332 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:45.176863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53cc49bf-7612-47ea-beda-4d61038816bf tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Action: 'create', calling method: .version_select at 0x7fc40fbf70d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1484916331"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:45.233113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-53cc49bf-7612-47ea-beda-4d61038816bf tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Getting quotas for project d70782066cce4f2fbf5744b63e4195cb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:10:45.239821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-53cc49bf-7612-47ea-beda-4d61038816bf tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Getting quotas for user 4f4cbf51481d45de862752fe273dceda and project d70782066cce4f2fbf5744b63e4195cb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:10:45.520748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-53cc49bf-7612-47ea-beda-4d61038816bf tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Getting quotas for project d70782066cce4f2fbf5744b63e4195cb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:10:45.528229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-53cc49bf-7612-47ea-beda-4d61038816bf tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Getting quotas for user 4f4cbf51481d45de862752fe273dceda and project d70782066cce4f2fbf5744b63e4195cb. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:10:45.555382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:45.556005 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53cc49bf-7612-47ea-beda-4d61038816bf tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.384924 May 07 22:10:45.561133 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2640/5314] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:10:45 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:45.563374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:45.572592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:45.573715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:45.574700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:45.575341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:45.839702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:45.840350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: bac6afa1-a9f5-4cb2-8f02-d226525d4d7a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:45.868225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:45.869451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:45.870488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:45.871148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:45.904659 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] HTTP exception thrown: Instance bac6afa1-a9f5-4cb2-8f02-d226525d4d7a could not be found. May 07 22:10:45.905455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Returning 404 to user: Instance bac6afa1-a9f5-4cb2-8f02-d226525d4d7a could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:10:45.906778 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-efda3883-ab77-4cbe-9540-13d06ff7d055 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a" status: 404 len: 111 microversion: 2.1 time: 0.072778 May 07 22:10:45.911008 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2641/5315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:45 2022] GET /compute/v2.1/servers/bac6afa1-a9f5-4cb2-8f02-d226525d4d7a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:10:46.100251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:46.110071 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c653f230-162d-418a-91c1-48c4d353cd2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1245 microversion: 2.1 time: 0.558771 May 07 22:10:46.120656 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2675/5316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:45 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1245 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:47.127538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:47.128149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:47.135906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:47.138040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:47.140596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:47.141522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:47.665230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:47.679876 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a59f52c-73ee-430a-9238-e316a59a32d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1251 microversion: 2.1 time: 0.554608 May 07 22:10:47.691948 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2642/5317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:47 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1251 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:48.683800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:48.684965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:48.694053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:48.694913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:48.696678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:48.697633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:48.702325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:48.703810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:48.715804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:48.716723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:48.718617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:48.719437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:48.978304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lazy-loading 'services' on Instance uuid a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:10:49.069809 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41ad0d2e-0473-4519-a85d-94374f48842a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0/os-volume_attachments/75dd9e1d-41d8-4373-81eb-a9b8cb88a957" status: 202 len: 0 microversion: 2.1 time: 0.391333 May 07 22:10:49.073936 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2676/5318] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:10:48 2022] DELETE /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0/os-volume_attachments/75dd9e1d-41d8-4373-81eb-a9b8cb88a957 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:10:49.508515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:49.516261 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-330852c4-11a9-4cb0-b14c-b696b079d039 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 0.823012 May 07 22:10:49.517162 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2643/5319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:48 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:50.343345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:50.346373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:50.356589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:50.357864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:50.359352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:50.360040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:50.390581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-600466441", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e4dd549f-c9a7-465c-a9bc-ac93b42c54fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1484916331", "security_groups": [{"name": "tempest-secgroup-smoke-1804087569"}], "networks": [{"uuid": "42882eb7-7f7c-429d-978e-a320afe6b945"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:50.393748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:10:50.510008 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-febb9c48-b70f-4ad6-9518-8e7e9c23da45 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 204 len: 0 microversion: 2.1 time: 0.173137 May 07 22:10:50.514485 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2677/5320] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:10:50 2022] DELETE /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:10:50.521083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:50.521827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:50.530009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:50.530467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:50.532023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:50.532642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:50.821811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] validate_networks() for [('42882eb7-7f7c-429d-978e-a320afe6b945', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:10:50.940960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:50.958681 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88c5c251-93a4-47d2-87d9-d8ec1dbae45f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1514 microversion: 2.1 time: 0.442431 May 07 22:10:50.959373 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2678/5321] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:50 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:50.978075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:50.979010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:50.991908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:50.992746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:50.993690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:50.994202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:51.442237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:51.454966 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ff8d8e01-205c-4be6-9f92-ed8e8f4d6518 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 0.483649 May 07 22:10:51.456228 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2679/5322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:50 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:51.464439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8bd512e7-bacb-4541-ac72-1674262bddd6 req-eb7d7c72-175d-462c-8118-fb7714443407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02c9e228-e26c-48a5-8400-6b213926a539", "tag": "a859dd9c-cf59-4a9b-84c9-dddc4e9476c0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:51.476589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8bd512e7-bacb-4541-ac72-1674262bddd6 req-eb7d7c72-175d-462c-8118-fb7714443407 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:51.477365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8bd512e7-bacb-4541-ac72-1674262bddd6 req-eb7d7c72-175d-462c-8118-fb7714443407 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:51.490613 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8bd512e7-bacb-4541-ac72-1674262bddd6 req-eb7d7c72-175d-462c-8118-fb7714443407 service nova] Creating event network-changed:a859dd9c-cf59-4a9b-84c9-dddc4e9476c0 for instance 02c9e228-e26c-48a5-8400-6b213926a539 on nch2-master-1 May 07 22:10:51.497578 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8bd512e7-bacb-4541-ac72-1674262bddd6 req-eb7d7c72-175d-462c-8118-fb7714443407 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038794 May 07 22:10:51.498568 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2680/5323] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:10:51.980099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:51.981210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:51.994208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:51.997042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:51.999357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:52.002619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:52.092346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:10:52.093692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:10:52.096055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:10:52.096704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:10:52.097790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:10:52.121925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:52.126717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:52.127718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:52.128228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:52.148212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Getting quotas for project d70782066cce4f2fbf5744b63e4195cb. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:10:52.154626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Getting quotas for user 4f4cbf51481d45de862752fe273dceda and project d70782066cce4f2fbf5744b63e4195cb. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:10:52.249209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:10:52.251435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4dd549f-c9a7-465c-a9bc-ac93b42c54fe',volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:10:52.457917 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-227f2d85-1039-4da6-b9af-a03f072bdda3 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.071064 May 07 22:10:52.464807 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2644/5324] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:10:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 2078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:10:52.472385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53a20f45-84c4-488c-8a33-d1f1bf151039 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:52.473350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-53a20f45-84c4-488c-8a33-d1f1bf151039 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:52.581983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-53a20f45-84c4-488c-8a33-d1f1bf151039 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:52.593942 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53a20f45-84c4-488c-8a33-d1f1bf151039 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1098 microversion: 2.1 time: 0.126240 May 07 22:10:52.595897 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2645/5325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:52 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1098 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:52.619146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:52.619960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:52.628239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:52.628969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:52.629971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:52.632489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:53.147130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:53.166018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7cf47896-8c2d-470e-866e-363f8e8967f8 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1514 microversion: 2.1 time: 1.192011 May 07 22:10:53.176291 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2681/5326] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:51 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1514 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:53.237482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:53.259078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6ed042c2-04a1-4ce3-92ab-9acd9e25ee7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 0.647723 May 07 22:10:53.260514 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2646/5327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:52 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:53.612248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:53.613215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:53.637442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:53.638239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:53.642497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:53.643312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:53.810191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:53.832819 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f0ccaafd-7de5-4e69-bef0-f3b175a9cd72 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1196 microversion: 2.1 time: 0.224592 May 07 22:10:53.846385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2682/5328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:53 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1196 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:54.186895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:54.187561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:54.198742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:54.215180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:54.223279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:54.225180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:54.284509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:54.289930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:54.322189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:54.325403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:54.328092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:54.332994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:54.885370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:54.900514 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-818e4c18-61ff-4d2f-9f5c-75e6eb49a7ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 200 len: 1514 microversion: 2.1 time: 0.713917 May 07 22:10:54.901304 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2647/5329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:54 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 1514 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:54.906441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:54.914549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:54.922968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:54.924983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:54.925799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:54.926256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:55.085700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:55.098709 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b11f532c-c284-47ce-85dd-fe2b8e37489e tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1214 microversion: 2.1 time: 0.196018 May 07 22:10:55.099673 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2648/5330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:54 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1214 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:55.321695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-98329858-3c3a-4798-9c4c-9e24bb37472d req-77ac3276-12e5-47e6-abdb-c326db99cc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ed5da6-ab19-4f8c-a82a-c988e23edcc0", "name": "network-vif-deleted", "tag": "337a2b26-27a2-4595-abbc-54e51b93680f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:55.339218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-98329858-3c3a-4798-9c4c-9e24bb37472d req-77ac3276-12e5-47e6-abdb-c326db99cc22 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:55.339589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-98329858-3c3a-4798-9c4c-9e24bb37472d req-77ac3276-12e5-47e6-abdb-c326db99cc22 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:55.367549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-98329858-3c3a-4798-9c4c-9e24bb37472d req-77ac3276-12e5-47e6-abdb-c326db99cc22 service nova] Creating event network-vif-deleted:337a2b26-27a2-4595-abbc-54e51b93680f for instance a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 on nch1-master-1 May 07 22:10:55.377647 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-98329858-3c3a-4798-9c4c-9e24bb37472d req-77ac3276-12e5-47e6-abdb-c326db99cc22 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059573 May 07 22:10:55.378571 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2649/5331] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:10:55.545813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:55.581606 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-81a9fc1a-1ff3-42b1-b567-9c3feba1f344 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 1.306397 May 07 22:10:55.583326 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2683/5332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:54 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:10:55.919737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:55.921401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: a3ed5da6-ab19-4f8c-a82a-c988e23edcc0] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:55.932792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:55.933799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:55.936022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:55.938137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:55.972411 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] HTTP exception thrown: Instance a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 could not be found. May 07 22:10:55.973359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Returning 404 to user: Instance a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:10:55.974509 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c6bd9803-dbbc-4400-93aa-6f2197a0ae0a tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0" status: 404 len: 111 microversion: 2.1 time: 0.060347 May 07 22:10:55.975427 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2650/5333] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:55 2022] GET /compute/v2.1/servers/a3ed5da6-ab19-4f8c-a82a-c988e23edcc0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:10:56.128634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:56.129460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:56.162907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:56.163674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:56.176541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:56.177024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:56.559323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:56.568816 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b5ce1b21-5706-492b-a040-9a4beb9b228b tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1214 microversion: 2.1 time: 0.445627 May 07 22:10:56.570032 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2684/5334] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:56 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1214 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:56.599810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:56.601374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:56.609464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:56.610155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:56.611130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:56.611728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:56.891401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:56.902389 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84e09193-98b8-4d4e-bf05-a87cac640f12 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 0.306270 May 07 22:10:56.904222 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2651/5335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:56 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:57.585910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:57.586540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:57.608573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:57.614212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:57.616951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:57.617510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:57.924927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:57.925635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:57.935850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:57.936648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:57.937984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:57.938646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:58.210294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:58.224428 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c61eee4d-a1ae-4757-b9cd-b031c816cfa1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.642998 May 07 22:10:58.230789 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2685/5336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:57 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:58.399702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:58.413611 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b0f38624-27d4-414b-a364-b4302037ba46 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 0.492611 May 07 22:10:58.417286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2652/5337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:57 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:59.248636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:59.250065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:59.269064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:59.270327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:59.271797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:59.272998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:59.430120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:10:59.430746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:10:59.439032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:59.439486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:59.440272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:59.455758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:59.770809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:10:59.784580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ecad2dc4-8abf-4283-88e5-8fc45c311218 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.542643 May 07 22:10:59.788109 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2686/5338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:59 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:10:59.805167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8b6bf079-a435-4ad8-aad2-e01fb7a05562 req-f4e3e53c-4eef-45f9-b2d9-85fedf119d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c9e228-e26c-48a5-8400-6b213926a539", "name": "network-vif-plugged", "status": "completed", "tag": "a859dd9c-cf59-4a9b-84c9-dddc4e9476c0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:10:59.854314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8b6bf079-a435-4ad8-aad2-e01fb7a05562 req-f4e3e53c-4eef-45f9-b2d9-85fedf119d0d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:10:59.858246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8b6bf079-a435-4ad8-aad2-e01fb7a05562 req-f4e3e53c-4eef-45f9-b2d9-85fedf119d0d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:10:59.881014 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8b6bf079-a435-4ad8-aad2-e01fb7a05562 req-f4e3e53c-4eef-45f9-b2d9-85fedf119d0d service nova] Creating event network-vif-plugged:a859dd9c-cf59-4a9b-84c9-dddc4e9476c0 for instance 02c9e228-e26c-48a5-8400-6b213926a539 on nch2-master-1 May 07 22:10:59.907009 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8b6bf079-a435-4ad8-aad2-e01fb7a05562 req-f4e3e53c-4eef-45f9-b2d9-85fedf119d0d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116518 May 07 22:10:59.907784 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2687/5339] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:00.132763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:00.147130 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3e083046-9a58-45d4-bbda-e9478ea1b1ad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 0.718201 May 07 22:11:00.149718 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2653/5340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:10:59 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:00.685193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a9b5ea7f-96db-427c-967e-f243d8f3278c req-d10bbd07-22cb-4fd2-ac15-36577abf432d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c332b03e-48f7-475c-9577-16a41760ca55", "tag": "5dccdd99-d437-459b-9d5e-a5ecdbf1e400"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:00.704600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a9b5ea7f-96db-427c-967e-f243d8f3278c req-d10bbd07-22cb-4fd2-ac15-36577abf432d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:00.705067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a9b5ea7f-96db-427c-967e-f243d8f3278c req-d10bbd07-22cb-4fd2-ac15-36577abf432d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:00.733021 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a9b5ea7f-96db-427c-967e-f243d8f3278c req-d10bbd07-22cb-4fd2-ac15-36577abf432d service nova] Creating event network-changed:5dccdd99-d437-459b-9d5e-a5ecdbf1e400 for instance c332b03e-48f7-475c-9577-16a41760ca55 on nch1-master-1 May 07 22:11:00.748252 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a9b5ea7f-96db-427c-967e-f243d8f3278c req-d10bbd07-22cb-4fd2-ac15-36577abf432d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064839 May 07 22:11:00.749367 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2688/5341] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:00.803067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:00.804603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:00.817361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:00.818642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:00.821165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:00.821839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:01.165612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:01.167004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:01.184482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:01.184982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:01.185826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:01.186657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:01.364090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:01.385976 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f6a268d1-bf2f-41ef-a451-9584165c1ee6 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.586611 May 07 22:11:01.388926 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2654/5342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:00 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:01.520703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-149955076", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "75e42e23-8e74-41bd-9a60-3536f620fe26"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:01.591158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] validate_networks() for [('75e42e23-8e74-41bd-9a60-3536f620fe26', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:11:01.999723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:02.010455 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd349de7-d56f-4756-ae1e-8fdb9569c59a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1293 microversion: 2.1 time: 0.850025 May 07 22:11:02.011853 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2689/5343] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:01 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1293 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:02.405095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:02.405726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:02.418446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:02.418945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:02.419756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:02.420401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:02.851542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:02.864524 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0af79410-deff-4967-b299-6c12582e36e0 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.463186 May 07 22:11:02.865056 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2690/5344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:02 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:03.028777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:03.029487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:03.040486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.041086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.042349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.047561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.310366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:11:03.312106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:11:03.312874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:11:03.313751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:11:03.314406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:11:03.335794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.336682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.337872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.339053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.383504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Getting quotas for project 72be56c2d4a54014a8f741c451fe014e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:11:03.393880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Getting quotas for user 97ef9a3039534d90ba9d268970cbe9d4 and project 72be56c2d4a54014a8f741c451fe014e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:11:03.418631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:11:03.421865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:11:03.536263 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c7e73bd-8965-4b40-9655-a026ce582b15 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018452 May 07 22:11:03.539920 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2655/5345] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:11:03.567509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ba55294-1788-468b-9f15-b35a3e4304cc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:03.570938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ba55294-1788-468b-9f15-b35a3e4304cc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:03.636679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:03.659842 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57272ed8-772d-4beb-a672-bcc5c3292612 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1474 microversion: 2.1 time: 0.633680 May 07 22:11:03.660816 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2691/5346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:03 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1474 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:03.677408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:03.678472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:03.719185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.725353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.726471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.727031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.772686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0ba55294-1788-468b-9f15-b35a3e4304cc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:03.795105 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ba55294-1788-468b-9f15-b35a3e4304cc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1218 microversion: 2.1 time: 0.240412 May 07 22:11:03.795818 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2656/5347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:03 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:03.805641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:11:03.811392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2426461c-d875-424f-9e19-306c807d8722 req-58e3f3c0-a07c-4243-8bcd-46c27f9934a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c1a630-bf3c-43b9-8367-4ad0368a202f", "tag": "ed17c686-5176-4e6b-9642-9888fb0132ac"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:03.836813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2426461c-d875-424f-9e19-306c807d8722 req-58e3f3c0-a07c-4243-8bcd-46c27f9934a8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.837428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2426461c-d875-424f-9e19-306c807d8722 req-58e3f3c0-a07c-4243-8bcd-46c27f9934a8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.861501 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2426461c-d875-424f-9e19-306c807d8722 req-58e3f3c0-a07c-4243-8bcd-46c27f9934a8 service nova] Creating event network-changed:ed17c686-5176-4e6b-9642-9888fb0132ac for instance 58c1a630-bf3c-43b9-8367-4ad0368a202f on nch1-master-1 May 07 22:11:03.904681 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2426461c-d875-424f-9e19-306c807d8722 req-58e3f3c0-a07c-4243-8bcd-46c27f9934a8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105452 May 07 22:11:03.905214 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2657/5348] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:03.924072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:03.925526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:03.956248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.957036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.958052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:03.958685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:03.978633 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e3cad2a-d39f-49b7-ae44-ce6fc9e2743a tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "DELETE /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 204 len: 0 microversion: 2.1 time: 0.307878 May 07 22:11:03.979627 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2692/5349] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:11:03 2022] DELETE /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:11:03.987601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-481295315", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:04.142437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:11:04.542184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:04.557256 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1048c84d-44ae-4739-9b14-1b6709a9e8ea tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.645923 May 07 22:11:04.558269 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2658/5350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:03 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:04.572087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:04.573245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:04.588502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:04.589528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:04.590733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:04.591121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:05.298152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:05.315406 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e556f310-8add-4596-bed5-1dcd7c696110 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1765 microversion: 2.1 time: 0.755127 May 07 22:11:05.325669 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2659/5351] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:04 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1765 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:05.340298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:05.341278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:05.356161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:05.357200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:05.360696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:05.361294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:05.499965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:05.511227 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7b653765-bff9-47b9-a97a-019885ee123c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1276 microversion: 2.1 time: 0.189101 May 07 22:11:05.512832 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2660/5352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:05 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:05.575082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:05.576966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:05.584989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:05.585776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:05.587026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:05.587668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:05.836960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:11:05.838267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:11:05.839262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:11:05.840012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:11:05.840622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:11:05.862408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:05.863135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:05.864709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:05.866417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:05.920514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:11:05.929203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:11:05.968568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:11:05.972086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: b3ee742d-7d43-4184-863a-c4b8a4b71071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:11:06.031302 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-36596e0e-8d88-4402-9edd-68563474ec51 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050330 May 07 22:11:06.032850 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2693/5353] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:11:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:11:06.044708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a44cd97c-07f5-40bb-b669-cac708b1ba08 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:06.045567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a44cd97c-07f5-40bb-b669-cac708b1ba08 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: b3ee742d-7d43-4184-863a-c4b8a4b71071] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:06.092465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a44cd97c-07f5-40bb-b669-cac708b1ba08 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: b3ee742d-7d43-4184-863a-c4b8a4b71071] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:11:06.111617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:06.126987 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9409aa6c-35b1-45ce-bc4d-29138b2810c9 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.554590 May 07 22:11:06.128277 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2661/5354] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:05 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:06.245083 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a44cd97c-07f5-40bb-b669-cac708b1ba08 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071" status: 204 len: 0 microversion: 2.1 time: 0.201417 May 07 22:11:06.261815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94433ca8-7e3f-431b-a561-a52d43c6af9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:06.262750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94433ca8-7e3f-431b-a561-a52d43c6af9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: b3ee742d-7d43-4184-863a-c4b8a4b71071] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:06.266463 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2694/5355] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:11:06 2022] DELETE /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:11:06.313326 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-94433ca8-7e3f-431b-a561-a52d43c6af9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance b3ee742d-7d43-4184-863a-c4b8a4b71071 could not be found. May 07 22:11:06.315217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94433ca8-7e3f-431b-a561-a52d43c6af9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance b3ee742d-7d43-4184-863a-c4b8a4b71071 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:11:06.317301 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94433ca8-7e3f-431b-a561-a52d43c6af9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071" status: 404 len: 111 microversion: 2.1 time: 0.060834 May 07 22:11:06.333961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:06.334174 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2662/5356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:06 2022] GET /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:11:06.335136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:06.345607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:06.346903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:06.348277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:06.350929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:06.409655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-155556638", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ebdf594d-504a-44e8-89b9-e74774287749"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:06.485934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:11:07.013210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:07.023795 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-61cd80e2-a5ec-4dfa-bccc-e26b89dac847 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1765 microversion: 2.1 time: 0.694099 May 07 22:11:07.024879 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2695/5357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:06 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1765 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:07.029789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:07.030592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:07.036833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:07.038075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:07.039074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:07.039688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:07.140612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:07.148764 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3656cf1c-4776-4990-a8d5-ec900d5bc713 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1276 microversion: 2.1 time: 0.122608 May 07 22:11:07.149370 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2696/5358] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:07 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:07.154346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:07.155222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:07.163601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:07.164301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:07.165701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:07.165701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:07.717904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:07.734201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da4ada72-0fee-42e5-8710-38a4336d5159 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.582697 May 07 22:11:07.737153 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2697/5359] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:07 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:07.901118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:11:07.901664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:11:07.902031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:11:07.902661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:11:07.903121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:11:07.929252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2a19df4b-db1d-4807-ba2a-9f9899e98755 req-c596e59d-e681-422b-965a-c99f60494947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c1a630-bf3c-43b9-8367-4ad0368a202f", "name": "network-vif-deleted", "tag": "ed17c686-5176-4e6b-9642-9888fb0132ac"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:07.949083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:07.949465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:07.950288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:07.950736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:07.954390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2a19df4b-db1d-4807-ba2a-9f9899e98755 req-c596e59d-e681-422b-965a-c99f60494947 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:07.957172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2a19df4b-db1d-4807-ba2a-9f9899e98755 req-c596e59d-e681-422b-965a-c99f60494947 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:07.991181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:11:08.006957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:11:08.023329 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2a19df4b-db1d-4807-ba2a-9f9899e98755 req-c596e59d-e681-422b-965a-c99f60494947 service nova] Creating event network-vif-deleted:ed17c686-5176-4e6b-9642-9888fb0132ac for instance 58c1a630-bf3c-43b9-8367-4ad0368a202f on nch1-master-1 May 07 22:11:08.032214 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2a19df4b-db1d-4807-ba2a-9f9899e98755 req-c596e59d-e681-422b-965a-c99f60494947 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113108 May 07 22:11:08.035178 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2698/5360] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:08.036669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:11:08.039930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:11:08.050218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:08.051061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:08.067651 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.068122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.069172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.079598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.145625 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12207b05-6d59-4b9c-b641-389798fa9ae7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741376 May 07 22:11:08.147181 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2663/5361] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:11:08.157302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-487f51c5-dc6d-49af-8bb1-3297a713f6e9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:08.158214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-487f51c5-dc6d-49af-8bb1-3297a713f6e9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:08.184369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.187331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.187331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lazy-loading 'fault' on Instance uuid 58c1a630-bf3c-43b9-8367-4ad0368a202f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:11:08.274747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-487f51c5-dc6d-49af-8bb1-3297a713f6e9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:08.285080 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-487f51c5-dc6d-49af-8bb1-3297a713f6e9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1220 microversion: 2.1 time: 0.130218 May 07 22:11:08.290504 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2664/5362] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:08 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:08.298432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:08.299359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:08.329922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.330393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.331247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.331706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.427919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd090d094c44c44519dcd3e98de4fc2ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:08.451937 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d3ca860-f2bb-4aba-a89a-b36e93e05a21 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 200 len: 1384 microversion: 2.1 time: 0.412865 May 07 22:11:08.452833 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2699/5363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:08 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 1384 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:08.473646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-381e5d0a-29c6-4c30-bbb4-7c6f019e5251 req-ba7154e8-dddd-4aa6-8002-d38e47abdef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c332b03e-48f7-475c-9577-16a41760ca55", "name": "network-vif-plugged", "status": "completed", "tag": "5dccdd99-d437-459b-9d5e-a5ecdbf1e400"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:08.524741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-381e5d0a-29c6-4c30-bbb4-7c6f019e5251 req-ba7154e8-dddd-4aa6-8002-d38e47abdef9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.530369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-381e5d0a-29c6-4c30-bbb4-7c6f019e5251 req-ba7154e8-dddd-4aa6-8002-d38e47abdef9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.563728 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-381e5d0a-29c6-4c30-bbb4-7c6f019e5251 req-ba7154e8-dddd-4aa6-8002-d38e47abdef9 service nova] Creating event network-vif-plugged:5dccdd99-d437-459b-9d5e-a5ecdbf1e400 for instance c332b03e-48f7-475c-9577-16a41760ca55 on nch1-master-1 May 07 22:11:08.582320 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-381e5d0a-29c6-4c30-bbb4-7c6f019e5251 req-ba7154e8-dddd-4aa6-8002-d38e47abdef9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124371 May 07 22:11:08.592089 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2700/5364] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:08.762294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:08.768784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:08.798352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.799326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.800425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:08.801258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:08.954032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:08.971791 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-68d2e642-53e8-4638-81a5-2206f9566247 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 0.679694 May 07 22:11:08.972309 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2665/5365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:08 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:09.307403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:09.308041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:09.321116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:09.321583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:09.322392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:09.323085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:09.436709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:09.457270 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ae4a6928-b89c-4907-8e72-7a5f6dd73456 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1216 microversion: 2.1 time: 0.152597 May 07 22:11:09.464539 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2666/5366] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:09 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:09.482363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:09.487127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] [instance: 58c1a630-bf3c-43b9-8367-4ad0368a202f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:09.504641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:09.504641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:09.505505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:09.511901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:09.541128 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] HTTP exception thrown: Instance 58c1a630-bf3c-43b9-8367-4ad0368a202f could not be found. May 07 22:11:09.542203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Returning 404 to user: Instance 58c1a630-bf3c-43b9-8367-4ad0368a202f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:11:09.543573 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8ebe940c-bfe3-4c65-9404-05a8bd95f423 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f" status: 404 len: 111 microversion: 2.1 time: 0.075598 May 07 22:11:09.546810 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2667/5367] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:09 2022] GET /compute/v2.1/servers/58c1a630-bf3c-43b9-8367-4ad0368a202f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:11:09.586695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:09.597498 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55498e3d-3d9f-4a8e-acbd-2ed490433828 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 0.844231 May 07 22:11:09.598532 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2701/5368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:08 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:09.989316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:09.990083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:09.998245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:09.999088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:10.000144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:10.000941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:10.484883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:10.486824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:10.504354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:10.507086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:10.511315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:10.512418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:10.682184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:10.715292 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce7a3a94-0d2f-471d-ad52-d0ed4b0dd56e tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 0.728608 May 07 22:11:10.715957 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2668/5369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:09 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:10.729064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:10.729719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:10.746105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:10.746593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:10.747448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:10.747910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:10.965738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:10.977808 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-51a2b5f4-d0b0-4a96-8727-06d97cefb869 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1278 microversion: 2.1 time: 0.499470 May 07 22:11:10.989776 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2702/5370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:10 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1278 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:11.734351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:11.736504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:11.748711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:11.750935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:11.753469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:11.755051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:12.067901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:12.098515 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef734d25-b70a-429c-a2a2-13fc85ccedfc tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 0.359191 May 07 22:11:12.102797 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2703/5371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:11 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:12.107780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4342d7d9-884e-4d31-8e69-10723783567e req-b38a023e-144c-4195-8e61-f98f64acd362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059fa640-aef8-49b9-984f-b96451387d95", "tag": "001d2755-5afe-49fd-b09f-b329e5af504d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:12.129487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4342d7d9-884e-4d31-8e69-10723783567e req-b38a023e-144c-4195-8e61-f98f64acd362 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:12.129953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4342d7d9-884e-4d31-8e69-10723783567e req-b38a023e-144c-4195-8e61-f98f64acd362 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:12.158972 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4342d7d9-884e-4d31-8e69-10723783567e req-b38a023e-144c-4195-8e61-f98f64acd362 service nova] Creating event network-changed:001d2755-5afe-49fd-b09f-b329e5af504d for instance 059fa640-aef8-49b9-984f-b96451387d95 on nch2-master-1 May 07 22:11:12.165965 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4342d7d9-884e-4d31-8e69-10723783567e req-b38a023e-144c-4195-8e61-f98f64acd362 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061622 May 07 22:11:12.166577 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2704/5372] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:12.172641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:12.179030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:12.211469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:12.229559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac4f9866-71de-42c0-98bd-1e469714d3d5 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1270 microversion: 2.1 time: 1.512453 May 07 22:11:12.232266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:12.233707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:12.234697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:12.235573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2669/5373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:10 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1270 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:12.236261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:12.818143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:12.827776 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-adbca5f3-7f40-4969-9ab8-ead5fc6d2416 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.659148 May 07 22:11:12.838152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2705/5374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:12 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:13.119416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:13.119866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:13.133021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.136103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:13.137070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.138867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:13.258329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:13.259094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:13.267380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.267952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:13.269025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.269907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:13.598030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:13.607056 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9f4ab0fe-f959-4a08-95ee-ca6d2c92bae3 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 0.491633 May 07 22:11:13.608079 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2670/5375] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:13 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:13.846440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:13.847591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:13.858802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.859230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:13.860208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.862223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:13.927476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:13.936519 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8ff213a7-3223-4f73-a92e-4c98652255f2 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1459 microversion: 2.1 time: 0.687001 May 07 22:11:13.937387 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2706/5376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:13 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1459 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:13.954239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:13.955052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:13.962914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.963544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:13.964630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:13.965291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:14.238366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:14.248241 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-877e8a70-f275-4d46-b91c-4c23ae3a50bc tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.405969 May 07 22:11:14.249423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2671/5377] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:13 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:14.294649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:14.304807 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-edfdc1ff-29d8-45ba-91c9-221e0c2a56ce tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1459 microversion: 2.1 time: 0.354481 May 07 22:11:14.306147 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2707/5378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:13 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1459 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:14.467334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9d90e020-a38e-4932-bc9f-8ae9d45098ed req-a0b46504-05be-41c6-8147-3056fcedc4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d76e503-6e1a-4cee-b3b8-29af6484df32", "tag": "5b241f8b-bf65-4cfc-a26e-58140662237c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:14.491636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9d90e020-a38e-4932-bc9f-8ae9d45098ed req-a0b46504-05be-41c6-8147-3056fcedc4de service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:14.492594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9d90e020-a38e-4932-bc9f-8ae9d45098ed req-a0b46504-05be-41c6-8147-3056fcedc4de service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:14.523142 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9d90e020-a38e-4932-bc9f-8ae9d45098ed req-a0b46504-05be-41c6-8147-3056fcedc4de service nova] Creating event network-changed:5b241f8b-bf65-4cfc-a26e-58140662237c for instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 on nch1-master-1 May 07 22:11:14.537840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9d90e020-a38e-4932-bc9f-8ae9d45098ed req-a0b46504-05be-41c6-8147-3056fcedc4de service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095032 May 07 22:11:14.541787 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2672/5379] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:14.624838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:14.625468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:14.635471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:14.638118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:14.638988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:14.639447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:15.051617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:15.062331 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4f7b7c9-5eaa-45f7-9974-7c016035e7e7 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 0.441272 May 07 22:11:15.068588 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2708/5380] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:14 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:15.270169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:15.271028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:15.284545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:15.286170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:15.287205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:15.287759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:15.747490 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:15.761307 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2277497-875d-44e9-9861-043494769df8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.497522 May 07 22:11:15.774419 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2673/5381] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:15 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:16.085283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:16.086917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:16.095148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:16.095613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:16.096908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:16.097371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:16.391339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:16.414428 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04400953-b250-4576-8146-42e2e38f0700 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 0.332438 May 07 22:11:16.415812 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2709/5382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:16 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:16.782714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:16.783501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:16.796237 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:16.799415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:16.801033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:16.808116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:17.433408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:17.434062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:17.453375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:17.455452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:17.457503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:17.457971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:17.541747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:17.567801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5082659c-5d4b-40d4-9257-ba5b959a02ce tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.790017 May 07 22:11:17.569454 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2674/5383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:16 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:18.596196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:18.596845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:18.608620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:18.613813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:18.614661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:18.615436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:18.706116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:18.721564 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-becd1644-77ee-4d02-b31f-0f0e18693632 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 1.289949 May 07 22:11:18.731499 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2710/5384] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:17 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:19.411760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:19.420279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8b423830-9ecc-49f1-9024-78e033088930 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.838229 May 07 22:11:19.421552 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2675/5385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:18 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:19.740596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:19.742527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:19.751261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:19.752316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:19.753365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:19.754060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:20.439539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:20.441501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:20.452538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:20.453263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:20.454533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:20.455421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:20.545169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:20.560923 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-958bc2ac-f13f-4093-8d31-1611e869db0d tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 0.825260 May 07 22:11:20.565657 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2711/5386] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:19 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:20.726450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5c86c729-83f8-463d-ac33-8d9500a31555 req-e5160663-e68e-4f68-884e-445326237a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059fa640-aef8-49b9-984f-b96451387d95", "name": "network-vif-plugged", "status": "completed", "tag": "001d2755-5afe-49fd-b09f-b329e5af504d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:20.741555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5c86c729-83f8-463d-ac33-8d9500a31555 req-e5160663-e68e-4f68-884e-445326237a9a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:20.760144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5c86c729-83f8-463d-ac33-8d9500a31555 req-e5160663-e68e-4f68-884e-445326237a9a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:20.784759 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5c86c729-83f8-463d-ac33-8d9500a31555 req-e5160663-e68e-4f68-884e-445326237a9a service nova] Creating event network-vif-plugged:001d2755-5afe-49fd-b09f-b329e5af504d for instance 059fa640-aef8-49b9-984f-b96451387d95 on nch2-master-1 May 07 22:11:20.798653 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5c86c729-83f8-463d-ac33-8d9500a31555 req-e5160663-e68e-4f68-884e-445326237a9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081331 May 07 22:11:20.800174 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2712/5387] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:11:20.982655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:21.016143 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4225f53c-dbd6-4937-867d-e280d06c97b3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.581853 May 07 22:11:21.016839 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2676/5388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:20 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:21.583036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:21.584573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:21.591759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:21.592500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:21.593590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:21.594287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:22.034546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:22.036969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:22.055845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:22.056086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:22.056895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:22.057985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:22.574697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:22.584549 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d7a007ca-2685-45f4-859b-188fc77dc744 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1318 microversion: 2.1 time: 1.006254 May 07 22:11:22.593580 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2713/5389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:21 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1318 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:22.883848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d9974f2a-439b-45bb-a9c9-01c80d68d36a req-ee72fbc2-5421-4e66-8034-7db1473c8efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d76e503-6e1a-4cee-b3b8-29af6484df32", "name": "network-vif-plugged", "status": "completed", "tag": "5b241f8b-bf65-4cfc-a26e-58140662237c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:22.912569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d9974f2a-439b-45bb-a9c9-01c80d68d36a req-ee72fbc2-5421-4e66-8034-7db1473c8efa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:22.913436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d9974f2a-439b-45bb-a9c9-01c80d68d36a req-ee72fbc2-5421-4e66-8034-7db1473c8efa service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:22.957124 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d9974f2a-439b-45bb-a9c9-01c80d68d36a req-ee72fbc2-5421-4e66-8034-7db1473c8efa service nova] Creating event network-vif-plugged:5b241f8b-bf65-4cfc-a26e-58140662237c for instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 on nch1-master-1 May 07 22:11:22.974071 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d9974f2a-439b-45bb-a9c9-01c80d68d36a req-ee72fbc2-5421-4e66-8034-7db1473c8efa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091541 May 07 22:11:22.975360 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2714/5390] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:11:22.984517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:23.013564 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c0e7bd18-148b-47f4-b1ba-dd6ddbf1db5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.983275 May 07 22:11:23.014196 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2677/5391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:22 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:23.485822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d00895ba-aee9-4138-8ef6-341dd955a037 req-bc1e774d-82f7-4b84-bb25-91dc52b82bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c332b03e-48f7-475c-9577-16a41760ca55", "tag": "5dccdd99-d437-459b-9d5e-a5ecdbf1e400"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:23.500847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d00895ba-aee9-4138-8ef6-341dd955a037 req-bc1e774d-82f7-4b84-bb25-91dc52b82bf5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:23.511693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d00895ba-aee9-4138-8ef6-341dd955a037 req-bc1e774d-82f7-4b84-bb25-91dc52b82bf5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:23.525141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d00895ba-aee9-4138-8ef6-341dd955a037 req-bc1e774d-82f7-4b84-bb25-91dc52b82bf5 service nova] Creating event network-changed:5dccdd99-d437-459b-9d5e-a5ecdbf1e400 for instance c332b03e-48f7-475c-9577-16a41760ca55 on nch1-master-1 May 07 22:11:23.540322 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d00895ba-aee9-4138-8ef6-341dd955a037 req-bc1e774d-82f7-4b84-bb25-91dc52b82bf5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062216 May 07 22:11:23.543121 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2715/5392] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:11:23.610935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:23.612310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:23.627668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:23.628453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:23.630033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:23.632517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:23.924751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:23.935617 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52226d50-d888-4766-a527-723b1bc2af05 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1506 microversion: 2.1 time: 0.329377 May 07 22:11:23.936434 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2678/5393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:23 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:23.955835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-680d70b6-7388-4ef6-bb7a-4279169afd2f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28875749-3b9f-4237-b844-689c84a5f03f", "device": "/dev/sdb"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:23.957086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-680d70b6-7388-4ef6-bb7a-4279169afd2f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:23.977362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d70b6-7388-4ef6-bb7a-4279169afd2f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:23.981489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d70b6-7388-4ef6-bb7a-4279169afd2f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:23.983887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d70b6-7388-4ef6-bb7a-4279169afd2f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:23.987401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-680d70b6-7388-4ef6-bb7a-4279169afd2f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:24.032809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:24.033736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:24.044114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:24.051072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:24.053235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:24.053235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:24.431339 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-680d70b6-7388-4ef6-bb7a-4279169afd2f tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "POST /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478915 May 07 22:11:24.444694 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2716/5394] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:11:23 2022] POST /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:11:24.453785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:24.461223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9be7cd99-1acd-455e-933a-4b6cabe79c68 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] Calling method '.version_select at 0x7fc41c41b0d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:24.468840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a1f98faf-0209-4639-9107-ad2fa2ab639a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1320 microversion: 2.1 time: 0.440943 May 07 22:11:24.469442 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2679/5395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:24 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:24.502499 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9be7cd99-1acd-455e-933a-4b6cabe79c68 tempest-TestSecurityGroupsBasicOps-1364257693 tempest-TestSecurityGroupsBasicOps-1364257693-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1681466864" status: 202 len: 0 microversion: 2.1 time: 0.053726 May 07 22:11:24.503646 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2717/5396] 10.222.0.32 () {58 vars in 1277 bytes} [Sat May 7 22:11:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1681466864 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:11:25.492457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:25.493246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:25.507981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:25.510874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:25.512079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:25.512687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:26.379600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:26.389369 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-222c5bf7-f182-41f8-8389-c21177979312 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1502 microversion: 2.1 time: 0.901272 May 07 22:11:26.390695 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2680/5397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:25 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1502 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:26.417260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:26.418914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:26.426750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:26.427650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:26.428957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:26.429642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:27.236588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:27.264315 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-276eb7f8-9c32-4f5c-8817-1bc9d42ad067 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1502 microversion: 2.1 time: 0.861035 May 07 22:11:27.287711 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2718/5398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:26 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1502 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:27.300700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:27.301833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:27.311802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:27.312467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:27.313447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:27.314801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:27.344088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:11:27.487273 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d696e7d-cee3-4439-a985-632cf68f1d9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 204 len: 0 microversion: 2.1 time: 0.190054 May 07 22:11:27.490969 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2681/5399] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:11:27 2022] DELETE /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:11:27.497039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:27.497899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:27.510151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:27.511609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:27.514117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:27.515392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:28.128713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:28.139310 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5d83d52-ff5b-45b5-9319-31a1b63818d5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1508 microversion: 2.1 time: 0.646820 May 07 22:11:28.140981 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2719/5400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:27 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1508 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:29.158170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:29.159166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:29.176331 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:29.178056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:29.179946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:29.182250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:29.194586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-fbf37e9a-40d3-4452-ab4d-a425909f0aef req-c5efe43e-cb64-47a8-b6f5-c1059fbd92db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c332b03e-48f7-475c-9577-16a41760ca55", "tag": "5dccdd99-d437-459b-9d5e-a5ecdbf1e400"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:29.228196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fbf37e9a-40d3-4452-ab4d-a425909f0aef req-c5efe43e-cb64-47a8-b6f5-c1059fbd92db service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:29.228844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fbf37e9a-40d3-4452-ab4d-a425909f0aef req-c5efe43e-cb64-47a8-b6f5-c1059fbd92db service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:29.299348 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-fbf37e9a-40d3-4452-ab4d-a425909f0aef req-c5efe43e-cb64-47a8-b6f5-c1059fbd92db service nova] Creating event network-changed:5dccdd99-d437-459b-9d5e-a5ecdbf1e400 for instance c332b03e-48f7-475c-9577-16a41760ca55 on nch1-master-1 May 07 22:11:29.325089 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-fbf37e9a-40d3-4452-ab4d-a425909f0aef req-c5efe43e-cb64-47a8-b6f5-c1059fbd92db service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132372 May 07 22:11:29.344235 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2720/5401] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:29.694184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:29.705301 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-302d2615-21dc-4a85-873e-5189570b4918 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1508 microversion: 2.1 time: 0.549553 May 07 22:11:29.706320 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2682/5402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:29 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1508 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:30.733610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:30.734462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:30.746276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:30.768393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:30.770423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:30.770988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:31.111602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:31.122704 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a37f292a-b159-4895-9f12-9bd0a6f4d7fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 200 len: 1466 microversion: 2.1 time: 0.393346 May 07 22:11:31.125523 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2721/5403] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:30 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 1466 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:31.442937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2cd4d6dc-c8dc-4342-a2a7-53b6e644ded5 req-581bb842-9474-441d-8d22-c32d87503ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c332b03e-48f7-475c-9577-16a41760ca55", "tag": "5dccdd99-d437-459b-9d5e-a5ecdbf1e400"}, {"server_uuid": "1d76e503-6e1a-4cee-b3b8-29af6484df32", "name": "network-vif-deleted", "tag": "5b241f8b-bf65-4cfc-a26e-58140662237c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:31.464192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2cd4d6dc-c8dc-4342-a2a7-53b6e644ded5 req-581bb842-9474-441d-8d22-c32d87503ff0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:31.466636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2cd4d6dc-c8dc-4342-a2a7-53b6e644ded5 req-581bb842-9474-441d-8d22-c32d87503ff0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:31.498452 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2cd4d6dc-c8dc-4342-a2a7-53b6e644ded5 req-581bb842-9474-441d-8d22-c32d87503ff0 service nova] Creating event network-changed:5dccdd99-d437-459b-9d5e-a5ecdbf1e400 for instance c332b03e-48f7-475c-9577-16a41760ca55 on nch1-master-1 May 07 22:11:31.503536 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2cd4d6dc-c8dc-4342-a2a7-53b6e644ded5 req-581bb842-9474-441d-8d22-c32d87503ff0 service nova] Creating event network-vif-deleted:5b241f8b-bf65-4cfc-a26e-58140662237c for instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 on nch1-master-1 May 07 22:11:31.517172 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2cd4d6dc-c8dc-4342-a2a7-53b6e644ded5 req-581bb842-9474-441d-8d22-c32d87503ff0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077758 May 07 22:11:31.523187 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2683/5404] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:32.142527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:32.143350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:32.158592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:32.159095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:32.159911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:32.160365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:32.181820 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 could not be found. May 07 22:11:32.182821 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:11:32.183866 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a40abe1-707a-454a-881d-4e1ae45c6e0a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 404 len: 111 microversion: 2.1 time: 0.046125 May 07 22:11:32.184994 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2722/5405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:32 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:11:32.199141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ad39b1fc-cdea-47bf-9cd9-2174f1f1d551 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: .version_select at 0x7fc40fc3e4c0>, body: {"keypair": {"name": "tempest-key-2137450983"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:32.229126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ad39b1fc-cdea-47bf-9cd9-2174f1f1d551 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:11:32.237738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ad39b1fc-cdea-47bf-9cd9-2174f1f1d551 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:11:32.475425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ad39b1fc-cdea-47bf-9cd9-2174f1f1d551 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:11:32.484059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ad39b1fc-cdea-47bf-9cd9-2174f1f1d551 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:11:32.510930 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ad39b1fc-cdea-47bf-9cd9-2174f1f1d551 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.318132 May 07 22:11:32.517215 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2684/5406] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:11:32 2022] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:32.522037 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e0b90362-6dff-435f-a6c7-cfc393b77d4d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '.version_select at 0x7fc42260e790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:32.525668 ncdv-master-1 devstack@n-api.service[136682]: WARNING oslo_db.sqlalchemy.utils [None req-e0b90362-6dff-435f-a6c7-cfc393b77d4d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Unique keys not in sort_keys. The sorting order may be unstable. May 07 22:11:32.550398 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e0b90362-6dff-435f-a6c7-cfc393b77d4d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.028445 May 07 22:11:32.551671 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2723/5407] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 22:11:32 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:11:32.682682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1246691466", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "key_name": "tempest-key-2137450983", "networks": [{"uuid": "ebdf594d-504a-44e8-89b9-e74774287749"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:32.799013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:11:33.928531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:11:33.929992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:11:33.930319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:11:33.930934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:11:33.931521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:11:33.944776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:33.946275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:33.947442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:33.947951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:33.993289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:11:34.016364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:11:34.038298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:11:34.042336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:11:34.117745 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1aed6b9-54ff-47f4-890d-9de6d125acd2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.441018 May 07 22:11:34.119072 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2685/5408] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:11:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:11:34.128971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1dcd45bc-8e34-4f49-a1b3-cc444f967403 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:34.129597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1dcd45bc-8e34-4f49-a1b3-cc444f967403 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:34.315298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1dcd45bc-8e34-4f49-a1b3-cc444f967403 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:34.324672 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1dcd45bc-8e34-4f49-a1b3-cc444f967403 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1229 microversion: 2.1 time: 0.199386 May 07 22:11:34.327385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2724/5409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:34 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1229 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:35.365129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:35.367707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:35.389898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:35.390681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:35.393393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:35.393855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:36.022637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:36.043248 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff0bf1ef-5e51-47b2-af18-30af35238a5c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1281 microversion: 2.1 time: 0.695807 May 07 22:11:36.044603 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2686/5410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:35 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1281 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:37.061877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:37.062517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:37.085070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:37.087135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:37.088173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:37.088973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:37.252793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:37.268185 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0cf27b22-0858-4be2-b455-d5d8c24067a8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1287 microversion: 2.1 time: 0.210449 May 07 22:11:37.269262 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2725/5411] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:37 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1287 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:38.288246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:38.289031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:38.303766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:38.312717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:38.314393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:38.316098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:38.547452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:38.588961 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e9bacf44-71be-4961-aace-52ee3b542a50 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1287 microversion: 2.1 time: 0.302685 May 07 22:11:38.589703 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2687/5412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:38 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1287 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:39.607129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:39.607744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:39.619879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:39.620608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:39.621710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:39.622657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:40.126631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:40.136203 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d90c5a1-2f5b-4a71-8ee6-830d0acdf085 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.533322 May 07 22:11:40.137198 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2726/5413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:39 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:41.157125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:41.158951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:41.180094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:41.181703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:41.184210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:41.184943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:41.537327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:41.584854 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2ec39abd-03a9-40a9-af7c-77775216225d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.433462 May 07 22:11:41.587385 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2688/5414] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:41 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:41.967964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f153c22d-13f8-40e7-9731-0fc5572976b0 req-7fd2004d-e6a5-40e3-827c-2559b6b21fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9829cd11-baa4-4561-9934-3becae825b83", "tag": "0541c2a2-9507-408f-93eb-52c625931320"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:42.017096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f153c22d-13f8-40e7-9731-0fc5572976b0 req-7fd2004d-e6a5-40e3-827c-2559b6b21fe7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:42.017965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f153c22d-13f8-40e7-9731-0fc5572976b0 req-7fd2004d-e6a5-40e3-827c-2559b6b21fe7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:42.055334 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f153c22d-13f8-40e7-9731-0fc5572976b0 req-7fd2004d-e6a5-40e3-827c-2559b6b21fe7 service nova] Creating event network-changed:0541c2a2-9507-408f-93eb-52c625931320 for instance 9829cd11-baa4-4561-9934-3becae825b83 on nch1-master-1 May 07 22:11:42.073012 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f153c22d-13f8-40e7-9731-0fc5572976b0 req-7fd2004d-e6a5-40e3-827c-2559b6b21fe7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108473 May 07 22:11:42.075940 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2727/5415] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:42.605413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:42.606054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:42.615638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:42.616095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:42.616883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:42.627616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:42.972961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:42.982829 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-08e2af0c-7689-4357-b7d5-35e535de7810 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.381908 May 07 22:11:42.987059 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2689/5416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:42 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:44.006974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:44.007888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:44.018547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:44.021854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:44.024041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:44.025594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:44.591740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:44.623114 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef2f1ac2-4bf7-473d-8fae-3ba19fd45e5d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.618039 May 07 22:11:44.623915 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2728/5417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:43 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:45.641355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:45.641958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:45.659026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:45.659935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:45.661062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:45.662000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:46.387510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:46.400984 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bda6151f-d628-48d9-9df8-4022770d51c6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.762471 May 07 22:11:46.404870 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2690/5418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:45 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:47.424066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:47.424987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:47.444998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:47.447508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:47.451151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:47.451151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:47.813725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:47.835717 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de02a4e4-89b6-454f-9c82-bd69ef952703 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.405544 May 07 22:11:47.837620 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2729/5419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:47 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:48.858967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:48.859572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:48.867473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:48.868003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:48.868790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:48.869231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:49.336032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:49.362482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87fba78d-3193-448c-ac21-07a2127888e2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.508711 May 07 22:11:49.364882 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2691/5420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:48 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:50.382690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:50.383539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:50.400707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:50.401512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:50.403652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:50.405091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:50.923865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:50.937873 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0152742f-bf86-4622-8daa-c7c1bdac403e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.560062 May 07 22:11:50.938867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2730/5421] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:50 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:11:51.964329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:51.965050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ab3e6e0b-46ba-426d-82fe-231bb9ebf11a req-85085c6a-feb4-4227-9d03-1ff534e6b785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9829cd11-baa4-4561-9934-3becae825b83", "name": "network-vif-plugged", "status": "completed", "tag": "0541c2a2-9507-408f-93eb-52c625931320"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:11:51.966004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:51.986156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:51.997303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:51.998644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:51.999163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:52.001359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ab3e6e0b-46ba-426d-82fe-231bb9ebf11a req-85085c6a-feb4-4227-9d03-1ff534e6b785 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:52.013048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ab3e6e0b-46ba-426d-82fe-231bb9ebf11a req-85085c6a-feb4-4227-9d03-1ff534e6b785 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:52.042844 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ab3e6e0b-46ba-426d-82fe-231bb9ebf11a req-85085c6a-feb4-4227-9d03-1ff534e6b785 service nova] Creating event network-vif-plugged:0541c2a2-9507-408f-93eb-52c625931320 for instance 9829cd11-baa4-4561-9934-3becae825b83 on nch1-master-1 May 07 22:11:52.054967 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ab3e6e0b-46ba-426d-82fe-231bb9ebf11a req-85085c6a-feb4-4227-9d03-1ff534e6b785 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103971 May 07 22:11:52.058177 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2692/5422] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:11:52.504078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:52.516134 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-886fecc2-bc1d-4d86-87b9-b76abe26d5dd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 0.563258 May 07 22:11:52.517519 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2731/5423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:51 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:53.536298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:53.537587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:53.555730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:53.556178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:53.557185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:53.557791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:54.654598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:54.666953 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-477525ed-27fd-44fb-a61a-965e32aa25fa tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1329 microversion: 2.1 time: 1.135168 May 07 22:11:54.673567 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2693/5424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:53 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1329 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:55.692864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:55.693585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:55.705919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:55.721774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:55.721774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:55.721774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:56.031249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:56.044387 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-402a3154-9d0b-49f5-933b-c82398efa829 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1511 microversion: 2.1 time: 0.355807 May 07 22:11:56.048482 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2732/5425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:55 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:56.062639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:56.063389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:56.073970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:56.074441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:56.075288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:56.075930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:56.561239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:56.591858 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c5afda16-3c68-48d4-a914-e384dd5f68cd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1511 microversion: 2.1 time: 0.531667 May 07 22:11:56.594182 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2694/5426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:56 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:56.619938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:56.621631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:56.636970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:56.637828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:56.638895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:56.639606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:56.686119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:11:56.861254 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da960f54-27fd-48ed-a4d6-ab236fcd5e4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 204 len: 0 microversion: 2.1 time: 0.252848 May 07 22:11:56.862711 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2733/5427] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:11:56 2022] DELETE /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:11:56.874135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:56.874885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:56.887804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:56.888903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:56.890889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:56.901825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:57.608634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:57.617750 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c54850ba-2aaf-4c72-add0-82f5a08dc3ff tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1517 microversion: 2.1 time: 0.749913 May 07 22:11:57.619579 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2695/5428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:56 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1517 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:11:58.641091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:11:58.646710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:11:58.681470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:58.682298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:58.689083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:11:58.692305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:11:59.134102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:11:59.162311 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b6b9f64-0295-4248-8827-d6d5a1a8b1e3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1517 microversion: 2.1 time: 0.528177 May 07 22:11:59.174294 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2734/5429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:11:58 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1517 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:00.135478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-774230b2-1354-4e53-9b76-8ff935c09620 req-67edfc88-28d7-42e0-a5d2-bbedc33c0ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9829cd11-baa4-4561-9934-3becae825b83", "name": "network-vif-deleted", "tag": "0541c2a2-9507-408f-93eb-52c625931320"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:00.164681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-774230b2-1354-4e53-9b76-8ff935c09620 req-67edfc88-28d7-42e0-a5d2-bbedc33c0ff3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:00.165131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-774230b2-1354-4e53-9b76-8ff935c09620 req-67edfc88-28d7-42e0-a5d2-bbedc33c0ff3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:00.182170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:00.183505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:00.222458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:00.230445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:00.231562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:00.233009 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-774230b2-1354-4e53-9b76-8ff935c09620 req-67edfc88-28d7-42e0-a5d2-bbedc33c0ff3 service nova] Creating event network-vif-deleted:0541c2a2-9507-408f-93eb-52c625931320 for instance 9829cd11-baa4-4561-9934-3becae825b83 on nch1-master-1 May 07 22:12:00.233879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:00.258224 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-774230b2-1354-4e53-9b76-8ff935c09620 req-67edfc88-28d7-42e0-a5d2-bbedc33c0ff3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.431715 May 07 22:12:00.260596 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2696/5430] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:12:00.308712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:00.309528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:00.310383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lazy-loading 'fault' on Instance uuid 9829cd11-baa4-4561-9934-3becae825b83 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:12:00.469112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:00.482222 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6f002f4c-587a-4f21-ae52-3af5baacae2d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 200 len: 1319 microversion: 2.1 time: 0.304083 May 07 22:12:00.483544 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2735/5431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:00 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:01.504059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:01.508567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:01.524406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:01.525519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:01.527191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:01.528538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:01.553826 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 9829cd11-baa4-4561-9934-3becae825b83 could not be found. May 07 22:12:01.554726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 9829cd11-baa4-4561-9934-3becae825b83 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:12:01.555820 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d9041e7-a9a0-4be2-a200-5bc948d04993 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 404 len: 111 microversion: 2.1 time: 0.057642 May 07 22:12:01.556787 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2697/5432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:01 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:12:01.565768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-96bea78a-b3bb-4201-bb0e-8d849501b8d4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '.version_select at 0x7fc41c34c5e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:01.601678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-96bea78a-b3bb-4201-bb0e-8d849501b8d4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-key-2137450983" status: 202 len: 0 microversion: 2.1 time: 0.039618 May 07 22:12:01.602636 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2736/5433] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 22:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2137450983 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:12:01.747373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-12371509", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "ebdf594d-504a-44e8-89b9-e74774287749"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:01.832858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:12:03.167326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:12:03.168039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:12:03.168229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:12:03.168851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:12:03.169482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:12:03.189781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:03.190548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:03.192122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:03.192746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:03.237111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:12:03.244307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:12:03.310494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:12:03.324788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:12:03.474657 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-831bfce3-4b6b-43ca-b438-62bc745eb617 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730721 May 07 22:12:03.475914 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2698/5434] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:12:03.485531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e1d2c0b-7884-4703-8cf9-bd0e2bcfad1e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:03.486161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6e1d2c0b-7884-4703-8cf9-bd0e2bcfad1e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:03.716436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6e1d2c0b-7884-4703-8cf9-bd0e2bcfad1e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:03.727688 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e1d2c0b-7884-4703-8cf9-bd0e2bcfad1e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1207 microversion: 2.1 time: 0.242946 May 07 22:12:03.730868 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2737/5435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:03 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1207 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:04.746625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:04.748074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:04.765741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:04.766254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:04.767157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:04.767604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:04.869332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:04.878495 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-35e63704-eb78-4525-bb2b-bd6b3d61c4ec tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1259 microversion: 2.1 time: 0.136944 May 07 22:12:04.888956 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2699/5436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:04 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:05.897559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:05.898309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:05.912823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:05.916350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:05.917499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:05.918186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:06.357637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:06.371292 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d4aba0fb-fdd9-4d88-a2e4-fc701afb7949 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1265 microversion: 2.1 time: 0.476069 May 07 22:12:06.372694 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2738/5437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:05 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1265 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:07.389724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:07.390394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:07.398760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:07.399250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:07.400045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:07.400493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:07.526545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:07.533951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-611335dc-cdbf-4f5a-8339-60d22837579e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1265 microversion: 2.1 time: 0.148094 May 07 22:12:07.544223 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2700/5438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:07 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:08.553820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:08.555442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:08.566060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:08.566983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:08.568152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:08.569020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:09.584187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:09.598130 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1bd5f93-a76b-417a-8968-6b131b9f6ebe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 1.051162 May 07 22:12:09.610311 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2739/5439] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:08 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:10.552345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-47dc79bb-c221-4eba-8bbc-38db7609132a req-97fc95f3-6038-49eb-91ca-9b26f594eb73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876afed0-19b4-4cae-83e8-a954d0cae1ba", "tag": "2aca6585-cfee-43a3-b4ee-9b346ed2588f"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:10.573047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-47dc79bb-c221-4eba-8bbc-38db7609132a req-97fc95f3-6038-49eb-91ca-9b26f594eb73 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:10.573514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-47dc79bb-c221-4eba-8bbc-38db7609132a req-97fc95f3-6038-49eb-91ca-9b26f594eb73 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:10.602742 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-47dc79bb-c221-4eba-8bbc-38db7609132a req-97fc95f3-6038-49eb-91ca-9b26f594eb73 service nova] Creating event network-changed:2aca6585-cfee-43a3-b4ee-9b346ed2588f for instance 876afed0-19b4-4cae-83e8-a954d0cae1ba on nch1-master-1 May 07 22:12:10.616534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:10.617187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:10.623964 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-47dc79bb-c221-4eba-8bbc-38db7609132a req-97fc95f3-6038-49eb-91ca-9b26f594eb73 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094362 May 07 22:12:10.624112 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2701/5440] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:12:10.626679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:10.627173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:10.627983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:10.628441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:11.126925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:11.146665 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1bfcdce9-2349-42ef-a405-d7c7d55287d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 0.533978 May 07 22:12:11.147509 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2740/5441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:10 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:12.171001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:12.179388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:12.211835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:12.237987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:12.239020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:12.243263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:13.074635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:13.085959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-edafcb0b-81a1-42fd-a5e9-7968272ec42f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 0.924513 May 07 22:12:13.088539 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2702/5442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:12 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:14.107993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:14.115742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:14.126705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:14.138213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:14.139395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:14.140076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:15.095382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:15.113723 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52004ea2-e048-44d2-8f7f-f989a23c4467 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 1.009017 May 07 22:12:15.115589 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2741/5443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:14 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:16.134372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:16.155291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:16.176870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:16.180413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:16.181590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:16.184476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:17.073744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:17.093788 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a56e8afa-03f9-4b6d-81ac-ad2100229df7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 0.965219 May 07 22:12:17.107557 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2703/5444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:16 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:18.120405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:18.124737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:18.156594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:18.157632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:18.160966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:18.162034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:19.227298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:19.250115 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5d7ea41-58d5-4efa-8937-a98a7cc69606 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 1.138110 May 07 22:12:19.254746 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2742/5445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:18 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:20.272548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:20.273927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:20.284275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:20.284995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:20.286532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:20.287180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:20.919299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8ac1de55-0acb-4bdb-96c1-377cde66291c req-07f62eb1-bc64-48bf-b9cc-67a1a235bc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876afed0-19b4-4cae-83e8-a954d0cae1ba", "name": "network-vif-plugged", "status": "completed", "tag": "2aca6585-cfee-43a3-b4ee-9b346ed2588f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:20.942081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8ac1de55-0acb-4bdb-96c1-377cde66291c req-07f62eb1-bc64-48bf-b9cc-67a1a235bc3e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:20.942643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8ac1de55-0acb-4bdb-96c1-377cde66291c req-07f62eb1-bc64-48bf-b9cc-67a1a235bc3e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:20.961340 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8ac1de55-0acb-4bdb-96c1-377cde66291c req-07f62eb1-bc64-48bf-b9cc-67a1a235bc3e service nova] Creating event network-vif-plugged:2aca6585-cfee-43a3-b4ee-9b346ed2588f for instance 876afed0-19b4-4cae-83e8-a954d0cae1ba on nch1-master-1 May 07 22:12:20.969948 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8ac1de55-0acb-4bdb-96c1-377cde66291c req-07f62eb1-bc64-48bf-b9cc-67a1a235bc3e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323947 May 07 22:12:20.974599 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2743/5446] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:12:21.394391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:21.409481 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9e63bd0-7823-45c6-a4d6-9aa274cacbc9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 1.143918 May 07 22:12:21.410639 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2704/5447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:20 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:21.977311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:21.983869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:22.008684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:22.009143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:22.009944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:22.010389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:22.058906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:12:22.138101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ec7b13f0-3d1e-4464-a253-558b1a94f1cc req-7b8f325a-96d1-4876-9432-da97fab66dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c332b03e-48f7-475c-9577-16a41760ca55", "tag": "5dccdd99-d437-459b-9d5e-a5ecdbf1e400"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:22.155704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ec7b13f0-3d1e-4464-a253-558b1a94f1cc req-7b8f325a-96d1-4876-9432-da97fab66dad service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:22.156284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ec7b13f0-3d1e-4464-a253-558b1a94f1cc req-7b8f325a-96d1-4876-9432-da97fab66dad service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:22.207753 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ec7b13f0-3d1e-4464-a253-558b1a94f1cc req-7b8f325a-96d1-4876-9432-da97fab66dad service nova] Creating event network-changed:5dccdd99-d437-459b-9d5e-a5ecdbf1e400 for instance c332b03e-48f7-475c-9577-16a41760ca55 on nch1-master-1 May 07 22:12:22.227224 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ec7b13f0-3d1e-4464-a253-558b1a94f1cc req-7b8f325a-96d1-4876-9432-da97fab66dad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247411 May 07 22:12:22.228442 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2705/5448] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:12:22.284934 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1fa5338e-1975-418a-8258-db7d6cadbb43 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 204 len: 0 microversion: 2.1 time: 0.311530 May 07 22:12:22.286099 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2744/5449] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:12:21 2022] DELETE /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:12:22.299922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:22.302129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:22.311238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:22.312080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:22.313338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:22.314056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:22.435981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:22.436879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:22.472057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:22.474186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:22.477194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:22.477813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:22.721253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:22.739456 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-419b4507-d914-452a-88cf-681e7bcf6ff1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1584 microversion: 2.1 time: 0.444594 May 07 22:12:22.743099 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2706/5450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:22 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1584 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:23.249289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:23.259978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-378f05b9-253d-4f2c-8674-8349b593c6c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 0.830362 May 07 22:12:23.260581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2745/5451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:22 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:23.763422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:23.766740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:23.785947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:23.786852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:23.789688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:23.791684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:24.290392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:24.298209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:24.322125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:24.322575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:24.323712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:24.344993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:24.449799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:24.462864 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1178e8d8-ead4-41bd-903f-a9edc8d84cd8 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1584 microversion: 2.1 time: 0.704592 May 07 22:12:24.464110 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2707/5452] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:23 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1584 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:25.008068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:25.017580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ac1d9e19-cfed-4059-968f-853db61632ac tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1307 microversion: 2.1 time: 0.743719 May 07 22:12:25.018863 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2746/5453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:24 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1307 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:25.488992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:25.490261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:25.507392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:25.508155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:25.510498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:25.511014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:25.943507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:25.964796 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a76af570-7383-42f3-a486-60b9de2e8a84 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1584 microversion: 2.1 time: 0.481149 May 07 22:12:25.976407 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2708/5454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:25 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1584 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:26.042254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:26.043090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:26.054513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:26.061419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:26.064461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:26.066823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:26.448689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-5e439cc4-429d-4e3f-8134-9b5c06f0743e req-5c7b0dc6-6c11-41d1-a4cd-fe3ccd552995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c332b03e-48f7-475c-9577-16a41760ca55", "name": "network-vif-deleted", "tag": "5dccdd99-d437-459b-9d5e-a5ecdbf1e400"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:26.462077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5e439cc4-429d-4e3f-8134-9b5c06f0743e req-5c7b0dc6-6c11-41d1-a4cd-fe3ccd552995 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:26.463611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-5e439cc4-429d-4e3f-8134-9b5c06f0743e req-5c7b0dc6-6c11-41d1-a4cd-fe3ccd552995 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:26.489672 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-5e439cc4-429d-4e3f-8134-9b5c06f0743e req-5c7b0dc6-6c11-41d1-a4cd-fe3ccd552995 service nova] Creating event network-vif-deleted:5dccdd99-d437-459b-9d5e-a5ecdbf1e400 for instance c332b03e-48f7-475c-9577-16a41760ca55 on nch1-master-1 May 07 22:12:26.502056 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-5e439cc4-429d-4e3f-8134-9b5c06f0743e req-5c7b0dc6-6c11-41d1-a4cd-fe3ccd552995 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057563 May 07 22:12:26.503264 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2709/5455] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:12:26.702997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:26.724773 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a76a7683-d2c6-473d-907d-1aa9b3d881eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1488 microversion: 2.1 time: 0.694250 May 07 22:12:26.754358 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2747/5456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:26 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1488 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:26.921470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-12371509", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "ebdf594d-504a-44e8-89b9-e74774287749"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:26.993391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:26.994025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:27.012062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:27.019099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:27.020226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:27.028860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:27.062516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:12:27.145815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:27.146950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:27.147603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lazy-loading 'fault' on Instance uuid c332b03e-48f7-475c-9577-16a41760ca55 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:12:27.219197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f4cbf51481d45de862752fe273dceda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70782066cce4f2fbf5744b63e4195cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:27.235726 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-909a4c76-ba77-4933-9df6-9e5c5bdcd44f tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 200 len: 1234 microversion: 2.1 time: 0.246602 May 07 22:12:27.236317 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2748/5457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:26 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 1234 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:27.959863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:12:27.960416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:12:27.962005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:12:27.962446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:12:27.962965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:12:27.974174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:27.974617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:27.975914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:27.976814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:28.031735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:12:28.039533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:12:28.065248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:12:28.070241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:12:28.204707 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-784dd6e3-1b20-45a5-9698-3b497a437534 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288908 May 07 22:12:28.219824 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2710/5458] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:12:28.236029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b7f6cc5-267b-41f5-b027-cc8c76708e38 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:28.237202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b7f6cc5-267b-41f5-b027-cc8c76708e38 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:28.254587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:28.255434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] [instance: c332b03e-48f7-475c-9577-16a41760ca55] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:28.266007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:28.268830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:28.271409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:28.274265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:28.311105 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] HTTP exception thrown: Instance c332b03e-48f7-475c-9577-16a41760ca55 could not be found. May 07 22:12:28.314229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Returning 404 to user: Instance c332b03e-48f7-475c-9577-16a41760ca55 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:12:28.315493 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ade322a6-9dc0-4e1f-9f69-4a4b8b8220b7 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55" status: 404 len: 111 microversion: 2.1 time: 0.065960 May 07 22:12:28.316980 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2711/5459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:28 2022] GET /compute/v2.1/servers/c332b03e-48f7-475c-9577-16a41760ca55 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:12:28.502923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b7f6cc5-267b-41f5-b027-cc8c76708e38 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:28.512540 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b7f6cc5-267b-41f5-b027-cc8c76708e38 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1207 microversion: 2.1 time: 0.285452 May 07 22:12:28.515487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2749/5460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:28 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1207 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:29.019885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-24d3faa3-717a-4c87-8049-cf90cf47baf1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] Calling method '.version_select at 0x7fc40fb6d0d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:29.075910 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-24d3faa3-717a-4c87-8049-cf90cf47baf1 tempest-TestVolumeBackupRestore-1882080688 tempest-TestVolumeBackupRestore-1882080688-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1484916331" status: 202 len: 0 microversion: 2.1 time: 0.060332 May 07 22:12:29.076566 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2712/5461] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 22:12:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1484916331 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:12:29.486685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1799010826", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "93e0a080-2e21-4a61-ae4e-18f16e01c432", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:29.531946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:29.532575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:29.542292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:29.560748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:29.561734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:29.567260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:29.805707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] validate_networks() for [('87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:12:29.812086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:29.829288 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d837c088-3dff-472f-b872-d0b08b32fc9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1259 microversion: 2.1 time: 0.300942 May 07 22:12:29.838494 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2713/5462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:29 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1259 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:30.855324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:30.856672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:30.881206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:30.881513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:30.882380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:30.883122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:31.024015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:31.042344 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c8e34af6-9e89-4b88-b259-1730c00aeb8c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1265 microversion: 2.1 time: 0.190976 May 07 22:12:31.044427 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2714/5463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:30 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:31.187451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:12:31.188048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:12:31.188366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:12:31.189013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:12:31.189613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:12:31.201154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:31.201927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:31.202837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:31.203259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:31.282152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:12:31.297705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:12:31.343928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:12:31.351118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='93e0a080-2e21-4a61-ae4e-18f16e01c432',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:12:31.541264 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a32d7a68-4c36-426b-9311-0d450929ab88 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.053709 May 07 22:12:31.543644 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2750/5464] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:12:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:12:31.557184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96ed1073-ca1b-48ba-9eee-55e48a79b491 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:31.558082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-96ed1073-ca1b-48ba-9eee-55e48a79b491 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:31.825606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-96ed1073-ca1b-48ba-9eee-55e48a79b491 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:31.833256 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96ed1073-ca1b-48ba-9eee-55e48a79b491 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1057 microversion: 2.1 time: 0.283940 May 07 22:12:31.838536 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2715/5465] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:31 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1057 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:32.061950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:32.064392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:32.103085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:32.104065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:32.105024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:32.105458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:32.273785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:32.284583 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-febd4e2c-2dd5-4803-8631-4df88aa93640 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1265 microversion: 2.1 time: 0.226779 May 07 22:12:32.285229 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2751/5466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:32 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:32.850045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:32.850742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:32.864547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:32.865026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:32.865846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:32.866303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:33.035458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:33.043948 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63da76ff-0cf8-4f1d-a4d7-97d6c4abc7be tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1109 microversion: 2.1 time: 0.198144 May 07 22:12:33.054644 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2716/5467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:32 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1109 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:33.302006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:33.303283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:33.311087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:33.311916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:33.312991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:33.313882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:34.064927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:34.066301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:34.076998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:34.077790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:34.078899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:34.079622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:34.091769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:34.100471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-919221be-80c1-4378-8f07-c5b82fb05a4c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1307 microversion: 2.1 time: 0.802683 May 07 22:12:34.104722 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2752/5468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:33 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1307 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:34.433564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:34.471663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6f5b265-8f87-486f-8b43-6d1e980e4192 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1127 microversion: 2.1 time: 0.413704 May 07 22:12:34.475540 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2717/5469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:34 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1127 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:35.121695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:35.122361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:35.136451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:35.136942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:35.137769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:35.138233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:35.474839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-35c8b17d-088c-409b-a4f2-a230c5ef1b3f req-e631d514-0b82-44dd-a21e-dc1bcabe7726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135", "tag": "30640e33-7566-46c1-bc06-e650cbb1fc12"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:35.485715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-35c8b17d-088c-409b-a4f2-a230c5ef1b3f req-e631d514-0b82-44dd-a21e-dc1bcabe7726 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:35.486473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-35c8b17d-088c-409b-a4f2-a230c5ef1b3f req-e631d514-0b82-44dd-a21e-dc1bcabe7726 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:35.517849 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-35c8b17d-088c-409b-a4f2-a230c5ef1b3f req-e631d514-0b82-44dd-a21e-dc1bcabe7726 service nova] Creating event network-changed:30640e33-7566-46c1-bc06-e650cbb1fc12 for instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 on nch2-master-1 May 07 22:12:35.527643 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-35c8b17d-088c-409b-a4f2-a230c5ef1b3f req-e631d514-0b82-44dd-a21e-dc1bcabe7726 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058963 May 07 22:12:35.529274 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2718/5470] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:12:35.552330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:35.553898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:35.562733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:35.563695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:35.565029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:35.567638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:35.730929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:35.740575 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-70ed91c1-b68c-47a2-8269-881e6b9283b5 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1307 microversion: 2.1 time: 0.622901 May 07 22:12:35.747628 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2753/5471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:35 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1307 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:36.096079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:36.118481 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-732fbd48-ea30-447f-ad3f-cc6f3af7506f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1127 microversion: 2.1 time: 0.575464 May 07 22:12:36.119207 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2719/5472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:35 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1127 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:36.764965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:36.765596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:36.772636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:36.773129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:36.773880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:36.774984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:37.135283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:37.135922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:37.153238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:37.154736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:37.157148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:37.159974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:37.472911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:37.490875 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6b504b6-df7f-414c-af86-be89c8d1c533 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1307 microversion: 2.1 time: 0.730057 May 07 22:12:37.513077 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2754/5473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:36 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1307 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:37.548479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:37.574813 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9269d37f-2b1e-4973-9897-5319e6fc06bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1169 microversion: 2.1 time: 0.443355 May 07 22:12:37.577988 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2720/5474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:37 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1169 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:38.508586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:38.509617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:38.529175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:38.531710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:38.532656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:38.536836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:38.595964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:38.597286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:38.633128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:38.636131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:38.637129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:38.640225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:39.500821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:39.511894 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7d0b38e9-d105-41d9-9cc5-11d2de0cbb6e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1215 microversion: 2.1 time: 0.921172 May 07 22:12:39.524709 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2721/5475] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:38 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1215 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:39.583613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:39.593673 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc25da5b-5f4f-4496-81d6-839098144c2a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1307 microversion: 2.1 time: 1.088550 May 07 22:12:39.595767 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2755/5476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:38 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1307 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:40.530655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:40.532111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:40.548011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:40.550234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:40.555342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:40.555815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:40.615554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:40.616930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:40.642229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:40.644427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:40.645421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:40.646940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:41.178283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:41.193098 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e0788f9-cb4b-4ffc-9350-8b6f6367944c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.667202 May 07 22:12:41.222551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:41.246497 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2722/5477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:40 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:41.254407 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-11049a0c-309d-4ddc-9a14-8d0cde84c585 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1307 microversion: 2.1 time: 0.644582 May 07 22:12:41.255603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2756/5478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:40 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1307 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:41.484443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-caf47c8e-45d6-4bdf-911d-adef7995ba03 req-00364582-aebb-4990-8e99-4272eaf3f5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e407f44-7420-4e8b-9e17-f47c5ae65c44", "tag": "9cc7735e-fc1f-4418-8730-5c1488d0ab2c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:41.541163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-caf47c8e-45d6-4bdf-911d-adef7995ba03 req-00364582-aebb-4990-8e99-4272eaf3f5ac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:41.541719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-caf47c8e-45d6-4bdf-911d-adef7995ba03 req-00364582-aebb-4990-8e99-4272eaf3f5ac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:41.573692 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-caf47c8e-45d6-4bdf-911d-adef7995ba03 req-00364582-aebb-4990-8e99-4272eaf3f5ac service nova] Creating event network-changed:9cc7735e-fc1f-4418-8730-5c1488d0ab2c for instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 on nch1-master-1 May 07 22:12:41.582042 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-caf47c8e-45d6-4bdf-911d-adef7995ba03 req-00364582-aebb-4990-8e99-4272eaf3f5ac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113830 May 07 22:12:41.583414 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2723/5479] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:12:41.837264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-54a0c2b9-d4d9-48d8-a827-90d8355fd4fb req-0336d3eb-15e3-4a54-8a0d-e3cb562ad9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135", "name": "network-vif-plugged", "status": "completed", "tag": "30640e33-7566-46c1-bc06-e650cbb1fc12"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:41.851464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-54a0c2b9-d4d9-48d8-a827-90d8355fd4fb req-0336d3eb-15e3-4a54-8a0d-e3cb562ad9c7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:41.852665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-54a0c2b9-d4d9-48d8-a827-90d8355fd4fb req-0336d3eb-15e3-4a54-8a0d-e3cb562ad9c7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:41.878458 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-54a0c2b9-d4d9-48d8-a827-90d8355fd4fb req-0336d3eb-15e3-4a54-8a0d-e3cb562ad9c7 service nova] Creating event network-vif-plugged:30640e33-7566-46c1-bc06-e650cbb1fc12 for instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 on nch2-master-1 May 07 22:12:41.884522 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-54a0c2b9-d4d9-48d8-a827-90d8355fd4fb req-0336d3eb-15e3-4a54-8a0d-e3cb562ad9c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051692 May 07 22:12:41.886073 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2757/5480] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:12:42.229520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:42.231686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:42.245585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:42.246346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:42.248043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:42.266407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:42.272905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:42.273917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:42.291848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:42.294188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:42.295237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:42.302139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:42.603677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:42.616266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15f5ddc9-a43b-4bb6-afb1-f9ed01d03136 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.399813 May 07 22:12:42.631018 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2724/5481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:42 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:43.080153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:43.090987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d98182d4-a6d4-46dd-a8d4-2fa9acf29f28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1307 microversion: 2.1 time: 0.822857 May 07 22:12:43.101537 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2758/5482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:42 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1307 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:43.637532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:43.638754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:43.647916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:43.648693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:43.649880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:43.650559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:44.016518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:44.028192 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-74b0308d-60e2-47f7-996c-08825f2e7286 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.394702 May 07 22:12:44.028922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2725/5483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:43 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:44.109658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:44.111129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:44.121477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:44.121945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:44.123582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:44.124104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:44.748642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:44.756838 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c9ac0e6f-0950-495c-97e6-5b56dc74e9f2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1488 microversion: 2.1 time: 0.651606 May 07 22:12:44.758123 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2759/5484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:44 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1488 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:44.774271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:44.775569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:44.783104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:44.784696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:44.785758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:44.786447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.046182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:45.048267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:45.064774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.066126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.067266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.067934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.405234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:45.415724 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-329d8e16-8a17-4840-bc7a-d88a8257c485 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1488 microversion: 2.1 time: 0.645179 May 07 22:12:45.431514 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2726/5485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:44 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1488 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:45.438381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:45.445034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:45.454099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.454567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.460219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.460695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.546602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:45.557914 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-12b58976-5740-44f1-9fbe-fc8df978e5cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.515636 May 07 22:12:45.559375 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2760/5486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:45 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:45.777706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:45.788099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c964405a-8918-4b40-99e2-90c46d6573f3 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1488 microversion: 2.1 time: 0.355443 May 07 22:12:45.788689 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2727/5487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:45 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1488 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:45.807712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:45.808409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:45.827743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.828465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.830451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.831449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.864797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:12:45.958503 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-767ca842-96e2-4002-844a-01a62f655135 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 204 len: 0 microversion: 2.1 time: 0.154877 May 07 22:12:45.963180 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2761/5488] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:12:45 2022] DELETE /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:12:45.969911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:45.970676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:45.979840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.980423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:45.981304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:45.981853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:46.293334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:46.305933 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3423433b-0d35-409f-9917-9a5fd85c6762 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1494 microversion: 2.1 time: 0.340784 May 07 22:12:46.327691 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2728/5489] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:45 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1494 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:12:46.575154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:46.576039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:46.588792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:46.589219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:46.590030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:46.590484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:46.945311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:46.953018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e4a1cf0e-bb4f-4c32-a07a-7ccf73250b87 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.382205 May 07 22:12:46.954483 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2762/5490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:46 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:47.333277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:47.335778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:47.352614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:47.353988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:47.357441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:47.358134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:47.794978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:47.805781 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a12e415-c11f-4fb8-a235-8c4e6fb3c0eb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1494 microversion: 2.1 time: 0.479005 May 07 22:12:47.816405 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2729/5491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:47 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1494 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:47.972118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:47.972915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:47.985308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:47.991109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:47.992174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:47.992912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:48.312415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:48.327754 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-242758ea-f004-4c25-952d-eae7dfe2ff78 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.359346 May 07 22:12:48.329656 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2763/5492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:47 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:48.407998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f40b1734-b062-4f01-83bf-c087f4841d87 req-c92e6604-3432-49fd-bd31-6954ab16ff18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135", "name": "network-vif-deleted", "tag": "30640e33-7566-46c1-bc06-e650cbb1fc12"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:48.419317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f40b1734-b062-4f01-83bf-c087f4841d87 req-c92e6604-3432-49fd-bd31-6954ab16ff18 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:48.419781 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f40b1734-b062-4f01-83bf-c087f4841d87 req-c92e6604-3432-49fd-bd31-6954ab16ff18 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:48.439980 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f40b1734-b062-4f01-83bf-c087f4841d87 req-c92e6604-3432-49fd-bd31-6954ab16ff18 service nova] Creating event network-vif-deleted:30640e33-7566-46c1-bc06-e650cbb1fc12 for instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 on nch2-master-1 May 07 22:12:48.447706 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f40b1734-b062-4f01-83bf-c087f4841d87 req-c92e6604-3432-49fd-bd31-6954ab16ff18 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044265 May 07 22:12:48.449128 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2730/5493] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:12:48.825763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:48.826540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:48.834572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:48.835065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:48.835891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:48.836340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:48.887743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:48.888292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:48.888665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lazy-loading 'fault' on Instance uuid 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:12:48.969187 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:48.997567 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1b89a2cc-4201-4a65-8a9d-aa0c63023c60 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 200 len: 1297 microversion: 2.1 time: 0.176316 May 07 22:12:48.998232 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2764/5494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:48 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 1297 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:49.166103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6acc943b-bbeb-4167-8aa6-36d53740e649 req-592f010c-d3cf-4433-817a-51a89491132d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e407f44-7420-4e8b-9e17-f47c5ae65c44", "name": "network-vif-plugged", "status": "completed", "tag": "9cc7735e-fc1f-4418-8730-5c1488d0ab2c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:49.179644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6acc943b-bbeb-4167-8aa6-36d53740e649 req-592f010c-d3cf-4433-817a-51a89491132d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:49.180373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6acc943b-bbeb-4167-8aa6-36d53740e649 req-592f010c-d3cf-4433-817a-51a89491132d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:49.205574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6acc943b-bbeb-4167-8aa6-36d53740e649 req-592f010c-d3cf-4433-817a-51a89491132d service nova] Creating event network-vif-plugged:9cc7735e-fc1f-4418-8730-5c1488d0ab2c for instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 on nch1-master-1 May 07 22:12:49.215589 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6acc943b-bbeb-4167-8aa6-36d53740e649 req-592f010c-d3cf-4433-817a-51a89491132d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056979 May 07 22:12:49.216301 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2731/5495] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:12:49.350991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:49.352769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:49.363285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:49.364185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:49.365913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:49.366733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:49.675885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:49.687857 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5a9073d2-c06d-4aa7-9556-41f834e7d715 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.345520 May 07 22:12:49.688781 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2765/5496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:49 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:50.018943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:50.020419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:50.033699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.035067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:50.035946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.036471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:50.053554 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 could not be found. May 07 22:12:50.055001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:12:50.056392 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d6b8ba7-d9d9-4c91-8d55-ecfb9df77d7f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 404 len: 111 microversion: 2.1 time: 0.043765 May 07 22:12:50.057591 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2732/5497] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:50 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:12:50.072060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:50.078717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:50.094994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.096911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:50.099392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.100440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:50.164294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:12:50.351603 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af50913c-4c35-4259-a9e6-1dc03c379319 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 204 len: 0 microversion: 2.1 time: 0.289540 May 07 22:12:50.352501 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2766/5498] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:12:50 2022] DELETE /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:12:50.370438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:50.371773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:50.384405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.385606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:50.386922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.387714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:50.709259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:50.709997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:50.726722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.731228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:50.732224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:50.732698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:51.073608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:51.096945 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-08fc350b-cc96-441f-8eae-5ea2ed8351d9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1494 microversion: 2.1 time: 0.739310 May 07 22:12:51.102348 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2733/5499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:50 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1494 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:51.154100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:51.165049 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c8fa5cd-a5e2-4466-a8e8-f91058d793d7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1203 microversion: 2.1 time: 0.460789 May 07 22:12:51.174698 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2767/5500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:50 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1203 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:52.120790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:52.122975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:52.132543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:52.133307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:52.135578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:52.136254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:52.185510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:52.186265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:52.198431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:52.203385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:52.207177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:52.208300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:52.591077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:52.605771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:52.609269 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a95e130e-7752-4320-89e0-e17fbfc4c622 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1494 microversion: 2.1 time: 0.497705 May 07 22:12:52.609560 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2734/5501] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:52 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1494 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:52.618140 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b73a9028-8817-434a-88ac-83ae561afd63 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1389 microversion: 2.1 time: 0.438098 May 07 22:12:52.619087 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2768/5502] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:52 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1389 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:52.635286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:52.636213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:52.642645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:52.643512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:52.644482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:52.645097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:52.878741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2f4ed188-1d1f-4639-9c2c-33a27687e421 req-caceeba9-90fb-40ec-96cb-4d0399f32d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876afed0-19b4-4cae-83e8-a954d0cae1ba", "name": "network-vif-deleted", "tag": "2aca6585-cfee-43a3-b4ee-9b346ed2588f"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:52.889688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2f4ed188-1d1f-4639-9c2c-33a27687e421 req-caceeba9-90fb-40ec-96cb-4d0399f32d80 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:52.890421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2f4ed188-1d1f-4639-9c2c-33a27687e421 req-caceeba9-90fb-40ec-96cb-4d0399f32d80 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:52.906902 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2f4ed188-1d1f-4639-9c2c-33a27687e421 req-caceeba9-90fb-40ec-96cb-4d0399f32d80 service nova] Creating event network-vif-deleted:2aca6585-cfee-43a3-b4ee-9b346ed2588f for instance 876afed0-19b4-4cae-83e8-a954d0cae1ba on nch1-master-1 May 07 22:12:52.913802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2f4ed188-1d1f-4639-9c2c-33a27687e421 req-caceeba9-90fb-40ec-96cb-4d0399f32d80 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040408 May 07 22:12:52.915385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2769/5503] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:12:52.995558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:53.003326 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fed6eef-89a6-400a-aa3a-5b30d453ba94 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1389 microversion: 2.1 time: 0.371899 May 07 22:12:53.004129 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2735/5504] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:52 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1389 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:53.020455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:53.021410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:53.028031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.028728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.029780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.030406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.395943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:53.416666 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3838248e-7f65-49d7-9ffa-7e9df7f2ed11 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1389 microversion: 2.1 time: 0.400879 May 07 22:12:53.422595 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2770/5505] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:53 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1389 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:53.610010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:53.612106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:53.619268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.619860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.622483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.628163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.628597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:53.629865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:53.652427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.653933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.655880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.656378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.691713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:12:53.746479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.747236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.747817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lazy-loading 'fault' on Instance uuid 876afed0-19b4-4cae-83e8-a954d0cae1ba {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:12:53.883252 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c61c82c-7ab8-4f96-bdf2-408975bd220d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 204 len: 0 microversion: 2.1 time: 0.275006 May 07 22:12:53.884638 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2736/5506] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:12:53 2022] DELETE /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:12:53.905550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:53.906539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:53.925776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.926689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.929145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:53.930299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:53.946575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:53.967078 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7f1bf4d5-6a4a-4a49-9ff6-9eb270687240 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 200 len: 1297 microversion: 2.1 time: 0.334300 May 07 22:12:53.968187 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2771/5507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:53 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 1297 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:54.126394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:54.134652 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-57396fa0-c57c-403c-8c96-050743fe9c72 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1395 microversion: 2.1 time: 0.244159 May 07 22:12:54.135276 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2737/5508] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:53 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1395 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:54.995626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:54.996996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:55.026522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:55.027145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:55.028834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:55.028834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:55.101704 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 876afed0-19b4-4cae-83e8-a954d0cae1ba could not be found. May 07 22:12:55.102351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 876afed0-19b4-4cae-83e8-a954d0cae1ba could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:12:55.105333 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c403913-e345-4207-9b2b-ca810cca30fb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 404 len: 111 microversion: 2.1 time: 0.124110 May 07 22:12:55.106176 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2772/5509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:54 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:12:55.156083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:55.157743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:55.169464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:55.170566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:55.171601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:55.176851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:55.296812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-610238816", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "ebdf594d-504a-44e8-89b9-e74774287749"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:55.390620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:12:55.403830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:55.419737 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c39973f2-e53b-4ad1-84d1-2a7348f7b2b0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1395 microversion: 2.1 time: 0.271735 May 07 22:12:55.421280 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2738/5510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:55 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1395 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:56.455543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:56.458962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:56.493524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:56.493961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:56.495837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:56.496471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:56.717881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:12:56.719320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:12:56.720552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:12:56.721791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:12:56.723197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:12:56.771298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:56.792973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:56.795551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:56.800980 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d1991c66-6a18-41e1-9ae3-e87c4462fbd6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 200 len: 1395 microversion: 2.1 time: 0.365053 May 07 22:12:56.802453 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2739/5511] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:56 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 1395 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:56.816149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:56.817397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:56.848870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:12:56.856349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:12:56.885564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:12:56.886477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9cf1d7a4-9a48-4b15-8800-290f29b980a8 req-89da2c7a-aa3e-497a-b4ad-4729516bdbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e407f44-7420-4e8b-9e17-f47c5ae65c44", "name": "network-vif-deleted", "tag": "9cc7735e-fc1f-4418-8730-5c1488d0ab2c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:12:56.889357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:12:56.922284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cf1d7a4-9a48-4b15-8800-290f29b980a8 req-89da2c7a-aa3e-497a-b4ad-4729516bdbd2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:56.924690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cf1d7a4-9a48-4b15-8800-290f29b980a8 req-89da2c7a-aa3e-497a-b4ad-4729516bdbd2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:56.951194 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9cf1d7a4-9a48-4b15-8800-290f29b980a8 req-89da2c7a-aa3e-497a-b4ad-4729516bdbd2 service nova] Creating event network-vif-deleted:9cc7735e-fc1f-4418-8730-5c1488d0ab2c for instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 on nch1-master-1 May 07 22:12:56.967521 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9cf1d7a4-9a48-4b15-8800-290f29b980a8 req-89da2c7a-aa3e-497a-b4ad-4729516bdbd2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088165 May 07 22:12:56.969722 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2740/5512] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:12:56.975128 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c7a50380-421c-418b-9d74-50f9c1810dde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682795 May 07 22:12:56.976324 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2773/5513] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:12:56.998184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c1234a30-7c46-4feb-83dc-7ccc08e3057a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:56.999313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c1234a30-7c46-4feb-83dc-7ccc08e3057a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:57.137083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c1234a30-7c46-4feb-83dc-7ccc08e3057a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:57.150356 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c1234a30-7c46-4feb-83dc-7ccc08e3057a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1208 microversion: 2.1 time: 0.165303 May 07 22:12:57.155180 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2741/5514] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:56 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1208 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:57.829279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:57.835681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:57.874304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:57.875092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:57.876259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:57.876943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:57.913233 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 could not be found. May 07 22:12:57.913989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:12:57.915059 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e6a863f-7b5b-445b-ac3e-75a3ad078f68 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 404 len: 111 microversion: 2.1 time: 0.097127 May 07 22:12:57.919380 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2774/5515] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:57 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:12:58.172391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:58.173775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:58.217149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:58.217681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:58.218534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:58.219023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:58.433569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:58.448632 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a620c45-dd91-4e38-a8ae-1256533966c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1260 microversion: 2.1 time: 0.282882 May 07 22:12:58.449740 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2742/5516] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:58 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:12:59.052693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:59.053363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:59.060920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:59.061904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:59.062897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:59.063581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:59.085017 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 could not be found. May 07 22:12:59.085630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:12:59.086489 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e5dff4f-e2da-4136-b3ca-43b819517114 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 404 len: 111 microversion: 2.1 time: 0.038212 May 07 22:12:59.087101 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2775/5517] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:12:59 2022] DELETE /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:12:59.098213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:59.099571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 1e407f44-7420-4e8b-9e17-f47c5ae65c44] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:59.165784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:59.166984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:59.170230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:59.171210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:59.245168 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 could not be found. May 07 22:12:59.247532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 1e407f44-7420-4e8b-9e17-f47c5ae65c44 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:12:59.249333 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06749f3f-3a84-40c0-9c7e-e0f63c72bc56 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44" status: 404 len: 111 microversion: 2.1 time: 0.156253 May 07 22:12:59.250484 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2743/5518] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:59 2022] GET /compute/v2.1/servers/1e407f44-7420-4e8b-9e17-f47c5ae65c44 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:12:59.470308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:12:59.475086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:12:59.496541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:59.499323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:59.501515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:12:59.503847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:12:59.709986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:12:59.720364 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b484593-d32c-41f7-80e7-ed11bc8a7a87 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1266 microversion: 2.1 time: 0.254790 May 07 22:12:59.722250 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2776/5519] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:12:59 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:00.742472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:00.744032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:00.772262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:00.773072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:00.775934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:00.776618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:01.033074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:01.050504 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f1936e84-a3d9-4f56-a811-018ca974856c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1308 microversion: 2.1 time: 0.315123 May 07 22:13:01.052290 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2744/5520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:00 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:02.039791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1679eead-9bc5-4c69-a299-1a1b22046109 req-7aa27529-b4ad-4d26-b00f-8833baa94adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5faf8f65-128b-4bf7-91b4-4b3acbc2d63e", "tag": "53aa1ea9-a047-4d11-b8ba-b5e87fd16eb0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:02.072410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:02.073397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:02.087262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1679eead-9bc5-4c69-a299-1a1b22046109 req-7aa27529-b4ad-4d26-b00f-8833baa94adb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:02.090793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1679eead-9bc5-4c69-a299-1a1b22046109 req-7aa27529-b4ad-4d26-b00f-8833baa94adb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:02.096980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:02.100988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:02.103179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:02.103938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:02.134734 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1679eead-9bc5-4c69-a299-1a1b22046109 req-7aa27529-b4ad-4d26-b00f-8833baa94adb service nova] Creating event network-changed:53aa1ea9-a047-4d11-b8ba-b5e87fd16eb0 for instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e on nch1-master-1 May 07 22:13:02.143445 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1679eead-9bc5-4c69-a299-1a1b22046109 req-7aa27529-b4ad-4d26-b00f-8833baa94adb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107087 May 07 22:13:02.144411 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2777/5521] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:02.488362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:02.507162 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8fc291d7-10ae-4bf1-badd-71e1e11d2664 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1308 microversion: 2.1 time: 0.440113 May 07 22:13:02.509502 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2745/5522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:02 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:03.528174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:03.528908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:03.536450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:03.536916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:03.537715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:03.538177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:03.764910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:03.777829 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ed4250a-63ed-4b44-b22d-91b0c3996b49 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1308 microversion: 2.1 time: 0.256636 May 07 22:13:03.780336 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2778/5523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:03 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:04.799820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:04.800610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:04.810488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:04.815929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:04.817704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:04.823403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:05.107445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:05.119699 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eba9678b-df29-41c1-8958-46cf923f476c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1308 microversion: 2.1 time: 0.324738 May 07 22:13:05.121497 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2746/5524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:04 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:05.598529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-464240749", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9a081585-6d81-4d08-8c50-ae0498445a58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:05.695459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] validate_networks() for [('87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:13:05.745897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:05.746420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:05.757747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:05.759498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:05.762066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:05.764231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:05.929913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lazy-loading 'services' on Instance uuid 059fa640-aef8-49b9-984f-b96451387d95 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:13:06.040919 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-47105e26-5595-4676-96da-a226f1737807 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "DELETE /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95/os-volume_attachments/28875749-3b9f-4237-b844-689c84a5f03f" status: 202 len: 0 microversion: 2.1 time: 0.298770 May 07 22:13:06.041538 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2747/5525] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:13:05 2022] DELETE /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95/os-volume_attachments/28875749-3b9f-4237-b844-689c84a5f03f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:13:06.150021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:06.150667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:06.180518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:06.182437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:06.199794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:06.201282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:06.497300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:06.508597 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52944d6b-70e5-4e47-a28f-732f81a9dc3f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1308 microversion: 2.1 time: 0.374337 May 07 22:13:06.522849 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2748/5526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:06 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:06.843777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-34cf203c-cb5b-4df5-89fc-50fc8c3eef41 req-d6f8194e-5f28-406a-b35b-432835bbde2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5faf8f65-128b-4bf7-91b4-4b3acbc2d63e", "name": "network-vif-plugged", "status": "completed", "tag": "53aa1ea9-a047-4d11-b8ba-b5e87fd16eb0"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:06.864278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-34cf203c-cb5b-4df5-89fc-50fc8c3eef41 req-d6f8194e-5f28-406a-b35b-432835bbde2f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:06.864713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-34cf203c-cb5b-4df5-89fc-50fc8c3eef41 req-d6f8194e-5f28-406a-b35b-432835bbde2f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:06.899127 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-34cf203c-cb5b-4df5-89fc-50fc8c3eef41 req-d6f8194e-5f28-406a-b35b-432835bbde2f service nova] Creating event network-vif-plugged:53aa1ea9-a047-4d11-b8ba-b5e87fd16eb0 for instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e on nch1-master-1 May 07 22:13:06.919308 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-34cf203c-cb5b-4df5-89fc-50fc8c3eef41 req-d6f8194e-5f28-406a-b35b-432835bbde2f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080322 May 07 22:13:06.924432 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2749/5527] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:07.094945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:13:07.096829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:13:07.097915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:13:07.098574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:13:07.100152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:13:07.125343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.127857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.129233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.130292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.170057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:13:07.181814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:13:07.282698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:13:07.285886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a081585-6d81-4d08-8c50-ae0498445a58',volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:13:07.341636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:07.342228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:07.363172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.364447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.373429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.375003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.451542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:13:07.493345 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09f60f01-39cb-4db9-a0b5-a5201a9bcb51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.899508 May 07 22:13:07.494553 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2779/5528] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:13:07.506206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-329c1ff7-d57c-4fa3-84a1-b3e91eb8a868 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:07.509526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-329c1ff7-d57c-4fa3-84a1-b3e91eb8a868 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:07.646374 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea2cbf23-c863-4e6b-a3c8-de521cbc81ba tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "DELETE /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 204 len: 0 microversion: 2.1 time: 0.309297 May 07 22:13:07.647371 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2750/5529] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:13:07 2022] DELETE /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:13:07.656765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:07.657983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:07.665548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.666333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.667376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.668032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.683449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-329c1ff7-d57c-4fa3-84a1-b3e91eb8a868 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:07.692301 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-329c1ff7-d57c-4fa3-84a1-b3e91eb8a868 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1070 microversion: 2.1 time: 0.190121 May 07 22:13:07.696534 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2780/5530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:07 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1070 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:07.716559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:07.717488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:07.734543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.735342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.736900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:07.742387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:07.976379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:07.988861 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c4b5614f-082f-4fba-9ee7-2cfb46880aca tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1308 microversion: 2.1 time: 0.339926 May 07 22:13:07.990066 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2751/5531] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:07 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:08.069545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:08.078763 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd1e54d3-a81e-44a7-8cbd-4b8da49b8bc5 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1512 microversion: 2.1 time: 0.379145 May 07 22:13:08.081129 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2781/5532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:07 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:08.718987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:08.720246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:08.728166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:08.729347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:08.730574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:08.731223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:08.855147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:08.874110 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7a9b5eef-0489-4fb8-afa1-03e7694d01d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1120 microversion: 2.1 time: 0.159609 May 07 22:13:08.874942 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2752/5533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:08 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1120 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:09.006126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:09.006737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:09.020626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.021091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.021894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.022349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.098673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:09.100460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:09.128769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.129231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.130048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.130494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.392426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:09.404987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c83ddc7c-6e86-43c8-9081-10ce63e9f4c8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1489 microversion: 2.1 time: 0.402746 May 07 22:13:09.423520 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2782/5534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:09 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1489 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:09.435318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a57f8a7-02cb-497a-b6f9-d67a49258b39 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:09.436567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0a57f8a7-02cb-497a-b6f9-d67a49258b39 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:09.443754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a57f8a7-02cb-497a-b6f9-d67a49258b39 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.444285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a57f8a7-02cb-497a-b6f9-d67a49258b39 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.445012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a57f8a7-02cb-497a-b6f9-d67a49258b39 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.445462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a57f8a7-02cb-497a-b6f9-d67a49258b39 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.556635 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a57f8a7-02cb-497a-b6f9-d67a49258b39 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "PUT /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1084 microversion: 2.1 time: 0.128214 May 07 22:13:09.557540 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2783/5535] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 22:13:09 2022] PUT /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1084 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:09.565148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:09.585154 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-98e09fe9-a1b5-4a3f-86f9-21fb9eda4088 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1512 microversion: 2.1 time: 0.485528 May 07 22:13:09.585991 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2753/5536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:09 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:09.592828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:09.593383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:09.607023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.612744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.613787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.614435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.892120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:09.898474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:09.907191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.907987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:09.909583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:09.910272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:10.095516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:10.108328 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84651f38-ea8a-44bd-8541-220f0750bd6c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1186 microversion: 2.1 time: 0.220731 May 07 22:13:10.109252 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2754/5537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:09 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1186 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:10.221894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:10.230008 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a2e97bd-517e-4141-b0ca-b9e91675acde tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1510 microversion: 2.1 time: 0.651943 May 07 22:13:10.230608 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2784/5538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:09 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1510 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:10.253579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:10.255161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:10.263117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:10.263966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:10.264969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:10.265616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:10.607095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:10.607954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:10.615557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:10.616375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:10.617306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:10.618372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:10.857732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:10.865254 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1aa6c98a-442b-4a79-885c-11b97eadb4b4 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1510 microversion: 2.1 time: 0.616819 May 07 22:13:10.879311 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2755/5539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:10 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1510 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:10.884250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:10.884701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:10.899914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:10.900576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:10.902360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:10.909898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:10.987407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:13:11.074988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:11.097531 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fd173594-ff82-4467-84aa-08b3699cd135 tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1512 microversion: 2.1 time: 0.492931 May 07 22:13:11.098517 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2785/5540] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:10 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1512 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:11.126079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:11.127499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:11.139032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:11.139490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:11.141123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:11.145849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:11.262579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14b24a6d-79e3-4d71-a956-fe722e940e04 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 204 len: 0 microversion: 2.1 time: 0.381247 May 07 22:13:11.279938 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2756/5541] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:13:10 2022] DELETE /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:13:11.298669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:11.300059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:11.319018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:11.323954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:11.324492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:11.326807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:11.328234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:11.331227 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-01781011-d672-498e-b3df-4b177d249ce7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1186 microversion: 2.1 time: 0.206865 May 07 22:13:11.332481 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2786/5542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:11 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1186 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:11.396965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5ae34bdb-bc96-4317-8acf-62e067878fe8 req-3ec7fa26-cb30-4028-8821-c6a10a39a47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059fa640-aef8-49b9-984f-b96451387d95", "name": "network-vif-deleted", "tag": "001d2755-5afe-49fd-b09f-b329e5af504d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:11.440542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5ae34bdb-bc96-4317-8acf-62e067878fe8 req-3ec7fa26-cb30-4028-8821-c6a10a39a47b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:11.441208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5ae34bdb-bc96-4317-8acf-62e067878fe8 req-3ec7fa26-cb30-4028-8821-c6a10a39a47b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:11.483478 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5ae34bdb-bc96-4317-8acf-62e067878fe8 req-3ec7fa26-cb30-4028-8821-c6a10a39a47b service nova] Creating event network-vif-deleted:001d2755-5afe-49fd-b09f-b329e5af504d for instance 059fa640-aef8-49b9-984f-b96451387d95 on nch2-master-1 May 07 22:13:11.500760 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5ae34bdb-bc96-4317-8acf-62e067878fe8 req-3ec7fa26-cb30-4028-8821-c6a10a39a47b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111742 May 07 22:13:11.504125 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2787/5543] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:13:11.783089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:11.793911 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6168b664-0365-4c85-9dc6-0222bc4ba653 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1516 microversion: 2.1 time: 0.509091 May 07 22:13:11.794695 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2757/5544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:11 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1516 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:12.117298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:12.118205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:12.131400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:12.132072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:12.133002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:12.143844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:12.223486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:12.226302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:12.226966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lazy-loading 'fault' on Instance uuid 059fa640-aef8-49b9-984f-b96451387d95 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:13:12.309841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ef9a3039534d90ba9d268970cbe9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72be56c2d4a54014a8f741c451fe014e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:12.323177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-978ff6d0-5c46-4d07-b521-a66172a0095c tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 200 len: 1308 microversion: 2.1 time: 0.211398 May 07 22:13:12.326046 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2788/5545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:12 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:12.349354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:12.350576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:12.371071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:12.371586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:12.375930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:12.376384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:12.811579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:12.812132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:12.823902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:12.824369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:12.825189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:12.825623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:12.950784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:12.958296 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94db7374-4221-48e1-8f8c-2a60913843d1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.614394 May 07 22:13:12.958964 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2758/5546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:12 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:13.645833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:13.647610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] [instance: 059fa640-aef8-49b9-984f-b96451387d95] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:13.658708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:13.659708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:13.660806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:13.661517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:13.721028 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] HTTP exception thrown: Instance 059fa640-aef8-49b9-984f-b96451387d95 could not be found. May 07 22:13:13.721645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] Returning 404 to user: Instance 059fa640-aef8-49b9-984f-b96451387d95 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:13:13.722511 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1f632042-9692-4ff5-a567-109208b814ef tempest-VolumesSnapshotTestJSON-1726756463 tempest-VolumesSnapshotTestJSON-1726756463-project] 10.222.0.32 "GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95" status: 404 len: 111 microversion: 2.1 time: 0.382403 May 07 22:13:13.723508 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2759/5547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:13 2022] GET /compute/v2.1/servers/059fa640-aef8-49b9-984f-b96451387d95 => generated 111 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:13:13.900583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:13.908746 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bed564a1-e9cc-4394-836f-28d756841ef1 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1516 microversion: 2.1 time: 1.100871 May 07 22:13:13.920632 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2789/5548] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:12 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1516 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:13.977670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:13.979295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:13.990426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:13.991783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:13.993682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:13.994376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:14.522330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4c6c52fe-3fad-47c1-b351-d979aa65f3d7 req-4612abfd-623c-4ced-bbed-8d03f169a467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5faf8f65-128b-4bf7-91b4-4b3acbc2d63e", "name": "network-vif-deleted", "tag": "53aa1ea9-a047-4d11-b8ba-b5e87fd16eb0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:14.545545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4c6c52fe-3fad-47c1-b351-d979aa65f3d7 req-4612abfd-623c-4ced-bbed-8d03f169a467 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:14.546000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4c6c52fe-3fad-47c1-b351-d979aa65f3d7 req-4612abfd-623c-4ced-bbed-8d03f169a467 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:14.590428 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4c6c52fe-3fad-47c1-b351-d979aa65f3d7 req-4612abfd-623c-4ced-bbed-8d03f169a467 service nova] Creating event network-vif-deleted:53aa1ea9-a047-4d11-b8ba-b5e87fd16eb0 for instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e on nch1-master-1 May 07 22:13:14.606169 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4c6c52fe-3fad-47c1-b351-d979aa65f3d7 req-4612abfd-623c-4ced-bbed-8d03f169a467 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087367 May 07 22:13:14.606725 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2790/5549] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:13:14.694342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:14.706524 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ec50b9c-e3e0-4d96-a15b-c7d8e0ff10a9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.733966 May 07 22:13:14.709776 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2760/5550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:13 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:14.927505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:14.928830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:14.936054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:14.936822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:14.937826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:14.938501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:15.008754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:15.009656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:15.011842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lazy-loading 'fault' on Instance uuid 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:13:15.116477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:15.129410 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b19363a-e6e5-4c2d-80c0-f90064a46b95 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 200 len: 1319 microversion: 2.1 time: 0.207299 May 07 22:13:15.143642 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2791/5551] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:14 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:15.290238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-490d8bac-6a00-4f43-bcc5-31f0d7427d27 req-91f8c4f2-4536-498e-858e-26bd24adc436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb197fc1-0207-498b-9fe9-b21826687a56", "tag": "b2b93741-196b-4634-b3a8-cacfa39e6497"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:15.305978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-490d8bac-6a00-4f43-bcc5-31f0d7427d27 req-91f8c4f2-4536-498e-858e-26bd24adc436 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:15.312077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-490d8bac-6a00-4f43-bcc5-31f0d7427d27 req-91f8c4f2-4536-498e-858e-26bd24adc436 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:15.346458 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-490d8bac-6a00-4f43-bcc5-31f0d7427d27 req-91f8c4f2-4536-498e-858e-26bd24adc436 service nova] Creating event network-changed:b2b93741-196b-4634-b3a8-cacfa39e6497 for instance bb197fc1-0207-498b-9fe9-b21826687a56 on nch2-master-1 May 07 22:13:15.361915 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-490d8bac-6a00-4f43-bcc5-31f0d7427d27 req-91f8c4f2-4536-498e-858e-26bd24adc436 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075412 May 07 22:13:15.363689 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2761/5552] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:15.726638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:15.727946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:15.735949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:15.737345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:15.739331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:15.740165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:16.150114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:16.151884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:16.160405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:16.166360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:16.167406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:16.170517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:16.198092 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e could not be found. May 07 22:13:16.199092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:13:16.200232 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d38e8728-779a-4b09-96b0-a96fddca4e9f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 404 len: 111 microversion: 2.1 time: 0.055389 May 07 22:13:16.222169 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2762/5553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:16 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:13:16.293436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:16.308505 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6284f50-5693-43e6-8294-9c1634fad495 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.586223 May 07 22:13:16.311902 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2792/5554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:15 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:16.372337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1027208791", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "ebdf594d-504a-44e8-89b9-e74774287749"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:16.455744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] validate_networks() for [('ebdf594d-504a-44e8-89b9-e74774287749', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:13:17.327311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:17.328703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:17.343438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:17.344480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:17.348059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:17.348996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:17.632453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:13:17.632992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:13:17.633364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:13:17.633789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:13:17.634214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:13:17.654942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:17.655419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:17.656241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:17.659069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:17.700269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:13:17.707254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Getting quotas for user 1e6cebb5024540799cabee75ff002d69 and project b29256ef64d74a5297507ca500a9468e. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:13:17.742951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:13:17.745271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:13:17.754510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:17.765374 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6faf3ff-469b-4e18-9448-4fc25a8d73b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.439971 May 07 22:13:17.766003 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2793/5555] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:17 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:17.854364 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1fe5aa9c-0414-47df-8eee-95b0bdddfc03 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.485785 May 07 22:13:17.855554 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2763/5556] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:13:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:13:17.867485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3cd2c57c-e7b9-4cc4-84e3-9b1d19f868fd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:17.868445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3cd2c57c-e7b9-4cc4-84e3-9b1d19f868fd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:17.985979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3cd2c57c-e7b9-4cc4-84e3-9b1d19f868fd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:18.007227 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3cd2c57c-e7b9-4cc4-84e3-9b1d19f868fd tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1209 microversion: 2.1 time: 0.142150 May 07 22:13:18.025285 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2794/5557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:17 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1209 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:18.784245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:18.784862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:18.803255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:18.805051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:18.814018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:18.815627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:19.031108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:19.031773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:19.073161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:19.084432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:19.088534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:19.089663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:19.242360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:19.252066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84cf294d-b751-4dd2-bf3b-dfff4478b16f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.472698 May 07 22:13:19.265136 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2764/5558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:18 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:19.487373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:19.491419 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6afbb93e-87b7-4e78-8253-36ac99a2874d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1261 microversion: 2.1 time: 0.469294 May 07 22:13:19.495784 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2795/5559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:19 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1261 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:19.600017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-211703625", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "aee5e538-fcd6-49ce-8112-161cb6d635be"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:19.717362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] validate_networks() for [('aee5e538-fcd6-49ce-8112-161cb6d635be', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:13:20.289285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:20.289933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:20.297602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:20.298282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:20.299863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:20.300507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:20.576821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:13:20.577754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:13:20.578416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:13:20.579012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:13:20.579584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:13:20.600507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:20.601017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:20.602251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:20.602906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:20.645153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Getting quotas for project d62508bea6e7484ea316f52f4d3b8471. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:13:20.663903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Getting quotas for user 313cb56eefdd49cab9f9ddcbfea4ab72 and project d62508bea6e7484ea316f52f4d3b8471. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:13:20.688114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:13:20.691934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:13:20.785896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-32fa5844-db7b-4851-a866-296f456f6d3c tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.516646 May 07 22:13:20.786891 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2765/5560] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:13:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:13:20.794061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:20.794687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:20.820578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:20.821046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:20.821847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:20.822292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:21.007023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:21.017848 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-252e7716-20f2-4ff0-8f48-e2b62ed8fb6b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1267 microversion: 2.1 time: 0.227103 May 07 22:13:21.019951 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2766/5561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:20 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:21.031285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9800b7b4-574a-488a-be7f-fbb717842258 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:21.034178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9800b7b4-574a-488a-be7f-fbb717842258 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:21.174248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9800b7b4-574a-488a-be7f-fbb717842258 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:21.183666 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9800b7b4-574a-488a-be7f-fbb717842258 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1213 microversion: 2.1 time: 0.161260 May 07 22:13:21.185146 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2767/5562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:21 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:21.295884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:21.312044 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7dd3adfe-08b9-4b92-8af1-6594ce6572ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 1.027490 May 07 22:13:21.313548 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2796/5563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:20 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:22.040852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:22.042795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:22.071952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:22.075100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:22.076358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:22.080765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:22.208552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:22.209178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:22.223274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:22.223743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:22.230583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:22.231122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:22.243396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:22.256998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4034790d-e12a-406e-913b-c2e08f01ccc6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1267 microversion: 2.1 time: 0.219417 May 07 22:13:22.270095 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2768/5564] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:22 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:22.330011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:22.330697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:22.341291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:22.344906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:22.345986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:22.347848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:22.428470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:22.439902 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7a85adb8-3ae1-4738-a256-c0bf0cdbd7eb tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1265 microversion: 2.1 time: 0.241212 May 07 22:13:22.444159 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2797/5565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:22 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:22.818852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:22.826901 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a03a4dc2-7e44-4e66-8092-142b885ee11c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.501245 May 07 22:13:22.830827 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2769/5566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:22 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:23.285649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:23.290048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:23.298954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:23.299783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:23.301937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:23.302638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:23.463217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:23.463864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:23.476917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:23.477394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:23.485708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:23.486238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:23.571722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:23.586520 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c347dcd4-372d-4529-ab80-b640826ed583 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1271 microversion: 2.1 time: 0.126892 May 07 22:13:23.587771 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2770/5567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:23 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:23.785447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:23.799009 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af30aa9e-2529-4919-bc78-41c95bea146e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.523757 May 07 22:13:23.800727 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2798/5568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:23 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:23.849904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:23.850816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:23.864602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:23.865522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:23.866583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:23.867266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:24.244630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9df1ddf4-82ce-4db6-9c5c-a09140032f96 req-9af9e5b3-aab4-4d49-8fa8-d066980439e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb197fc1-0207-498b-9fe9-b21826687a56", "name": "network-vif-plugged", "status": "completed", "tag": "b2b93741-196b-4634-b3a8-cacfa39e6497"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:24.255806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9df1ddf4-82ce-4db6-9c5c-a09140032f96 req-9af9e5b3-aab4-4d49-8fa8-d066980439e5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:24.260225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9df1ddf4-82ce-4db6-9c5c-a09140032f96 req-9af9e5b3-aab4-4d49-8fa8-d066980439e5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:24.281126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:24.285481 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9df1ddf4-82ce-4db6-9c5c-a09140032f96 req-9af9e5b3-aab4-4d49-8fa8-d066980439e5 service nova] Creating event network-vif-plugged:b2b93741-196b-4634-b3a8-cacfa39e6497 for instance bb197fc1-0207-498b-9fe9-b21826687a56 on nch2-master-1 May 07 22:13:24.299711 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9df1ddf4-82ce-4db6-9c5c-a09140032f96 req-9af9e5b3-aab4-4d49-8fa8-d066980439e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058980 May 07 22:13:24.300333 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3e88ca77-239a-4703-bb1d-ab2e794bfbe3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.460261 May 07 22:13:24.301286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2771/5569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:23 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:24.312036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2799/5570] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:13:24.609242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:24.611428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:24.621606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:24.622301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:24.624684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:24.625383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:24.802509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:24.815440 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1b2acd5-6bb0-4586-9cc3-a72d2c397fb1 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1271 microversion: 2.1 time: 0.213395 May 07 22:13:24.816853 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2800/5571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:24 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:24.817829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:24.818470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:24.827925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:24.829299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:24.831476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:24.832120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:25.057523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:25.065584 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-affa5590-3220-4c30-a463-9ef5cdcf72fe tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.252317 May 07 22:13:25.066189 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2772/5572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:24 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:25.323632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:25.324277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:25.342399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:25.342907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:25.343710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:25.344156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:25.835652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:25.836907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:25.848068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:25.848738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:25.850637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:25.851327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:26.056249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:26.068271 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c92205d-678b-4a77-8b92-cc54e82c0ba2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1216 microversion: 2.1 time: 0.751257 May 07 22:13:26.071110 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2801/5573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:25 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1216 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:26.093676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:26.094343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:26.110726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:26.111640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:26.113039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:26.113664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:26.272500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:26.282287 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ba999720-8597-4b4a-b3e8-2048a3e08f35 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.452695 May 07 22:13:26.289137 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2773/5574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:25 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:26.546428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3379624e-8e85-4e65-93d0-3647024a0eb1 req-bded2521-3811-4c2f-b62e-7224df02091c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f65a5d21-0a34-4bef-82e5-f77821caa253", "tag": "38281ec1-7309-4230-88df-07aeb79aaee9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:26.555965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3379624e-8e85-4e65-93d0-3647024a0eb1 req-bded2521-3811-4c2f-b62e-7224df02091c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:26.556803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3379624e-8e85-4e65-93d0-3647024a0eb1 req-bded2521-3811-4c2f-b62e-7224df02091c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:26.581144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3379624e-8e85-4e65-93d0-3647024a0eb1 req-bded2521-3811-4c2f-b62e-7224df02091c service nova] Creating event network-changed:38281ec1-7309-4230-88df-07aeb79aaee9 for instance f65a5d21-0a34-4bef-82e5-f77821caa253 on nch1-master-1 May 07 22:13:26.586254 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3379624e-8e85-4e65-93d0-3647024a0eb1 req-bded2521-3811-4c2f-b62e-7224df02091c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043690 May 07 22:13:26.587116 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2774/5575] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:13:26.620252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:26.633620 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9cf7b5af-ad79-4b81-817e-9bc149cff78e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.542555 May 07 22:13:26.635216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2802/5576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:26 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:27.094726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:27.095964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:27.112604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.113467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.115152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.117517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.306611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:27.307067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:27.318983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.319511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.320424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.321489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.389995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:27.400558 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e86ad7d-a04a-49e7-8101-f19d735c17bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1403 microversion: 2.1 time: 0.311602 May 07 22:13:27.412945 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2775/5577] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:27 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1403 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:27.418737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:27.419588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:27.429770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.430487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.432127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.432752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.600680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:27.609781 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-55a85bdb-4fb9-40ca-8894-49df99e65a4a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1403 microversion: 2.1 time: 0.195408 May 07 22:13:27.611344 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2776/5578] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:27 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1403 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:27.631178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1396188411"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:27.632295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:27.638879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.639342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.640418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.641021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.760190 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.compute.api [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Attempting to quiesce instance before volume snapshot. May 07 22:13:27.825769 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.compute.api [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 07 22:13:27.889181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:27.899055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd70781f-e11c-4d26-90a7-60da3f20a7dd tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.596864 May 07 22:13:27.900230 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2803/5579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:27 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:27.905407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:27.906383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:27.916673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.917312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.918299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:27.918969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:27.945312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Creating snapshot from volume 9a081585-6d81-4d08-8c50-ae0498445a58. {{(pid=136681) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 07 22:13:28.712305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:28.733886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1444d92-59be-46bc-ae02-ee71d159fb2c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.832374 May 07 22:13:28.735188 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2804/5580] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:27 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:28.916803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:28.917612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:28.933718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:28.937374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:28.939626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:28.945163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:29.500042 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c5002c4c-36fc-4823-8994-6eba09c6e6f3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56/action" status: 202 len: 0 microversion: 2.1 time: 1.874461 May 07 22:13:29.501317 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2777/5581] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:13:27 2022] POST /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56/action => generated 0 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 22:13:29.751124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:29.757320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:29.759205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:29.765206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:29.765688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:29.766493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:29.770515 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-af1c347b-1f7c-4420-95b2-f3bf1e2a3f5a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.857586 May 07 22:13:29.775104 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2805/5582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:28 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:29.779475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:29.834457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-630584346", "imageRef": "69c333ec-af9a-44b3-b161-3390611183e6", "flavorRef": "452", "networks": [{"uuid": "87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:29.937020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] validate_networks() for [('87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:13:30.054389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:30.064641 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-38b9ce22-439a-4507-8054-f9808d1c2685 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.317683 May 07 22:13:30.065289 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2778/5583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:29 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:30.070596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-47ac3709-2f51-4971-9136-a922a24b8168 req-70a4ef3e-ed4a-45d5-a17a-b26b166ea740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea99916-97ab-4e68-90bc-a95c38f04964", "tag": "ab0dee45-f2e9-4c0d-bd11-e0508238475b"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:30.086301 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-47ac3709-2f51-4971-9136-a922a24b8168 req-70a4ef3e-ed4a-45d5-a17a-b26b166ea740 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:30.086810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-47ac3709-2f51-4971-9136-a922a24b8168 req-70a4ef3e-ed4a-45d5-a17a-b26b166ea740 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:30.101317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-47ac3709-2f51-4971-9136-a922a24b8168 req-70a4ef3e-ed4a-45d5-a17a-b26b166ea740 service nova] Creating event network-changed:ab0dee45-f2e9-4c0d-bd11-e0508238475b for instance 4ea99916-97ab-4e68-90bc-a95c38f04964 on nch1-master-1 May 07 22:13:30.106527 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-47ac3709-2f51-4971-9136-a922a24b8168 req-70a4ef3e-ed4a-45d5-a17a-b26b166ea740 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039322 May 07 22:13:30.107753 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2779/5584] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:30.795285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:30.796088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:30.809728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:30.810100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:30.812137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:30.813790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:31.288470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:13:31.288917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:13:31.289375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:13:31.289805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:13:31.290226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:13:31.310705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:31.311197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:31.312020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:31.312472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:31.372753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:13:31.388322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:13:31.422566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:13:31.429657 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f9d757db-ff45-4ae6-b388-a2d8a6598713',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:13:31.484351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:31.494265 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2678d7a-c3a0-4a5b-8f9a-e202d7d393fc tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.704353 May 07 22:13:31.504423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2780/5585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:30 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:31.509273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:31.509908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:31.529057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:31.529536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:31.530347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:31.530879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:31.658746 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5cf2a65-2e9e-48bf-9493-a6c1773414f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823296 May 07 22:13:31.661118 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2806/5586] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:13:31.672719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-193b9196-cbe0-4b41-8a7b-d3a61c3f744f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:31.674374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-193b9196-cbe0-4b41-8a7b-d3a61c3f744f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:31.753342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-193b9196-cbe0-4b41-8a7b-d3a61c3f744f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:31.765574 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-193b9196-cbe0-4b41-8a7b-d3a61c3f744f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1229 microversion: 2.1 time: 0.097378 May 07 22:13:31.767528 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2807/5587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:31 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:31.988252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:32.016690 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c37cf2d4-fba6-4255-b35e-af585c3dbb0c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.511000 May 07 22:13:32.018725 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2781/5588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:31 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:32.521647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:32.524541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:32.533133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:32.543132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:32.544477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:32.545170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:32.787222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:32.792045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:32.810411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:32.811000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:32.821837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:32.822636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:32.938489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:32.962982 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aef8dd54-648a-4497-87c9-bf77d2b9ee32 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.443828 May 07 22:13:32.977262 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2808/5589] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:32 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:33.037637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:33.039465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:33.098070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:33.098755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:33.108204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:33.109577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:33.165586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:33.194676 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-68fe519a-a0c0-49a4-901b-a7737c5e849f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1281 microversion: 2.1 time: 0.415286 May 07 22:13:33.221336 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2782/5590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:32 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1281 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:33.526934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:33.552129 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d40a450-0279-4028-82be-b95706f2bc15 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.519156 May 07 22:13:33.554410 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2809/5591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:33 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:33.982359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:33.983040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:34.004783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:34.005132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:34.005966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:34.006436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:34.228117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:34.228664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:34.242812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:34.243211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:34.245855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:34.255813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:34.414978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:34.423714 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7f6e636-2eee-486d-ad26-099a578efcb5 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1299 microversion: 2.1 time: 0.199221 May 07 22:13:34.449105 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2810/5592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:34 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1299 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:34.572059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:34.572587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:34.586099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:34.586823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:34.587617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:34.588054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:34.964226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:34.973571 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f3e02c32-24db-41fe-920c-b856882395c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.406466 May 07 22:13:34.984623 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2811/5593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:34 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:35.465460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:35.466382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:35.477329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:35.477806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:35.478614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:35.479103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:35.588595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:35.600594 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2af18b7d-8caa-4031-a3fd-e913cf2009e4 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 1.622859 May 07 22:13:35.601347 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2783/5594] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:33 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:35.613580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6e5f674a-19dd-4296-87e9-552506dc8a66 req-fca37024-d3e4-4c8e-84ba-b581b8962e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65a5d21-0a34-4bef-82e5-f77821caa253", "name": "network-vif-plugged", "status": "completed", "tag": "38281ec1-7309-4230-88df-07aeb79aaee9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:35.631295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6e5f674a-19dd-4296-87e9-552506dc8a66 req-fca37024-d3e4-4c8e-84ba-b581b8962e7d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:35.631971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6e5f674a-19dd-4296-87e9-552506dc8a66 req-fca37024-d3e4-4c8e-84ba-b581b8962e7d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:35.646901 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6e5f674a-19dd-4296-87e9-552506dc8a66 req-fca37024-d3e4-4c8e-84ba-b581b8962e7d service nova] Creating event network-vif-plugged:38281ec1-7309-4230-88df-07aeb79aaee9 for instance f65a5d21-0a34-4bef-82e5-f77821caa253 on nch1-master-1 May 07 22:13:35.653238 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6e5f674a-19dd-4296-87e9-552506dc8a66 req-fca37024-d3e4-4c8e-84ba-b581b8962e7d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048411 May 07 22:13:35.654054 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2784/5595] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:36.004868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:36.005946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:36.028786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:36.031638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:36.033255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:36.035845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:36.425331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:36.443539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-75579099-0aa2-467e-9a79-79432f81ef50 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1341 microversion: 2.1 time: 0.981884 May 07 22:13:36.444649 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2812/5596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:35 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1341 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:36.559627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:36.582971 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7d1a825d-645d-4e71-804d-64b65612aed6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1309 microversion: 2.1 time: 0.581257 May 07 22:13:36.585645 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2785/5597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:35 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1309 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:36.619709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:36.620868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:36.648858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:36.649612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:36.654266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:36.654940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:37.223544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:37.234062 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7ac5fdc8-e061-44f6-b470-9e2a15ed69e9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.620101 May 07 22:13:37.240370 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2813/5598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:36 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:37.461845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:37.463074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:37.476920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:37.477580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:37.478551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:37.493631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:37.601191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:37.601827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:37.617165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:37.617809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:37.618681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:37.619168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:37.990758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:38.003488 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06d42d7e-b673-4462-95ee-0ba017f823a6 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1341 microversion: 2.1 time: 0.545369 May 07 22:13:38.023501 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2786/5599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:37 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1341 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:38.023501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9af7c829-122a-4db6-a512-ffadabdf9c19 req-2102ce4d-2172-4d96-b66f-57afe97f49d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d382c3-52c5-4312-a2a5-47fdfc1625fd", "tag": "6bfd345f-53d0-4135-ad4d-03cc3f0666db"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:38.050371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9af7c829-122a-4db6-a512-ffadabdf9c19 req-2102ce4d-2172-4d96-b66f-57afe97f49d7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:38.056087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9af7c829-122a-4db6-a512-ffadabdf9c19 req-2102ce4d-2172-4d96-b66f-57afe97f49d7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:38.112917 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9af7c829-122a-4db6-a512-ffadabdf9c19 req-2102ce4d-2172-4d96-b66f-57afe97f49d7 service nova] Creating event network-changed:6bfd345f-53d0-4135-ad4d-03cc3f0666db for instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd on nch2-master-1 May 07 22:13:38.138395 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9af7c829-122a-4db6-a512-ffadabdf9c19 req-2102ce4d-2172-4d96-b66f-57afe97f49d7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125536 May 07 22:13:38.139053 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2787/5600] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:38.168108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:38.182213 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ebc601c-187e-4f50-8031-86dcb978f11b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1491 microversion: 2.1 time: 0.585792 May 07 22:13:38.189109 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2814/5601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:37 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1491 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:38.208307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3e6ad8e-d9d8-4ab9-8067-28e65030d32b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1018826247"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:38.211381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b3e6ad8e-d9d8-4ab9-8067-28e65030d32b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:38.239887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3e6ad8e-d9d8-4ab9-8067-28e65030d32b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:38.240677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3e6ad8e-d9d8-4ab9-8067-28e65030d32b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:38.241566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3e6ad8e-d9d8-4ab9-8067-28e65030d32b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:38.242035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3e6ad8e-d9d8-4ab9-8067-28e65030d32b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:38.255693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:38.256496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:38.265178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:38.279217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:38.284006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:38.288537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:38.554352 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b3e6ad8e-d9d8-4ab9-8067-28e65030d32b tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "PUT /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1076 microversion: 2.1 time: 0.352903 May 07 22:13:38.567756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2788/5602] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 22:13:38 2022] PUT /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1076 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:38.573137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:38.574130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:38.581908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:38.582594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:38.591258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:38.591977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:38.954442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:38.963282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:38.965539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f9086a50-99ab-45a2-ac4b-fa3f026ca4f9 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.714626 May 07 22:13:38.968088 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2815/5603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:38 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:38.977441 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f937f84a-894c-446a-b371-fd227d4abcad tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1502 microversion: 2.1 time: 0.402540 May 07 22:13:38.980410 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2789/5604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:38 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:38.984994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f2bcefd1-bd94-426c-9656-7f4f4f860701 req-d4f16a9c-367b-467a-8fa6-2420416308fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea99916-97ab-4e68-90bc-a95c38f04964", "name": "network-vif-plugged", "status": "completed", "tag": "ab0dee45-f2e9-4c0d-bd11-e0508238475b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:39.003444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f2bcefd1-bd94-426c-9656-7f4f4f860701 req-d4f16a9c-367b-467a-8fa6-2420416308fe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:39.007409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f2bcefd1-bd94-426c-9656-7f4f4f860701 req-d4f16a9c-367b-467a-8fa6-2420416308fe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:39.023383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:39.027761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:39.040783 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f2bcefd1-bd94-426c-9656-7f4f4f860701 req-d4f16a9c-367b-467a-8fa6-2420416308fe service nova] Creating event network-vif-plugged:ab0dee45-f2e9-4c0d-bd11-e0508238475b for instance 4ea99916-97ab-4e68-90bc-a95c38f04964 on nch1-master-1 May 07 22:13:39.055034 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f2bcefd1-bd94-426c-9656-7f4f4f860701 req-d4f16a9c-367b-467a-8fa6-2420416308fe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081985 May 07 22:13:39.060702 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2816/5605] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:39.066918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:39.074611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:39.094680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:39.095933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:39.102521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:39.103429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:39.105456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:39.106210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:39.152583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:39.153185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:39.763358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:39.780924 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a729de4-2b52-4945-8d4d-3f716f3f6327 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1341 microversion: 2.1 time: 0.718583 May 07 22:13:39.792461 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2817/5606] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:39 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1341 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:39.885828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:39.905095 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2808ccbf-4e46-4b0c-8aba-0ecdd34dd7c2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1502 microversion: 2.1 time: 0.902033 May 07 22:13:39.908676 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2790/5607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:39 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1502 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:39.927497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1bf399dd-c0c6-4dd9-8efe-098370893b32 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:39.945937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bf399dd-c0c6-4dd9-8efe-098370893b32 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:39.954675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1bf399dd-c0c6-4dd9-8efe-098370893b32 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:39.991155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:39.991825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:40.012680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:40.013163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:40.014006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:40.019283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:40.058180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1bf399dd-c0c6-4dd9-8efe-098370893b32 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:13:40.184600 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1bf399dd-c0c6-4dd9-8efe-098370893b32 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "POST /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253/action" status: 202 len: 0 microversion: 2.1 time: 0.264767 May 07 22:13:40.185578 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2818/5608] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:13:39 2022] POST /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:13:40.195313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:40.196894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:40.219312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:40.220084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:40.221079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:40.222276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:40.350667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:40.361125 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d331beed-a8ee-43d1-83e6-0c86ba7d2146 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1313 microversion: 2.1 time: 0.371343 May 07 22:13:40.361755 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2791/5609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:39 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:40.636594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:40.648579 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b96089a8-1de6-4592-ac4f-346059e0e179 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.458358 May 07 22:13:40.649908 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2819/5610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:40 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:40.811852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:40.812879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:40.823254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:40.823999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:40.828755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:40.829285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:41.186527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:41.198540 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d82b56a1-5543-46b5-b117-593882cc4da1 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1375 microversion: 2.1 time: 0.392337 May 07 22:13:41.211901 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2792/5611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:40 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1375 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:41.392437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:41.393641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:41.412589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:41.413055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:41.414316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:41.415050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:41.667352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:41.668924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:41.680100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:41.680937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:41.681979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:41.684984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:41.815498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:41.823923 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-66fa5242-6416-434e-8189-2c63182a224a tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1496 microversion: 2.1 time: 0.437866 May 07 22:13:41.827590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2820/5612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:41 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1496 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:42.014058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:42.025652 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f6dc984f-3926-4536-9d65-e940376c5d61 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.362148 May 07 22:13:42.038703 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2793/5613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:41 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:42.217282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:42.218163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:42.230893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:42.232340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:42.235056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:42.236290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:42.571800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:42.605780 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5bcd6ad5-627c-41cb-b104-041a83042142 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1375 microversion: 2.1 time: 0.392415 May 07 22:13:42.608415 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2821/5614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:42 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1375 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:43.043660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:43.044322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:43.069082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:43.069473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:43.076492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:43.077107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:43.621043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:43.625596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:43.626848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:43.640440 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-520ea7f3-279f-482a-97c7-638850ab097e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.600817 May 07 22:13:43.645500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:43.645975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:43.646790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:43.647247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:43.650517 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2794/5615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:43 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:44.052403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:44.074479 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f39170c-894d-45be-937c-b603dcde712c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1375 microversion: 2.1 time: 0.452158 May 07 22:13:44.086914 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2822/5616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:43 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1375 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:44.659109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:44.663364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:44.676249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:44.677014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:44.678983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:44.680303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:45.093722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:45.094361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:45.114025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:45.123366 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54e7a9ad-d6c0-4e07-b831-16911a1151e6 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.469513 May 07 22:13:45.125479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:45.126665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:45.128407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:45.128809 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2795/5617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:44 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:45.129442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:45.255793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:45.256849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:45.266378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:45.271310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:45.272333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:45.272921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:45.337123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:13:45.485592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:45.499570 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50b98072-8051-4ab6-89de-e8adba3d2b47 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 204 len: 0 microversion: 2.1 time: 0.247510 May 07 22:13:45.499803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf4ffb54-5056-4d6d-bb14-79f72380975a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1375 microversion: 2.1 time: 0.410111 May 07 22:13:45.506549 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2796/5618] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:13:45 2022] DELETE /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:13:45.511097 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2823/5619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:45 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1375 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:45.520704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:45.521505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:45.539289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:45.540210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:45.541353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:45.541821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:46.144051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:46.144675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:46.153090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:46.158125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:46.159189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:46.159789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:46.418268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:46.427132 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e4d9bc8-4fe0-42d0-ad15-7117b4365088 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1502 microversion: 2.1 time: 0.913307 May 07 22:13:46.439184 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2797/5620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:45 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1502 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:46.453027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:46.471948 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-656d8cbc-38f0-40ed-9a54-7076ef37a766 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.331581 May 07 22:13:46.475915 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2824/5621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:46 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:46.518011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:46.518662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:46.533413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:46.533898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:46.534711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:46.535912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:46.795940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:46.806031 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27a62ba3-7698-4c42-b1e2-526de22d0afd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1375 microversion: 2.1 time: 0.292406 May 07 22:13:46.816820 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2798/5622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:46 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1375 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:47.447049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:47.447602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:47.454574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:47.455297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:47.456266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:47.456865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:47.491891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:47.492541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:47.501984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:47.502476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:47.503336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:47.507437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:47.769755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:47.787667 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c87df57-6921-4cd8-bca5-c97d78ffde26 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.299206 May 07 22:13:47.789141 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2799/5623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:47 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:47.825638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:47.826537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:47.837662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:47.838699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:47.840326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:47.841680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:48.169110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:48.183292 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-99e8d569-da6c-4c7d-bbb7-3661f5a7b9bf tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1375 microversion: 2.1 time: 0.361229 May 07 22:13:48.189421 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2800/5624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:47 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1375 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:48.208232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d3449ec5-04eb-4faf-afe2-116055653cde req-e1c4503c-8bc2-4168-b18b-f66fcf371a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d382c3-52c5-4312-a2a5-47fdfc1625fd", "name": "network-vif-plugged", "status": "completed", "tag": "6bfd345f-53d0-4135-ad4d-03cc3f0666db"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:48.233816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d3449ec5-04eb-4faf-afe2-116055653cde req-e1c4503c-8bc2-4168-b18b-f66fcf371a67 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:48.234492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d3449ec5-04eb-4faf-afe2-116055653cde req-e1c4503c-8bc2-4168-b18b-f66fcf371a67 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:48.248449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d3449ec5-04eb-4faf-afe2-116055653cde req-e1c4503c-8bc2-4168-b18b-f66fcf371a67 service nova] Creating event network-vif-plugged:6bfd345f-53d0-4135-ad4d-03cc3f0666db for instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd on nch2-master-1 May 07 22:13:48.253998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d3449ec5-04eb-4faf-afe2-116055653cde req-e1c4503c-8bc2-4168-b18b-f66fcf371a67 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065795 May 07 22:13:48.254620 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2801/5625] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:48.451054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:48.474511 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0f163564-79e6-489b-9ec5-1dcc8804e68f tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1502 microversion: 2.1 time: 1.031411 May 07 22:13:48.488259 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2825/5626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:47 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1502 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:48.809424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:48.811057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:48.827702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:48.828589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:48.829791 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:48.835036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:48.886501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-76833d13-5374-49f9-9ffd-06405c176cfa req-6724ff34-d8c7-49ae-9269-3b2ca6854289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea99916-97ab-4e68-90bc-a95c38f04964", "name": "network-vif-deleted", "tag": "ab0dee45-f2e9-4c0d-bd11-e0508238475b"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:48.910290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-76833d13-5374-49f9-9ffd-06405c176cfa req-6724ff34-d8c7-49ae-9269-3b2ca6854289 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:48.917506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-76833d13-5374-49f9-9ffd-06405c176cfa req-6724ff34-d8c7-49ae-9269-3b2ca6854289 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:48.961790 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-76833d13-5374-49f9-9ffd-06405c176cfa req-6724ff34-d8c7-49ae-9269-3b2ca6854289 service nova] Creating event network-vif-deleted:ab0dee45-f2e9-4c0d-bd11-e0508238475b for instance 4ea99916-97ab-4e68-90bc-a95c38f04964 on nch1-master-1 May 07 22:13:48.981417 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-76833d13-5374-49f9-9ffd-06405c176cfa req-6724ff34-d8c7-49ae-9269-3b2ca6854289 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100590 May 07 22:13:48.997780 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2826/5627] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:49.205400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:49.206440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:49.214470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:49.223013 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d81b3b27-3ebc-466c-8296-84930310aeb7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.420809 May 07 22:13:49.223794 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2802/5628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:48 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:49.226994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:49.229239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:49.230740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:49.231614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:49.508835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:49.509674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:49.518076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:49.518728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:49.520108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:49.522530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:49.559953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:49.560602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:49.561234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lazy-loading 'fault' on Instance uuid 4ea99916-97ab-4e68-90bc-a95c38f04964 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:13:49.663672 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '313cb56eefdd49cab9f9ddcbfea4ab72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62508bea6e7484ea316f52f4d3b8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:49.674949 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f4410550-7fb2-4219-a8d4-b9be2504a496 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 200 len: 1303 microversion: 2.1 time: 0.170796 May 07 22:13:49.676816 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2803/5629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:49 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:49.718871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:49.730469 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5874503f-c4d3-4ae0-a9e7-f4c002bbbcd0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1375 microversion: 2.1 time: 0.532558 May 07 22:13:49.731704 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2827/5630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:49 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1375 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:50.241253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:50.241962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:50.249757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:50.250238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:50.251871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:50.252562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:50.516093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:50.529378 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-395b1362-a037-4b75-880a-a3f147e6ba40 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.292122 May 07 22:13:50.530458 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2804/5631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:50 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:50.693752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:50.695490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] [instance: 4ea99916-97ab-4e68-90bc-a95c38f04964] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:50.702865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:50.705680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:50.708597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:50.710739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:50.743701 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] HTTP exception thrown: Instance 4ea99916-97ab-4e68-90bc-a95c38f04964 could not be found. May 07 22:13:50.747613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] Returning 404 to user: Instance 4ea99916-97ab-4e68-90bc-a95c38f04964 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:13:50.750248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:50.751547 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc23fa2e-ef24-4754-8cb1-098ca74245e2 tempest-VolumesActionsTest-1113665028 tempest-VolumesActionsTest-1113665028-project] 10.222.0.32 "GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964" status: 404 len: 111 microversion: 2.1 time: 0.062065 May 07 22:13:50.752267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:50.755767 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2828/5632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:50 2022] GET /compute/v2.1/servers/4ea99916-97ab-4e68-90bc-a95c38f04964 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:13:50.772657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:50.773437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:50.774594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:50.775597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:51.156443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:51.169614 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fb97b38-1ab9-4043-a4fa-700930f45687 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1561 microversion: 2.1 time: 0.423706 May 07 22:13:51.170595 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2805/5633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:50 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1561 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:51.197038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:51.198586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:51.218573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:51.222812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:51.224825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:51.227947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:51.315754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-2003738795", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "eb2eb303-0e82-4936-8d9b-0c09343eec4b"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:51.415602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] validate_networks() for [('eb2eb303-0e82-4936-8d9b-0c09343eec4b', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:13:51.536998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:51.546361 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e3048962-7a3e-455d-8f56-c5c5a3e6c346 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1561 microversion: 2.1 time: 0.360156 May 07 22:13:51.555207 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2806/5634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:51 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1561 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:51.560567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:51.561570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:51.575842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:51.576515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:51.577557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:51.578030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:51.923349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:51.938592 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-102da5ce-79c3-471d-82db-858b289d8b4e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.380856 May 07 22:13:51.939860 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2807/5635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:51 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:51.958918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:51.959740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:51.973059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:51.973959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:51.976446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:51.977175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:52.039595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:13:52.179141 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2e6939a3-6162-4d46-b4ee-a26f6806a634 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 204 len: 0 microversion: 2.1 time: 0.236255 May 07 22:13:52.181169 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2808/5636] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:13:51 2022] DELETE /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:13:52.202967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:52.204565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:52.211030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:52.211778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:52.212787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:52.213464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:52.332872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:13:52.334062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:13:52.334557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:13:52.335212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:13:52.335915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:13:52.348275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:52.349130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:52.350062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:52.350571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:52.373767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Getting quotas for project c642a488de414517ac98cee7e2cc2406. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:13:52.382167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Getting quotas for user a29e307a46c4444cbe01dbeb1ebbed81 and project c642a488de414517ac98cee7e2cc2406. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:13:52.403579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:13:52.406101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:13:52.502489 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-024ccf7d-563b-4415-8d6b-89e127f1bb17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479089 May 07 22:13:52.504152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2829/5637] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:13:52.514489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a5e0c9c6-02b2-4a47-8776-fad3188fb6f4 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:52.516163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a5e0c9c6-02b2-4a47-8776-fad3188fb6f4 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:52.732353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a5e0c9c6-02b2-4a47-8776-fad3188fb6f4 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:52.750698 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a5e0c9c6-02b2-4a47-8776-fad3188fb6f4 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1215 microversion: 2.1 time: 0.240521 May 07 22:13:52.751364 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2830/5638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:52 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:52.803821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:52.818916 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c0379d8c-cff6-4fb1-a67f-88bbe40e5fba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1567 microversion: 2.1 time: 0.631377 May 07 22:13:52.821783 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2809/5639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:52 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1567 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:52.958389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:52.959049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:52.972899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:52.973369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:52.974163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:52.974836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:53.355102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:53.367503 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93f8af61-313a-473b-b90c-0f9873f5c79c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.414437 May 07 22:13:53.371168 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2831/5640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:52 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:53.768974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:53.769930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:53.779776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:53.780528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:53.781524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:53.782575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:53.839466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:53.841076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:53.863278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:53.863758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:53.865253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:53.865848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:53.993210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:54.008608 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4407f23a-7a20-4bb2-a395-186a3983f584 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1267 microversion: 2.1 time: 0.244887 May 07 22:13:54.010418 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2810/5641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:53 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:54.394266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:54.395219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:54.443547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:54.444479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:54.445359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:54.445814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:54.865291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:54.874376 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3e0c7c9b-eac9-411b-bbc3-d4404d8d13b8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1567 microversion: 2.1 time: 1.042105 May 07 22:13:54.889667 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2832/5642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:53 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1567 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:55.035994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:55.036992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:55.057248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:55.057930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:55.061893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:55.063028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:55.065505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:55.078328 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54085b4e-b778-4c30-8f63-1e3e89f3841e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.692026 May 07 22:13:55.080745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2811/5643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:54 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:55.210331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:55.224401 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57246cef-8e93-482a-9197-bfe5cedd9f61 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1273 microversion: 2.1 time: 0.199343 May 07 22:13:55.230108 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2833/5644] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:55 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:13:55.577473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e98dbbd3-7aa9-45e4-9ed8-154430dddfb1 req-94f47148-2e7a-4df7-8eb1-8eb7d6acc60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d382c3-52c5-4312-a2a5-47fdfc1625fd", "name": "network-vif-deleted", "tag": "6bfd345f-53d0-4135-ad4d-03cc3f0666db"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:55.588014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e98dbbd3-7aa9-45e4-9ed8-154430dddfb1 req-94f47148-2e7a-4df7-8eb1-8eb7d6acc60e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:55.588885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e98dbbd3-7aa9-45e4-9ed8-154430dddfb1 req-94f47148-2e7a-4df7-8eb1-8eb7d6acc60e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:55.604528 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e98dbbd3-7aa9-45e4-9ed8-154430dddfb1 req-94f47148-2e7a-4df7-8eb1-8eb7d6acc60e service nova] Creating event network-vif-deleted:6bfd345f-53d0-4135-ad4d-03cc3f0666db for instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd on nch2-master-1 May 07 22:13:55.617634 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e98dbbd3-7aa9-45e4-9ed8-154430dddfb1 req-94f47148-2e7a-4df7-8eb1-8eb7d6acc60e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041955 May 07 22:13:55.618424 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2812/5645] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:13:55.899381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:55.901808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:55.919753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:55.921536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:55.924209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:55.924504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:56.102107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:56.102702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:56.132962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:56.136190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:56.137829 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:56.144856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:56.219728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:56.228931 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-45120af8-8216-4d79-b214-13d23e27e4ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 200 len: 1360 microversion: 2.1 time: 0.334416 May 07 22:13:56.229538 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2834/5646] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:55 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 1360 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:56.255640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:56.259814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:56.277948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:56.278849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:56.279639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:56.280091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:56.605963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:56.629518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6859e6fa-1a5d-40e6-85e5-9fca80a503ad tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1273 microversion: 2.1 time: 0.384926 May 07 22:13:56.648124 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2835/5647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:56 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1273 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:56.687049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:56.700362 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0d44e4aa-4369-472a-a395-c963637ef9ba tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.606991 May 07 22:13:56.706533 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2813/5648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:56 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:57.247409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:57.248713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:57.263352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:57.268417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:57.276524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:57.278157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:57.312284 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd could not be found. May 07 22:13:57.313592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:13:57.316727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea0b6ca3-2189-46c1-9718-3dd373aff69c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 404 len: 111 microversion: 2.1 time: 0.072128 May 07 22:13:57.319722 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2836/5649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:57 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:13:57.656278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:57.660653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:57.698079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:57.698564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:57.699727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:57.700338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:57.727031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:57.727680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:57.740775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:57.741178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:57.745194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:57.746394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:58.207481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:58.238212 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-30993a80-6ccc-4f90-ab81-e2b0050f220a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.519103 May 07 22:13:58.239942 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2837/5650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:57 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:58.369215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:58.381072 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c2830c1-2acf-4cb9-9042-ef17bad48676 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1315 microversion: 2.1 time: 0.732215 May 07 22:13:58.393052 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2814/5651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:57 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:59.051401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a8c10695-8e94-4df2-93ae-3780dbeb4751 req-20207552-5bae-41f5-a945-c89d8048f8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164426a0-c59d-477b-9c73-bd9b5d17842f", "tag": "d7900d83-4563-4b12-ac82-d89aa7319b93"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:13:59.061850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a8c10695-8e94-4df2-93ae-3780dbeb4751 req-20207552-5bae-41f5-a945-c89d8048f8b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:59.072083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a8c10695-8e94-4df2-93ae-3780dbeb4751 req-20207552-5bae-41f5-a945-c89d8048f8b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:59.091924 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a8c10695-8e94-4df2-93ae-3780dbeb4751 req-20207552-5bae-41f5-a945-c89d8048f8b7 service nova] Creating event network-changed:d7900d83-4563-4b12-ac82-d89aa7319b93 for instance 164426a0-c59d-477b-9c73-bd9b5d17842f on nch1-master-1 May 07 22:13:59.097216 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a8c10695-8e94-4df2-93ae-3780dbeb4751 req-20207552-5bae-41f5-a945-c89d8048f8b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050577 May 07 22:13:59.098216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2838/5652] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:13:59.258676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:59.259948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:59.266655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:59.267196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:59.268208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:59.268679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:59.398692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:13:59.399604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:13:59.412550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:59.416408 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:59.417488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:13:59.418496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:13:59.721212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:59.729584 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-88d12b0b-473d-415f-906a-b3798cc447b0 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1315 microversion: 2.1 time: 0.335506 May 07 22:13:59.730764 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2839/5653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:59 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:13:59.812323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:13:59.821019 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd96f744-3e2b-40a8-b2f5-ba710c0c97bb tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.567473 May 07 22:13:59.821714 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2815/5654] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:13:59 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:00.748838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:00.749469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:00.758107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:00.759812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:00.769073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:00.769594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:00.840659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:00.842199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:00.863924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:00.864652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:00.865849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:00.866730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:01.105770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:01.117642 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-39336acd-9af6-4325-9354-28bc75d67680 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1315 microversion: 2.1 time: 0.372727 May 07 22:14:01.118254 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2840/5655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:00 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:01.533942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:01.563357 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-82d89ef8-8562-4987-ad77-974dd325d41d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.727803 May 07 22:14:01.564577 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2816/5656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:00 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:02.136981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:02.139007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:02.147460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:02.149286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:02.151419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:02.153565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:02.581732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:02.582371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:02.590357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:02.590856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:02.591673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:02.592129 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:02.759206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:02.773755 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-797ad2e9-c4b5-4b1e-ae0b-a5421b9cd835 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.196946 May 07 22:14:02.774565 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2817/5657] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:02 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:02.955583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:02.969375 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9954d5f1-8321-4ebf-a309-5acba16c3fe7 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1315 microversion: 2.1 time: 0.838027 May 07 22:14:02.970736 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2841/5658] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:02 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:03.793407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:03.794239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:03.809504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:03.810431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:03.811656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:03.812697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:03.991198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:03.992996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:04.002338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:04.003027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:04.004257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:04.004711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:04.062384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:04.073146 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-abd869ce-9eea-4040-aa1c-34f81d4fe0df tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.285579 May 07 22:14:04.074626 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2818/5659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:03 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:04.409368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:04.420612 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e26b580d-1dda-4525-9d89-bf52337980cc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1315 microversion: 2.1 time: 0.436199 May 07 22:14:04.422549 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2842/5660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:03 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:05.005429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bb0034be-5d06-42d5-be0b-d16fb63731a1 req-41f8da3f-6b84-4aa9-b6c1-335bcc6904f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164426a0-c59d-477b-9c73-bd9b5d17842f", "name": "network-vif-plugged", "status": "completed", "tag": "d7900d83-4563-4b12-ac82-d89aa7319b93"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:05.016512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bb0034be-5d06-42d5-be0b-d16fb63731a1 req-41f8da3f-6b84-4aa9-b6c1-335bcc6904f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:05.017201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bb0034be-5d06-42d5-be0b-d16fb63731a1 req-41f8da3f-6b84-4aa9-b6c1-335bcc6904f7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:05.030457 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bb0034be-5d06-42d5-be0b-d16fb63731a1 req-41f8da3f-6b84-4aa9-b6c1-335bcc6904f7 service nova] Creating event network-vif-plugged:d7900d83-4563-4b12-ac82-d89aa7319b93 for instance 164426a0-c59d-477b-9c73-bd9b5d17842f on nch1-master-1 May 07 22:14:05.038499 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bb0034be-5d06-42d5-be0b-d16fb63731a1 req-41f8da3f-6b84-4aa9-b6c1-335bcc6904f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038068 May 07 22:14:05.039562 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2819/5661] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:14:05.091989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:05.092548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:05.113101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:05.113718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:05.114554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:05.115041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:05.439914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:05.440652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:05.454933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:05.455435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:05.456506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:05.457162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:05.585673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:05.606733 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d23beb0e-c9a6-46ce-b013-e19211b4928e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1512 microversion: 2.1 time: 0.512069 May 07 22:14:05.612175 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2843/5662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:05 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:05.847873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:05.876453 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-09f639b1-8e74-45ec-b5cf-51e4a0698f26 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1315 microversion: 2.1 time: 0.438838 May 07 22:14:05.877489 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2820/5663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:05 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:06.631181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:06.632008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:06.647899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:06.649547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:06.652263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:06.654557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:06.899577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:06.905305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:06.923834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:06.925481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:06.931070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:06.931754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.101687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:07.128920 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-acb47bcb-dcaa-40ae-b4e9-463fe26901af tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1489 microversion: 2.1 time: 0.504033 May 07 22:14:07.131304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2844/5664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:06 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1489 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:07.161974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4ce87dc-42cb-4453-82c1-a1c662d0d2ee tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1096362458"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:07.163369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a4ce87dc-42cb-4453-82c1-a1c662d0d2ee tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:07.181581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4ce87dc-42cb-4453-82c1-a1c662d0d2ee tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.182206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4ce87dc-42cb-4453-82c1-a1c662d0d2ee tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.183140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4ce87dc-42cb-4453-82c1-a1c662d0d2ee tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.183726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4ce87dc-42cb-4453-82c1-a1c662d0d2ee tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.327321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:07.334664 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4ce87dc-42cb-4453-82c1-a1c662d0d2ee tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "PUT /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1062 microversion: 2.1 time: 0.178235 May 07 22:14:07.340709 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ff0335e-d7da-4d25-84b0-298093871f1b tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1502 microversion: 2.1 time: 0.448803 May 07 22:14:07.343318 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2821/5665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:06 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1502 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:07.351579 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2845/5666] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 22:14:07 2022] PUT /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1062 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:07.351579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:07.351579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:07.357627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.358098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.358912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.359382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.368847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:07.369540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:07.387914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.388410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.389335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.393480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.686704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:07.698394 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab551b1d-31b9-4bb4-925c-4b7dc6214162 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1489 microversion: 2.1 time: 0.351526 May 07 22:14:07.699575 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2846/5667] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:07 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1489 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:07.717727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:07.718604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:07.726353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.727088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.728055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.730410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.844807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:07.860568 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1dbba188-118d-41e9-af2b-bfecc1e4dd18 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1502 microversion: 2.1 time: 0.501405 May 07 22:14:07.861858 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2822/5668] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:07 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1502 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:07.883512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:07.884089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:07.893642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.894281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.895450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:07.896115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:07.928324 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lazy-loading 'flavor' on Instance uuid 164426a0-c59d-477b-9c73-bd9b5d17842f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:14:08.054416 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c97f756-ad82-4547-a72f-61ab5db70c0e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action" status: 202 len: 0 microversion: 2.1 time: 0.176360 May 07 22:14:08.056745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2823/5669] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:14:07 2022] POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:14:08.070359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:08.072143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:08.083883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:08.084970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:08.086617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:08.091610 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:08.122919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:08.135539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b31852b0-7e45-4b41-822f-f0898c4d718a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1489 microversion: 2.1 time: 0.421918 May 07 22:14:08.151670 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2847/5670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:07 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1489 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:08.166683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:08.167468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:08.175652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:08.176400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:08.177484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:08.178288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:08.215426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:14:08.329013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d4231709-1c93-405c-bf02-3a72dcc2459a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 204 len: 0 microversion: 2.1 time: 0.174212 May 07 22:14:08.332732 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2848/5671] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:08 2022] DELETE /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:14:08.341497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:08.342298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:08.352959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:08.353792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:08.354991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:08.355646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:08.513658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:08.522409 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b68b8498-09fc-4083-8b28-a18b3d8e497f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1510 microversion: 2.1 time: 0.459679 May 07 22:14:08.523674 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2824/5672] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:08 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1510 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:08.657650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:08.672145 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0579d8f3-3990-4d70-b4d1-4c7644a91c16 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1495 microversion: 2.1 time: 0.337021 May 07 22:14:08.672805 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2849/5673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:08 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1495 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:09.542920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:09.543615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:09.587238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:09.588010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:09.589432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:09.590289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:09.691064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:09.692448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:09.708386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:09.710380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:09.715047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:09.716152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:09.847592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:09.858246 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f55f2582-17d6-4b46-bcac-09406ce71258 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1493 microversion: 2.1 time: 0.321625 May 07 22:14:09.861510 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2825/5674] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:09 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1493 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:09.882815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd0d2966-1216-4933-9875-457a0d8322e6 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:09.882815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd0d2966-1216-4933-9875-457a0d8322e6 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:09.895518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd0d2966-1216-4933-9875-457a0d8322e6 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:09.896009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd0d2966-1216-4933-9875-457a0d8322e6 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:09.897011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd0d2966-1216-4933-9875-457a0d8322e6 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:09.897573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd0d2966-1216-4933-9875-457a0d8322e6 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:09.998294 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd0d2966-1216-4933-9875-457a0d8322e6 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action" status: 202 len: 0 microversion: 2.1 time: 0.121658 May 07 22:14:10.003353 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2826/5675] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:14:09 2022] POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:14:10.014701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:10.016541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:10.025759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:10.026606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:10.027737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:10.028814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:10.253840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:10.267011 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-234b8dff-2fb8-41d6-a26a-2590818bf624 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1499 microversion: 2.1 time: 0.258029 May 07 22:14:10.268698 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2827/5676] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:10 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1499 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:10.628928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:10.639818 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2171ac7d-3813-4e67-b3a9-d8c7f60f917d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1495 microversion: 2.1 time: 0.953978 May 07 22:14:10.641749 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2850/5677] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:09 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1495 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:11.287106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:11.288422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:11.300894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:11.301405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:11.304707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:11.305193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:11.586031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:11.604811 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2631d22e-f732-4ba6-9c2e-d622abc933d3 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1499 microversion: 2.1 time: 0.322672 May 07 22:14:11.611035 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2828/5678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:11 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1499 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:11.666238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:11.674936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:11.714042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:11.715684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:11.717412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:11.719694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:11.870908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c850da9e-d035-4e69-b3f0-a09f973c35f9 req-8577c104-5057-4912-a932-b6a9aa9b7e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65a5d21-0a34-4bef-82e5-f77821caa253", "name": "network-vif-deleted", "tag": "38281ec1-7309-4230-88df-07aeb79aaee9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:11.884270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c850da9e-d035-4e69-b3f0-a09f973c35f9 req-8577c104-5057-4912-a932-b6a9aa9b7e22 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:11.888776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c850da9e-d035-4e69-b3f0-a09f973c35f9 req-8577c104-5057-4912-a932-b6a9aa9b7e22 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:11.893873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:11.910587 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8aa9e90d-1e45-4839-bbff-6befdb46e34f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 200 len: 1453 microversion: 2.1 time: 0.246604 May 07 22:14:11.913251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2851/5679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:11 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:11.917482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c850da9e-d035-4e69-b3f0-a09f973c35f9 req-8577c104-5057-4912-a932-b6a9aa9b7e22 service nova] Creating event network-vif-deleted:38281ec1-7309-4230-88df-07aeb79aaee9 for instance f65a5d21-0a34-4bef-82e5-f77821caa253 on nch1-master-1 May 07 22:14:11.933429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c850da9e-d035-4e69-b3f0-a09f973c35f9 req-8577c104-5057-4912-a932-b6a9aa9b7e22 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073215 May 07 22:14:11.934552 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2829/5680] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:12.623898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:12.624695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:12.636874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:12.637344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:12.639238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:12.641176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:12.935532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:12.937147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:12.945597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:12.947221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:12.948268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:12.949162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:12.970056 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance f65a5d21-0a34-4bef-82e5-f77821caa253 could not be found. May 07 22:14:12.971162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance f65a5d21-0a34-4bef-82e5-f77821caa253 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:12.973376 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bd456303-9513-4659-83e4-87a5d93ee542 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 404 len: 111 microversion: 2.1 time: 0.048022 May 07 22:14:12.974636 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2830/5681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:12 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:12.993146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:12.993677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:12.994736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:13.001154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.001633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.002446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.003220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.008770 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7dc9419-17be-48a4-b210-52403830da37 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1502 microversion: 2.1 time: 0.389840 May 07 22:14:13.009922 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2852/5682] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:12 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:13.021872 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance f65a5d21-0a34-4bef-82e5-f77821caa253 could not be found. May 07 22:14:13.022750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance f65a5d21-0a34-4bef-82e5-f77821caa253 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.024099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23516a97-99ec-4699-890b-cdfe69c1847e tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 404 len: 111 microversion: 2.1 time: 0.035834 May 07 22:14:13.025394 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2831/5683] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:12 2022] DELETE /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.032605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:13.033217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.036052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.037018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: f65a5d21-0a34-4bef-82e5-f77821caa253] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.040128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.041558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.042380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.043596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.046327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.047982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.049056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.050228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.069673 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance f65a5d21-0a34-4bef-82e5-f77821caa253 could not be found. May 07 22:14:13.070534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance f65a5d21-0a34-4bef-82e5-f77821caa253 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.071728 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4981b969-0e88-43dd-a521-d0bac287af3d tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253" status: 404 len: 111 microversion: 2.1 time: 0.042771 May 07 22:14:13.073534 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2832/5684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/f65a5d21-0a34-4bef-82e5-f77821caa253 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:14:13.079198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lazy-loading 'flavor' on Instance uuid 164426a0-c59d-477b-9c73-bd9b5d17842f {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:14:13.086352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.087653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.097891 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.099149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.100597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.101380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.127231 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e could not be found. May 07 22:14:13.128111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.129846 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ff42015-94bb-4b26-be3b-a113316f427a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 404 len: 111 microversion: 2.1 time: 0.051657 May 07 22:14:13.134950 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2833/5685] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:13 2022] DELETE /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.144996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.148927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.164314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.166053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.169450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.171041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.207651 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e could not be found. May 07 22:14:13.208354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 5faf8f65-128b-4bf7-91b4-4b3acbc2d63e could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.213185 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-813c5398-f12d-400a-b504-671d920996ab tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action" status: 202 len: 0 microversion: 2.1 time: 0.188564 May 07 22:14:13.214480 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2853/5686] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:14:13 2022] POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:14:13.223603 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9fae3ffd-7be9-41f6-a31e-7f4c8977a855 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e" status: 404 len: 111 microversion: 2.1 time: 0.087088 May 07 22:14:13.224772 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2834/5687] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/5faf8f65-128b-4bf7-91b4-4b3acbc2d63e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.236763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.237759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.242687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.243728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.246754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.247473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.248484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.249249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.261512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.264796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.266285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.266876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.269742 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 could not be found. May 07 22:14:13.270801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.272134 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-caf632f9-bbbb-4c03-85f6-fd4f7454ac3a tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 404 len: 111 microversion: 2.1 time: 0.042120 May 07 22:14:13.273175 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2835/5688] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:13 2022] DELETE /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.281754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.282552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.305882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.306360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.307227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.307697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.340484 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 could not be found. May 07 22:14:13.341128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.342002 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c5926008-f9fc-430e-a228-fec1180ba79f tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135" status: 404 len: 111 microversion: 2.1 time: 0.065019 May 07 22:14:13.344745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2836/5689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/9fb3ec2c-34c7-4d9b-875d-43a2ec0b2135 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.361995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.365258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.378863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.379724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.380702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.381700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.409027 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 876afed0-19b4-4cae-83e8-a954d0cae1ba could not be found. May 07 22:14:13.410376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 876afed0-19b4-4cae-83e8-a954d0cae1ba could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.411634 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c87bdad4-163a-458a-b0f9-dedc049f6ac2 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 404 len: 111 microversion: 2.1 time: 0.057459 May 07 22:14:13.415440 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2837/5690] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:13 2022] DELETE /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.427685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.428880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 876afed0-19b4-4cae-83e8-a954d0cae1ba] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.438216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.439206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.440192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.442574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.461354 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 876afed0-19b4-4cae-83e8-a954d0cae1ba could not be found. May 07 22:14:13.462397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 876afed0-19b4-4cae-83e8-a954d0cae1ba could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.463502 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-305bd78a-cc93-448f-a3f3-2e16f0d547da tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba" status: 404 len: 111 microversion: 2.1 time: 0.043192 May 07 22:14:13.468470 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2838/5691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/876afed0-19b4-4cae-83e8-a954d0cae1ba => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:14:13.474462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.475312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.482911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.483655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.484779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.486419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.513752 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 9829cd11-baa4-4561-9934-3becae825b83 could not be found. May 07 22:14:13.515983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 9829cd11-baa4-4561-9934-3becae825b83 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.517549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3d989dd5-84ac-481b-8896-af4047a96b64 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 404 len: 111 microversion: 2.1 time: 0.047116 May 07 22:14:13.518632 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2839/5692] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:13 2022] DELETE /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.530587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.532403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 9829cd11-baa4-4561-9934-3becae825b83] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.540882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.541853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.543142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.543915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.561766 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 9829cd11-baa4-4561-9934-3becae825b83 could not be found. May 07 22:14:13.562807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 9829cd11-baa4-4561-9934-3becae825b83 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.564171 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-85c93f7a-f41a-4a39-acdb-561582cf04c7 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83" status: 404 len: 111 microversion: 2.1 time: 0.041108 May 07 22:14:13.565302 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2840/5693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/9829cd11-baa4-4561-9934-3becae825b83 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.583206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.584419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.588634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:13.595452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.595935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.596965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.597413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.606132 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4aec6aeb-3f53-49b6-a42c-e436f6b92f17 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1510 microversion: 2.1 time: 0.370358 May 07 22:14:13.610299 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2854/5694] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:13.633949 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 could not be found. May 07 22:14:13.634686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.636147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5b801944-a224-4a73-99a1-09b88787b924 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 404 len: 111 microversion: 2.1 time: 0.066025 May 07 22:14:13.639640 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2841/5695] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:13 2022] DELETE /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.646817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.647822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 1d76e503-6e1a-4cee-b3b8-29af6484df32] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.662528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.665199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.665954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.666457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.711354 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 could not be found. May 07 22:14:13.717280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 1d76e503-6e1a-4cee-b3b8-29af6484df32 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.717280 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-413d40a0-5c14-4569-9bde-482e8250b102 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32" status: 404 len: 111 microversion: 2.1 time: 0.073958 May 07 22:14:13.717850 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2855/5696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/1d76e503-6e1a-4cee-b3b8-29af6484df32 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.731818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb7db662-aef0-4be6-a933-631dca11ba9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.731818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb7db662-aef0-4be6-a933-631dca11ba9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: b3ee742d-7d43-4184-863a-c4b8a4b71071] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.745702 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-bb7db662-aef0-4be6-a933-631dca11ba9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance b3ee742d-7d43-4184-863a-c4b8a4b71071 could not be found. May 07 22:14:13.746155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb7db662-aef0-4be6-a933-631dca11ba9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance b3ee742d-7d43-4184-863a-c4b8a4b71071 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.751488 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb7db662-aef0-4be6-a933-631dca11ba9c tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071" status: 404 len: 111 microversion: 2.1 time: 0.022927 May 07 22:14:13.755581 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2842/5697] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:13 2022] DELETE /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.766954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5fd1adf5-9ce4-496b-8716-39d399cdbe28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.768293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5fd1adf5-9ce4-496b-8716-39d399cdbe28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: b3ee742d-7d43-4184-863a-c4b8a4b71071] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.781164 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5fd1adf5-9ce4-496b-8716-39d399cdbe28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance b3ee742d-7d43-4184-863a-c4b8a4b71071 could not be found. May 07 22:14:13.783190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5fd1adf5-9ce4-496b-8716-39d399cdbe28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance b3ee742d-7d43-4184-863a-c4b8a4b71071 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:13.786062 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5fd1adf5-9ce4-496b-8716-39d399cdbe28 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071" status: 404 len: 111 microversion: 2.1 time: 0.029118 May 07 22:14:13.787646 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2856/5698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:13 2022] GET /compute/v2.1/servers/b3ee742d-7d43-4184-863a-c4b8a4b71071 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:13.797204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:13.798076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:13.811253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.811938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.828922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:13.831343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:13.881438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:14:14.030493 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7dfb11c4-697d-4e09-abd4-1e8138e06721 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "DELETE /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 204 len: 0 microversion: 2.1 time: 0.238031 May 07 22:14:14.031482 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2843/5699] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:13 2022] DELETE /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:14:14.043280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:14.044626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:14.057396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:14.058825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:14.060945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:14.063640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:14.634503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:14.635665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:14.642421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:14.643606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:14.645430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:14.645837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:14.646496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:14.653309 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-80ed157b-b35a-46c0-80a0-32b6ac4e7d90 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1480 microversion: 2.1 time: 0.617351 May 07 22:14:14.657503 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2857/5700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:14 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1480 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:14.873580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:14.884629 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5859a704-6177-4c74-b1e4-99a73b4a346d tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1493 microversion: 2.1 time: 0.259014 May 07 22:14:14.885248 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2844/5701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:14 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:14.903123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3abc2efc-4247-422f-a826-7c39035dcb7f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:14.903936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3abc2efc-4247-422f-a826-7c39035dcb7f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:14.915127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abc2efc-4247-422f-a826-7c39035dcb7f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:14.915869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abc2efc-4247-422f-a826-7c39035dcb7f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:14.916850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abc2efc-4247-422f-a826-7c39035dcb7f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:14.917747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abc2efc-4247-422f-a826-7c39035dcb7f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:15.030458 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3abc2efc-4247-422f-a826-7c39035dcb7f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action" status: 202 len: 0 microversion: 2.1 time: 0.131053 May 07 22:14:15.041372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:15.042250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:15.046653 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2858/5702] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:14:14 2022] POST /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:14:15.052111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:15.052972 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:15.054326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:15.055060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:15.455519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:15.469456 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-448174a4-6439-474a-8c12-f2ff5bf6494e tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1499 microversion: 2.1 time: 0.432208 May 07 22:14:15.470416 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2845/5703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:15 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1499 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:15.676479 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:15.677285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:15.684192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:15.684976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:15.686933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:15.687805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:16.112004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:16.126323 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a26276bc-b7f1-4e5c-bc24-ecdac8e21f81 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1480 microversion: 2.1 time: 0.455233 May 07 22:14:16.139859 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2859/5704] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:15 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1480 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:16.488695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:16.489360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:16.496602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:16.507531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:16.508989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:16.511212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:17.148034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:17.149469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:17.159128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:17.160277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:17.161340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:17.161883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:17.290446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:17.302052 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e359700-18e0-4f73-a8e1-26bc90823ad9 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1438 microversion: 2.1 time: 0.157855 May 07 22:14:17.318876 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2860/5705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:17 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1438 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:17.561499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:17.572239 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-de8834af-f38d-4546-8de4-2fab6e09de7c tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1499 microversion: 2.1 time: 1.088517 May 07 22:14:17.573717 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2846/5706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:16 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1499 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:17.578555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-813c9623-41d3-407c-8009-d07bbb129fb1 req-387734b8-a73b-425f-aeb7-f1de0f8b5e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02c9e228-e26c-48a5-8400-6b213926a539", "name": "network-vif-deleted", "tag": "a859dd9c-cf59-4a9b-84c9-dddc4e9476c0"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:17.592490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-813c9623-41d3-407c-8009-d07bbb129fb1 req-387734b8-a73b-425f-aeb7-f1de0f8b5e34 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:17.595927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-813c9623-41d3-407c-8009-d07bbb129fb1 req-387734b8-a73b-425f-aeb7-f1de0f8b5e34 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:17.642558 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-813c9623-41d3-407c-8009-d07bbb129fb1 req-387734b8-a73b-425f-aeb7-f1de0f8b5e34 service nova] Creating event network-vif-deleted:a859dd9c-cf59-4a9b-84c9-dddc4e9476c0 for instance 02c9e228-e26c-48a5-8400-6b213926a539 on nch2-master-1 May 07 22:14:17.657886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-813c9623-41d3-407c-8009-d07bbb129fb1 req-387734b8-a73b-425f-aeb7-f1de0f8b5e34 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082794 May 07 22:14:17.671112 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2861/5707] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:14:18.324856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:18.325520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:18.336962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:18.337274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:18.338164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:18.339198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:18.386118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:18.387200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:18.387794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lazy-loading 'fault' on Instance uuid 02c9e228-e26c-48a5-8400-6b213926a539 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:14:18.512723 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e6cebb5024540799cabee75ff002d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b29256ef64d74a5297507ca500a9468e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:18.521520 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8cb09b45-b80b-4742-b794-a598ce106cb8 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 200 len: 1283 microversion: 2.1 time: 0.206171 May 07 22:14:18.526971 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2847/5708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:18 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 1283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:18.595564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:18.597208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:18.605856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:18.606599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:18.608819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:18.609631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:18.938104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:18.957243 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae46ae78-d161-4255-896c-f454d3767532 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1502 microversion: 2.1 time: 0.367123 May 07 22:14:18.958331 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2862/5709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:18 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:18.976170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:18.977320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:18.984928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:18.985753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:18.987186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:18.987779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:19.023822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:14:19.176917 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aeb48110-0f51-4635-9738-e608e7c5b81f tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "DELETE /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 204 len: 0 microversion: 2.1 time: 0.204874 May 07 22:14:19.177531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2848/5710] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:18 2022] DELETE /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:14:19.186011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:19.186641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:19.193673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:19.194121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:19.195152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:19.195802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:19.450753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:19.459055 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-78184ea3-9937-4e61-bac1-09b33f503150 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1508 microversion: 2.1 time: 0.276922 May 07 22:14:19.461985 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2863/5711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:19 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:19.557049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:19.559909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] [instance: 02c9e228-e26c-48a5-8400-6b213926a539] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:19.572563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:19.573389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:19.574525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:19.575253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:19.594293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] HTTP exception thrown: Instance 02c9e228-e26c-48a5-8400-6b213926a539 could not be found. May 07 22:14:19.595532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] Returning 404 to user: Instance 02c9e228-e26c-48a5-8400-6b213926a539 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:19.597310 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-79491e46-0100-41c8-8877-7358ef3dc325 tempest-ServersTestJSON-836128070 tempest-ServersTestJSON-836128070-project] 10.222.0.32 "GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539" status: 404 len: 111 microversion: 2.1 time: 0.056458 May 07 22:14:19.599951 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2849/5712] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:19 2022] GET /compute/v2.1/servers/02c9e228-e26c-48a5-8400-6b213926a539 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:20.478422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:20.479646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:20.489856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:20.492686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:20.495132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:20.495976 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:20.948169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:20.963718 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-618b1726-374b-4c98-bf0c-684a9a703459 tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1508 microversion: 2.1 time: 0.488929 May 07 22:14:20.973405 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2864/5713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:20 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1508 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:21.981789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:21.984556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:22.004727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:22.008433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:22.010598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:22.012484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:22.320572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:22.332062 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e65eebe-a397-4857-af70-de644e5e73ff tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1508 microversion: 2.1 time: 0.355565 May 07 22:14:22.335239 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2850/5714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:21 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:22.995750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6780d18f-bd5f-4abd-b007-43a43ff6fb3e req-876a681a-e2dc-4606-aee0-77bc91cafafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164426a0-c59d-477b-9c73-bd9b5d17842f", "name": "network-vif-deleted", "tag": "d7900d83-4563-4b12-ac82-d89aa7319b93"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:23.050612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6780d18f-bd5f-4abd-b007-43a43ff6fb3e req-876a681a-e2dc-4606-aee0-77bc91cafafc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:23.056252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6780d18f-bd5f-4abd-b007-43a43ff6fb3e req-876a681a-e2dc-4606-aee0-77bc91cafafc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:23.087468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6780d18f-bd5f-4abd-b007-43a43ff6fb3e req-876a681a-e2dc-4606-aee0-77bc91cafafc service nova] Creating event network-vif-deleted:d7900d83-4563-4b12-ac82-d89aa7319b93 for instance 164426a0-c59d-477b-9c73-bd9b5d17842f on nch1-master-1 May 07 22:14:23.102209 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6780d18f-bd5f-4abd-b007-43a43ff6fb3e req-876a681a-e2dc-4606-aee0-77bc91cafafc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110609 May 07 22:14:23.102999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2865/5715] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:23.349776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:23.350512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:23.380149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:23.380971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:23.385231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:23.386932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:23.504115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:23.505020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:23.505834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lazy-loading 'fault' on Instance uuid 164426a0-c59d-477b-9c73-bd9b5d17842f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:14:23.665483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29e307a46c4444cbe01dbeb1ebbed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c642a488de414517ac98cee7e2cc2406', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:23.693399 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cd43d991-d68b-422d-a910-c54a2654c30a tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 200 len: 1305 microversion: 2.1 time: 0.348442 May 07 22:14:23.722352 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2851/5716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:23 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 1305 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:14:24.731907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:24.742471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] [instance: 164426a0-c59d-477b-9c73-bd9b5d17842f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:24.767429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:24.771318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:24.774274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:24.776681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:24.818274 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] HTTP exception thrown: Instance 164426a0-c59d-477b-9c73-bd9b5d17842f could not be found. May 07 22:14:24.819267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] Returning 404 to user: Instance 164426a0-c59d-477b-9c73-bd9b5d17842f could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:24.820859 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5e65f5c3-f178-4bb2-b17a-7eeb00fa9adc tempest-TestServerAdvancedOps-129343738 tempest-TestServerAdvancedOps-129343738-project] 10.222.0.32 "GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f" status: 404 len: 111 microversion: 2.1 time: 0.095158 May 07 22:14:24.824412 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2866/5717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:24 2022] GET /compute/v2.1/servers/164426a0-c59d-477b-9c73-bd9b5d17842f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:25.401100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a0d86b87-af35-4815-b721-2999413f943b tempest-ComputeTenantNetworksTest-91730105 tempest-ComputeTenantNetworksTest-91730105-project] Calling method '.version_select at 0x7fc41cc185e0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:26.711188 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a0d86b87-af35-4815-b721-2999413f943b tempest-ComputeTenantNetworksTest-91730105 tempest-ComputeTenantNetworksTest-91730105-project] 10.222.0.32 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.607289 May 07 22:14:26.712015 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2852/5718] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 22:14:25 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:26.721563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc28a16f-0290-4b71-bb6f-2ba093040497 tempest-ComputeTenantNetworksTest-91730105 tempest-ComputeTenantNetworksTest-91730105-project] Calling method '.version_select at 0x7fc41cd915e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:26.878208 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc28a16f-0290-4b71-bb6f-2ba093040497 tempest-ComputeTenantNetworksTest-91730105 tempest-ComputeTenantNetworksTest-91730105-project] 10.222.0.32 "GET /compute/v2.1/os-tenant-networks/0d53b847-10e2-47e1-862d-fa8e405472ff" status: 200 len: 139 microversion: 2.1 time: 0.159631 May 07 22:14:26.879673 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2867/5719] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 22:14:26 2022] GET /compute/v2.1/os-tenant-networks/0d53b847-10e2-47e1-862d-fa8e405472ff => generated 139 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:29.134263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:29.135343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:29.152289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:29.157692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:29.159944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:29.160398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:29.252592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:14:29.485408 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-98bad389-d868-40ac-89b6-9e41b66a9ff3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 204 len: 0 microversion: 2.1 time: 0.357090 May 07 22:14:29.490856 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2853/5720] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:29 2022] DELETE /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:14:29.504305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:29.505775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:29.521140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:29.521607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:29.526149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:29.538938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:29.850592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:29.863604 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f6b40b5c-97ed-4fe1-9da5-755de0965891 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1409 microversion: 2.1 time: 0.363774 May 07 22:14:29.864552 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2868/5721] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:29 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1409 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:30.887338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:30.891060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:30.909802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:30.913071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:30.914182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:30.916832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:31.088984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-283e5720-0cd1-432d-bd96-2593e3be1f1d tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Action: 'create', calling method: .version_select at 0x7fc41cc19ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-955329550"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:31.244700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:31.259508 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b76ec271-2091-4d86-807c-bb9c8e52ff51 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1409 microversion: 2.1 time: 0.381087 May 07 22:14:31.260682 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2869/5722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:30 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1409 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:31.761608 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-283e5720-0cd1-432d-bd96-2593e3be1f1d tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 1.197505 May 07 22:14:31.763165 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2854/5723] 10.222.0.32 () {60 vars in 1154 bytes} [Sat May 7 22:14:30 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 1200 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 07 22:14:31.774501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c54cb5c-1a6d-4701-9db6-62afc1cf661d tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc4224f0790>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:31.874505 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c54cb5c-1a6d-4701-9db6-62afc1cf661d tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc" status: 200 len: 337 microversion: 2.1 time: 0.104103 May 07 22:14:31.875612 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2870/5724] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:14:31 2022] GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc => generated 337 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:32.281901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:32.283232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:32.303010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:32.305106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:32.307179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:32.349368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:32.889489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a117bc62-1d43-48c7-9912-eade65b7fe03 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41d091dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:32.956369 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a117bc62-1d43-48c7-9912-eade65b7fe03 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc" status: 200 len: 338 microversion: 2.1 time: 0.072517 May 07 22:14:32.958824 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2871/5725] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:14:32 2022] GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc => generated 338 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:14:32.972950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ceca9557-0bab-4b8b-922e-64c1d96b547f tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Action: 'create', calling method: .version_select at 0x7fc4224cc040>, body: {"snapshot": {"volume_id": "24243580-a0f2-4edd-84d9-cb81af63f8bc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-193929636"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:33.173056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:33.184268 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97d2970a-92f5-4af0-a5b2-5a193cb139ba tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1409 microversion: 2.1 time: 0.909141 May 07 22:14:33.201296 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2855/5726] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:32 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1409 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:33.269720 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ceca9557-0bab-4b8b-922e-64c1d96b547f tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.304704 May 07 22:14:33.271306 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2872/5727] 10.222.0.32 () {60 vars in 1161 bytes} [Sat May 7 22:14:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:33.304442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3db78605-5687-47a3-bd90-4a7fe3bb57b2 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41cbb6af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:33.353018 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3db78605-5687-47a3-bd90-4a7fe3bb57b2 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 200 len: 286 microversion: 2.1 time: 0.076078 May 07 22:14:33.355284 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2856/5728] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:33 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:33.365673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f35fb097-c4e3-4307-81fd-46c2179e1897 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41d0910d0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:33.440788 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f35fb097-c4e3-4307-81fd-46c2179e1897 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.080267 May 07 22:14:33.441718 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2873/5729] 10.222.0.32 () {58 vars in 1139 bytes} [Sat May 7 22:14:33 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:33.461761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd209fe2-249d-41e6-bf2f-ec956e85aa55 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41cc301f0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:33.518341 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd209fe2-249d-41e6-bf2f-ec956e85aa55 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 200 len: 286 microversion: 2.1 time: 0.069108 May 07 22:14:33.522548 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2857/5730] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:33 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:34.206042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:34.209510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:34.219980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:34.221163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:34.222312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:34.223008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:34.320139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:34.338116 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c30e78dd-87d6-4f66-a645-57ce7ac2ab41 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1367 microversion: 2.1 time: 0.137989 May 07 22:14:34.338740 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2874/5731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:34 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1367 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:34.562986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-da823b74-a0f0-4f54-b3bd-88cc562c5774 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41cbb9280>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:34.595012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b368cf5f-ff2e-4045-ab4e-293661ebd75f req-967c3422-a451-4337-a790-156937182fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb197fc1-0207-498b-9fe9-b21826687a56", "name": "network-vif-deleted", "tag": "b2b93741-196b-4634-b3a8-cacfa39e6497"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:34.618034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b368cf5f-ff2e-4045-ab4e-293661ebd75f req-967c3422-a451-4337-a790-156937182fe2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:34.618610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b368cf5f-ff2e-4045-ab4e-293661ebd75f req-967c3422-a451-4337-a790-156937182fe2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:34.630122 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-da823b74-a0f0-4f54-b3bd-88cc562c5774 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 200 len: 286 microversion: 2.1 time: 0.098776 May 07 22:14:34.630708 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2858/5732] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:34 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:34.675173 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b368cf5f-ff2e-4045-ab4e-293661ebd75f req-967c3422-a451-4337-a790-156937182fe2 service nova] Creating event network-vif-deleted:b2b93741-196b-4634-b3a8-cacfa39e6497 for instance bb197fc1-0207-498b-9fe9-b21826687a56 on nch2-master-1 May 07 22:14:34.692844 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b368cf5f-ff2e-4045-ab4e-293661ebd75f req-967c3422-a451-4337-a790-156937182fe2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107728 May 07 22:14:34.705578 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2875/5733] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:14:35.357505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:35.359101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:35.380342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:35.381072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:35.403653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:35.405788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:35.548567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:35.549426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:35.550624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lazy-loading 'fault' on Instance uuid bb197fc1-0207-498b-9fe9-b21826687a56 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:14:35.644359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d272f5d3-51a4-45ce-abb0-52caed150f9f tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41fd03670>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:35.747476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d272f5d3-51a4-45ce-abb0-52caed150f9f tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 200 len: 287 microversion: 2.1 time: 0.106810 May 07 22:14:35.750037 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2876/5734] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:35 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:35.774213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b202fb9-b6c4-4f2f-894b-8a7c14810bfd tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc4224cc940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:35.920306 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b202fb9-b6c4-4f2f-894b-8a7c14810bfd tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 202 len: 0 microversion: 2.1 time: 0.163423 May 07 22:14:35.921435 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2877/5735] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 22:14:35 2022] DELETE /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:14:35.931646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9350ee1c-c5b2-40f6-90ab-4b624115dc7a tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41f360af0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:35.958070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:35.975913 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-47a0beac-809f-4d9d-85a7-3a949e0a11dc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 200 len: 1160 microversion: 2.1 time: 0.624298 May 07 22:14:35.976752 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2859/5736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:35 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 1160 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:36.005252 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9350ee1c-c5b2-40f6-90ab-4b624115dc7a tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 200 len: 286 microversion: 2.1 time: 0.079162 May 07 22:14:36.009678 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2878/5737] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:35 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:36.995884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:36.997501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:37.020791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de4b7f71-501f-4a7b-b204-2e24036ab7ec tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41fd03700>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:37.024691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:37.031005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:37.036008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:37.038966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:37.109301 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de4b7f71-501f-4a7b-b204-2e24036ab7ec tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 200 len: 286 microversion: 2.1 time: 0.094764 May 07 22:14:37.113526 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2879/5738] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:37 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:37.117671 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance bb197fc1-0207-498b-9fe9-b21826687a56 could not be found. May 07 22:14:37.118858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance bb197fc1-0207-498b-9fe9-b21826687a56 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:37.120114 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63e69c27-2d81-4532-9602-1c029093c7c4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 404 len: 111 microversion: 2.1 time: 0.129887 May 07 22:14:37.125168 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2860/5739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:36 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:38.131380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4af10441-19f1-4112-94e4-8989921a6b6e tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41c584dc0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:38.201182 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4af10441-19f1-4112-94e4-8989921a6b6e tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 200 len: 286 microversion: 2.1 time: 0.083670 May 07 22:14:38.201833 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2880/5740] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:38 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:38.293633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:38.294171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:38.315963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:38.316935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:38.318003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:38.319212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:38.373564 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd could not be found. May 07 22:14:38.375569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:38.376890 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-358f538a-0455-43a0-8ff1-85ecf6531ea7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 404 len: 111 microversion: 2.1 time: 0.088467 May 07 22:14:38.378308 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2861/5741] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:38 2022] DELETE /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:38.390810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:38.391683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 95d382c3-52c5-4312-a2a5-47fdfc1625fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:38.404906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:38.410371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:38.411755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:38.414868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:38.438630 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd could not be found. May 07 22:14:38.439525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 95d382c3-52c5-4312-a2a5-47fdfc1625fd could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:38.440921 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d222ac05-736f-4fd7-9009-67c5116e62f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd" status: 404 len: 111 microversion: 2.1 time: 0.057420 May 07 22:14:38.441850 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2881/5742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:38 2022] GET /compute/v2.1/servers/95d382c3-52c5-4312-a2a5-47fdfc1625fd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:39.219031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d1b703d-fa15-4187-838f-45994b9390fa tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc40fb8aa60>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:39.272766 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-3d1b703d-fa15-4187-838f-45994b9390fa tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] HTTP exception thrown: Snapshot f313a77d-76d6-4a34-aef5-1f9e36c21cd9 could not be found. May 07 22:14:39.273586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3d1b703d-fa15-4187-838f-45994b9390fa tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Returning 404 to user: Snapshot f313a77d-76d6-4a34-aef5-1f9e36c21cd9 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:39.274763 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3d1b703d-fa15-4187-838f-45994b9390fa tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9" status: 404 len: 111 microversion: 2.1 time: 0.065029 May 07 22:14:39.275996 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2862/5743] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:39 2022] GET /compute/v2.1/os-snapshots/f313a77d-76d6-4a34-aef5-1f9e36c21cd9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:39.284970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2fc1c36-09f5-4575-920c-d44805586def tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc4224ccca0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:39.420295 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2fc1c36-09f5-4575-920c-d44805586def tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc" status: 202 len: 0 microversion: 2.1 time: 0.140339 May 07 22:14:39.420938 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2882/5744] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:39 2022] DELETE /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:14:39.431614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-533c4974-3131-4553-b4e7-9fcd0487c2ba tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41ca6bf70>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:39.540779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:39.541562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:39.555490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:39.557284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:39.559044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:39.560434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:39.593636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance bb197fc1-0207-498b-9fe9-b21826687a56 could not be found. May 07 22:14:39.594321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance bb197fc1-0207-498b-9fe9-b21826687a56 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:39.594726 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-533c4974-3131-4553-b4e7-9fcd0487c2ba tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc" status: 200 len: 337 microversion: 2.1 time: 0.169101 May 07 22:14:39.595333 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2863/5745] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:14:39 2022] GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc => generated 337 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:39.595469 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0e3d450-465e-4f0e-89b1-342c260ece43 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 404 len: 111 microversion: 2.1 time: 0.059968 May 07 22:14:39.595895 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2883/5746] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:39 2022] DELETE /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:39.609790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:39.610683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: bb197fc1-0207-498b-9fe9-b21826687a56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:39.619850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:39.625365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:39.626607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:39.627973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:39.655392 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance bb197fc1-0207-498b-9fe9-b21826687a56 could not be found. May 07 22:14:39.664983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance bb197fc1-0207-498b-9fe9-b21826687a56 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:39.667611 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3f30f8c-821a-44df-a094-8b07eda9c53e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56" status: 404 len: 111 microversion: 2.1 time: 0.062385 May 07 22:14:39.672845 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2864/5747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:39 2022] GET /compute/v2.1/servers/bb197fc1-0207-498b-9fe9-b21826687a56 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:39.761508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5d96b462-b03c-4775-b655-1ab409cf5c67 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'create', calling method: .version_select at 0x7fc4224ccd30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-419159820"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:39.817790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-5d96b462-b03c-4775-b655-1ab409cf5c67 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:14:39.835620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-5d96b462-b03c-4775-b655-1ab409cf5c67 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:14:40.178903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-5d96b462-b03c-4775-b655-1ab409cf5c67 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:14:40.219463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-5d96b462-b03c-4775-b655-1ab409cf5c67 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:14:40.259357 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5d96b462-b03c-4775-b655-1ab409cf5c67 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.503014 May 07 22:14:40.265436 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2884/5748] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:14:39 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:40.607777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7ab49d30-8e48-4115-b40c-d437de303f58 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41cc03dc0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:40.667698 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7ab49d30-8e48-4115-b40c-d437de303f58 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] HTTP exception thrown: Volume 24243580-a0f2-4edd-84d9-cb81af63f8bc could not be found. May 07 22:14:40.668391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7ab49d30-8e48-4115-b40c-d437de303f58 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Returning 404 to user: Volume 24243580-a0f2-4edd-84d9-cb81af63f8bc could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:40.669319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7ab49d30-8e48-4115-b40c-d437de303f58 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc" status: 404 len: 109 microversion: 2.1 time: 0.065681 May 07 22:14:40.670443 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2865/5749] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:14:40 2022] GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:40.682313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2aa4494-f803-49e9-8328-76794d646f40 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc4226235e0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:40.715621 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a2aa4494-f803-49e9-8328-76794d646f40 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] HTTP exception thrown: Volume 24243580-a0f2-4edd-84d9-cb81af63f8bc could not be found. May 07 22:14:40.716533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2aa4494-f803-49e9-8328-76794d646f40 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Returning 404 to user: Volume 24243580-a0f2-4edd-84d9-cb81af63f8bc could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:40.718149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2aa4494-f803-49e9-8328-76794d646f40 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc" status: 404 len: 109 microversion: 2.1 time: 0.040306 May 07 22:14:40.719282 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2885/5750] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:40 2022] DELETE /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:14:40.730917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40361f1b-19f3-4d18-90cb-23123ac81610 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Calling method '.version_select at 0x7fc41cc038b0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:40.809673 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-40361f1b-19f3-4d18-90cb-23123ac81610 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] HTTP exception thrown: Volume 24243580-a0f2-4edd-84d9-cb81af63f8bc could not be found. May 07 22:14:40.812257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40361f1b-19f3-4d18-90cb-23123ac81610 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] Returning 404 to user: Volume 24243580-a0f2-4edd-84d9-cb81af63f8bc could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:14:40.814425 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-40361f1b-19f3-4d18-90cb-23123ac81610 tempest-VolumesSnapshotsTestJSON-1598825046 tempest-VolumesSnapshotsTestJSON-1598825046-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc" status: 404 len: 109 microversion: 2.1 time: 0.091364 May 07 22:14:40.816076 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2866/5751] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:14:40 2022] GET /compute/v2.1/os-volumes/24243580-a0f2-4edd-84d9-cb81af63f8bc => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:14:42.024294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67330378-1bc0-4f3f-a320-2dd0f4beb86c tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-442757980", "availability_zone": "foo_zone"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:42.029098 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:42.029098 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:14:42.031106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.aggregate [None req-67330378-1bc0-4f3f-a320-2dd0f4beb86c tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Generated uuid 7b6f54cd-896c-4e5f-adb0-204ec6468b69 for aggregate {{(pid=136682) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 07 22:14:42.087454 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67330378-1bc0-4f3f-a320-2dd0f4beb86c tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.807144 May 07 22:14:42.088356 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2886/5752] 10.222.0.32 () {60 vars in 1163 bytes} [Sat May 7 22:14:41 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:42.100124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f821f66f-5c63-4ac3-86b2-72819d859c43 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:42.101582 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:42.101582 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 22:14:42.127597 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f821f66f-5c63-4ac3-86b2-72819d859c43 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] [5ac2e258-af1e-4664-82a5-cf6fe78bc0af] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:14:43.136988 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [None req-f821f66f-5c63-4ac3-86b2-72819d859c43 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] [5ac2e258-af1e-4664-82a5-cf6fe78bc0af] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 51448. May 07 22:14:43.180779 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f821f66f-5c63-4ac3-86b2-72819d859c43 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.085869 May 07 22:14:43.181585 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2867/5753] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 22:14:42 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:43.230873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-321693b6-eeaf-40c2-b4d9-63baf9f27155 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:43.233745 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:43.233745 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:14:43.235800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-321693b6-eeaf-40c2-b4d9-63baf9f27155 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:43.236227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-321693b6-eeaf-40c2-b4d9-63baf9f27155 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:43.237074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-321693b6-eeaf-40c2-b4d9-63baf9f27155 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:43.237671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-321693b6-eeaf-40c2-b4d9-63baf9f27155 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:43.320419 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-321693b6-eeaf-40c2-b4d9-63baf9f27155 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.129974 May 07 22:14:43.328952 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2887/5754] 10.222.0.32 () {58 vars in 1175 bytes} [Sat May 7 22:14:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:43.332716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d6113fbf-f872-4c0c-9774-cdd5e796bc35 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:43.333736 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:43.333736 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 22:14:43.349682 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d6113fbf-f872-4c0c-9774-cdd5e796bc35 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.020455 May 07 22:14:43.350308 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2868/5755] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 22:14:43 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:14:43.369632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09fec060-e421-4d89-9de1-38b013830302 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:43.370979 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:43.370979 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:14:43.390703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09fec060-e421-4d89-9de1-38b013830302 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:43.391323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09fec060-e421-4d89-9de1-38b013830302 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:44.214562 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09fec060-e421-4d89-9de1-38b013830302 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.842830 May 07 22:14:44.216702 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2888/5756] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 22:14:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:44.228308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aa1f5668-36ca-4007-8e49-de7654284558 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:44.230258 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:44.230258 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 22:14:44.249866 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aa1f5668-36ca-4007-8e49-de7654284558 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.026018 May 07 22:14:44.256376 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2869/5757] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 22:14:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:44.268259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-30a86944-f952-44b0-a7d2-c7211d0188c2 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-558218679", "availability_zone": "foo_zone"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:44.277545 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:44.277545 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:14:44.386615 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-30a86944-f952-44b0-a7d2-c7211d0188c2 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.122612 May 07 22:14:44.388486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2889/5758] 10.222.0.32 () {60 vars in 1172 bytes} [Sat May 7 22:14:44 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:44.402029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-601c9e14-c1a9-4d9d-9242-c3cca4a16e16 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:44.403633 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:44.403633 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 22:14:44.472515 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-601c9e14-c1a9-4d9d-9242-c3cca4a16e16 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.076426 May 07 22:14:44.477840 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2870/5759] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 22:14:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:44.487379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-19a6e1eb-dd28-46f2-97bf-dd16d65e87d2 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:44.488374 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:44.488374 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:14:44.512899 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-19a6e1eb-dd28-46f2-97bf-dd16d65e87d2 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.031510 May 07 22:14:44.532189 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2890/5760] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 22:14:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:44.552858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8de4ca35-c159-43ac-9001-8f75d7d58c82 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:44.556200 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:44.556200 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 22:14:44.570802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8de4ca35-c159-43ac-9001-8f75d7d58c82 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:44.581090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8de4ca35-c159-43ac-9001-8f75d7d58c82 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:45.245143 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8de4ca35-c159-43ac-9001-8f75d7d58c82 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.706194 May 07 22:14:45.247172 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2871/5761] 10.222.0.32 () {60 vars in 1193 bytes} [Sat May 7 22:14:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:14:45.260881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9d8eea8a-fec9-4913-baef-863778409d25 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:45.261958 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:45.261958 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:14:45.320842 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9d8eea8a-fec9-4913-baef-863778409d25 tempest-TestAggregatesBasicOps-1832578791 tempest-TestAggregatesBasicOps-1832578791-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.065963 May 07 22:14:45.322592 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2891/5762] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 22:14:45 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 07 22:14:49.739867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1349196866", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-419159820", "security_groups": [{"name": "tempest-secgroup-smoke-1983604752"}], "block_device_mapping_v2": [{"uuid": "d5293072-2a82-483d-ad24-437bd38b3be7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:14:50.039228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] validate_networks() for [('87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:14:52.997341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:14:52.997902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:14:52.999177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:14:53.000287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:14:53.001468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:14:53.029243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:53.038363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:53.040885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:53.047294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:53.104312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:14:53.133765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:14:53.314091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:14:53.316576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5293072-2a82-483d-ad24-437bd38b3be7',volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:14:53.742640 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5aaa12c0-1e5f-4ab8-9fce-e56c0d193272 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.015951 May 07 22:14:53.746481 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2872/5763] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:14:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 4021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:14:53.763691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e090436c-97a0-46de-b4b4-aa255e0ce180 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:53.768812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e090436c-97a0-46de-b4b4-aa255e0ce180 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:53.986449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e090436c-97a0-46de-b4b4-aa255e0ce180 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:54.001082 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e090436c-97a0-46de-b4b4-aa255e0ce180 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1094 microversion: 2.1 time: 0.247566 May 07 22:14:54.002862 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2892/5764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:53 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1094 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:55.021592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:55.022404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:55.038202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:55.038644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:55.043168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:55.043649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:55.338961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:55.352563 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-788c58d9-eef6-4b30-b64e-d339dfd4019b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1192 microversion: 2.1 time: 0.335970 May 07 22:14:55.364071 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2873/5765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:55 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1192 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:56.369649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:56.370856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:56.382384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:56.382678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:56.388014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:56.389483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:57.888472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:14:57.897482 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-35add4c4-1829-4e1c-b35b-c5b21e88c3e0 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1210 microversion: 2.1 time: 1.531622 May 07 22:14:57.898085 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2893/5766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:56 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1210 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:14:58.916159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:14:58.917646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:14:58.929589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:58.933960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:14:58.935109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:14:58.936471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:00.083683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:00.129206 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2e04d71f-e153-4fc4-92be-6f3705810181 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1198 microversion: 2.1 time: 1.197295 May 07 22:15:00.130143 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2874/5767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:58 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1198 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:01.013562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c868e6d-a455-4560-bc61-041fc2cf73ba tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:01.015616 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:15:01.015616 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:15:01.017905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c868e6d-a455-4560-bc61-041fc2cf73ba tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:01.019087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c868e6d-a455-4560-bc61-041fc2cf73ba tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:01.021186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c868e6d-a455-4560-bc61-041fc2cf73ba tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:01.021840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c868e6d-a455-4560-bc61-041fc2cf73ba tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:01.084432 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c868e6d-a455-4560-bc61-041fc2cf73ba tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.351531 May 07 22:15:01.098024 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2894/5768] 10.222.0.32 () {58 vars in 1184 bytes} [Sat May 7 22:15:00 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:01.147310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:01.148828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:01.156656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:01.157371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:01.158197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:01.158659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:01.324203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1806208018", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "70fd104c-7c86-4065-a52d-06f0c8cd30c4"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:01.460248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] validate_networks() for [('70fd104c-7c86-4065-a52d-06f0c8cd30c4', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:15:01.830271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:01.854309 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88e012a4-15e3-4c59-8371-f0cf1799fd4e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1266 microversion: 2.1 time: 0.710907 May 07 22:15:01.860413 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2875/5769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:01 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1266 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:02.229796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ef9dd4ae-e482-43c2-b79a-15241b7150da req-bbbbb06f-9201-4dcc-9071-ee9f13355950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0b5de-f6ce-4056-b170-f80b05559ef2", "tag": "1b64f639-6c53-4e70-9bf6-32f27e15becc"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:02.262347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ef9dd4ae-e482-43c2-b79a-15241b7150da req-bbbbb06f-9201-4dcc-9071-ee9f13355950 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:02.263012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ef9dd4ae-e482-43c2-b79a-15241b7150da req-bbbbb06f-9201-4dcc-9071-ee9f13355950 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:02.281530 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ef9dd4ae-e482-43c2-b79a-15241b7150da req-bbbbb06f-9201-4dcc-9071-ee9f13355950 service nova] Creating event network-changed:1b64f639-6c53-4e70-9bf6-32f27e15becc for instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 on nch1-master-1 May 07 22:15:02.288973 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ef9dd4ae-e482-43c2-b79a-15241b7150da req-bbbbb06f-9201-4dcc-9071-ee9f13355950 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067474 May 07 22:15:02.290384 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2876/5770] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:02.882922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:02.883968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:02.905809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:02.912015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:02.918734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:02.923192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:03.115388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:15:03.117108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:15:03.118256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:15:03.129084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:15:03.129977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:15:03.150118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:03.151390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:03.164701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:03.166155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:03.257251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Getting quotas for project 7258ee48454a4985a79b7f26d184493f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:15:03.268630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Getting quotas for user 8cddd0e679bc49369c57f5679f8226ee and project 7258ee48454a4985a79b7f26d184493f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:15:03.299856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:15:03.303026 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:15:03.394462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:03.406279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-267c73e8-994e-49d8-9f77-3bd44616db8e tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1266 microversion: 2.1 time: 0.538016 May 07 22:15:03.413206 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2877/5771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:02 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1266 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:03.421974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-238343cc-8ae9-4485-8eec-8b3ab294b91c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107489 May 07 22:15:03.426744 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2895/5772] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:15:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:15:03.439830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ff92384-3901-4ee6-9fde-545e1041a742 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:03.440871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ff92384-3901-4ee6-9fde-545e1041a742 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:03.697368 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ff92384-3901-4ee6-9fde-545e1041a742 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1329 microversion: 2.1 time: 0.263877 May 07 22:15:03.700600 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2878/5773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:03 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1329 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:04.430940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:04.432831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:04.441654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:04.444473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:04.445846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:04.448165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:04.720706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-851f0dfe-cb3f-4200-aaa2-c011bf800d15 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:04.721980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-851f0dfe-cb3f-4200-aaa2-c011bf800d15 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:04.755114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-851f0dfe-cb3f-4200-aaa2-c011bf800d15 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:04.755631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-851f0dfe-cb3f-4200-aaa2-c011bf800d15 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:04.756796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-851f0dfe-cb3f-4200-aaa2-c011bf800d15 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:04.760155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-851f0dfe-cb3f-4200-aaa2-c011bf800d15 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:04.855289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:04.864398 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a7eaea05-dcd8-4ab5-b3f6-bd566218ae8d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1266 microversion: 2.1 time: 0.437921 May 07 22:15:04.864502 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2896/5774] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:04 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:05.088752 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-851f0dfe-cb3f-4200-aaa2-c011bf800d15 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1416 microversion: 2.1 time: 0.373626 May 07 22:15:05.089383 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2879/5775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:04 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1416 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:15:05.881802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:05.882932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:05.897221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:05.897694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:05.898503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:05.899188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:06.108859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c59ec5a2-a788-4d80-b398-f8ecdde42839 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:06.109808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c59ec5a2-a788-4d80-b398-f8ecdde42839 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:06.124977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c59ec5a2-a788-4d80-b398-f8ecdde42839 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:06.127243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c59ec5a2-a788-4d80-b398-f8ecdde42839 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:06.130344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c59ec5a2-a788-4d80-b398-f8ecdde42839 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:06.132320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c59ec5a2-a788-4d80-b398-f8ecdde42839 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:06.286147 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c59ec5a2-a788-4d80-b398-f8ecdde42839 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1422 microversion: 2.1 time: 0.181572 May 07 22:15:06.289132 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2880/5776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:06 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1422 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:07.124660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:07.140171 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea5d8dcd-d298-4dac-92b8-e75f08e7c457 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1266 microversion: 2.1 time: 1.259197 May 07 22:15:07.165500 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2897/5777] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:05 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1266 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:07.306411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a96932c2-a858-415a-be5e-6f5c7dce45ff tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:07.307775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a96932c2-a858-415a-be5e-6f5c7dce45ff tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:07.324938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a96932c2-a858-415a-be5e-6f5c7dce45ff tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:07.325399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a96932c2-a858-415a-be5e-6f5c7dce45ff tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:07.329435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a96932c2-a858-415a-be5e-6f5c7dce45ff tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:07.332272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a96932c2-a858-415a-be5e-6f5c7dce45ff tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:07.448176 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a96932c2-a858-415a-be5e-6f5c7dce45ff tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1422 microversion: 2.1 time: 0.145695 May 07 22:15:07.450413 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2881/5778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:07 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1422 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:08.189286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:08.189973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:08.238733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:08.239367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:08.244847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:08.247698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:08.473157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-945b4ce0-2e99-48e9-954c-01a62057f470 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:08.473809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-945b4ce0-2e99-48e9-954c-01a62057f470 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:08.493630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-945b4ce0-2e99-48e9-954c-01a62057f470 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:08.494108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-945b4ce0-2e99-48e9-954c-01a62057f470 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:08.494944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-945b4ce0-2e99-48e9-954c-01a62057f470 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:08.495407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-945b4ce0-2e99-48e9-954c-01a62057f470 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:08.859894 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-945b4ce0-2e99-48e9-954c-01a62057f470 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1464 microversion: 2.1 time: 0.395848 May 07 22:15:08.871539 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2882/5779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:08 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1464 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:09.020665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:09.029105 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc5ade42-722c-4503-ab7e-d2142f424c8c tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1266 microversion: 2.1 time: 0.850230 May 07 22:15:09.032041 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2898/5780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:08 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1266 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:09.879128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f48412dc-0a27-4f68-bf18-03fab6841452 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:09.880226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f48412dc-0a27-4f68-bf18-03fab6841452 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:09.889639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f48412dc-0a27-4f68-bf18-03fab6841452 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:09.890309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f48412dc-0a27-4f68-bf18-03fab6841452 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:09.892659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f48412dc-0a27-4f68-bf18-03fab6841452 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:09.893142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f48412dc-0a27-4f68-bf18-03fab6841452 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:09.992610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a43869bb-b51c-4dfe-854e-6d6ff8d85099 req-c65f0ea6-d8d4-49d5-b5f5-ee947a543fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "434474d3-686a-4f99-99bb-17e74f258a84", "tag": "7973ea98-3ae5-4cd7-9d25-d975a8a79190"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:10.017275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a43869bb-b51c-4dfe-854e-6d6ff8d85099 req-c65f0ea6-d8d4-49d5-b5f5-ee947a543fe7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:10.027186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a43869bb-b51c-4dfe-854e-6d6ff8d85099 req-c65f0ea6-d8d4-49d5-b5f5-ee947a543fe7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:10.050805 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a43869bb-b51c-4dfe-854e-6d6ff8d85099 req-c65f0ea6-d8d4-49d5-b5f5-ee947a543fe7 service nova] Creating event network-changed:7973ea98-3ae5-4cd7-9d25-d975a8a79190 for instance 434474d3-686a-4f99-99bb-17e74f258a84 on nch1-master-1 May 07 22:15:10.056206 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a43869bb-b51c-4dfe-854e-6d6ff8d85099 req-c65f0ea6-d8d4-49d5-b5f5-ee947a543fe7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068304 May 07 22:15:10.057396 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2899/5781] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:10.063915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:10.065054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:10.072496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:10.073231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:10.074239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:10.075517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:10.162679 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f48412dc-0a27-4f68-bf18-03fab6841452 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1464 microversion: 2.1 time: 0.282483 May 07 22:15:10.163947 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2883/5782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:09 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1464 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:10.398601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:10.411309 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ece64b79-bec8-4db3-b3e2-4e369ec84337 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1266 microversion: 2.1 time: 0.351520 May 07 22:15:10.411948 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2900/5783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:10 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:11.180224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0a9a8f67-c29b-4535-be2c-028196f2f5b5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:11.181015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0a9a8f67-c29b-4535-be2c-028196f2f5b5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:11.193774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a9a8f67-c29b-4535-be2c-028196f2f5b5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:11.194963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a9a8f67-c29b-4535-be2c-028196f2f5b5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:11.196251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a9a8f67-c29b-4535-be2c-028196f2f5b5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:11.198159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a9a8f67-c29b-4535-be2c-028196f2f5b5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:11.303044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-75635eec-73e6-4d88-be05-9e07c66e580c req-2d8e7b25-413d-4f7c-8807-73ab6c503abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f0b5de-f6ce-4056-b170-f80b05559ef2", "name": "network-vif-plugged", "status": "completed", "tag": "1b64f639-6c53-4e70-9bf6-32f27e15becc"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:11.344049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-75635eec-73e6-4d88-be05-9e07c66e580c req-2d8e7b25-413d-4f7c-8807-73ab6c503abf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:11.346205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-75635eec-73e6-4d88-be05-9e07c66e580c req-2d8e7b25-413d-4f7c-8807-73ab6c503abf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:11.391735 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-75635eec-73e6-4d88-be05-9e07c66e580c req-2d8e7b25-413d-4f7c-8807-73ab6c503abf service nova] Creating event network-vif-plugged:1b64f639-6c53-4e70-9bf6-32f27e15becc for instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 on nch1-master-1 May 07 22:15:11.402471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-75635eec-73e6-4d88-be05-9e07c66e580c req-2d8e7b25-413d-4f7c-8807-73ab6c503abf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108125 May 07 22:15:11.405603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2901/5784] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:15:11.429603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:11.430336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:11.441058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:11.441529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:11.442334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:11.442801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:11.513253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0a9a8f67-c29b-4535-be2c-028196f2f5b5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1464 microversion: 2.1 time: 0.337127 May 07 22:15:11.515178 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2884/5785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:11 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:11.815508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:11.823083 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc5780ba-c88b-4349-afc0-f5433425a806 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1266 microversion: 2.1 time: 0.398172 May 07 22:15:11.823571 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2902/5786] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:11 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:15:12.531273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-305240d0-d535-4342-be3e-1154dc2dcb66 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:12.531911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-305240d0-d535-4342-be3e-1154dc2dcb66 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:12.538627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305240d0-d535-4342-be3e-1154dc2dcb66 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:12.539145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305240d0-d535-4342-be3e-1154dc2dcb66 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:12.540138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305240d0-d535-4342-be3e-1154dc2dcb66 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:12.540704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-305240d0-d535-4342-be3e-1154dc2dcb66 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:12.786715 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-305240d0-d535-4342-be3e-1154dc2dcb66 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1464 microversion: 2.1 time: 0.259792 May 07 22:15:12.787686 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2885/5787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:12 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1464 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:12.839462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:12.842950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:12.850208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:12.850764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:12.851613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:12.852054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:13.043319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:13.053784 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3180074f-d973-4834-b7c8-dc00426f4b34 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1452 microversion: 2.1 time: 0.218128 May 07 22:15:13.054722 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2903/5788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:12 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:13.070810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:13.071469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:13.081701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:13.084679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:13.085520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:13.085979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:13.282818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:13.294165 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-227e7db4-33ca-46ff-bea1-f74d4d78accc tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1452 microversion: 2.1 time: 0.226598 May 07 22:15:13.295763 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2886/5789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:13 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:13.803252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-280263aa-8756-4e2a-9d6a-4bdf70b30350 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:13.804167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-280263aa-8756-4e2a-9d6a-4bdf70b30350 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:13.810339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280263aa-8756-4e2a-9d6a-4bdf70b30350 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:13.810853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280263aa-8756-4e2a-9d6a-4bdf70b30350 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:13.811636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280263aa-8756-4e2a-9d6a-4bdf70b30350 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:13.812123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-280263aa-8756-4e2a-9d6a-4bdf70b30350 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:13.977050 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-280263aa-8756-4e2a-9d6a-4bdf70b30350 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1464 microversion: 2.1 time: 0.177706 May 07 22:15:13.977918 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2904/5790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:13 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:15.005486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1782d352-5668-44f2-8a1a-992cafa02ab4 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:15.009416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1782d352-5668-44f2-8a1a-992cafa02ab4 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:15.030616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1782d352-5668-44f2-8a1a-992cafa02ab4 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:15.031334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1782d352-5668-44f2-8a1a-992cafa02ab4 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:15.041035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1782d352-5668-44f2-8a1a-992cafa02ab4 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:15.041441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1782d352-5668-44f2-8a1a-992cafa02ab4 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:15.273227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8de9a8e8-0086-4911-aeba-4c7d4be3ad9b req-e845e523-8732-4d8d-a9f0-16a1cc1a2013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434474d3-686a-4f99-99bb-17e74f258a84", "name": "network-vif-plugged", "status": "completed", "tag": "7973ea98-3ae5-4cd7-9d25-d975a8a79190"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:15.286703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8de9a8e8-0086-4911-aeba-4c7d4be3ad9b req-e845e523-8732-4d8d-a9f0-16a1cc1a2013 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:15.287528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8de9a8e8-0086-4911-aeba-4c7d4be3ad9b req-e845e523-8732-4d8d-a9f0-16a1cc1a2013 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:15.322238 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8de9a8e8-0086-4911-aeba-4c7d4be3ad9b req-e845e523-8732-4d8d-a9f0-16a1cc1a2013 service nova] Creating event network-vif-plugged:7973ea98-3ae5-4cd7-9d25-d975a8a79190 for instance 434474d3-686a-4f99-99bb-17e74f258a84 on nch1-master-1 May 07 22:15:15.336990 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8de9a8e8-0086-4911-aeba-4c7d4be3ad9b req-e845e523-8732-4d8d-a9f0-16a1cc1a2013 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067817 May 07 22:15:15.338128 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2905/5791] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:15.438497 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1782d352-5668-44f2-8a1a-992cafa02ab4 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1464 microversion: 2.1 time: 0.441791 May 07 22:15:15.441127 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2887/5792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:14 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1464 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:16.456702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b66304b9-7fc6-4c79-9aa6-d5f9142a9fcb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:16.457409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b66304b9-7fc6-4c79-9aa6-d5f9142a9fcb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:16.468441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b66304b9-7fc6-4c79-9aa6-d5f9142a9fcb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:16.468911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b66304b9-7fc6-4c79-9aa6-d5f9142a9fcb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:16.471249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b66304b9-7fc6-4c79-9aa6-d5f9142a9fcb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:16.471706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b66304b9-7fc6-4c79-9aa6-d5f9142a9fcb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:16.627517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-43ec0252-3f76-4287-962e-0670630343e0 req-f792c9b7-591a-4037-b78e-b04389faec37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f0b5de-f6ce-4056-b170-f80b05559ef2", "tag": "1b64f639-6c53-4e70-9bf6-32f27e15becc"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:16.638905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-43ec0252-3f76-4287-962e-0670630343e0 req-f792c9b7-591a-4037-b78e-b04389faec37 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:16.639664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-43ec0252-3f76-4287-962e-0670630343e0 req-f792c9b7-591a-4037-b78e-b04389faec37 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:16.654755 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-43ec0252-3f76-4287-962e-0670630343e0 req-f792c9b7-591a-4037-b78e-b04389faec37 service nova] Creating event network-changed:1b64f639-6c53-4e70-9bf6-32f27e15becc for instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 on nch1-master-1 May 07 22:15:16.673194 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-43ec0252-3f76-4287-962e-0670630343e0 req-f792c9b7-591a-4037-b78e-b04389faec37 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055164 May 07 22:15:16.675004 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2888/5793] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:16.820276 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b66304b9-7fc6-4c79-9aa6-d5f9142a9fcb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1464 microversion: 2.1 time: 0.367646 May 07 22:15:16.825586 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2906/5794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:16 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:17.843201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5db9c26-2aab-4154-8f2e-ea653f2f9cdb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:17.844130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5db9c26-2aab-4154-8f2e-ea653f2f9cdb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:17.852238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5db9c26-2aab-4154-8f2e-ea653f2f9cdb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:17.853985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5db9c26-2aab-4154-8f2e-ea653f2f9cdb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:17.855229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5db9c26-2aab-4154-8f2e-ea653f2f9cdb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:17.855870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5db9c26-2aab-4154-8f2e-ea653f2f9cdb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:18.048386 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5db9c26-2aab-4154-8f2e-ea653f2f9cdb tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1649 microversion: 2.1 time: 0.209761 May 07 22:15:18.061540 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2889/5795] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:17 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1649 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:18.066661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c4bae3f-ef0a-4064-999e-429cab70247d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:18.067237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c4bae3f-ef0a-4064-999e-429cab70247d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:18.074485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c4bae3f-ef0a-4064-999e-429cab70247d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:18.074999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c4bae3f-ef0a-4064-999e-429cab70247d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:18.076098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c4bae3f-ef0a-4064-999e-429cab70247d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:18.076865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c4bae3f-ef0a-4064-999e-429cab70247d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:18.325313 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c4bae3f-ef0a-4064-999e-429cab70247d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1649 microversion: 2.1 time: 0.261278 May 07 22:15:18.325831 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2907/5796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:18 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1649 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:18.342342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e3897272-7941-4205-8354-7954cd76fcf6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:18.343256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e3897272-7941-4205-8354-7954cd76fcf6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:18.353557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3897272-7941-4205-8354-7954cd76fcf6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:18.354684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3897272-7941-4205-8354-7954cd76fcf6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:18.356353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3897272-7941-4205-8354-7954cd76fcf6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:18.357697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3897272-7941-4205-8354-7954cd76fcf6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:18.509972 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e3897272-7941-4205-8354-7954cd76fcf6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1649 microversion: 2.1 time: 0.172562 May 07 22:15:18.510573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2890/5797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:18 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1649 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:18.666897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1861122833", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "70fd104c-7c86-4065-a52d-06f0c8cd30c4"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:18.734324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] validate_networks() for [('70fd104c-7c86-4065-a52d-06f0c8cd30c4', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:15:19.595059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:15:19.596226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:15:19.596861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:15:19.597669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:15:19.598239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:15:19.608563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:19.609233 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:19.610031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:19.610471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:19.628212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Getting quotas for project 7258ee48454a4985a79b7f26d184493f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:15:19.633538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Getting quotas for user 8cddd0e679bc49369c57f5679f8226ee and project 7258ee48454a4985a79b7f26d184493f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:15:19.646649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:15:19.649001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:15:19.695706 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-52aa25d4-120d-45d1-8cd0-42c1abdf3aa5 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033917 May 07 22:15:19.696443 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2908/5798] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:15:19.707454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-33feadd0-dfc5-4e30-8736-7b4ffe25cd57 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:19.708768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-33feadd0-dfc5-4e30-8736-7b4ffe25cd57 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:19.851052 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-33feadd0-dfc5-4e30-8736-7b4ffe25cd57 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1329 microversion: 2.1 time: 0.145722 May 07 22:15:19.853015 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2891/5799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:19 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1329 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:20.869373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-246b9998-e05b-4899-a995-39ec834c4726 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:20.870169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-246b9998-e05b-4899-a995-39ec834c4726 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:20.884458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-246b9998-e05b-4899-a995-39ec834c4726 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:20.885089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-246b9998-e05b-4899-a995-39ec834c4726 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:20.885896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-246b9998-e05b-4899-a995-39ec834c4726 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:20.886343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-246b9998-e05b-4899-a995-39ec834c4726 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:21.034536 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-246b9998-e05b-4899-a995-39ec834c4726 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1424 microversion: 2.1 time: 0.168813 May 07 22:15:21.042817 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2909/5800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:20 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1424 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:22.058007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac2c3c9c-eef1-49ae-9625-af3ca0432d32 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:22.058677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac2c3c9c-eef1-49ae-9625-af3ca0432d32 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:22.085259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2c3c9c-eef1-49ae-9625-af3ca0432d32 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:22.085919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2c3c9c-eef1-49ae-9625-af3ca0432d32 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:22.086846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2c3c9c-eef1-49ae-9625-af3ca0432d32 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:22.087327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac2c3c9c-eef1-49ae-9625-af3ca0432d32 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:22.421076 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac2c3c9c-eef1-49ae-9625-af3ca0432d32 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1464 microversion: 2.1 time: 0.368360 May 07 22:15:22.421705 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2892/5801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:22 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1464 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:23.017650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9b44e43a-7eb5-4df5-bf9d-0f7302666691 req-64763272-0a4b-4e2f-9084-d3acce9f0a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbb9cccc-0708-4d94-95ef-2fdc1fe91932", "tag": "4a837318-516a-4ad3-8f47-b08117406901"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:23.038793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9b44e43a-7eb5-4df5-bf9d-0f7302666691 req-64763272-0a4b-4e2f-9084-d3acce9f0a11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:23.040566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9b44e43a-7eb5-4df5-bf9d-0f7302666691 req-64763272-0a4b-4e2f-9084-d3acce9f0a11 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:23.075654 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9b44e43a-7eb5-4df5-bf9d-0f7302666691 req-64763272-0a4b-4e2f-9084-d3acce9f0a11 service nova] Creating event network-changed:4a837318-516a-4ad3-8f47-b08117406901 for instance cbb9cccc-0708-4d94-95ef-2fdc1fe91932 on nch2-master-1 May 07 22:15:23.088023 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9b44e43a-7eb5-4df5-bf9d-0f7302666691 req-64763272-0a4b-4e2f-9084-d3acce9f0a11 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073453 May 07 22:15:23.091657 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2910/5802] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:23.443491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88328cfc-fd2e-48ae-8702-b913b6dfd68e tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:23.447990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88328cfc-fd2e-48ae-8702-b913b6dfd68e tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:23.468487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88328cfc-fd2e-48ae-8702-b913b6dfd68e tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:23.469403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88328cfc-fd2e-48ae-8702-b913b6dfd68e tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:23.471182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88328cfc-fd2e-48ae-8702-b913b6dfd68e tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:23.472282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88328cfc-fd2e-48ae-8702-b913b6dfd68e tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:23.840157 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88328cfc-fd2e-48ae-8702-b913b6dfd68e tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1464 microversion: 2.1 time: 0.404399 May 07 22:15:23.840774 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2893/5803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:23 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1464 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:24.860413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-de55463e-5fa9-4b80-864a-37acc8897caa tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:24.861731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-de55463e-5fa9-4b80-864a-37acc8897caa tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:24.871459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de55463e-5fa9-4b80-864a-37acc8897caa tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:24.872108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de55463e-5fa9-4b80-864a-37acc8897caa tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:24.873124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de55463e-5fa9-4b80-864a-37acc8897caa tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:24.873765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-de55463e-5fa9-4b80-864a-37acc8897caa tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:25.103220 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-de55463e-5fa9-4b80-864a-37acc8897caa tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1464 microversion: 2.1 time: 0.249065 May 07 22:15:25.108084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2911/5804] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:24 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1464 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:26.130225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e2a14e4-6107-4abb-9986-51d00682eed9 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:26.130955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2e2a14e4-6107-4abb-9986-51d00682eed9 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:26.140289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e2a14e4-6107-4abb-9986-51d00682eed9 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:26.140805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e2a14e4-6107-4abb-9986-51d00682eed9 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:26.144343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e2a14e4-6107-4abb-9986-51d00682eed9 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:26.144809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e2a14e4-6107-4abb-9986-51d00682eed9 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:26.448321 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2e2a14e4-6107-4abb-9986-51d00682eed9 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1464 microversion: 2.1 time: 0.325634 May 07 22:15:26.449986 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2894/5805] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:26 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1464 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:27.467533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1b771579-0587-40b0-af12-214f6fc507b7 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:27.468490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1b771579-0587-40b0-af12-214f6fc507b7 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:27.475783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b771579-0587-40b0-af12-214f6fc507b7 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:27.476313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b771579-0587-40b0-af12-214f6fc507b7 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:27.477338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b771579-0587-40b0-af12-214f6fc507b7 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:27.478735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b771579-0587-40b0-af12-214f6fc507b7 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:27.685245 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1b771579-0587-40b0-af12-214f6fc507b7 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1464 microversion: 2.1 time: 0.222304 May 07 22:15:27.686599 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2912/5806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:27 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1464 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:27.780062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-83edfd8d-38ae-44f9-80ac-032c0d16c80c req-919a62f1-d38a-41a6-850d-c983b9c487ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb9cccc-0708-4d94-95ef-2fdc1fe91932", "name": "network-vif-plugged", "status": "completed", "tag": "4a837318-516a-4ad3-8f47-b08117406901"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:27.792322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-83edfd8d-38ae-44f9-80ac-032c0d16c80c req-919a62f1-d38a-41a6-850d-c983b9c487ce service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:27.792754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-83edfd8d-38ae-44f9-80ac-032c0d16c80c req-919a62f1-d38a-41a6-850d-c983b9c487ce service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:27.806650 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-83edfd8d-38ae-44f9-80ac-032c0d16c80c req-919a62f1-d38a-41a6-850d-c983b9c487ce service nova] Creating event network-vif-plugged:4a837318-516a-4ad3-8f47-b08117406901 for instance cbb9cccc-0708-4d94-95ef-2fdc1fe91932 on nch2-master-1 May 07 22:15:27.812126 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-83edfd8d-38ae-44f9-80ac-032c0d16c80c req-919a62f1-d38a-41a6-850d-c983b9c487ce service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038034 May 07 22:15:27.812758 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2895/5807] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:28.703760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7d4d98bf-0037-4ca1-84b7-9a55e9edfa95 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:28.705136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7d4d98bf-0037-4ca1-84b7-9a55e9edfa95 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:28.715429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d4d98bf-0037-4ca1-84b7-9a55e9edfa95 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:28.715894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d4d98bf-0037-4ca1-84b7-9a55e9edfa95 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:28.717580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d4d98bf-0037-4ca1-84b7-9a55e9edfa95 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:28.718203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7d4d98bf-0037-4ca1-84b7-9a55e9edfa95 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:28.914186 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7d4d98bf-0037-4ca1-84b7-9a55e9edfa95 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1464 microversion: 2.1 time: 0.215172 May 07 22:15:28.923285 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2913/5808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:28 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1464 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:29.942026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-561c8c29-c58d-4a17-9691-763d26bb1d85 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:29.942892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-561c8c29-c58d-4a17-9691-763d26bb1d85 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:29.953994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-561c8c29-c58d-4a17-9691-763d26bb1d85 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:29.954466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-561c8c29-c58d-4a17-9691-763d26bb1d85 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:29.958093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-561c8c29-c58d-4a17-9691-763d26bb1d85 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:29.958560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-561c8c29-c58d-4a17-9691-763d26bb1d85 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.125104 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-561c8c29-c58d-4a17-9691-763d26bb1d85 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1649 microversion: 2.1 time: 0.188492 May 07 22:15:30.127277 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2896/5809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:29 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1649 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:30.151363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1db90b2d-ba53-423a-b027-97d9149fd523 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:30.151993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1db90b2d-ba53-423a-b027-97d9149fd523 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:30.179625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db90b2d-ba53-423a-b027-97d9149fd523 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.183529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db90b2d-ba53-423a-b027-97d9149fd523 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.184350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db90b2d-ba53-423a-b027-97d9149fd523 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.185027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1db90b2d-ba53-423a-b027-97d9149fd523 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.510599 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1db90b2d-ba53-423a-b027-97d9149fd523 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1649 microversion: 2.1 time: 0.372636 May 07 22:15:30.511244 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2914/5810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:30 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1649 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:30.535144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63578527-950e-4456-8db8-4a6d32951171 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:30.536049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63578527-950e-4456-8db8-4a6d32951171 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:30.542379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63578527-950e-4456-8db8-4a6d32951171 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.542886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63578527-950e-4456-8db8-4a6d32951171 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.545061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63578527-950e-4456-8db8-4a6d32951171 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.545699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63578527-950e-4456-8db8-4a6d32951171 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.718910 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63578527-950e-4456-8db8-4a6d32951171 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1649 microversion: 2.1 time: 0.187866 May 07 22:15:30.719745 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2897/5811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:30 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1649 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:15:30.739102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:30.739846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:30.748928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.750029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.751830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.752872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.782915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:15:30.877661 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da66744b-09d9-4c13-b2d0-cd41f960a89b tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "DELETE /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 204 len: 0 microversion: 2.1 time: 0.145516 May 07 22:15:30.878622 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2915/5812] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:15:30 2022] DELETE /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:15:30.892952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f736ec2f-77a9-4c5d-919a-6e7f44c5d609 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:30.895421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f736ec2f-77a9-4c5d-919a-6e7f44c5d609 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:30.904323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f736ec2f-77a9-4c5d-919a-6e7f44c5d609 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.904805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f736ec2f-77a9-4c5d-919a-6e7f44c5d609 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:30.905620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f736ec2f-77a9-4c5d-919a-6e7f44c5d609 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:30.906264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f736ec2f-77a9-4c5d-919a-6e7f44c5d609 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:31.081888 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f736ec2f-77a9-4c5d-919a-6e7f44c5d609 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1655 microversion: 2.1 time: 0.196311 May 07 22:15:31.090865 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2898/5813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:30 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:15:32.100273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e681d552-1f73-4eb8-8442-3e21e099f935 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:32.101031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e681d552-1f73-4eb8-8442-3e21e099f935 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:32.109059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e681d552-1f73-4eb8-8442-3e21e099f935 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:32.109569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e681d552-1f73-4eb8-8442-3e21e099f935 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:32.110402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e681d552-1f73-4eb8-8442-3e21e099f935 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:32.110887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e681d552-1f73-4eb8-8442-3e21e099f935 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:32.272776 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e681d552-1f73-4eb8-8442-3e21e099f935 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1655 microversion: 2.1 time: 0.176202 May 07 22:15:32.273383 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2916/5814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:32 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1655 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:33.137539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-79a42a6f-cd9c-494a-870d-b9a6747a232c req-0827571f-e5e7-4d8b-ab8d-777bb8907050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbb9cccc-0708-4d94-95ef-2fdc1fe91932", "name": "network-vif-deleted", "tag": "4a837318-516a-4ad3-8f47-b08117406901"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:33.157372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-79a42a6f-cd9c-494a-870d-b9a6747a232c req-0827571f-e5e7-4d8b-ab8d-777bb8907050 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:33.158119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-79a42a6f-cd9c-494a-870d-b9a6747a232c req-0827571f-e5e7-4d8b-ab8d-777bb8907050 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:33.185729 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-79a42a6f-cd9c-494a-870d-b9a6747a232c req-0827571f-e5e7-4d8b-ab8d-777bb8907050 service nova] Creating event network-vif-deleted:4a837318-516a-4ad3-8f47-b08117406901 for instance cbb9cccc-0708-4d94-95ef-2fdc1fe91932 on nch2-master-1 May 07 22:15:33.204706 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-79a42a6f-cd9c-494a-870d-b9a6747a232c req-0827571f-e5e7-4d8b-ab8d-777bb8907050 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071769 May 07 22:15:33.211779 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2899/5815] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:33.291981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:33.292707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:33.308004 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:33.311839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:33.313940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:33.317122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:33.378425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:33.379604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:33.380114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lazy-loading 'fault' on Instance uuid cbb9cccc-0708-4d94-95ef-2fdc1fe91932 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:15:33.477153 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-54f66629-c05b-46c1-be01-3b91810126b0 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 200 len: 1454 microversion: 2.1 time: 0.189248 May 07 22:15:33.477785 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2917/5816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:33 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:34.502150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:34.503547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: cbb9cccc-0708-4d94-95ef-2fdc1fe91932] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:34.522112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:34.523293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:34.525384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:34.526429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:34.545678 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] HTTP exception thrown: Instance cbb9cccc-0708-4d94-95ef-2fdc1fe91932 could not be found. May 07 22:15:34.546556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Returning 404 to user: Instance cbb9cccc-0708-4d94-95ef-2fdc1fe91932 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:15:34.547804 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-679f740d-6ded-42a0-ab5d-faca23935d8c tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932" status: 404 len: 111 microversion: 2.1 time: 0.053340 May 07 22:15:34.548541 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2900/5817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:34 2022] GET /compute/v2.1/servers/cbb9cccc-0708-4d94-95ef-2fdc1fe91932 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:15:34.559055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:34.560770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:34.568801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:34.569587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:34.570521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:34.571063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:34.647901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:15:34.787084 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b208ea5e-3fc9-474e-9494-a40fea1932f6 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "DELETE /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 204 len: 0 microversion: 2.1 time: 0.232684 May 07 22:15:34.794547 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2918/5818] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:15:34 2022] DELETE /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:15:34.798998 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2556b10b-cb12-4e9a-8c7b-9ea0057e2107 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:34.800454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2556b10b-cb12-4e9a-8c7b-9ea0057e2107 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:34.809118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2556b10b-cb12-4e9a-8c7b-9ea0057e2107 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:34.809649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2556b10b-cb12-4e9a-8c7b-9ea0057e2107 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:34.810666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2556b10b-cb12-4e9a-8c7b-9ea0057e2107 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:34.811290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2556b10b-cb12-4e9a-8c7b-9ea0057e2107 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:34.997230 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2556b10b-cb12-4e9a-8c7b-9ea0057e2107 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1655 microversion: 2.1 time: 0.202986 May 07 22:15:34.999797 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2901/5819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:34 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1655 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:36.018978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-45b40c2b-cceb-44c2-964d-0437948a3a36 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:36.020372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-45b40c2b-cceb-44c2-964d-0437948a3a36 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:36.038902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45b40c2b-cceb-44c2-964d-0437948a3a36 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:36.042456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45b40c2b-cceb-44c2-964d-0437948a3a36 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:36.045444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45b40c2b-cceb-44c2-964d-0437948a3a36 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:36.047418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-45b40c2b-cceb-44c2-964d-0437948a3a36 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:36.353802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-45b40c2b-cceb-44c2-964d-0437948a3a36 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1655 microversion: 2.1 time: 0.340331 May 07 22:15:36.354410 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2919/5820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:36 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1655 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:37.022168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-72eb167e-e3ef-43e1-9d53-8d1bd407f010 req-2f610dc1-c2d6-4885-af42-7a06b7240a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434474d3-686a-4f99-99bb-17e74f258a84", "name": "network-vif-deleted", "tag": "7973ea98-3ae5-4cd7-9d25-d975a8a79190"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:37.042578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-72eb167e-e3ef-43e1-9d53-8d1bd407f010 req-2f610dc1-c2d6-4885-af42-7a06b7240a16 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:37.045206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-72eb167e-e3ef-43e1-9d53-8d1bd407f010 req-2f610dc1-c2d6-4885-af42-7a06b7240a16 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:37.098402 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-72eb167e-e3ef-43e1-9d53-8d1bd407f010 req-2f610dc1-c2d6-4885-af42-7a06b7240a16 service nova] Creating event network-vif-deleted:7973ea98-3ae5-4cd7-9d25-d975a8a79190 for instance 434474d3-686a-4f99-99bb-17e74f258a84 on nch1-master-1 May 07 22:15:37.112940 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-72eb167e-e3ef-43e1-9d53-8d1bd407f010 req-2f610dc1-c2d6-4885-af42-7a06b7240a16 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094006 May 07 22:15:37.113766 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2902/5821] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:15:37.380508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:37.381619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:37.397839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:37.398649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:37.400669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:37.401354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:37.454576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:37.455097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:37.455569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lazy-loading 'fault' on Instance uuid 434474d3-686a-4f99-99bb-17e74f258a84 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:15:37.567692 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2751839d-e858-4192-9265-08e870c05c8d tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 200 len: 1454 microversion: 2.1 time: 0.190941 May 07 22:15:37.571560 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2920/5822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:37 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 1454 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:38.590303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:38.592249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] [instance: 434474d3-686a-4f99-99bb-17e74f258a84] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:38.612086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:38.614468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:38.615667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:38.618100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:38.664892 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] HTTP exception thrown: Instance 434474d3-686a-4f99-99bb-17e74f258a84 could not be found. May 07 22:15:38.665635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] Returning 404 to user: Instance 434474d3-686a-4f99-99bb-17e74f258a84 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:15:38.666523 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc919ebe-14bf-4dc3-8e34-5e37cd417976 tempest-TestServerMultinode-1901098445 tempest-TestServerMultinode-1901098445-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84" status: 404 len: 111 microversion: 2.1 time: 0.082294 May 07 22:15:38.667156 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2903/5823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:38 2022] GET /compute/v2.1/servers/434474d3-686a-4f99-99bb-17e74f258a84 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 07 22:15:55.444883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1041712220", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0a44a823-8b70-42ae-bf24-489d4cc11196"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:55.689569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] validate_networks() for [('0a44a823-8b70-42ae-bf24-489d4cc11196', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:15:56.440395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:15:56.440833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:15:56.441397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:15:56.442143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:15:56.442477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:15:56.452226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:56.452858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:56.453512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:56.453962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:56.476093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Getting quotas for project c82534ba00c049e6bfa7421398228fff. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:15:56.482992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Getting quotas for user af105dbc34cb4e4191e14314d88df4c4 and project c82534ba00c049e6bfa7421398228fff. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:15:56.497588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:15:56.500398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:15:56.571341 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b219efe-7ba9-4403-9179-142cf23bf62c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.130576 May 07 22:15:56.578231 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2921/5824] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:15:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:15:56.586361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c874518-7535-48c5-ad9b-1af67ee2a5bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:56.587107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c874518-7535-48c5-ad9b-1af67ee2a5bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:56.880119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9c874518-7535-48c5-ad9b-1af67ee2a5bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:56.889080 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c874518-7535-48c5-ad9b-1af67ee2a5bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1214 microversion: 2.1 time: 0.308100 May 07 22:15:56.889911 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2904/5825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:56 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:57.908461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:57.909095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:57.917347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:57.918035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:57.919678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:57.920500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:57.991715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:58.000530 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77d8cd87-7ba0-4094-9b78-e8365e4db549 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1272 microversion: 2.1 time: 0.097962 May 07 22:15:58.001178 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2922/5826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:57 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:59.019384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:15:59.020819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:15:59.032363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:59.033078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:59.034073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:59.034698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:59.336133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:15:59.353022 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4be993c0-ea9a-4d85-b99b-7a4e20514d3b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1314 microversion: 2.1 time: 0.338570 May 07 22:15:59.354125 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2905/5827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:59 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:15:59.620096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-17c12d1a-b614-4c8c-9b26-a6f1e81b34a2 req-425a1ded-6939-41f8-b5db-c5fb9883971c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2464fc-0c20-429b-9b5b-a23a01ad87f2", "tag": "3df9b806-6f21-455e-b95e-8902afb4c299"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:15:59.652032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-17c12d1a-b614-4c8c-9b26-a6f1e81b34a2 req-425a1ded-6939-41f8-b5db-c5fb9883971c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:15:59.652722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-17c12d1a-b614-4c8c-9b26-a6f1e81b34a2 req-425a1ded-6939-41f8-b5db-c5fb9883971c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:15:59.671471 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-17c12d1a-b614-4c8c-9b26-a6f1e81b34a2 req-425a1ded-6939-41f8-b5db-c5fb9883971c service nova] Creating event network-changed:3df9b806-6f21-455e-b95e-8902afb4c299 for instance ee2464fc-0c20-429b-9b5b-a23a01ad87f2 on nch2-master-1 May 07 22:15:59.687133 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-17c12d1a-b614-4c8c-9b26-a6f1e81b34a2 req-425a1ded-6939-41f8-b5db-c5fb9883971c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082374 May 07 22:15:59.687133 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2923/5828] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:00.369894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:00.370559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:00.385022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:00.385505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:00.386439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:00.387008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:00.589236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:00.597784 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bcfa48e4-7332-464f-b777-206dd4619844 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1314 microversion: 2.1 time: 0.232004 May 07 22:16:00.598378 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2906/5829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:00 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:01.615114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:01.616436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:01.622979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:01.623727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:01.624509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:01.624948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:01.797147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:01.804920 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b3185a6-8f7c-4c18-8a4b-c9f62d2d80d1 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1314 microversion: 2.1 time: 0.195108 May 07 22:16:01.805515 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2924/5830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:01 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:02.822965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:02.823543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:02.830729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:02.831243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:02.832172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:02.832735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:02.978246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:02.988726 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4fc1bf4f-34e6-46ba-bc0f-da603c1d2d57 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1314 microversion: 2.1 time: 0.168787 May 07 22:16:02.989457 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2907/5831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:02 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:16:04.005446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:04.006041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:04.013414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:04.013874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:04.014659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:04.015145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:04.153865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:04.161651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-385e16f3-780f-4344-a6ba-734d9dcd93bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1314 microversion: 2.1 time: 0.160078 May 07 22:16:04.162240 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2925/5832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:04 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:05.177928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:05.178574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:05.185197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:05.185698 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:05.186473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:05.186999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:05.323715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:05.332129 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c13c4f7f-5978-48fb-b0d2-a2e02bfb213d tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1314 microversion: 2.1 time: 0.158045 May 07 22:16:05.332711 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2908/5833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:05 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:05.867463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-89541452-3c58-4810-9dff-10508cb3f3ad req-b04750bd-f735-45cb-bb25-4804cc2d0da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2464fc-0c20-429b-9b5b-a23a01ad87f2", "name": "network-vif-plugged", "status": "completed", "tag": "3df9b806-6f21-455e-b95e-8902afb4c299"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:05.885466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-89541452-3c58-4810-9dff-10508cb3f3ad req-b04750bd-f735-45cb-bb25-4804cc2d0da1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:05.886830 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-89541452-3c58-4810-9dff-10508cb3f3ad req-b04750bd-f735-45cb-bb25-4804cc2d0da1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:05.902744 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-89541452-3c58-4810-9dff-10508cb3f3ad req-b04750bd-f735-45cb-bb25-4804cc2d0da1 service nova] Creating event network-vif-plugged:3df9b806-6f21-455e-b95e-8902afb4c299 for instance ee2464fc-0c20-429b-9b5b-a23a01ad87f2 on nch2-master-1 May 07 22:16:05.909217 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-89541452-3c58-4810-9dff-10508cb3f3ad req-b04750bd-f735-45cb-bb25-4804cc2d0da1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047734 May 07 22:16:05.910260 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2926/5834] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:06.350410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:06.351027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:06.358582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:06.359084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:06.359890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:06.360382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:06.497470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:06.504947 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-548b9286-0113-400c-8624-3ed5c547ae64 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1314 microversion: 2.1 time: 0.158628 May 07 22:16:06.505524 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2909/5835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:06 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:07.522756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:07.523703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:07.531314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:07.531712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:07.532495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:07.533218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:07.691106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:07.700961 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bed337f0-b674-4583-a1f9-5385b0af9a81 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1498 microversion: 2.1 time: 0.182972 May 07 22:16:07.701637 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2927/5836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:07 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1498 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:08.217061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:08.217681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:08.228246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:08.228731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:08.229918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:08.230586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:08.260779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:16:08.341574 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e3b4e881-2a68-4d1b-991d-94493ea2fd2e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 204 len: 0 microversion: 2.1 time: 0.129323 May 07 22:16:08.343086 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2910/5837] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:16:08 2022] DELETE /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:16:08.352854 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:08.353532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:08.360168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:08.360639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:08.361475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:08.361960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:08.509144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:08.524382 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ddbde9df-4b72-4dfe-ab95-f7a74bda756c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1504 microversion: 2.1 time: 0.170442 May 07 22:16:08.524382 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2928/5838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:08 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:09.536145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:09.537591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:09.547607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:09.548462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:09.549419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:09.549932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:10.181153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:10.190225 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4110f4c1-f1f2-4d21-9640-8e2dc7fdb7b3 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 200 len: 1504 microversion: 2.1 time: 0.659014 May 07 22:16:10.190896 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2911/5839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:09 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 1504 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:10.657791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b3e1f947-ba1e-4c27-81d6-b25b66c8926a req-143bb2f3-c07b-4321-ac4c-3c9c38e751c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2464fc-0c20-429b-9b5b-a23a01ad87f2", "name": "network-vif-deleted", "tag": "3df9b806-6f21-455e-b95e-8902afb4c299"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:10.669756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b3e1f947-ba1e-4c27-81d6-b25b66c8926a req-143bb2f3-c07b-4321-ac4c-3c9c38e751c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:10.670087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b3e1f947-ba1e-4c27-81d6-b25b66c8926a req-143bb2f3-c07b-4321-ac4c-3c9c38e751c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:10.689042 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b3e1f947-ba1e-4c27-81d6-b25b66c8926a req-143bb2f3-c07b-4321-ac4c-3c9c38e751c3 service nova] Creating event network-vif-deleted:3df9b806-6f21-455e-b95e-8902afb4c299 for instance ee2464fc-0c20-429b-9b5b-a23a01ad87f2 on nch2-master-1 May 07 22:16:10.695366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b3e1f947-ba1e-4c27-81d6-b25b66c8926a req-143bb2f3-c07b-4321-ac4c-3c9c38e751c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043797 May 07 22:16:10.696107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2929/5840] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:11.210487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:11.211867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: ee2464fc-0c20-429b-9b5b-a23a01ad87f2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:11.219066 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:11.219752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:11.220701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:11.221288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:11.239086 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] HTTP exception thrown: Instance ee2464fc-0c20-429b-9b5b-a23a01ad87f2 could not be found. May 07 22:16:11.239928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Returning 404 to user: Instance ee2464fc-0c20-429b-9b5b-a23a01ad87f2 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:16:11.240896 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d27e4b39-5f86-4263-94a6-e7897f7cf458 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2" status: 404 len: 111 microversion: 2.1 time: 0.035785 May 07 22:16:11.241459 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2930/5841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:11 2022] GET /compute/v2.1/servers/ee2464fc-0c20-429b-9b5b-a23a01ad87f2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:16:11.337075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a999613b-fbc9-4318-a634-ce8228281e2a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: .version_select at 0x7fc41cb040d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1530140642"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:11.353565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a999613b-fbc9-4318-a634-ce8228281e2a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:16:11.363399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a999613b-fbc9-4318-a634-ce8228281e2a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:16:11.368045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-531854419", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0a44a823-8b70-42ae-bf24-489d4cc11196"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:11.449449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] validate_networks() for [('0a44a823-8b70-42ae-bf24-489d4cc11196', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:16:11.463895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a999613b-fbc9-4318-a634-ce8228281e2a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:16:11.471327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-a999613b-fbc9-4318-a634-ce8228281e2a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:16:11.489381 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a999613b-fbc9-4318-a634-ce8228281e2a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.352816 May 07 22:16:11.490737 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2912/5842] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:16:11 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:11.946079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:16:11.947192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:16:11.948079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:16:11.948735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:16:11.949387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:16:11.961402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:11.962390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:11.963487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:11.964160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:11.986566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Getting quotas for project c82534ba00c049e6bfa7421398228fff. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:16:12.004684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Getting quotas for user af105dbc34cb4e4191e14314d88df4c4 and project c82534ba00c049e6bfa7421398228fff. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:16:12.025718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:16:12.029223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:16:12.084141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3c673886-c9ad-4fdb-9da8-f2b3bd5f8c92 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720454 May 07 22:16:12.085997 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2931/5843] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:16:12.097232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3be3db9b-05c8-4171-9326-9eafe64eeae2 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:12.098886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3be3db9b-05c8-4171-9326-9eafe64eeae2 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:12.182874 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3be3db9b-05c8-4171-9326-9eafe64eeae2 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:12.192995 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3be3db9b-05c8-4171-9326-9eafe64eeae2 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1213 microversion: 2.1 time: 0.100765 May 07 22:16:12.194357 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2913/5844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:12 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:16:13.216630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:13.218528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:13.231109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:13.232378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:13.234102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:13.235258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:13.313042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:13.321455 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a845d1d-2fec-4735-8adf-65f99eb45b32 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1273 microversion: 2.1 time: 0.111005 May 07 22:16:13.333279 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2932/5845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:13 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:14.339250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:14.340704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:14.350563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:14.351390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:14.352242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:14.352906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:14.459116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:14.468640 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-88f9db21-c031-44ba-aeb3-cbb1d1a2b544 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1271 microversion: 2.1 time: 0.133420 May 07 22:16:14.469443 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2914/5846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:14 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:15.486588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:15.487340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:15.494286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:15.495038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:15.496056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:15.496440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:15.658630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:15.667782 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f230e05-2da9-4711-9c5e-16faa956d13c tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1313 microversion: 2.1 time: 0.185512 May 07 22:16:15.668525 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2933/5847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:15 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:16.193924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d0c88b14-fb4e-4fa3-8e1f-94fba67869b1 req-db9a1d0b-4ec6-4584-a6eb-cde7ad98909e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa6abbec-a7a3-431b-a106-38de1fc2e254", "tag": "2e7d137f-939a-4472-bae8-4575fc685551"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:16.215121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d0c88b14-fb4e-4fa3-8e1f-94fba67869b1 req-db9a1d0b-4ec6-4584-a6eb-cde7ad98909e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:16.215121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d0c88b14-fb4e-4fa3-8e1f-94fba67869b1 req-db9a1d0b-4ec6-4584-a6eb-cde7ad98909e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:16.230672 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d0c88b14-fb4e-4fa3-8e1f-94fba67869b1 req-db9a1d0b-4ec6-4584-a6eb-cde7ad98909e service nova] Creating event network-changed:2e7d137f-939a-4472-bae8-4575fc685551 for instance fa6abbec-a7a3-431b-a106-38de1fc2e254 on nch2-master-1 May 07 22:16:16.239416 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d0c88b14-fb4e-4fa3-8e1f-94fba67869b1 req-db9a1d0b-4ec6-4584-a6eb-cde7ad98909e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046506 May 07 22:16:16.240184 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2915/5848] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:16.684793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:16.685499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:16.697692 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:16.698160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:16.699015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:16.699460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:16.939083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:16.950193 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f4f0671f-56ed-4183-b7d4-a576e74497bf tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1313 microversion: 2.1 time: 0.269634 May 07 22:16:16.951420 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2934/5849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:16 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:17.972778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:17.974360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:17.984352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:17.985332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:17.986669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:17.988128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:18.217600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:18.228267 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8e327520-489f-4138-a132-82620efa68f9 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1313 microversion: 2.1 time: 0.264281 May 07 22:16:18.229402 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2916/5850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:17 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:19.245765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:19.246396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:19.259892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:19.262546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:19.263471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:19.264718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:20.153866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:20.162059 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8179b879-0fb2-40c4-88be-336acd0ebd6b tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1313 microversion: 2.1 time: 0.920149 May 07 22:16:20.166714 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2935/5851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:19 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1313 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:20.852909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1156850747", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0839a7af-146b-454e-bfcf-a3b86e510e90"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1530140642", "security_groups": [{"name": "tempest-secgroup-smoke-1056662019"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:20.998340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] validate_networks() for [('0839a7af-146b-454e-bfcf-a3b86e510e90', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:16:21.181593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:21.182329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:21.192253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:21.194495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:21.196121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:21.200239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:21.413950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:21.424277 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e27b9237-6ffc-4e5a-8187-9417d3fe047e tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1313 microversion: 2.1 time: 0.245465 May 07 22:16:21.425385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2936/5852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:21 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:21.602510 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:16:21.603068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:16:21.603735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:16:21.604541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:16:21.605394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:16:21.619680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:21.620157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:21.621381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:21.621844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:21.648681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:16:21.659092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:16:21.682982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:16:21.686014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:16:21.772028 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4a069dc2-fdd1-43b2-9d65-34027aa0ed86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.925831 May 07 22:16:21.784663 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2917/5853] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:16:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:16:21.790572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d135adae-e35b-42ab-a208-0f8ac698e664 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:21.791357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d135adae-e35b-42ab-a208-0f8ac698e664 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:21.947480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d135adae-e35b-42ab-a208-0f8ac698e664 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:21.960672 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d135adae-e35b-42ab-a208-0f8ac698e664 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1267 microversion: 2.1 time: 0.174306 May 07 22:16:21.962152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2937/5854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:21 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:22.252165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-f693b1de-e867-4b40-93e7-524aecd6ef27 req-ea4ce6ae-cc77-49e9-812b-96fa500313f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6abbec-a7a3-431b-a106-38de1fc2e254", "name": "network-vif-plugged", "status": "completed", "tag": "2e7d137f-939a-4472-bae8-4575fc685551"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:22.283775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f693b1de-e867-4b40-93e7-524aecd6ef27 req-ea4ce6ae-cc77-49e9-812b-96fa500313f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:22.289561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-f693b1de-e867-4b40-93e7-524aecd6ef27 req-ea4ce6ae-cc77-49e9-812b-96fa500313f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:22.324817 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-f693b1de-e867-4b40-93e7-524aecd6ef27 req-ea4ce6ae-cc77-49e9-812b-96fa500313f0 service nova] Creating event network-vif-plugged:2e7d137f-939a-4472-bae8-4575fc685551 for instance fa6abbec-a7a3-431b-a106-38de1fc2e254 on nch2-master-1 May 07 22:16:22.337544 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-f693b1de-e867-4b40-93e7-524aecd6ef27 req-ea4ce6ae-cc77-49e9-812b-96fa500313f0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090237 May 07 22:16:22.341513 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2918/5855] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:22.449667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:22.455338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:22.474100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:22.476166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:22.479256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:22.480995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:22.766845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:22.777744 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e8a78b30-10ca-4806-bb55-75072b56a7c0 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1313 microversion: 2.1 time: 0.338859 May 07 22:16:22.778900 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2938/5856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:22 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:22.978028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:22.978896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:22.986184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:22.987158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:22.988268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:22.989141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:23.110724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:23.120053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c0a6223c-abf9-4d96-a977-3653bf25e281 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1319 microversion: 2.1 time: 0.146198 May 07 22:16:23.120709 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2919/5857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:22 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:23.797537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:23.798851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:23.806814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:23.807553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:23.809133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:23.809689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:24.026229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:24.035743 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48a08b7d-0521-4f80-b297-34734f1be288 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1497 microversion: 2.1 time: 0.244819 May 07 22:16:24.036454 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2939/5858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:23 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:24.137776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:24.138358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:24.151058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:24.151546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:24.152921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:24.153473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:24.345925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:24.364123 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fbff001a-f2cb-4f2a-b74c-82a83909b475 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1393 microversion: 2.1 time: 0.230262 May 07 22:16:24.365302 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2920/5859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:24 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1393 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:24.740400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:24.740918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:24.747211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:24.747729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:24.748465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:24.748915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:24.774406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:16:24.876091 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f25a29f1-186d-445d-82a0-485c88df3360 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 204 len: 0 microversion: 2.1 time: 0.141965 May 07 22:16:24.876781 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2940/5860] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:16:24 2022] DELETE /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:16:24.886995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:24.888154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:24.895774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:24.896254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:24.897252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:24.897751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:25.052308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e727a886-b860-4d73-9aba-6fed5ce5b32f req-9f047024-6ed0-485c-8534-bc43637b06b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:25.063163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:25.073778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e727a886-b860-4d73-9aba-6fed5ce5b32f req-9f047024-6ed0-485c-8534-bc43637b06b1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:25.074237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e727a886-b860-4d73-9aba-6fed5ce5b32f req-9f047024-6ed0-485c-8534-bc43637b06b1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:25.094432 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-59affca1-78ef-462d-87e1-c428a9bef6aa tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1503 microversion: 2.1 time: 0.212738 May 07 22:16:25.105305 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2921/5861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:24 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:25.108870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e727a886-b860-4d73-9aba-6fed5ce5b32f req-9f047024-6ed0-485c-8534-bc43637b06b1 service nova] Creating event network-changed:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch1-master-1 May 07 22:16:25.115941 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e727a886-b860-4d73-9aba-6fed5ce5b32f req-9f047024-6ed0-485c-8534-bc43637b06b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067891 May 07 22:16:25.117516 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2941/5862] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:16:25.381520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:25.382169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:25.388977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:25.389463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:25.390271 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:25.390740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:25.541042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:25.548938 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee380797-1476-4b03-9082-650d3b360781 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1393 microversion: 2.1 time: 0.171321 May 07 22:16:25.558100 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2922/5863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:25 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:26.113332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:26.113998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:26.120387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:26.120956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:26.121770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:26.122224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:26.260328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af105dbc34cb4e4191e14314d88df4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c82534ba00c049e6bfa7421398228fff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:26.268301 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e52436f5-c74d-42e9-9334-8f91d71bdcf4 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 200 len: 1503 microversion: 2.1 time: 0.160148 May 07 22:16:26.268883 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2942/5864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:26 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:26.566236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:26.567047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:26.579040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:26.579907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:26.581000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:26.581851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:26.623935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f285446a-e121-460c-8d0f-867cc265bcfb req-fe7a1ed1-cac9-4654-878a-158edb1b7992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa6abbec-a7a3-431b-a106-38de1fc2e254", "name": "network-vif-deleted", "tag": "2e7d137f-939a-4472-bae8-4575fc685551"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:26.644536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f285446a-e121-460c-8d0f-867cc265bcfb req-fe7a1ed1-cac9-4654-878a-158edb1b7992 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:26.644989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f285446a-e121-460c-8d0f-867cc265bcfb req-fe7a1ed1-cac9-4654-878a-158edb1b7992 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:26.668184 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f285446a-e121-460c-8d0f-867cc265bcfb req-fe7a1ed1-cac9-4654-878a-158edb1b7992 service nova] Creating event network-vif-deleted:2e7d137f-939a-4472-bae8-4575fc685551 for instance fa6abbec-a7a3-431b-a106-38de1fc2e254 on nch2-master-1 May 07 22:16:26.685678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f285446a-e121-460c-8d0f-867cc265bcfb req-fe7a1ed1-cac9-4654-878a-158edb1b7992 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065820 May 07 22:16:26.686482 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2943/5865] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:26.796211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:26.805178 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9da23003-37a0-4c23-bce9-c6ec4bea563c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1393 microversion: 2.1 time: 0.243102 May 07 22:16:26.806082 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2923/5866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:26 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1393 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:27.289369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:27.290750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] [instance: fa6abbec-a7a3-431b-a106-38de1fc2e254] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:27.298153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:27.299503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:27.300607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:27.301057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:27.316474 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] HTTP exception thrown: Instance fa6abbec-a7a3-431b-a106-38de1fc2e254 could not be found. May 07 22:16:27.317741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] Returning 404 to user: Instance fa6abbec-a7a3-431b-a106-38de1fc2e254 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:16:27.317978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f92c85d2-149b-4e22-ad40-cd14886d1d05 tempest-VolumesActionsTest-497963316 tempest-VolumesActionsTest-497963316-project] 10.222.0.32 "GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254" status: 404 len: 111 microversion: 2.1 time: 0.035367 May 07 22:16:27.318495 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2944/5867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:27 2022] GET /compute/v2.1/servers/fa6abbec-a7a3-431b-a106-38de1fc2e254 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:16:27.823038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:27.823938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:27.832120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:27.832875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:27.834061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:27.834755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:28.000107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:28.008071 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e9842eee-9001-47c7-8ab8-263bf9d1c5e1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1393 microversion: 2.1 time: 0.189922 May 07 22:16:28.008733 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2924/5868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:27 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:29.025682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:29.026404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:29.035605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:29.036446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:29.037250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:29.037801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:29.266884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:29.277149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57dd11dc-14f8-49d8-95a2-dcf3e765a6f3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1393 microversion: 2.1 time: 0.254736 May 07 22:16:29.277973 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2945/5869] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:29 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1393 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:29.475832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bbb38b4a-5ce5-4d60-ab88-5689b290db3b req-371925c8-af9c-4849-94fc-e2670b7db6c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "name": "network-vif-plugged", "status": "completed", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:29.490454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bbb38b4a-5ce5-4d60-ab88-5689b290db3b req-371925c8-af9c-4849-94fc-e2670b7db6c1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:29.491457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bbb38b4a-5ce5-4d60-ab88-5689b290db3b req-371925c8-af9c-4849-94fc-e2670b7db6c1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:29.512085 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bbb38b4a-5ce5-4d60-ab88-5689b290db3b req-371925c8-af9c-4849-94fc-e2670b7db6c1 service nova] Creating event network-vif-plugged:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch1-master-1 May 07 22:16:29.517639 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bbb38b4a-5ce5-4d60-ab88-5689b290db3b req-371925c8-af9c-4849-94fc-e2670b7db6c1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048097 May 07 22:16:29.518537 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2925/5870] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:30.295755 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:30.296583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:30.312717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:30.313180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:30.317404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:30.318076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:30.545666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:30.554586 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-645c2f63-b3e3-45af-b78b-790d4d9bc3bb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1393 microversion: 2.1 time: 0.263934 May 07 22:16:30.555209 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2946/5871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:30 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1393 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:31.577742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:31.581558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:31.589564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:31.590548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:31.591608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:31.592505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:31.784136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:31.804281 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5f9a0a6-fea4-491e-8e7a-a401fb3e5283 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1566 microversion: 2.1 time: 0.234977 May 07 22:16:31.805053 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2926/5872] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:31 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:31.822018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:31.822717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:31.831238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:31.831729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:31.832525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:31.833155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:32.079141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:32.100957 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c43f01d1-2b47-4997-8ef4-589a63de82e9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1566 microversion: 2.1 time: 0.283250 May 07 22:16:32.101567 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2947/5873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:31 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1566 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:35.238247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8e724441-8fb1-4d37-9dd8-5c240d360fd4 req-8dad7694-18e0-4422-ab88-2807b8a9674b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:35.241070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:16:35.246845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:35.262948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:35.263476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:35.264320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:35.264787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:35.269106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8e724441-8fb1-4d37-9dd8-5c240d360fd4 req-8dad7694-18e0-4422-ab88-2807b8a9674b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:35.269570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8e724441-8fb1-4d37-9dd8-5c240d360fd4 req-8dad7694-18e0-4422-ab88-2807b8a9674b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:35.299915 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8e724441-8fb1-4d37-9dd8-5c240d360fd4 req-8dad7694-18e0-4422-ab88-2807b8a9674b service nova] Creating event network-changed:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch1-master-1 May 07 22:16:35.322394 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8e724441-8fb1-4d37-9dd8-5c240d360fd4 req-8dad7694-18e0-4422-ab88-2807b8a9674b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090427 May 07 22:16:35.324805 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2948/5874] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:16:35.510667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:16:35.521703 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4d73714d-fb68-4533-bd74-fd648ae5d858 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1566 microversion: 2.1 time: 0.292151 May 07 22:16:35.522554 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2927/5875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:16:35 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:16:54.115990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b3db75f-e9f4-4758-9d68-5efff346ecec tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:16:54.117194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b3db75f-e9f4-4758-9d68-5efff346ecec tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:16:54.125214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b3db75f-e9f4-4758-9d68-5efff346ecec tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:54.125681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b3db75f-e9f4-4758-9d68-5efff346ecec tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:54.126473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b3db75f-e9f4-4758-9d68-5efff346ecec tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:16:54.126955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b3db75f-e9f4-4758-9d68-5efff346ecec tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:16:54.180891 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b3db75f-e9f4-4758-9d68-5efff346ecec tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action" status: 200 len: 24575 microversion: 2.1 time: 0.069611 May 07 22:16:54.181674 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2949/5876] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:16:54 2022] POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action => generated 24575 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:17:05.286181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5051e2dc-d8e0-4571-a0e7-bbafa895fb51 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:05.287896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5051e2dc-d8e0-4571-a0e7-bbafa895fb51 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:05.295594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5051e2dc-d8e0-4571-a0e7-bbafa895fb51 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:05.296083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5051e2dc-d8e0-4571-a0e7-bbafa895fb51 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:05.296952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5051e2dc-d8e0-4571-a0e7-bbafa895fb51 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:05.297777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5051e2dc-d8e0-4571-a0e7-bbafa895fb51 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:05.544637 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5051e2dc-d8e0-4571-a0e7-bbafa895fb51 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1836 microversion: 2.1 time: 0.262874 May 07 22:17:05.545233 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2928/5877] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:05 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1836 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:05.562682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:05.563437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:05.571273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:05.571849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:05.572721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:05.573304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:05.717220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:05.725005 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3daf2382-4d8f-4c29-8a66-2203a22e502a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1685 microversion: 2.1 time: 0.166573 May 07 22:17:05.725677 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2950/5878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:05 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:05.877960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50ff33d5-15d0-43bc-8fe8-8f4e6a4343f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:05.879014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50ff33d5-15d0-43bc-8fe8-8f4e6a4343f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:05.885809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50ff33d5-15d0-43bc-8fe8-8f4e6a4343f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:05.886292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50ff33d5-15d0-43bc-8fe8-8f4e6a4343f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:05.887754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50ff33d5-15d0-43bc-8fe8-8f4e6a4343f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:05.888219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50ff33d5-15d0-43bc-8fe8-8f4e6a4343f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:05.938277 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50ff33d5-15d0-43bc-8fe8-8f4e6a4343f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action" status: 200 len: 32638 microversion: 2.1 time: 0.064434 May 07 22:17:05.939210 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2929/5879] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:17:05 2022] POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:17:06.172783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:06.172783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:06.177143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:06.177612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:06.178442 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:06.178926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:06.280398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '89531afef5cb418ba1f03c733b07816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6b6f47ee48bb9910c2053c218c5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:06.281110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] flavor_id is None. Assuming migration. {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4142}} May 07 22:17:06.281632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:17:06.750061 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-08b25cca-fb3a-4544-9937-2c7ee1871ea4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action" status: 202 len: 0 microversion: 2.1 time: 0.587645 May 07 22:17:06.751397 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2951/5880] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:17:06 2022] POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:17:06.762537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:06.763341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:06.781321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:06.782050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:06.783353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:06.784077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:06.952247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:06.960970 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3750ac0c-3d73-415b-8188-7def8f91795e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1694 microversion: 2.1 time: 0.204641 May 07 22:17:06.961871 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2930/5881] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:06 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1694 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:07.986150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:07.987550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:08.008721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:08.009511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:08.010883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:08.011840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:08.171942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:08.181905 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb6379b3-7b90-4861-b3ef-d762e33925a4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1694 microversion: 2.1 time: 0.205226 May 07 22:17:08.182493 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2952/5882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:07 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:09.199508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:09.200144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:09.207202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:09.207669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:09.208462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:09.208921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:09.341592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:09.350504 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d3c29b8-88d7-4467-879d-e13342763177 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.154968 May 07 22:17:09.351148 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2931/5883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:09 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:10.369965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:10.370556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:10.378909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:10.379395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:10.380350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:10.380839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:10.526455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:10.534827 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae0c3869-f1ea-417a-a308-cd2b2589333f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.168970 May 07 22:17:10.535419 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2953/5884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:10 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:11.552004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:11.552699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:11.559917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:11.560482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:11.561505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:11.562041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:11.701042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:11.708654 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-620ba210-f78b-49bc-a105-c80f147434fd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.160646 May 07 22:17:11.709234 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2932/5885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:11 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:12.727677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:12.728287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:12.735788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:12.736254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:12.737128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:12.737583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:12.875244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:12.882946 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd41e152-2a67-4c2d-a20c-d64c019c1c85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.160167 May 07 22:17:12.883524 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2954/5886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:12 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:13.902764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:13.903831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:13.911970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:13.912576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:13.913372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:13.914012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:14.059503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:14.067970 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a0ee0815-fa16-4940-a116-68d7db05f66c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.170615 May 07 22:17:14.068571 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2933/5887] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:13 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:15.085438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:15.086946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:15.098390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:15.098912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:15.099947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:15.100480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:15.257486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:15.266174 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f14572e6-1281-4bad-8b29-7b13af649ff7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.184689 May 07 22:17:15.266758 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2955/5888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:15 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:16.283852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:16.284509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:16.306541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:16.306858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:16.308222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:16.309587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:16.550663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:16.565292 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23a8dd67-f6d8-4d44-8c17-34b1b9510a01 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.285329 May 07 22:17:16.566016 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2934/5889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:16 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:17.583933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:17.584565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:17.597861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:17.598338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:17.599160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:17.599614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:17.757663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:17.766845 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5dd27a09-db09-47b9-8c57-324407b9e21e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.187034 May 07 22:17:17.767445 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2956/5890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:17 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:18.785417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:18.786268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:18.794588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:18.795099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:18.795938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:18.796410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:18.939875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:18.947776 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cf50b5cc-a537-455d-9a8e-27adfe60473b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.166816 May 07 22:17:18.958494 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2935/5891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:18 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:19.274351 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:17:19.290577 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:17:19.967713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:19.968689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:19.977498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:19.978071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:19.978849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:19.979573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:20.144544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:20.153778 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2062544a-de2d-4fb9-a47a-8d508bc5ccc3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.190879 May 07 22:17:20.154396 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2957/5892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:19 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:21.170916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:21.171492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:21.178743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:21.179250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:21.180047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:21.180514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:21.313222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:21.320666 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a4c5bbf6-b8bc-4e0c-ac77-1235b6583cf2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.153840 May 07 22:17:21.321247 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2936/5893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:21 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:22.337968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:22.338608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:22.346554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:22.347055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:22.347863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:22.348311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:22.501435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:22.509520 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-796c9b05-dab9-4bf4-a1cb-d6cd157d4c98 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.175710 May 07 22:17:22.510133 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2958/5894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:22 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:23.528047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:23.528693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:23.535769 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:23.536247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:23.537047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:23.537512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:23.668877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:23.676791 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4b23596e-a6e4-43c1-a8e7-87c7cd70de6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.152745 May 07 22:17:23.677370 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2937/5895] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:23 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:17:24.694595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:24.695252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:24.702656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:24.703143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:24.703927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:24.704380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:24.834281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:24.841762 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-174e7097-1be8-4315-98b0-6330ee945646 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1699 microversion: 2.1 time: 0.151062 May 07 22:17:24.842340 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2959/5896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:24 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:25.859985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:25.860634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:25.868655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:25.869250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:25.870225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:25.870929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:26.063280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:26.070704 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c24967e7-229c-4d1a-b03c-18042b04199d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1698 microversion: 2.1 time: 0.215977 May 07 22:17:26.071308 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2938/5897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:25 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1698 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:26.587939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-61710069-8d56-46f5-ab62-6da0a73cdc5b req-2cc18532-e032-4f00-8887-c5c0538abeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "name": "network-vif-unplugged", "status": "completed", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:26.602094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-61710069-8d56-46f5-ab62-6da0a73cdc5b req-2cc18532-e032-4f00-8887-c5c0538abeb6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:26.602813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-61710069-8d56-46f5-ab62-6da0a73cdc5b req-2cc18532-e032-4f00-8887-c5c0538abeb6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:26.618289 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-61710069-8d56-46f5-ab62-6da0a73cdc5b req-2cc18532-e032-4f00-8887-c5c0538abeb6 service nova] Creating event network-vif-unplugged:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch2-master-1 May 07 22:17:26.626617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-61710069-8d56-46f5-ab62-6da0a73cdc5b req-2cc18532-e032-4f00-8887-c5c0538abeb6 service nova] Instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:17:26.638613 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-61710069-8d56-46f5-ab62-6da0a73cdc5b req-2cc18532-e032-4f00-8887-c5c0538abeb6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.191984 May 07 22:17:26.639270 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2960/5898] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:17:27.089433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:27.090738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:27.097600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:27.098077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:27.098914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:27.099395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:27.317693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:27.325352 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3aaea3c2-733c-489c-8a39-a8dc108c7416 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1698 microversion: 2.1 time: 0.240953 May 07 22:17:27.326042 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2939/5899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:27 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1698 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:28.344376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:28.345079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:28.351568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:28.352104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:28.352972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:28.353416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:28.488012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:28.495508 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9ab54461-781d-4e9a-8d62-fe1af94fdbe9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1696 microversion: 2.1 time: 0.156318 May 07 22:17:28.496079 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2961/5900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:28 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:28.654726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bf8cc3ea-3487-4dac-9038-90549c9e140f req-08cd955d-c58c-42ae-aa5c-ee6c59d0b035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:28.663643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bf8cc3ea-3487-4dac-9038-90549c9e140f req-08cd955d-c58c-42ae-aa5c-ee6c59d0b035 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:28.664109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bf8cc3ea-3487-4dac-9038-90549c9e140f req-08cd955d-c58c-42ae-aa5c-ee6c59d0b035 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:28.676299 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bf8cc3ea-3487-4dac-9038-90549c9e140f req-08cd955d-c58c-42ae-aa5c-ee6c59d0b035 service nova] Creating event network-changed:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch2-master-1 May 07 22:17:28.681531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-bf8cc3ea-3487-4dac-9038-90549c9e140f req-08cd955d-c58c-42ae-aa5c-ee6c59d0b035 service nova] Instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:17:28.692761 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bf8cc3ea-3487-4dac-9038-90549c9e140f req-08cd955d-c58c-42ae-aa5c-ee6c59d0b035 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041756 May 07 22:17:28.693353 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2940/5901] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:17:29.513561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:29.514186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:29.520876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:29.521339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:29.522117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:29.522566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:29.654730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:29.662253 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3ccae415-fbf7-4186-9702-fa77cc528422 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1693 microversion: 2.1 time: 0.153109 May 07 22:17:29.662872 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2962/5902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:29 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:29.680367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc753870-e5e0-463f-894d-3d1e81eac8b3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:29.681655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bc753870-e5e0-463f-894d-3d1e81eac8b3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:29.688159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc753870-e5e0-463f-894d-3d1e81eac8b3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:29.688629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc753870-e5e0-463f-894d-3d1e81eac8b3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:29.689436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc753870-e5e0-463f-894d-3d1e81eac8b3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:29.689897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc753870-e5e0-463f-894d-3d1e81eac8b3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:29.747158 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc753870-e5e0-463f-894d-3d1e81eac8b3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action" status: 204 len: 0 microversion: 2.1 time: 0.071157 May 07 22:17:29.747792 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2941/5903] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:17:29 2022] POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:17:29.756694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:29.757314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:29.764030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:29.764562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:29.765502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:29.765970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:30.022572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:30.030177 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3a2937db-488c-464c-aa1d-9e646be02edf tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1693 microversion: 2.1 time: 0.277503 May 07 22:17:30.030760 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2963/5904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:29 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1693 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:31.049409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:31.050136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:31.056391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:31.056863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:31.057659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:31.058119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:31.190601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:31.198222 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f028db24-b4bb-46eb-9352-10607b2ba0db tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1685 microversion: 2.1 time: 0.154519 May 07 22:17:31.198821 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2942/5905] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:31 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:33.730818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:33.731368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:33.737299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:33.737753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:33.738525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:33.739005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:33.764111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:17:33.841637 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6c3d1ff7-7d50-4640-bab8-7899aa1283ce tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 204 len: 0 microversion: 2.1 time: 0.224057 May 07 22:17:33.842236 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2964/5906] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:17:33 2022] DELETE /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:17:33.850916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:33.851543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:33.858788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:33.859310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:33.860094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:33.860562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:33.991568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:33.999617 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50d848e5-9861-48d7-b9c2-3f396181290b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1577 microversion: 2.1 time: 0.152961 May 07 22:17:34.000185 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2943/5907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:33 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:34.482749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-83a1eb9d-a4f2-4437-8d58-40ef5281b1f0 req-ef3b8d4f-7e5f-40ed-a36b-e0ff7a31ce45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "name": "network-vif-plugged", "status": "completed", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:34.490676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-83a1eb9d-a4f2-4437-8d58-40ef5281b1f0 req-ef3b8d4f-7e5f-40ed-a36b-e0ff7a31ce45 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:34.491190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-83a1eb9d-a4f2-4437-8d58-40ef5281b1f0 req-ef3b8d4f-7e5f-40ed-a36b-e0ff7a31ce45 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:34.501986 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-83a1eb9d-a4f2-4437-8d58-40ef5281b1f0 req-ef3b8d4f-7e5f-40ed-a36b-e0ff7a31ce45 service nova] Creating event network-vif-plugged:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch2-master-1 May 07 22:17:34.506741 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-83a1eb9d-a4f2-4437-8d58-40ef5281b1f0 req-ef3b8d4f-7e5f-40ed-a36b-e0ff7a31ce45 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090494 May 07 22:17:34.507344 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2965/5908] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:17:35.020718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:35.021759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:35.028979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:35.029451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:35.030261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:35.030696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:35.166645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:35.178886 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db0a423f-db2c-4115-9fbf-774b941f3848 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1577 microversion: 2.1 time: 0.164452 May 07 22:17:35.179474 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2944/5909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:35 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:36.198869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:36.201533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:36.210705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:36.211601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:36.212488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:36.213001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:36.328430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a6acfb10-4c01-4051-ad82-75737e9a9cce req-c1d72e50-9192-45d9-8b68-56d3c119cd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f0b5de-f6ce-4056-b170-f80b05559ef2", "name": "network-vif-deleted", "tag": "1b64f639-6c53-4e70-9bf6-32f27e15becc"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:36.342472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a6acfb10-4c01-4051-ad82-75737e9a9cce req-c1d72e50-9192-45d9-8b68-56d3c119cd4a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:36.342982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a6acfb10-4c01-4051-ad82-75737e9a9cce req-c1d72e50-9192-45d9-8b68-56d3c119cd4a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:36.359084 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a6acfb10-4c01-4051-ad82-75737e9a9cce req-c1d72e50-9192-45d9-8b68-56d3c119cd4a service nova] Creating event network-vif-deleted:1b64f639-6c53-4e70-9bf6-32f27e15becc for instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 on nch1-master-1 May 07 22:17:36.368504 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a6acfb10-4c01-4051-ad82-75737e9a9cce req-c1d72e50-9192-45d9-8b68-56d3c119cd4a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156070 May 07 22:17:36.370954 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2945/5910] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:17:36.616380 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:36.624618 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5d89756-da02-4651-b368-7de9f1363c21 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 200 len: 1509 microversion: 2.1 time: 0.430703 May 07 22:17:36.625215 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2966/5911] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:36 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 1509 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:37.642395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:37.643153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:37.650236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:37.650716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:37.651542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:37.652004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:37.665817 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 could not be found. May 07 22:17:37.666428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:17:37.667318 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1b36098d-a805-4f00-9ac3-38ab780b7d9d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 404 len: 111 microversion: 2.1 time: 0.029266 May 07 22:17:37.667856 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2946/5912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:37 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:17:37.712995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1131140183", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-419159820", "security_groups": [{"name": "tempest-secgroup-smoke-1983604752"}], "block_device_mapping_v2": [{"uuid": "d5293072-2a82-483d-ad24-437bd38b3be7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:37.830529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] validate_networks() for [('87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:17:38.272696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:17:38.273118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:17:38.273595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:17:38.274005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:17:38.274423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:17:38.283083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:38.283535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:38.284336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:38.284784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:38.301082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:17:38.306241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:17:38.363445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:17:38.365512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5293072-2a82-483d-ad24-437bd38b3be7',volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:17:38.487974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1baf4c3-ab50-492c-a4d5-744ef30c44d4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.778757 May 07 22:17:38.488650 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2967/5913] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:17:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:17:38.498818 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b34d0f7-1da5-4f53-92c7-0482c10882ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:38.499547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0b34d0f7-1da5-4f53-92c7-0482c10882ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:38.557094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0b34d0f7-1da5-4f53-92c7-0482c10882ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:38.564256 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b34d0f7-1da5-4f53-92c7-0482c10882ca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1094 microversion: 2.1 time: 0.069483 May 07 22:17:38.564832 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2947/5914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:38 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:39.581918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:39.582530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:39.589683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:39.590649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:39.591845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:39.592301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:39.658997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:39.669566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d679eac0-dfc3-4427-a78e-a9ddf96b028b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1210 microversion: 2.1 time: 0.090751 May 07 22:17:39.670914 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2968/5915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:39 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:40.687810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:40.689043 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:40.701230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:40.701617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:40.702420 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:40.702915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:40.794146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-aa242ca6-d871-4245-a8d3-529c8891bef1 req-d063d9da-9191-4d47-9476-2cf48ceb48be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72021281-107d-4e98-b768-6b8d54710130", "tag": "4734e952-8aca-4ba2-be4b-da036580c7c5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:40.805810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aa242ca6-d871-4245-a8d3-529c8891bef1 req-d063d9da-9191-4d47-9476-2cf48ceb48be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:40.806271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aa242ca6-d871-4245-a8d3-529c8891bef1 req-d063d9da-9191-4d47-9476-2cf48ceb48be service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:40.824269 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-aa242ca6-d871-4245-a8d3-529c8891bef1 req-d063d9da-9191-4d47-9476-2cf48ceb48be service nova] Creating event network-changed:4734e952-8aca-4ba2-be4b-da036580c7c5 for instance 72021281-107d-4e98-b768-6b8d54710130 on nch1-master-1 May 07 22:17:40.833869 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-aa242ca6-d871-4245-a8d3-529c8891bef1 req-d063d9da-9191-4d47-9476-2cf48ceb48be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043909 May 07 22:17:40.835240 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2969/5916] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:17:40.869941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:40.878273 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5f868b15-10a5-4b98-b69e-eb76f9060228 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1266 microversion: 2.1 time: 0.195092 May 07 22:17:40.888112 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2948/5917] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:40 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:41.896737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:41.897482 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:41.904366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:41.904897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:41.905659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:41.906099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:42.124429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:42.131841 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-87f4cd4d-0dc0-40ff-bf1c-fd267aaf3c64 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1266 microversion: 2.1 time: 0.240228 May 07 22:17:42.132415 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2970/5918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:41 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:43.148514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:43.149152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:43.156286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:43.156752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:43.157531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:43.157984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:43.285343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:43.292765 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee347786-a84a-4b6c-9e21-1df11e36b87f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1266 microversion: 2.1 time: 0.148324 May 07 22:17:43.293340 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2949/5919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:43 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:44.310170 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:44.310715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:44.317774 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:44.318250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:44.319096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:44.319567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:44.456355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:44.464150 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d64e1568-0beb-4375-8d96-efeae83d80cd tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1266 microversion: 2.1 time: 0.158579 May 07 22:17:44.464753 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2971/5920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:44 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:45.480540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:45.481234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:45.488161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:45.488635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:45.489424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:45.489887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:45.622628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:45.630261 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51adeb80-b197-41d7-80b7-7e3b61ddf916 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1266 microversion: 2.1 time: 0.153714 May 07 22:17:45.630867 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2950/5921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:45 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:45.846276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7d38da6f-1859-4479-969f-ce6e120480f1 req-724e1974-4dc5-4c03-becd-227c16a12628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72021281-107d-4e98-b768-6b8d54710130", "name": "network-vif-plugged", "status": "completed", "tag": "4734e952-8aca-4ba2-be4b-da036580c7c5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:45.857987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7d38da6f-1859-4479-969f-ce6e120480f1 req-724e1974-4dc5-4c03-becd-227c16a12628 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:45.858447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7d38da6f-1859-4479-969f-ce6e120480f1 req-724e1974-4dc5-4c03-becd-227c16a12628 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:45.869826 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7d38da6f-1859-4479-969f-ce6e120480f1 req-724e1974-4dc5-4c03-becd-227c16a12628 service nova] Creating event network-vif-plugged:4734e952-8aca-4ba2-be4b-da036580c7c5 for instance 72021281-107d-4e98-b768-6b8d54710130 on nch1-master-1 May 07 22:17:45.875014 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7d38da6f-1859-4479-969f-ce6e120480f1 req-724e1974-4dc5-4c03-becd-227c16a12628 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032679 May 07 22:17:45.875628 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2972/5922] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:17:46.647895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:46.648556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:46.655312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:46.655777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:46.656554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:46.657009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:46.787264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:46.795271 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8f5e34a6-74cd-4b38-8e75-ffe0cda9b518 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1266 microversion: 2.1 time: 0.151281 May 07 22:17:46.795850 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2951/5923] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:46 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:47.813296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:47.814001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:47.821073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:47.821538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:47.822316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:47.822762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:47.949372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:47.957256 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d0c937e-92bd-4384-a8ff-9b0ad2fe2330 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1453 microversion: 2.1 time: 0.148744 May 07 22:17:47.957833 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2973/5924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:47 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:17:47.973191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:47.973825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:47.980546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:47.981012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:47.981807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:47.982263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:48.107912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:17:48.115204 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7496fbf5-b44d-4a0e-b7ab-b30f8564ee3a tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1453 microversion: 2.1 time: 0.145841 May 07 22:17:48.115777 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2952/5925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:47 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:17:50.036324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-269607d3-8f1d-4ab3-b67a-abf2f5135283 req-82ef63e1-9b07-4811-a528-68902c0fb126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72021281-107d-4e98-b768-6b8d54710130", "tag": "4734e952-8aca-4ba2-be4b-da036580c7c5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:50.045621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-269607d3-8f1d-4ab3-b67a-abf2f5135283 req-82ef63e1-9b07-4811-a528-68902c0fb126 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:50.046081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-269607d3-8f1d-4ab3-b67a-abf2f5135283 req-82ef63e1-9b07-4811-a528-68902c0fb126 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:50.057442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-269607d3-8f1d-4ab3-b67a-abf2f5135283 req-82ef63e1-9b07-4811-a528-68902c0fb126 service nova] Creating event network-changed:4734e952-8aca-4ba2-be4b-da036580c7c5 for instance 72021281-107d-4e98-b768-6b8d54710130 on nch1-master-1 May 07 22:17:50.062386 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-269607d3-8f1d-4ab3-b67a-abf2f5135283 req-82ef63e1-9b07-4811-a528-68902c0fb126 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029882 May 07 22:17:50.063043 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2974/5926] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:17:53.386246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b0e172b9-9f64-4e9e-8fc5-dfd86dd39c3b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:17:53.387214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b0e172b9-9f64-4e9e-8fc5-dfd86dd39c3b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:53.394532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0e172b9-9f64-4e9e-8fc5-dfd86dd39c3b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:53.395045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0e172b9-9f64-4e9e-8fc5-dfd86dd39c3b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:53.395826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0e172b9-9f64-4e9e-8fc5-dfd86dd39c3b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:53.396285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0e172b9-9f64-4e9e-8fc5-dfd86dd39c3b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:53.447185 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b0e172b9-9f64-4e9e-8fc5-dfd86dd39c3b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action" status: 200 len: 24574 microversion: 2.1 time: 0.064837 May 07 22:17:53.447851 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2953/5927] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:17:53 2022] POST /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4/action => generated 24574 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:17:59.755793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-53c2d9bd-5a52-489a-b2fd-558df9004626 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:17:59.756502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-53c2d9bd-5a52-489a-b2fd-558df9004626 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:17:59.762801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53c2d9bd-5a52-489a-b2fd-558df9004626 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:59.763259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53c2d9bd-5a52-489a-b2fd-558df9004626 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:59.764666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53c2d9bd-5a52-489a-b2fd-558df9004626 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:17:59.765114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-53c2d9bd-5a52-489a-b2fd-558df9004626 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:17:59.892033 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-53c2d9bd-5a52-489a-b2fd-558df9004626 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1836 microversion: 2.1 time: 0.141616 May 07 22:17:59.892619 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2975/5928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:17:59 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1836 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:00.780938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:00.781544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:00.786515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f01b0825-a597-47bd-af43-b87b080fd0ba req-adad1c74-e910-4025-a65f-9229d651f36d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:00.799139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:00.799362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f01b0825-a597-47bd-af43-b87b080fd0ba req-adad1c74-e910-4025-a65f-9229d651f36d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:00.799663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f01b0825-a597-47bd-af43-b87b080fd0ba req-adad1c74-e910-4025-a65f-9229d651f36d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:00.799962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:00.800937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:00.801386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:00.811180 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f01b0825-a597-47bd-af43-b87b080fd0ba req-adad1c74-e910-4025-a65f-9229d651f36d service nova] Creating event network-changed:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch2-master-1 May 07 22:18:00.816721 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f01b0825-a597-47bd-af43-b87b080fd0ba req-adad1c74-e910-4025-a65f-9229d651f36d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033732 May 07 22:18:00.817768 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2976/5929] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:18:00.839120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:18:00.926044 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fdb15c94-2392-49aa-ad09-01218acf16a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 204 len: 0 microversion: 2.1 time: 0.149536 May 07 22:18:00.932936 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2954/5930] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:18:00 2022] DELETE /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:18:00.942560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:00.943305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:00.951649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:00.952108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:00.952892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:00.953332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:01.089700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:01.097879 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92a398f6-8f22-4657-b2e7-80f9ca2aae5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1691 microversion: 2.1 time: 0.163030 May 07 22:18:01.098473 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2977/5931] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:00 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:02.119746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:02.120480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:02.127410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:02.127890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:02.128726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:02.129165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:02.268071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:02.275529 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9f04a773-f4b5-40df-8785-6fde051e7f3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1691 microversion: 2.1 time: 0.160309 May 07 22:18:02.276099 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2955/5932] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:02 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:03.182039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2fc8a6ba-6074-4af4-b16d-a897e8d4cd62 req-db250140-db17-4f54-8ac7-cb78bd69e27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb649c7-b657-44d4-bb73-606cd09d5be4", "name": "network-vif-deleted", "tag": "9c2ebdfc-88f2-4b16-86b6-f431afb49876"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:03.191633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2fc8a6ba-6074-4af4-b16d-a897e8d4cd62 req-db250140-db17-4f54-8ac7-cb78bd69e27b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:03.192217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2fc8a6ba-6074-4af4-b16d-a897e8d4cd62 req-db250140-db17-4f54-8ac7-cb78bd69e27b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:03.204467 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2fc8a6ba-6074-4af4-b16d-a897e8d4cd62 req-db250140-db17-4f54-8ac7-cb78bd69e27b service nova] Creating event network-vif-deleted:9c2ebdfc-88f2-4b16-86b6-f431afb49876 for instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 on nch2-master-1 May 07 22:18:03.209528 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2fc8a6ba-6074-4af4-b16d-a897e8d4cd62 req-db250140-db17-4f54-8ac7-cb78bd69e27b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 May 07 22:18:03.210146 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2978/5933] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:18:03.293682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:03.295560 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:03.303092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:03.303566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:03.304359 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:03.304820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:03.336443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:03.336917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:03.337386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lazy-loading 'fault' on Instance uuid 8eb649c7-b657-44d4-bb73-606cd09d5be4 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:18:03.378059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:03.385923 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5a85a1fd-4059-4833-ac5c-34b7aad90ce5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 200 len: 1357 microversion: 2.1 time: 0.097058 May 07 22:18:03.386576 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2956/5934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:03 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:04.406414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:04.407351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 8eb649c7-b657-44d4-bb73-606cd09d5be4] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:04.414635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:04.415218 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:04.416267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:04.417281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:04.433536 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] HTTP exception thrown: Instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 could not be found. May 07 22:18:04.434355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Returning 404 to user: Instance 8eb649c7-b657-44d4-bb73-606cd09d5be4 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:18:04.436067 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-83f96e8d-f480-4a04-b5c0-2446ae1fa121 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4" status: 404 len: 111 microversion: 2.1 time: 0.035347 May 07 22:18:04.436801 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2979/5935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:04 2022] GET /compute/v2.1/servers/8eb649c7-b657-44d4-bb73-606cd09d5be4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:18:07.899920 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-031eba9d-15b9-4675-833b-4c0845e41493 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '.version_select at 0x7fc41cedd790>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:07.923860 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-031eba9d-15b9-4675-833b-4c0845e41493 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1530140642" status: 202 len: 0 microversion: 2.1 time: 0.027841 May 07 22:18:07.924459 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2957/5936] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:18:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1530140642 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:18:07.953086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6e7d91cd-1c6b-4dad-a89c-c0dc19a97a73 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: .version_select at 0x7fc40fb104c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1551205815"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:07.970474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6e7d91cd-1c6b-4dad-a89c-c0dc19a97a73 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:18:07.979932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6e7d91cd-1c6b-4dad-a89c-c0dc19a97a73 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:18:08.130872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6e7d91cd-1c6b-4dad-a89c-c0dc19a97a73 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:18:08.136007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6e7d91cd-1c6b-4dad-a89c-c0dc19a97a73 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:18:08.154682 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6e7d91cd-1c6b-4dad-a89c-c0dc19a97a73 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.206521 May 07 22:18:08.155342 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2980/5937] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:18:07 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:18:14.475591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1180823186", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "d28ff04e-297c-4778-a4e4-921b5acd931f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1551205815", "security_groups": [{"name": "tempest-secgroup-smoke-415066268"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:14.617408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] validate_networks() for [('d28ff04e-297c-4778-a4e4-921b5acd931f', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:18:15.047154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:18:15.047678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:18:15.049263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:18:15.050112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:18:15.051178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:18:15.065474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:15.066549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:15.068201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:15.068962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:15.101821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:18:15.111872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:18:15.135943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:18:15.139849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:18:15.189758 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-80c51753-58c3-451f-841d-78121421e284 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719039 May 07 22:18:15.195694 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2958/5938] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:18:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:18:15.203404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a467c35f-213d-426c-ae98-6b370b4db677 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:15.204087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a467c35f-213d-426c-ae98-6b370b4db677 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:15.268438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a467c35f-213d-426c-ae98-6b370b4db677 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:15.275796 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a467c35f-213d-426c-ae98-6b370b4db677 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1267 microversion: 2.1 time: 0.078333 May 07 22:18:15.276389 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2981/5939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:15 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:16.304976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:16.306123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:16.320453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:16.320952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:16.321856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:16.322357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:16.417726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:16.432823 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4da0abb2-a72c-4230-b11e-d4ec3cfd8efc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1337 microversion: 2.1 time: 0.138062 May 07 22:18:16.433421 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2959/5940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:16 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1337 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:17.450847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:17.452401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:17.461735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:17.462197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:17.463197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:17.463648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:17.610265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:17.617982 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8071768d-afbd-42a5-b60b-4d052dc18a42 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.171119 May 07 22:18:17.618568 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2982/5941] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:17 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:17.928453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-eefdc6db-8625-412a-9e53-e6a67017906e req-dbc1df93-9531-4a93-90b6-42cf4d1e3d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:17.938675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-eefdc6db-8625-412a-9e53-e6a67017906e req-dbc1df93-9531-4a93-90b6-42cf4d1e3d9b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:17.939594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-eefdc6db-8625-412a-9e53-e6a67017906e req-dbc1df93-9531-4a93-90b6-42cf4d1e3d9b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:17.960332 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-eefdc6db-8625-412a-9e53-e6a67017906e req-dbc1df93-9531-4a93-90b6-42cf4d1e3d9b service nova] Creating event network-changed:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch2-master-1 May 07 22:18:17.966870 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-eefdc6db-8625-412a-9e53-e6a67017906e req-dbc1df93-9531-4a93-90b6-42cf4d1e3d9b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041826 May 07 22:18:17.967980 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2960/5942] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:18:18.635926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:18.636578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:18.644046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:18.644512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:18.645288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:18.646100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:18.780991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:18.788478 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f9aa93e5-46e4-4986-998b-7fd10fc114a5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.156431 May 07 22:18:18.789059 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2983/5943] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:18 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:19.807383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:19.808113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:19.815160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:19.815633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:19.816437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:19.816894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:19.960155 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:19.967571 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-812f25bf-0916-4911-b502-7902531e43f8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.165692 May 07 22:18:19.968166 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2961/5944] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:19 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:20.984536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:20.985148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:20.991987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:20.992441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:20.993204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:20.993642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:21.123788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:21.131168 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-02ae555d-8247-4d3d-95c7-0fb4b5548f5c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.150571 May 07 22:18:21.131739 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2984/5945] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:20 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:22.147773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:22.148410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:22.155996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:22.156466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:22.157296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:22.157755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:22.284248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:22.291687 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-908c0405-f5eb-4cf9-a296-4b231176e83a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.147980 May 07 22:18:22.292257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2962/5946] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:22 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:23.308423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:23.308943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:23.315827 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:23.316281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:23.317068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:23.317516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:23.448615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:23.456373 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8766012c-478e-417a-81de-da9d52873fff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.151908 May 07 22:18:23.456948 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2985/5947] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:23 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:24.472856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:24.473616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:24.480796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:24.481411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:24.482260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:24.482719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:24.528845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-069da08e-db04-4f91-9362-2ff1c60f3d83 req-8fcc29dd-d61a-43e6-a8b3-153be81f71af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "name": "network-vif-plugged", "status": "completed", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:24.537717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-069da08e-db04-4f91-9362-2ff1c60f3d83 req-8fcc29dd-d61a-43e6-a8b3-153be81f71af service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:24.538241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-069da08e-db04-4f91-9362-2ff1c60f3d83 req-8fcc29dd-d61a-43e6-a8b3-153be81f71af service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:24.550003 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-069da08e-db04-4f91-9362-2ff1c60f3d83 req-8fcc29dd-d61a-43e6-a8b3-153be81f71af service nova] Creating event network-vif-plugged:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch2-master-1 May 07 22:18:24.555095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-069da08e-db04-4f91-9362-2ff1c60f3d83 req-8fcc29dd-d61a-43e6-a8b3-153be81f71af service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030317 May 07 22:18:24.555845 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2986/5948] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:18:24.663065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:24.670621 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-31c4d82c-08db-4c71-84ea-68eaed3e2572 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.201798 May 07 22:18:24.671541 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2963/5949] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:24 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:25.688514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:25.689336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:25.695550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:25.696009 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:25.696782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:25.697226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:25.834163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:25.842305 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-648a1cbc-caa8-42f7-b8c3-b623103adeb0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1392 microversion: 2.1 time: 0.158902 May 07 22:18:25.842904 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2987/5950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:25 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:26.859113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:26.859748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:26.866603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:26.867108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:26.867926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:26.868381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:27.001257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:27.008776 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2b6c25ce-2e8a-44d3-b972-0c34cf8a6d69 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1565 microversion: 2.1 time: 0.153725 May 07 22:18:27.009354 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2964/5951] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:26 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:27.025379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:27.026024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:27.032784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:27.033243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:27.034017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:27.034463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:27.167295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:27.175519 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e38b1b43-3296-41b8-b773-1dd0b9a40672 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1565 microversion: 2.1 time: 0.154003 May 07 22:18:27.176117 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2988/5952] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:27 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:29.096026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:29.096670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:29.099689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-eeae0bf0-1877-4968-a1cf-108b67544cbe req-beace3f9-2df0-4c68-b1a9-7de8ac13eeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:29.103648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:29.104210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:29.105213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:29.105875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:29.109415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-eeae0bf0-1877-4968-a1cf-108b67544cbe req-beace3f9-2df0-4c68-b1a9-7de8ac13eeb8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:29.110090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-eeae0bf0-1877-4968-a1cf-108b67544cbe req-beace3f9-2df0-4c68-b1a9-7de8ac13eeb8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:29.121579 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-eeae0bf0-1877-4968-a1cf-108b67544cbe req-beace3f9-2df0-4c68-b1a9-7de8ac13eeb8 service nova] Creating event network-changed:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch2-master-1 May 07 22:18:29.126840 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-eeae0bf0-1877-4968-a1cf-108b67544cbe req-beace3f9-2df0-4c68-b1a9-7de8ac13eeb8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031647 May 07 22:18:29.127452 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2989/5953] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:18:29.347516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:29.355966 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c758b6ba-4128-47e5-a689-1196630a4aa3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1565 microversion: 2.1 time: 0.264002 May 07 22:18:29.362984 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2965/5954] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:29 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1565 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:50.649450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-34633715-a5f5-4b31-9db6-eb85f28e28b0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:50.650458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-34633715-a5f5-4b31-9db6-eb85f28e28b0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:50.656750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34633715-a5f5-4b31-9db6-eb85f28e28b0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:50.657709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34633715-a5f5-4b31-9db6-eb85f28e28b0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:50.658477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34633715-a5f5-4b31-9db6-eb85f28e28b0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:50.658950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34633715-a5f5-4b31-9db6-eb85f28e28b0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:50.712683 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-34633715-a5f5-4b31-9db6-eb85f28e28b0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action" status: 200 len: 24569 microversion: 2.1 time: 0.068419 May 07 22:18:50.713347 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2990/5955] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:18:50 2022] POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action => generated 24569 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:18:57.115439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e52d269-cfcc-457a-b273-616ceb6f8d35 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:57.116543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e52d269-cfcc-457a-b273-616ceb6f8d35 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:57.124796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e52d269-cfcc-457a-b273-616ceb6f8d35 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.125338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e52d269-cfcc-457a-b273-616ceb6f8d35 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.126310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e52d269-cfcc-457a-b273-616ceb6f8d35 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.126810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e52d269-cfcc-457a-b273-616ceb6f8d35 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.270191 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e52d269-cfcc-457a-b273-616ceb6f8d35 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1835 microversion: 2.1 time: 0.162115 May 07 22:18:57.270793 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2966/5956] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:57 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1835 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:57.288228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:57.289506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:57.297963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.298426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.299248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.299701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.447305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:57.457979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6642f437-818d-4af5-a6c4-ee9d6587a6f5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1684 microversion: 2.1 time: 0.173843 May 07 22:18:57.459388 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2991/5957] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:57 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:57.569405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-120c0766-6f78-4f3c-abaa-458738694f86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:57.570373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-120c0766-6f78-4f3c-abaa-458738694f86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:57.577079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120c0766-6f78-4f3c-abaa-458738694f86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.577538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120c0766-6f78-4f3c-abaa-458738694f86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.578339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120c0766-6f78-4f3c-abaa-458738694f86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.578836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-120c0766-6f78-4f3c-abaa-458738694f86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.635262 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-120c0766-6f78-4f3c-abaa-458738694f86 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action" status: 200 len: 32639 microversion: 2.1 time: 0.069402 May 07 22:18:57.636011 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2967/5958] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:18:57 2022] POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action => generated 32639 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:18:57.778790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:18:57.779375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:57.786584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.787142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.787985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.788387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.817348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '89531afef5cb418ba1f03c733b07816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eeb6b6f47ee48bb9910c2053c218c5f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:57.817936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] flavor_id is None. Assuming migration. {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4142}} May 07 22:18:57.818388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:18:57.937541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-38a77230-fafe-4b5d-b1f9-d06a4b854b88 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action" status: 202 len: 0 microversion: 2.1 time: 0.162303 May 07 22:18:57.938217 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2992/5959] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:18:57 2022] POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:18:57.948673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:57.949764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:57.958667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.959307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:57.960189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:57.960751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:58.147195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:58.156063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d2fc4b4-6d93-4c3d-a4cd-e972731bb06a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1693 microversion: 2.1 time: 0.212841 May 07 22:18:58.156831 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2968/5960] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:57 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:18:59.178080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:18:59.178984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:18:59.186590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:59.187157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:59.188080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:18:59.188585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:18:59.332255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:18:59.340519 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0913cf4-d005-4d86-9245-e99770cbdb17 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1693 microversion: 2.1 time: 0.167990 May 07 22:18:59.341216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2993/5961] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:18:59 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:00.359080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:00.359787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:00.367987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:00.368468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:00.369270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:00.369737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:00.506260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:00.513772 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-74f24897-c6a7-4588-9a1b-66349c83a79c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.158706 May 07 22:19:00.514347 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2969/5962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:00 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:01.531363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:01.531982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:01.538725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:01.539216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:01.539990 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:01.540433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:01.674165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:01.682063 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-24693545-a537-4d06-9d0a-879a2fb83571 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.154677 May 07 22:19:01.682638 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2994/5963] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:01 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:02.700259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:02.700930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:02.707813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:02.708291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:02.709085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:02.709548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:02.843427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:02.851628 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e8d09d55-e99f-49ea-b35a-b0a3577a3d85 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.155493 May 07 22:19:02.852211 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2970/5964] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:02 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:03.869124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:03.869750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:03.877206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:03.877682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:03.878457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:03.878945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:04.006493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:04.014018 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1663e920-6c35-44dc-a783-9fe1727e39ff tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.148834 May 07 22:19:04.014599 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2995/5965] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:03 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:05.031374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:05.032018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:05.039099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:05.039586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:05.040396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:05.040865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:05.227090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:05.234614 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-76e8288f-a3b8-4da6-88b4-08405539839c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.207266 May 07 22:19:05.235227 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2971/5966] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:05 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:06.252739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:06.253357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:06.260096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:06.260557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:06.261321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:06.261767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:06.394201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:06.401551 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d704cee-046d-440d-afc6-acc0a4769491 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.153057 May 07 22:19:06.402125 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2996/5967] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:06 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:07.420535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:07.421125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:07.428731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:07.429208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:07.430002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:07.430466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:07.574363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:07.582326 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4892b1d4-5548-4a20-8613-c56847ff040e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.166252 May 07 22:19:07.583032 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2972/5968] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:07 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:08.600198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:08.600853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:08.607732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:08.608193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:08.608965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:08.609413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:08.739596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:08.746979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e47e99e-0e62-4cd2-af42-06cfc4f2fbd9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.150724 May 07 22:19:08.747563 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2997/5969] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:08 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:09.764258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:09.764899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:09.771893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:09.772366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:09.773160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:09.773628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:09.906400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:09.913941 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-68681881-033b-42ea-a475-f8bc7669b185 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.153670 May 07 22:19:09.914521 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2973/5970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:09 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:10.932014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:10.932669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:10.940137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:10.940591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:10.941368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:10.941811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:11.068706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:11.076137 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2a587d3d-f83f-4da4-92c1-34a50e8a0263 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1698 microversion: 2.1 time: 0.148000 May 07 22:19:11.076714 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2998/5971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:10 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1698 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:12.093608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:12.094285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:12.101902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:12.102378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:12.103218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:12.103683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:12.249112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:12.257232 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b807db60-e649-46fb-9b77-ef6d4baa8d64 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1697 microversion: 2.1 time: 0.167698 May 07 22:19:12.257836 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2974/5972] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:12 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:12.293023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8e3020b6-56bd-42b5-a2c8-78058a571697 req-ab67809e-663a-4275-9d4a-c324f10f2f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "name": "network-vif-unplugged", "status": "completed", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:12.302291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8e3020b6-56bd-42b5-a2c8-78058a571697 req-ab67809e-663a-4275-9d4a-c324f10f2f07 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:12.302886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8e3020b6-56bd-42b5-a2c8-78058a571697 req-ab67809e-663a-4275-9d4a-c324f10f2f07 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:12.314379 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8e3020b6-56bd-42b5-a2c8-78058a571697 req-ab67809e-663a-4275-9d4a-c324f10f2f07 service nova] Creating event network-vif-unplugged:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch1-master-1 May 07 22:19:12.319683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-8e3020b6-56bd-42b5-a2c8-78058a571697 req-ab67809e-663a-4275-9d4a-c324f10f2f07 service nova] Instance 2387d312-9744-4eb5-b6b6-aa41a601c7db is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:19:12.330935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8e3020b6-56bd-42b5-a2c8-78058a571697 req-ab67809e-663a-4275-9d4a-c324f10f2f07 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041615 May 07 22:19:12.331766 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 2999/5973] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:19:13.274747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:13.275446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:13.282381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:13.283387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:13.284200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:13.284662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:13.424078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:13.431810 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fedd558f-af97-4306-9363-3733f3c30ae4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1697 microversion: 2.1 time: 0.161050 May 07 22:19:13.432397 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2975/5974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:13 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:14.349705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-19e8c5be-5f63-4461-95b8-f86548955cf9 req-bdd86953-a2fd-4d3a-a011-9e8b3ec26bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:14.358544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-19e8c5be-5f63-4461-95b8-f86548955cf9 req-bdd86953-a2fd-4d3a-a011-9e8b3ec26bb4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:14.359025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-19e8c5be-5f63-4461-95b8-f86548955cf9 req-bdd86953-a2fd-4d3a-a011-9e8b3ec26bb4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:14.373360 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-19e8c5be-5f63-4461-95b8-f86548955cf9 req-bdd86953-a2fd-4d3a-a011-9e8b3ec26bb4 service nova] Creating event network-changed:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch1-master-1 May 07 22:19:14.379352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-19e8c5be-5f63-4461-95b8-f86548955cf9 req-bdd86953-a2fd-4d3a-a011-9e8b3ec26bb4 service nova] Instance 2387d312-9744-4eb5-b6b6-aa41a601c7db is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:19:14.390032 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-19e8c5be-5f63-4461-95b8-f86548955cf9 req-bdd86953-a2fd-4d3a-a011-9e8b3ec26bb4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045294 May 07 22:19:14.390638 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3000/5975] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:19:14.449159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:14.450007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:14.457025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:14.457506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:14.458309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:14.458802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:14.675626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:14.683129 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee27d5b2-f48d-459c-96c0-be14ceb90150 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1695 microversion: 2.1 time: 0.238096 May 07 22:19:14.683797 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2976/5976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:14 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1695 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:15.700857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:15.701480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:15.709157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:15.709609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:15.710373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:15.710844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:15.841549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:15.849013 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-856bbd66-618e-4fa8-a78a-f1716f64d946 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1692 microversion: 2.1 time: 0.152564 May 07 22:19:15.849583 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3001/5977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:15 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:15.865678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f0b8a51b-d3b8-4708-83e5-720611a653c4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:15.866243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f0b8a51b-d3b8-4708-83e5-720611a653c4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:15.873054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0b8a51b-d3b8-4708-83e5-720611a653c4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:15.873530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0b8a51b-d3b8-4708-83e5-720611a653c4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:15.874314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0b8a51b-d3b8-4708-83e5-720611a653c4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:15.874793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f0b8a51b-d3b8-4708-83e5-720611a653c4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:15.979327 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f0b8a51b-d3b8-4708-83e5-720611a653c4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action" status: 202 len: 0 microversion: 2.1 time: 0.117327 May 07 22:19:15.979957 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2977/5978] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:19:15 2022] POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:19:15.988627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:15.989256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:15.995243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:15.995707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:15.996511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:15.996950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:16.198119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:16.205943 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-49a32c91-3661-40a1-bd79-a625376f8460 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1691 microversion: 2.1 time: 0.221697 May 07 22:19:16.206624 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3002/5979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:15 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1691 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:19:17.224986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:17.225733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:17.232073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:17.232545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:17.233326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:17.233778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:17.368720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:17.376738 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ef0e3f3a-c33d-4bd6-a69f-7c89d912278b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1691 microversion: 2.1 time: 0.156358 May 07 22:19:17.377639 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2978/5980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:17 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:18.393426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:18.394098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:18.401249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:18.401717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:18.402498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:18.402989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:18.543506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:18.552143 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-35965c4a-2100-4024-b22c-ccf9c00dfe61 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1691 microversion: 2.1 time: 0.162599 May 07 22:19:18.552724 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3003/5981] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:18 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:19.399638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9ea50cc7-41bb-4b09-902c-d4b2944e5172 req-43cb7d4b-c0fc-4bc5-9bbe-0ab6056a1662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:19.409742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9ea50cc7-41bb-4b09-902c-d4b2944e5172 req-43cb7d4b-c0fc-4bc5-9bbe-0ab6056a1662 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:19.410662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9ea50cc7-41bb-4b09-902c-d4b2944e5172 req-43cb7d4b-c0fc-4bc5-9bbe-0ab6056a1662 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:19.424251 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9ea50cc7-41bb-4b09-902c-d4b2944e5172 req-43cb7d4b-c0fc-4bc5-9bbe-0ab6056a1662 service nova] Creating event network-changed:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch2-master-1 May 07 22:19:19.431492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-9ea50cc7-41bb-4b09-902c-d4b2944e5172 req-43cb7d4b-c0fc-4bc5-9bbe-0ab6056a1662 service nova] Instance 2387d312-9744-4eb5-b6b6-aa41a601c7db is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:19:19.444531 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9ea50cc7-41bb-4b09-902c-d4b2944e5172 req-43cb7d4b-c0fc-4bc5-9bbe-0ab6056a1662 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056023 May 07 22:19:19.445156 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2979/5982] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:19:19.570524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:19.571191 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:19.579470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:19.580307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:19.581590 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:19.582261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:19.816866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:19.824492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1356b470-4cc3-4ab3-95ae-2326bbfbc9b7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1691 microversion: 2.1 time: 0.257894 May 07 22:19:19.825321 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3004/5983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:19 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:20.842846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:20.843577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:20.849964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:20.850445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:20.851267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:20.851727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:20.990197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:20.997714 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-72ad8347-734c-42bb-8b7d-7493cf2fe9c5 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1691 microversion: 2.1 time: 0.160115 May 07 22:19:20.998306 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2980/5984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:20 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:19:22.016086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:22.016742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:22.023589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:22.024050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:22.024828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:22.025274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:22.162344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:22.169997 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3fefc5b1-34dd-4d22-a22a-0b3f149a831a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1684 microversion: 2.1 time: 0.157829 May 07 22:19:22.170571 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3005/5985] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:22 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:24.829355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-246f8377-f0c9-4856-ae33-af2036555c5d req-704ad96d-a730-4814-b948-5af90d76d49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "name": "network-vif-plugged", "status": "completed", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:24.838979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-246f8377-f0c9-4856-ae33-af2036555c5d req-704ad96d-a730-4814-b948-5af90d76d49b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:24.839453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-246f8377-f0c9-4856-ae33-af2036555c5d req-704ad96d-a730-4814-b948-5af90d76d49b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:24.853954 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-246f8377-f0c9-4856-ae33-af2036555c5d req-704ad96d-a730-4814-b948-5af90d76d49b service nova] Creating event network-vif-plugged:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch2-master-1 May 07 22:19:24.859354 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-246f8377-f0c9-4856-ae33-af2036555c5d req-704ad96d-a730-4814-b948-5af90d76d49b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 May 07 22:19:24.860207 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2981/5986] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:19:44.955586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1793557541", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-419159820", "security_groups": [{"name": "tempest-secgroup-smoke-1983604752"}], "block_device_mapping_v2": [{"uuid": "f9f101f0-0189-4520-a073-6074f76ea4db", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:45.062795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] validate_networks() for [('87b1e7a7-8c2c-4e76-aa0c-2bc5b8c974ce', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:19:45.430873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:19:45.431342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:19:45.431826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:19:45.432244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:19:45.432665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:19:45.442569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:45.443064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:45.443878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:45.444328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:45.463612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:19:45.469445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Getting quotas for user 9b4988836610494ab48a138bd43d5b52 and project f3657e8df46a4252b9eb1eb159306a66. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:19:45.526179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:19:45.528303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9f101f0-0189-4520-a073-6074f76ea4db',volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:19:45.648760 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a640ddb3-50df-4787-b7f7-f91137da2784 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.697335 May 07 22:19:45.649424 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3006/5987] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:19:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:19:45.661046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-44484be1-bc52-4bed-aa73-9a01a392e7d3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:45.661774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-44484be1-bc52-4bed-aa73-9a01a392e7d3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:45.715758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-44484be1-bc52-4bed-aa73-9a01a392e7d3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:45.722449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-44484be1-bc52-4bed-aa73-9a01a392e7d3 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1094 microversion: 2.1 time: 0.066780 May 07 22:19:45.723144 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2982/5988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:45 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:46.359529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-15ef4f13-e669-481e-81df-c8f9a565a590 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:46.360550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-15ef4f13-e669-481e-81df-c8f9a565a590 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:46.368661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15ef4f13-e669-481e-81df-c8f9a565a590 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:46.369128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15ef4f13-e669-481e-81df-c8f9a565a590 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:46.369909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15ef4f13-e669-481e-81df-c8f9a565a590 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:46.370360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-15ef4f13-e669-481e-81df-c8f9a565a590 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:46.427123 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-15ef4f13-e669-481e-81df-c8f9a565a590 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action" status: 200 len: 62597 microversion: 2.1 time: 0.071320 May 07 22:19:46.427874 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3007/5989] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:19:46 2022] POST /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db/action => generated 62597 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:19:46.739097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:46.739733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:46.748112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:46.748804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:46.749592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:46.750048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:46.814944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:46.823836 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a5d4931e-b9ca-49b7-b4ec-95d6e96d6b4b tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1210 microversion: 2.1 time: 0.088601 May 07 22:19:46.824656 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2983/5990] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:46 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:47.842524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:47.843384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:47.852236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:47.852691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:47.853584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:47.854091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:47.989889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-557a0157-c364-48f5-b4e7-40ea7f01be58 req-8a1151b2-0b6a-418d-94ec-2e76eaf48e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ab6dd8-49af-4888-a060-d9434ef4faf9", "tag": "cbe19c2f-74d7-43b0-9ac7-a1dd5f232233"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:48.008122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-557a0157-c364-48f5-b4e7-40ea7f01be58 req-8a1151b2-0b6a-418d-94ec-2e76eaf48e96 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:48.008685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-557a0157-c364-48f5-b4e7-40ea7f01be58 req-8a1151b2-0b6a-418d-94ec-2e76eaf48e96 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:48.022482 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-557a0157-c364-48f5-b4e7-40ea7f01be58 req-8a1151b2-0b6a-418d-94ec-2e76eaf48e96 service nova] Creating event network-changed:cbe19c2f-74d7-43b0-9ac7-a1dd5f232233 for instance 11ab6dd8-49af-4888-a060-d9434ef4faf9 on nch1-master-1 May 07 22:19:48.029798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-557a0157-c364-48f5-b4e7-40ea7f01be58 req-8a1151b2-0b6a-418d-94ec-2e76eaf48e96 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043870 May 07 22:19:48.031289 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2984/5991] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:19:48.085583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:48.094803 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d3311e2-fad2-4296-b087-a603e28680c8 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1266 microversion: 2.1 time: 0.256467 May 07 22:19:48.095405 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3008/5992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:47 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:49.113799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:49.114532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:49.121846 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:49.122249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:49.123080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:49.123540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:49.261718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:49.271190 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6b67649-70e4-47a4-b3a8-f9e903b0a010 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1266 microversion: 2.1 time: 0.162189 May 07 22:19:49.271779 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2985/5993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:49 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:50.288889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:50.289520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:50.296567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:50.297032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:50.297808 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:50.298260 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:50.430072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:50.437541 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0f6cbc50-30f9-4dc1-b3d3-8283864d0f44 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1266 microversion: 2.1 time: 0.152598 May 07 22:19:50.438115 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3009/5994] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:50 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:51.453975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:51.454555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:51.462333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:51.462850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:51.463665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:51.464128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:51.601719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:51.609208 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-489cc929-c46e-4bbd-8e9d-ed4e8005a1ee tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1266 microversion: 2.1 time: 0.159299 May 07 22:19:51.609788 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2986/5995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:51 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:52.620678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d3dd31b8-acd4-4332-a7fa-cd4184d46fb4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:52.621244 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d3dd31b8-acd4-4332-a7fa-cd4184d46fb4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:52.626581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:52.627265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:52.628331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3dd31b8-acd4-4332-a7fa-cd4184d46fb4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:52.628791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3dd31b8-acd4-4332-a7fa-cd4184d46fb4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:52.630209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3dd31b8-acd4-4332-a7fa-cd4184d46fb4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:52.630654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d3dd31b8-acd4-4332-a7fa-cd4184d46fb4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:52.634549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:52.635058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:52.635851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:52.636316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:52.766917 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d3dd31b8-acd4-4332-a7fa-cd4184d46fb4 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1835 microversion: 2.1 time: 0.149943 May 07 22:19:52.772789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:52.779009 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3010/5996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:52 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1835 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:52.782152 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-883077e1-0e3c-48fb-8593-028de5723546 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1266 microversion: 2.1 time: 0.159345 May 07 22:19:52.782930 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2987/5997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:52 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:19:53.800461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:53.801091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:53.808232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:53.808733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:53.809524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:53.809971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:54.026015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:54.026511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:54.034274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:54.034832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:54.035903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:54.036375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:54.044339 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:54.052491 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6d5d534-a536-4bef-aa1b-0efea91f35b9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1266 microversion: 2.1 time: 0.255926 May 07 22:19:54.053338 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3011/5998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:53 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:54.058221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e8fecdb8-17f3-40f4-ac4a-3f398ae5a1ea req-148d2fc9-54ca-49cc-9592-0db09fcc13df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:54.066366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e8fecdb8-17f3-40f4-ac4a-3f398ae5a1ea req-148d2fc9-54ca-49cc-9592-0db09fcc13df service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:54.067433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e8fecdb8-17f3-40f4-ac4a-3f398ae5a1ea req-148d2fc9-54ca-49cc-9592-0db09fcc13df service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:54.076467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:19:54.079484 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e8fecdb8-17f3-40f4-ac4a-3f398ae5a1ea req-148d2fc9-54ca-49cc-9592-0db09fcc13df service nova] Creating event network-changed:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch2-master-1 May 07 22:19:54.084455 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e8fecdb8-17f3-40f4-ac4a-3f398ae5a1ea req-148d2fc9-54ca-49cc-9592-0db09fcc13df service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029584 May 07 22:19:54.085399 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3012/5999] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:19:54.162369 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d7fbae08-7faf-4524-b160-6fbb911aa625 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 204 len: 0 microversion: 2.1 time: 0.140866 May 07 22:19:54.163416 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2988/6000] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:19:54 2022] DELETE /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:19:54.172878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:54.174001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:54.183184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:54.184023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:54.185303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:54.186068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:54.336668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:54.344181 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a5758759-70b9-4b1a-b7b4-e74f022b3a1e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1690 microversion: 2.1 time: 0.176023 May 07 22:19:54.344772 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3013/6001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:54 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:54.509384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-606a1796-ee09-4219-9114-d8ebed032f48 req-5fd47fa4-dc34-4a6b-af0e-02da46c9ab9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ab6dd8-49af-4888-a060-d9434ef4faf9", "name": "network-vif-plugged", "status": "completed", "tag": "cbe19c2f-74d7-43b0-9ac7-a1dd5f232233"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:54.520349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-606a1796-ee09-4219-9114-d8ebed032f48 req-5fd47fa4-dc34-4a6b-af0e-02da46c9ab9f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:54.520887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-606a1796-ee09-4219-9114-d8ebed032f48 req-5fd47fa4-dc34-4a6b-af0e-02da46c9ab9f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:54.532759 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-606a1796-ee09-4219-9114-d8ebed032f48 req-5fd47fa4-dc34-4a6b-af0e-02da46c9ab9f service nova] Creating event network-vif-plugged:cbe19c2f-74d7-43b0-9ac7-a1dd5f232233 for instance 11ab6dd8-49af-4888-a060-d9434ef4faf9 on nch1-master-1 May 07 22:19:54.538447 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-606a1796-ee09-4219-9114-d8ebed032f48 req-5fd47fa4-dc34-4a6b-af0e-02da46c9ab9f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036000 May 07 22:19:54.539305 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2989/6002] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:19:55.068892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:55.069542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:55.076370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:55.076828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:55.077597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:55.078044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:55.220035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:55.230807 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c8531803-1d4e-42e7-b5da-040eea0edc04 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1266 microversion: 2.1 time: 0.166162 May 07 22:19:55.231409 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3014/6003] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:55 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:55.362148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:55.362807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:55.370385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:55.370882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:55.371667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:55.372696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:55.682014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:55.692616 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-977366f1-5658-4439-b6d2-ddc8da89b464 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 200 len: 1690 microversion: 2.1 time: 0.334624 May 07 22:19:55.694222 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2990/6004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:55 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 1690 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:56.011285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d057a40a-d703-42e4-91ab-29e2adfc6eb1 req-a3509b0a-4304-4fcb-9153-49417a3e284d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2387d312-9744-4eb5-b6b6-aa41a601c7db", "name": "network-vif-deleted", "tag": "02290a02-2fd0-43fa-b574-58f6e0c7135e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:56.019737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d057a40a-d703-42e4-91ab-29e2adfc6eb1 req-a3509b0a-4304-4fcb-9153-49417a3e284d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:56.020700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d057a40a-d703-42e4-91ab-29e2adfc6eb1 req-a3509b0a-4304-4fcb-9153-49417a3e284d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:56.032098 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d057a40a-d703-42e4-91ab-29e2adfc6eb1 req-a3509b0a-4304-4fcb-9153-49417a3e284d service nova] Creating event network-vif-deleted:02290a02-2fd0-43fa-b574-58f6e0c7135e for instance 2387d312-9744-4eb5-b6b6-aa41a601c7db on nch2-master-1 May 07 22:19:56.037022 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d057a40a-d703-42e4-91ab-29e2adfc6eb1 req-a3509b0a-4304-4fcb-9153-49417a3e284d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029411 May 07 22:19:56.037632 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3015/6005] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:19:56.247603 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:56.248236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:56.254830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:56.255299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:56.256076 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:56.256530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:56.390068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:56.398034 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0b5eab32-0ec6-4b47-b300-9e4ae46559e7 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1452 microversion: 2.1 time: 0.154235 May 07 22:19:56.398626 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2991/6006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:56 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:56.416076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:56.416887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:56.423998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:56.424704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:56.426372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:56.427046 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:56.575360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:19:56.583280 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cab42ed2-e208-4c4d-beec-e14021fe8658 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1452 microversion: 2.1 time: 0.172738 May 07 22:19:56.583826 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3016/6007] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:56 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:19:56.710164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:19:56.710942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 2387d312-9744-4eb5-b6b6-aa41a601c7db] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:19:56.717768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:56.718276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:56.719120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:56.719591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:56.734062 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] HTTP exception thrown: Instance 2387d312-9744-4eb5-b6b6-aa41a601c7db could not be found. May 07 22:19:56.734688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Returning 404 to user: Instance 2387d312-9744-4eb5-b6b6-aa41a601c7db could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:19:56.735579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-265d76a8-f1e1-4187-b33d-886cc4a3b737 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db" status: 404 len: 111 microversion: 2.1 time: 0.029554 May 07 22:19:56.736147 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2992/6008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:19:56 2022] GET /compute/v2.1/servers/2387d312-9744-4eb5-b6b6-aa41a601c7db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:19:58.645585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-6cc092bd-28ec-4a9c-b154-ef895dba9bc1 req-939d8b49-ea8c-4a6b-bac7-4b60e62a2e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ab6dd8-49af-4888-a060-d9434ef4faf9", "tag": "cbe19c2f-74d7-43b0-9ac7-a1dd5f232233"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:19:58.655685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6cc092bd-28ec-4a9c-b154-ef895dba9bc1 req-939d8b49-ea8c-4a6b-bac7-4b60e62a2e3d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:19:58.656453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-6cc092bd-28ec-4a9c-b154-ef895dba9bc1 req-939d8b49-ea8c-4a6b-bac7-4b60e62a2e3d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:19:58.668581 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-6cc092bd-28ec-4a9c-b154-ef895dba9bc1 req-939d8b49-ea8c-4a6b-bac7-4b60e62a2e3d service nova] Creating event network-changed:cbe19c2f-74d7-43b0-9ac7-a1dd5f232233 for instance 11ab6dd8-49af-4888-a060-d9434ef4faf9 on nch1-master-1 May 07 22:19:58.674743 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-6cc092bd-28ec-4a9c-b154-ef895dba9bc1 req-939d8b49-ea8c-4a6b-bac7-4b60e62a2e3d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033025 May 07 22:19:58.675630 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3017/6009] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:20:00.976986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a62c6cea-7ee1-4555-8097-54a62a44455e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '.version_select at 0x7fc41d03dc10>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:01.014504 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a62c6cea-7ee1-4555-8097-54a62a44455e tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1551205815" status: 202 len: 0 microversion: 2.1 time: 0.042507 May 07 22:20:01.015508 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2993/6010] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:20:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1551205815 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:20:01.051568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-05440397-7c71-4b02-8340-3e8057fdc38f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: .version_select at 0x7fc41c3513a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1694832417"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:01.067505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-05440397-7c71-4b02-8340-3e8057fdc38f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:20:01.073729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-05440397-7c71-4b02-8340-3e8057fdc38f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:20:01.393291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-05440397-7c71-4b02-8340-3e8057fdc38f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:20:01.398293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-05440397-7c71-4b02-8340-3e8057fdc38f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:20:01.413347 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-05440397-7c71-4b02-8340-3e8057fdc38f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.367793 May 07 22:20:01.414096 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3018/6011] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:20:01 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:20:07.020941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1283612680", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "83d4eed6-e9e5-4ea0-ad2e-dfc2eb001753"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1694832417", "security_groups": [{"name": "tempest-secgroup-smoke-1184605145"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:07.157328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] validate_networks() for [('83d4eed6-e9e5-4ea0-ad2e-dfc2eb001753', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:20:07.736959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:20:07.737491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:20:07.738534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:20:07.739943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:20:07.740350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:20:07.757955 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:07.758484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:07.759431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:07.759898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:07.781989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:20:07.789091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:20:07.814763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:20:07.817443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:20:07.894003 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-21fec9f8-b7f2-45db-badf-c007c400e70d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.876724 May 07 22:20:07.903546 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2994/6012] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:20:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:20:07.928835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f81e967c-50fc-44e2-808e-e280ed26c447 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:07.929778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f81e967c-50fc-44e2-808e-e280ed26c447 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:08.015256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f81e967c-50fc-44e2-808e-e280ed26c447 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:08.025431 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f81e967c-50fc-44e2-808e-e280ed26c447 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1267 microversion: 2.1 time: 0.119524 May 07 22:20:08.030815 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3019/6013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:07 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:09.044168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:09.045570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:09.063169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:09.063809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:09.064682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:09.065227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:09.267947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:09.283365 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c913756-89fd-4c52-a2a0-4d56f2117b19 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1327 microversion: 2.1 time: 0.242438 May 07 22:20:09.294477 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2995/6014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:09 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1327 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:20:10.302513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:10.304167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:10.320147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:10.320948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:10.322954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:10.323569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:10.515292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:10.528532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-35e32235-d395-4972-abea-7593df01338b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1393 microversion: 2.1 time: 0.230679 May 07 22:20:10.531808 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3020/6015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:10 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1393 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:11.033673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ae12227e-84f2-43f9-a701-ed04de103773 req-c7114026-ae56-4c64-869b-a1ab2495f75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:11.046642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ae12227e-84f2-43f9-a701-ed04de103773 req-c7114026-ae56-4c64-869b-a1ab2495f75c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:11.047833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ae12227e-84f2-43f9-a701-ed04de103773 req-c7114026-ae56-4c64-869b-a1ab2495f75c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:11.062209 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ae12227e-84f2-43f9-a701-ed04de103773 req-c7114026-ae56-4c64-869b-a1ab2495f75c service nova] Creating event network-changed:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch2-master-1 May 07 22:20:11.069069 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ae12227e-84f2-43f9-a701-ed04de103773 req-c7114026-ae56-4c64-869b-a1ab2495f75c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039830 May 07 22:20:11.069798 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2996/6016] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:20:11.546088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:11.546699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:11.554058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:11.554509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:11.555306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:11.555746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:11.690295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:11.697794 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-63d0e630-1104-4058-8158-519c4873e04d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1393 microversion: 2.1 time: 0.155939 May 07 22:20:11.698359 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3021/6017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:11 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:12.716529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:12.717239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:12.723896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:12.724360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:12.725139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:12.725588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:12.864356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:12.871706 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e765dc99-5961-4e46-ad99-b649e6ff96f6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1393 microversion: 2.1 time: 0.160383 May 07 22:20:12.872286 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2997/6018] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:12 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:13.888898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:13.889648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:13.897595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:13.898085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:13.898937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:13.899457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:14.042818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:14.051578 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-62c698b2-700b-4ff5-a79f-4117db2fa99b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1393 microversion: 2.1 time: 0.166847 May 07 22:20:14.052223 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3022/6019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:13 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:15.068812 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:15.070133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:15.077628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:15.078142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:15.079100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:15.079639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:15.235809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:15.243404 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-45aef44e-d874-4382-a7ae-26a13bd7a5ae tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1393 microversion: 2.1 time: 0.179647 May 07 22:20:15.243989 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2998/6020] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:15 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:16.260606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:16.261221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:16.267955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:16.268404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:16.269165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:16.269605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:16.402546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:16.410465 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0a4a2d89-28c1-4bb9-a78d-eff289dbe9d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1393 microversion: 2.1 time: 0.153177 May 07 22:20:16.411032 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3023/6021] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:16 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:17.132001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e0461d79-3c63-4d04-9e3d-aaf5ae6ac962 req-86265891-9315-461b-8f0b-d371a3227785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "name": "network-vif-plugged", "status": "completed", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:17.141345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e0461d79-3c63-4d04-9e3d-aaf5ae6ac962 req-86265891-9315-461b-8f0b-d371a3227785 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:17.141808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e0461d79-3c63-4d04-9e3d-aaf5ae6ac962 req-86265891-9315-461b-8f0b-d371a3227785 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:17.153804 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e0461d79-3c63-4d04-9e3d-aaf5ae6ac962 req-86265891-9315-461b-8f0b-d371a3227785 service nova] Creating event network-vif-plugged:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch2-master-1 May 07 22:20:17.158990 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e0461d79-3c63-4d04-9e3d-aaf5ae6ac962 req-86265891-9315-461b-8f0b-d371a3227785 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030806 May 07 22:20:17.160415 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 2999/6022] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:20:17.427286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:17.427941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:17.434709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:17.435203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:17.435982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:17.436439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:17.568035 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:17.575509 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-87bc4d5d-1f9a-4fd2-9152-befce2579f40 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1393 microversion: 2.1 time: 0.152106 May 07 22:20:17.576084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3024/6023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:17 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:18.595441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:18.596168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:18.602412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:18.602925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:18.603715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:18.604166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:18.745032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:18.752831 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e8e93c87-eeca-4d5e-a439-bcc9ab5fb6e2 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1566 microversion: 2.1 time: 0.163005 May 07 22:20:18.753455 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3000/6024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:18 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:18.768886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:18.769667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:18.776443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:18.776912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:18.777680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:18.778127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:18.915280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:18.923553 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc2c1679-0447-4d21-bc70-4ec4ba8f8abb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1566 microversion: 2.1 time: 0.158559 May 07 22:20:18.924096 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3025/6025] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:18 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:20.605172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:20.605819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:20.612863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:20.613341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:20.614147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:20.614863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:20.616476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-909e131d-8857-477d-af0c-6d14a8d30cef req-02fcd52c-1be2-415b-bd50-aef1c4c89d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:20.633459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-909e131d-8857-477d-af0c-6d14a8d30cef req-02fcd52c-1be2-415b-bd50-aef1c4c89d6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:20.635760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-909e131d-8857-477d-af0c-6d14a8d30cef req-02fcd52c-1be2-415b-bd50-aef1c4c89d6d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:20.652302 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-909e131d-8857-477d-af0c-6d14a8d30cef req-02fcd52c-1be2-415b-bd50-aef1c4c89d6d service nova] Creating event network-changed:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch2-master-1 May 07 22:20:20.659182 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-909e131d-8857-477d-af0c-6d14a8d30cef req-02fcd52c-1be2-415b-bd50-aef1c4c89d6d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047506 May 07 22:20:20.661390 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3026/6026] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:20:20.869142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:20.877825 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c38be55-da98-44ff-9f54-6664ecae520c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1566 microversion: 2.1 time: 0.276420 May 07 22:20:20.878678 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3001/6027] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:20 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1566 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:42.194117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8210e222-7c3f-4c97-a46a-b70f4a6d1400 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:42.195248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8210e222-7c3f-4c97-a46a-b70f4a6d1400 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:42.202457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8210e222-7c3f-4c97-a46a-b70f4a6d1400 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:42.202994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8210e222-7c3f-4c97-a46a-b70f4a6d1400 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:42.203819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8210e222-7c3f-4c97-a46a-b70f4a6d1400 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:42.204301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8210e222-7c3f-4c97-a46a-b70f4a6d1400 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:42.254079 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8210e222-7c3f-4c97-a46a-b70f4a6d1400 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action" status: 200 len: 24567 microversion: 2.1 time: 0.065503 May 07 22:20:42.254732 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3027/6028] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:20:42 2022] POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action => generated 24567 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:20:53.311372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:53.311941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:53.318330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:53.318836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:53.319639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:53.320101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:53.792706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:53.802079 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2072362b-0928-4ad0-8829-ac0ea892baca tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1685 microversion: 2.1 time: 0.495601 May 07 22:20:53.802659 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3002/6029] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:53 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1685 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:53.906942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0bffc8ea-8584-4fd3-a257-1185da55d116 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:53.908109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0bffc8ea-8584-4fd3-a257-1185da55d116 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:53.915553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bffc8ea-8584-4fd3-a257-1185da55d116 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:53.916075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bffc8ea-8584-4fd3-a257-1185da55d116 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:53.916956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bffc8ea-8584-4fd3-a257-1185da55d116 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:53.917496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bffc8ea-8584-4fd3-a257-1185da55d116 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:53.968681 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0bffc8ea-8584-4fd3-a257-1185da55d116 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action" status: 200 len: 32640 microversion: 2.1 time: 0.067503 May 07 22:20:53.969260 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3028/6030] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:20:53 2022] POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action => generated 32640 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:20:54.133473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7cbe46c6-348a-4477-8012-58f5e67222b1 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:54.134101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7cbe46c6-348a-4477-8012-58f5e67222b1 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:54.141120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7cbe46c6-348a-4477-8012-58f5e67222b1 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:54.141587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7cbe46c6-348a-4477-8012-58f5e67222b1 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:54.142393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7cbe46c6-348a-4477-8012-58f5e67222b1 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:54.142896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7cbe46c6-348a-4477-8012-58f5e67222b1 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:54.278125 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7cbe46c6-348a-4477-8012-58f5e67222b1 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1836 microversion: 2.1 time: 0.148461 May 07 22:20:54.278807 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3003/6031] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:54 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1836 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:54.295415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:54.296635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:54.303631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:54.304088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:54.304856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:54.305301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:54.334129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lazy-loading 'flavor' on Instance uuid 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:20:54.346500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Going to try to live migrate instance to another host {{(pid=136682) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 07 22:20:55.677946 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2f5226eb-3af2-42a0-bd2f-4ce4daf13dcd tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action" status: 202 len: 0 microversion: 2.1 time: 1.386820 May 07 22:20:55.679264 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3029/6032] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:20:54 2022] POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action => generated 0 bytes in 1389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:20:55.689939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:55.691370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:55.703999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:55.704646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:55.705484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:55.705942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:55.873734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:55.882108 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b8756e73-bc6e-4e49-a616-462f2f05410b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1695 microversion: 2.1 time: 0.196995 May 07 22:20:55.883045 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3004/6033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:55 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:56.771440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-69f2a583-5541-41f7-bff3-cd22dc0159a6 req-8beba1b4-97cf-44ff-95bd-e0be9031e8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "name": "network-vif-unplugged", "status": "completed", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:56.781658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-69f2a583-5541-41f7-bff3-cd22dc0159a6 req-8beba1b4-97cf-44ff-95bd-e0be9031e8da service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:56.782107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-69f2a583-5541-41f7-bff3-cd22dc0159a6 req-8beba1b4-97cf-44ff-95bd-e0be9031e8da service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:56.793434 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-69f2a583-5541-41f7-bff3-cd22dc0159a6 req-8beba1b4-97cf-44ff-95bd-e0be9031e8da service nova] Creating event network-vif-unplugged:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch2-master-1 May 07 22:20:56.798886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-69f2a583-5541-41f7-bff3-cd22dc0159a6 req-8beba1b4-97cf-44ff-95bd-e0be9031e8da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032002 May 07 22:20:56.799668 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3030/6034] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:20:56.903666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:56.904443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:56.911706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:56.912179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:56.912981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:56.913437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:57.139695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:57.152606 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-70047370-346c-4632-8e69-9f08fc27f70c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1695 microversion: 2.1 time: 0.254420 May 07 22:20:57.153814 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3005/6035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:56 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:58.172636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:58.173255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:58.179426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:58.179913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:58.180677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:58.181116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:58.382538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:58.391095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9987378a-d581-4634-9568-7e3612e9b0da tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1695 microversion: 2.1 time: 0.224303 May 07 22:20:58.391660 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3031/6036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:58 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:20:58.813749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3f1143b6-ec1d-45a8-99cf-389bf9356f06 req-f92d8654-a2db-437c-936d-1d48835f97a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:20:58.822496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3f1143b6-ec1d-45a8-99cf-389bf9356f06 req-f92d8654-a2db-437c-936d-1d48835f97a6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:58.822989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3f1143b6-ec1d-45a8-99cf-389bf9356f06 req-f92d8654-a2db-437c-936d-1d48835f97a6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:58.834182 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3f1143b6-ec1d-45a8-99cf-389bf9356f06 req-f92d8654-a2db-437c-936d-1d48835f97a6 service nova] Creating event network-changed:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch2-master-1 May 07 22:20:58.839157 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3f1143b6-ec1d-45a8-99cf-389bf9356f06 req-f92d8654-a2db-437c-936d-1d48835f97a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029655 May 07 22:20:58.839897 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3006/6037] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:20:59.407559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:20:59.408217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:20:59.415047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:59.415511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:59.416317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:20:59.416848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:20:59.547947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:20:59.555478 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c665af56-e498-4756-9682-3fbbf3d8e09b tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1695 microversion: 2.1 time: 0.151819 May 07 22:20:59.556057 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3032/6038] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:20:59 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:00.574869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:00.575600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:00.582401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:00.582908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:00.583704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:00.584203 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:00.715314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:00.723606 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-08ffbfb3-bf19-45b4-b00a-eefcacbed2b4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1695 microversion: 2.1 time: 0.153932 May 07 22:21:00.724192 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3007/6039] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:00 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:01.740847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:01.741468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:01.749908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:01.750375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:01.751752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:01.753137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:01.955314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:01.962692 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-881d23aa-4d4f-4da8-ab2e-5f83fba0e955 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1695 microversion: 2.1 time: 0.225872 May 07 22:21:01.963298 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3033/6040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:01 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:02.564097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cc7d7eaf-9564-4b2c-a6fe-b8badb307070 req-1258b3d4-0775-4015-b00a-90cab44137bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "name": "network-vif-unplugged", "status": "completed", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:02.573102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cc7d7eaf-9564-4b2c-a6fe-b8badb307070 req-1258b3d4-0775-4015-b00a-90cab44137bf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:02.573504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cc7d7eaf-9564-4b2c-a6fe-b8badb307070 req-1258b3d4-0775-4015-b00a-90cab44137bf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:02.584759 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cc7d7eaf-9564-4b2c-a6fe-b8badb307070 req-1258b3d4-0775-4015-b00a-90cab44137bf service nova] Creating event network-vif-unplugged:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch2-master-1 May 07 22:21:02.589801 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cc7d7eaf-9564-4b2c-a6fe-b8badb307070 req-1258b3d4-0775-4015-b00a-90cab44137bf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029580 May 07 22:21:02.590438 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3008/6041] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:02.980013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:02.980646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:02.987295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:02.987748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:02.988519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:02.988959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:03.183823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:03.191903 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-388659e2-b8df-46da-af89-3fefbeacd3fb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1695 microversion: 2.1 time: 0.215872 May 07 22:21:03.192501 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3034/6042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:02 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1695 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:04.211137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:04.211870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:04.218898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.219441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.220459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.220923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.362259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:04.369798 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ae5593e8-05ac-425f-8325-d8a0f7115f96 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1685 microversion: 2.1 time: 0.163880 May 07 22:21:04.370388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3009/6043] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:04 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:04.385890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-46a6b57f-b544-4f60-a166-8bae25c64149 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:04.386516 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-46a6b57f-b544-4f60-a166-8bae25c64149 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:04.393983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46a6b57f-b544-4f60-a166-8bae25c64149 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.394445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46a6b57f-b544-4f60-a166-8bae25c64149 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.395266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46a6b57f-b544-4f60-a166-8bae25c64149 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.395715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46a6b57f-b544-4f60-a166-8bae25c64149 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.528250 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-46a6b57f-b544-4f60-a166-8bae25c64149 tempest-TestNetworkAdvancedServerOps-305006253 tempest-TestNetworkAdvancedServerOps-305006253-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1836 microversion: 2.1 time: 0.145947 May 07 22:21:04.529410 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3035/6044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:04 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1836 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:04.545470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:04.546115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:04.552466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.552946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.553752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.554220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.688094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:04.695646 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5c120b0f-5eda-4808-a75f-d979441097fa tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1685 microversion: 2.1 time: 0.154413 May 07 22:21:04.696230 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3010/6045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:04 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:04.790762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-817a3ab1-f922-4071-b120-ec178894c4d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:04.791756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-817a3ab1-f922-4071-b120-ec178894c4d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:04.798108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-817a3ab1-f922-4071-b120-ec178894c4d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.798555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-817a3ab1-f922-4071-b120-ec178894c4d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.799363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-817a3ab1-f922-4071-b120-ec178894c4d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:04.799802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-817a3ab1-f922-4071-b120-ec178894c4d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:04.846638 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-817a3ab1-f922-4071-b120-ec178894c4d6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action" status: 200 len: 38692 microversion: 2.1 time: 0.059681 May 07 22:21:04.847300 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3036/6046] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:21:04 2022] POST /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d/action => generated 38692 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:21:05.879408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:05.879919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:05.881768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-81e607ab-1863-43df-9a81-d24fc3bf85c3 req-2279da81-a2ab-4bcf-8bc1-4b88db534c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:05.886529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:05.887041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:05.887830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:05.889125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:05.892702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-81e607ab-1863-43df-9a81-d24fc3bf85c3 req-2279da81-a2ab-4bcf-8bc1-4b88db534c6b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:05.893440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-81e607ab-1863-43df-9a81-d24fc3bf85c3 req-2279da81-a2ab-4bcf-8bc1-4b88db534c6b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:05.905532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-81e607ab-1863-43df-9a81-d24fc3bf85c3 req-2279da81-a2ab-4bcf-8bc1-4b88db534c6b service nova] Creating event network-changed:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch1-master-1 May 07 22:21:05.911566 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-81e607ab-1863-43df-9a81-d24fc3bf85c3 req-2279da81-a2ab-4bcf-8bc1-4b88db534c6b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 May 07 22:21:05.912677 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3037/6047] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:05.920526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:21:06.006715 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48f5e57b-d0f0-4fa8-92aa-18168d747042 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 204 len: 0 microversion: 2.1 time: 0.131394 May 07 22:21:06.011389 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3011/6048] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:21:05 2022] DELETE /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:21:06.018001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:06.018734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:06.024910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:06.025379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:06.026654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:06.026654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:06.181641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:06.189455 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-617eef3f-c593-4069-a376-6ec52461d1d3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 200 len: 1691 microversion: 2.1 time: 0.176744 May 07 22:21:06.190288 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3038/6049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:06 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:21:07.008621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-4dfaadf4-f958-427a-aa89-ff0b310eca3c req-caa6c7a2-ac08-4192-a31a-b6d5fb120744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d", "name": "network-vif-deleted", "tag": "f2f0c336-3f97-4f08-9ef4-03776eda7c75"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:07.018183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4dfaadf4-f958-427a-aa89-ff0b310eca3c req-caa6c7a2-ac08-4192-a31a-b6d5fb120744 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:07.018659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-4dfaadf4-f958-427a-aa89-ff0b310eca3c req-caa6c7a2-ac08-4192-a31a-b6d5fb120744 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:07.030066 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-4dfaadf4-f958-427a-aa89-ff0b310eca3c req-caa6c7a2-ac08-4192-a31a-b6d5fb120744 service nova] Creating event network-vif-deleted:f2f0c336-3f97-4f08-9ef4-03776eda7c75 for instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d on nch1-master-1 May 07 22:21:07.034759 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-4dfaadf4-f958-427a-aa89-ff0b310eca3c req-caa6c7a2-ac08-4192-a31a-b6d5fb120744 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030228 May 07 22:21:07.035397 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3012/6050] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:07.207811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:07.208527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:07.219132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:07.219547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:07.220458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:07.220950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:07.235236 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] HTTP exception thrown: Instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d could not be found. May 07 22:21:07.235828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Returning 404 to user: Instance 9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:21:07.236660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd570a55-67d6-4000-aab9-28e0c2092899 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d" status: 404 len: 111 microversion: 2.1 time: 0.033628 May 07 22:21:07.237210 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3039/6051] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:07 2022] GET /compute/v2.1/servers/9cd8bf7a-230c-4bc4-a0a7-9161d2c8db8d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:21:10.626278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7826b947-8ee8-48af-b10a-a48ed2c0652a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '.version_select at 0x7fc4224eb9d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:10.646109 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7826b947-8ee8-48af-b10a-a48ed2c0652a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694832417" status: 202 len: 0 microversion: 2.1 time: 0.025222 May 07 22:21:10.646640 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3013/6052] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694832417 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:21:10.671944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69f738b8-1995-49db-a107-31891f33ee95 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: .version_select at 0x7fc41c4b2ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1691361429"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:10.686995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-69f738b8-1995-49db-a107-31891f33ee95 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:21:10.693180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-69f738b8-1995-49db-a107-31891f33ee95 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:21:10.911062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-69f738b8-1995-49db-a107-31891f33ee95 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:21:10.916189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-69f738b8-1995-49db-a107-31891f33ee95 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:21:10.932074 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69f738b8-1995-49db-a107-31891f33ee95 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.264851 May 07 22:21:10.932676 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3040/6053] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:21:10 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:16.677457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-115974734", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "566e4246-db23-47c5-92d7-49344149ddf5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1691361429", "security_groups": [{"name": "tempest-secgroup-smoke-215309333"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:16.798905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] validate_networks() for [('566e4246-db23-47c5-92d7-49344149ddf5', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:21:17.178944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:21:17.179487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:21:17.180148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:21:17.180690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:21:17.181336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:21:17.192214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:17.192691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:17.193534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:17.198557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:17.214169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:21:17.220488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Getting quotas for user aeee01bf990e46bfa331c1cd93528cab and project 16812b38c4514406886f0ab13cabe8ad. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:21:17.236615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:21:17.239161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:21:17.287687 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8b12e0c6-df21-427a-b0e7-b0e889ca906a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.615625 May 07 22:21:17.288641 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3014/6054] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:21:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:21:17.300019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce6b3a42-99fd-4bc0-81b8-b2216d7e3e68 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:17.301283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce6b3a42-99fd-4bc0-81b8-b2216d7e3e68 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:17.366757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ce6b3a42-99fd-4bc0-81b8-b2216d7e3e68 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:17.375329 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce6b3a42-99fd-4bc0-81b8-b2216d7e3e68 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1266 microversion: 2.1 time: 0.079938 May 07 22:21:17.376479 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3041/6055] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:17 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:18.395521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:18.396157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:18.404030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:18.404953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:18.405763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:18.406224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:18.508228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:18.516020 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db42fb4b-b864-4eda-8be3-7981c7ca11cc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1324 microversion: 2.1 time: 0.126245 May 07 22:21:18.516601 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3015/6056] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:18 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1324 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:19.535611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:19.536864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:19.546932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:19.547765 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:19.548738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:19.549803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:19.727115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:19.735476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9e676a33-4969-45b1-8c65-c09a6668a402 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1391 microversion: 2.1 time: 0.204607 May 07 22:21:19.736064 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3042/6057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:19 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:19.816702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-873ebd89-79b2-4836-a387-23b1031eb0af req-c290eb04-d4ac-4214-a1dc-a0de74166415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb0157b-8f8e-4034-8008-661d7feedd75", "tag": "9f190edf-f733-4a78-83fc-965d6c3096bd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:19.832815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-873ebd89-79b2-4836-a387-23b1031eb0af req-c290eb04-d4ac-4214-a1dc-a0de74166415 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:19.833625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-873ebd89-79b2-4836-a387-23b1031eb0af req-c290eb04-d4ac-4214-a1dc-a0de74166415 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:19.851305 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-873ebd89-79b2-4836-a387-23b1031eb0af req-c290eb04-d4ac-4214-a1dc-a0de74166415 service nova] Creating event network-changed:9f190edf-f733-4a78-83fc-965d6c3096bd for instance 0fb0157b-8f8e-4034-8008-661d7feedd75 on nch2-master-1 May 07 22:21:19.857624 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-873ebd89-79b2-4836-a387-23b1031eb0af req-c290eb04-d4ac-4214-a1dc-a0de74166415 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046035 May 07 22:21:19.858945 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3016/6058] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:20.752843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:20.753471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:20.760682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:20.761144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:20.762181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:20.763181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:20.904276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:20.911757 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a5b2c2a-3a94-498d-ad57-fb93dac9ddd7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1391 microversion: 2.1 time: 0.163330 May 07 22:21:20.912347 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3043/6059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:20 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:21.929456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:21.930172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:21.936930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:21.937397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:21.938172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:21.938656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:22.072158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:22.080136 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87ac248c-ba6f-4dcd-810f-a4f666edbaf0 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1391 microversion: 2.1 time: 0.155803 May 07 22:21:22.080712 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3017/6060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:21 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:23.097192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:23.097815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:23.104647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:23.105110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:23.105884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:23.106868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:23.239387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:23.246874 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-375bb981-077f-499b-b762-109a5f946e6c tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1391 microversion: 2.1 time: 0.153636 May 07 22:21:23.248115 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3044/6061] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:23 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:24.264509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:24.265211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:24.272126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:24.272595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:24.273379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:24.273827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:24.403832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:24.411174 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c11765f-1398-42df-94e5-b9428923ac16 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1391 microversion: 2.1 time: 0.150553 May 07 22:21:24.411746 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3018/6062] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:24 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:25.357141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-3e266dfc-e8f7-48ee-a2fe-398fb124a4c9 req-089c3986-ff5d-4038-b00f-a8c86003f853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb0157b-8f8e-4034-8008-661d7feedd75", "name": "network-vif-plugged", "status": "completed", "tag": "9f190edf-f733-4a78-83fc-965d6c3096bd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:25.368352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e266dfc-e8f7-48ee-a2fe-398fb124a4c9 req-089c3986-ff5d-4038-b00f-a8c86003f853 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:25.368805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-3e266dfc-e8f7-48ee-a2fe-398fb124a4c9 req-089c3986-ff5d-4038-b00f-a8c86003f853 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:25.380711 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-3e266dfc-e8f7-48ee-a2fe-398fb124a4c9 req-089c3986-ff5d-4038-b00f-a8c86003f853 service nova] Creating event network-vif-plugged:9f190edf-f733-4a78-83fc-965d6c3096bd for instance 0fb0157b-8f8e-4034-8008-661d7feedd75 on nch2-master-1 May 07 22:21:25.386091 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-3e266dfc-e8f7-48ee-a2fe-398fb124a4c9 req-089c3986-ff5d-4038-b00f-a8c86003f853 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033140 May 07 22:21:25.386751 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3045/6063] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:25.428499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:25.429223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:25.436893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:25.437369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:25.438173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:25.438635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:25.617831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:25.625148 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a6f326b1-0b28-4e05-8e79-9380430ee453 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1391 microversion: 2.1 time: 0.200640 May 07 22:21:25.625739 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3019/6064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:25 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:26.642538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:26.643289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:26.650232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:26.650694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:26.651496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:26.651946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:26.802455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:26.812492 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5d4e62c1-6ffd-4af5-ba67-1b8e1bebd2a7 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1563 microversion: 2.1 time: 0.174165 May 07 22:21:26.813082 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3046/6065] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:26 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:26.829079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:26.829725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:26.837543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:26.838013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:26.838836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:26.839295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:26.967260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:26.974621 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-52c0da56-107e-40c1-890c-fe2fc74bb2d4 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1563 microversion: 2.1 time: 0.149988 May 07 22:21:26.975217 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3020/6066] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:26 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:29.031231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:29.031867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:29.039717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-03f1901e-019c-45c0-b201-6db689e21ae0 req-d7496319-c3e4-4a02-9861-08ad7a638878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb0157b-8f8e-4034-8008-661d7feedd75", "tag": "9f190edf-f733-4a78-83fc-965d6c3096bd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:29.048989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:29.049475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-03f1901e-019c-45c0-b201-6db689e21ae0 req-d7496319-c3e4-4a02-9861-08ad7a638878 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:29.049593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:29.049915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-03f1901e-019c-45c0-b201-6db689e21ae0 req-d7496319-c3e4-4a02-9861-08ad7a638878 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:29.050234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:29.050683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:29.061437 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-03f1901e-019c-45c0-b201-6db689e21ae0 req-d7496319-c3e4-4a02-9861-08ad7a638878 service nova] Creating event network-changed:9f190edf-f733-4a78-83fc-965d6c3096bd for instance 0fb0157b-8f8e-4034-8008-661d7feedd75 on nch2-master-1 May 07 22:21:29.066522 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-03f1901e-019c-45c0-b201-6db689e21ae0 req-d7496319-c3e4-4a02-9861-08ad7a638878 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030337 May 07 22:21:29.067388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3021/6067] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:29.211591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:29.221740 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d2e181c-5093-4122-bdd3-527f43ba1ad9 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1563 microversion: 2.1 time: 0.195009 May 07 22:21:29.234712 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3047/6068] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:29 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1563 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:35.607656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:35.608346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:35.609688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2dca8412-05f6-4130-9fa3-8babdbd63c42 req-6b56962f-978a-4c91-9cd1-5b3547d969ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ab6dd8-49af-4888-a060-d9434ef4faf9", "tag": "cbe19c2f-74d7-43b0-9ac7-a1dd5f232233"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:35.614881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:35.615366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:35.616178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:35.616703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:35.618979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2dca8412-05f6-4130-9fa3-8babdbd63c42 req-6b56962f-978a-4c91-9cd1-5b3547d969ab service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:35.619512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2dca8412-05f6-4130-9fa3-8babdbd63c42 req-6b56962f-978a-4c91-9cd1-5b3547d969ab service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:35.631546 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2dca8412-05f6-4130-9fa3-8babdbd63c42 req-6b56962f-978a-4c91-9cd1-5b3547d969ab service nova] Creating event network-changed:cbe19c2f-74d7-43b0-9ac7-a1dd5f232233 for instance 11ab6dd8-49af-4888-a060-d9434ef4faf9 on nch1-master-1 May 07 22:21:35.637738 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2dca8412-05f6-4130-9fa3-8babdbd63c42 req-6b56962f-978a-4c91-9cd1-5b3547d969ab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032206 May 07 22:21:35.638726 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3048/6069] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:35.646542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:21:35.738829 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c7d0659-87d7-4d0f-b730-997bc7043f7f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 204 len: 0 microversion: 2.1 time: 0.136325 May 07 22:21:35.740584 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3022/6070] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:21:35 2022] DELETE /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:21:35.750001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:35.751021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:35.757849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:35.758614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:35.759438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:35.760126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:35.906489 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:35.914515 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a0556071-4bb4-4aff-9d69-f2e8a13bd0f4 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1576 microversion: 2.1 time: 0.169327 May 07 22:21:35.915434 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3049/6071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:35 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:36.934496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:36.935273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:36.942261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:36.942921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:36.943730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:36.944196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:37.073887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:37.082056 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e3b63c81-5d60-4ab1-8a81-2bd87f45ecb9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1576 microversion: 2.1 time: 0.152401 May 07 22:21:37.082648 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3023/6072] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:36 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:37.651874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-90c6852b-7bc0-4c33-a72c-fb85a55c18dd req-ff64880e-8230-47bf-a777-b2451f7dcae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ab6dd8-49af-4888-a060-d9434ef4faf9", "name": "network-vif-deleted", "tag": "cbe19c2f-74d7-43b0-9ac7-a1dd5f232233"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:37.660988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-90c6852b-7bc0-4c33-a72c-fb85a55c18dd req-ff64880e-8230-47bf-a777-b2451f7dcae5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:37.661687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-90c6852b-7bc0-4c33-a72c-fb85a55c18dd req-ff64880e-8230-47bf-a777-b2451f7dcae5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:37.673266 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-90c6852b-7bc0-4c33-a72c-fb85a55c18dd req-ff64880e-8230-47bf-a777-b2451f7dcae5 service nova] Creating event network-vif-deleted:cbe19c2f-74d7-43b0-9ac7-a1dd5f232233 for instance 11ab6dd8-49af-4888-a060-d9434ef4faf9 on nch1-master-1 May 07 22:21:37.678387 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-90c6852b-7bc0-4c33-a72c-fb85a55c18dd req-ff64880e-8230-47bf-a777-b2451f7dcae5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030198 May 07 22:21:37.679261 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3050/6073] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:21:38.099652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:38.100441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:38.108714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:38.109393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:38.110218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:38.110685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:38.142311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:38.142819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:38.143305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lazy-loading 'fault' on Instance uuid 11ab6dd8-49af-4888-a060-d9434ef4faf9 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:21:38.190525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:21:38.197304 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-858db362-c628-4770-a9c2-41ee0a195ea9 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 200 len: 1184 microversion: 2.1 time: 0.101763 May 07 22:21:38.198110 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3024/6074] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:38 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 1184 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:21:39.215135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:21:39.217003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 11ab6dd8-49af-4888-a060-d9434ef4faf9] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:39.223503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:39.223961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:39.224731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:39.225169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:39.241549 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 11ab6dd8-49af-4888-a060-d9434ef4faf9 could not be found. May 07 22:21:39.242156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 11ab6dd8-49af-4888-a060-d9434ef4faf9 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:21:39.243027 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ca014fa4-5862-4daf-a34b-07480c6f1209 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9" status: 404 len: 111 microversion: 2.1 time: 0.033295 May 07 22:21:39.243573 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3051/6075] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:21:39 2022] GET /compute/v2.1/servers/11ab6dd8-49af-4888-a060-d9434ef4faf9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:21:50.469704 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-da7dda45-32fa-40aa-8831-5c9a1bfc653a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:21:50.470576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-da7dda45-32fa-40aa-8831-5c9a1bfc653a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:21:50.477464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da7dda45-32fa-40aa-8831-5c9a1bfc653a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:50.477929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da7dda45-32fa-40aa-8831-5c9a1bfc653a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:50.478738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da7dda45-32fa-40aa-8831-5c9a1bfc653a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:21:50.479281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-da7dda45-32fa-40aa-8831-5c9a1bfc653a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:21:50.530876 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-da7dda45-32fa-40aa-8831-5c9a1bfc653a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75/action" status: 200 len: 24574 microversion: 2.1 time: 0.065197 May 07 22:21:50.531522 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3025/6076] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:21:50 2022] POST /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75/action => generated 24574 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:22:01.288217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:22:01.289668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:01.296460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:01.296919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:01.297696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:01.298152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:01.373311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:22:01.373734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:22:01.374210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:22:01.374622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:22:01.375062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:22:01.433870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:01.439751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:01.440208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:01.440988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:01.441428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:01.468339 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-db6d3efd-ab94-4cb4-a415-bf6c32cef7fc tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75/action" status: 202 len: 1137 microversion: 2.1 time: 0.184177 May 07 22:22:01.469001 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3052/6077] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:22:01 2022] POST /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75/action => generated 1137 bytes in 186 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 07 22:22:01.483832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:01.484653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:01.492419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:01.492807 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:01.493710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:01.494175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:01.661219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:01.669663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-447f6244-2dd4-4b5c-b6c8-a24b338e7e6f tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.190214 May 07 22:22:01.679613 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3026/6078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:01 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:02.687021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:02.687663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:02.694585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:02.695073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:02.695836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:02.696277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:02.827435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:02.834748 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07078055-3c33-4492-b0ae-dc8ae6a51d08 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.151626 May 07 22:22:02.835338 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3053/6079] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:02 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:03.852487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:03.853132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:03.860637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:03.861114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:03.861904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:03.862365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:03.998403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:04.006019 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-90574670-b65c-4326-87c0-aa0277838ce8 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.157550 May 07 22:22:04.006695 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3027/6080] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:03 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:05.022631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:05.023343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:05.029989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:05.030453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:05.031257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:05.031702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:05.165371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:05.173608 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb4705cc-6271-4e45-878c-72bb712d900a tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.154905 May 07 22:22:05.174185 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3054/6081] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:05 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:06.190986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:06.191621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:06.198467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:06.198974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:06.199760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:06.200215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:06.328744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:06.336144 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ee0ec5ba-efdc-4c00-a52f-a7e4d50dc294 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.149045 May 07 22:22:06.336723 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3028/6082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:06 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:07.353161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:07.353700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:07.360707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:07.361167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:07.361946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:07.362397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:07.493895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:07.501955 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-58327409-6704-46db-ac7e-2e784120a69d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.152778 May 07 22:22:07.502544 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3055/6083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:07 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:08.519315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:08.519962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:08.526901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:08.527383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:08.528180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:08.529176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:08.662978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:08.670996 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-050ffabf-56fd-4458-90e5-8ca635117886 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.155672 May 07 22:22:08.671595 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3029/6084] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:08 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:09.688182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:09.688805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:09.695627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:09.696088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:09.696863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:09.697312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:09.842992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:09.851115 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-655ba3a9-1124-4cac-b71f-edcaf9684413 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.166781 May 07 22:22:09.851695 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3056/6085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:09 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:10.868103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:10.868651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:10.875973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:10.876454 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:10.877262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:10.877725 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:11.026926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:11.036156 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b52b0fdd-ee47-4a9e-82ab-5b8f464411f1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.172181 May 07 22:22:11.036756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3030/6086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:10 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:12.053689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:12.054247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:12.070175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:12.071057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:12.071476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:12.071977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:12.155464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:12.157047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:12.167497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:12.168200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:12.169951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:12.170676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:12.210878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:22:12.238286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:12.246209 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9abe97c4-3a5b-469b-b7a6-6216f0da8745 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1691 microversion: 2.1 time: 0.196567 May 07 22:22:12.247171 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3057/6087] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:12 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:12.251459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7881720f-1115-4fd8-8ae8-8d747f33d5ca req-e378752d-df1f-430f-b7a8-0bc4143947fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72021281-107d-4e98-b768-6b8d54710130", "tag": "4734e952-8aca-4ba2-be4b-da036580c7c5"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:22:12.259365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7881720f-1115-4fd8-8ae8-8d747f33d5ca req-e378752d-df1f-430f-b7a8-0bc4143947fc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:12.260568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7881720f-1115-4fd8-8ae8-8d747f33d5ca req-e378752d-df1f-430f-b7a8-0bc4143947fc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:12.273568 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7881720f-1115-4fd8-8ae8-8d747f33d5ca req-e378752d-df1f-430f-b7a8-0bc4143947fc service nova] Creating event network-changed:4734e952-8aca-4ba2-be4b-da036580c7c5 for instance 72021281-107d-4e98-b768-6b8d54710130 on nch1-master-1 May 07 22:22:12.279469 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7881720f-1115-4fd8-8ae8-8d747f33d5ca req-e378752d-df1f-430f-b7a8-0bc4143947fc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030734 May 07 22:22:12.280262 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3058/6088] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:22:12.320494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9c364b8-292d-4b10-985b-c7b27810591d tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 204 len: 0 microversion: 2.1 time: 0.169973 May 07 22:22:12.321474 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3031/6089] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:22:12 2022] DELETE /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:22:12.330051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:12.330815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:12.338661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:12.340120 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:12.340488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:12.341538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:12.478160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:12.485680 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4457b469-fd4f-4161-90c3-d34728a1785f tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1578 microversion: 2.1 time: 0.159901 May 07 22:22:12.486261 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3059/6090] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:12 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:13.264604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:13.265367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:13.272187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:13.272656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:13.273440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:13.273894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:13.417360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:13.426711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b421446a-ec7c-452b-a551-5aa2d5026803 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1697 microversion: 2.1 time: 0.166774 May 07 22:22:13.427438 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3032/6091] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:13 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:13.503547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:13.504169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:13.510935 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:13.511393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:13.512165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:13.512608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:13.717746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:13.725186 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-13fa33ec-5952-4900-be67-f93651c21a77 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1578 microversion: 2.1 time: 0.225472 May 07 22:22:13.725766 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3060/6092] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:13 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:14.305187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e9189136-9318-4e0b-b5d4-18f39cfd9111 req-b842380d-c1e5-4703-918d-350f42009031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72021281-107d-4e98-b768-6b8d54710130", "name": "network-vif-deleted", "tag": "4734e952-8aca-4ba2-be4b-da036580c7c5"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:22:14.314322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e9189136-9318-4e0b-b5d4-18f39cfd9111 req-b842380d-c1e5-4703-918d-350f42009031 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:14.314843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e9189136-9318-4e0b-b5d4-18f39cfd9111 req-b842380d-c1e5-4703-918d-350f42009031 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:14.326604 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e9189136-9318-4e0b-b5d4-18f39cfd9111 req-b842380d-c1e5-4703-918d-350f42009031 service nova] Creating event network-vif-deleted:4734e952-8aca-4ba2-be4b-da036580c7c5 for instance 72021281-107d-4e98-b768-6b8d54710130 on nch1-master-1 May 07 22:22:14.331480 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e9189136-9318-4e0b-b5d4-18f39cfd9111 req-b842380d-c1e5-4703-918d-350f42009031 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030144 May 07 22:22:14.332214 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3033/6093] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:22:14.444945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:14.445555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:14.451739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:14.452201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:14.452983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:14.453424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:14.589883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:14.598285 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1b1be2aa-31dd-4870-ba5e-a99b57451232 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1697 microversion: 2.1 time: 0.157236 May 07 22:22:14.598899 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3061/6094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:14 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:14.744123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:14.744907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:14.752929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:14.753607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:14.754606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:14.755104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:14.789379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:14.789777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:14.790253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lazy-loading 'fault' on Instance uuid 72021281-107d-4e98-b768-6b8d54710130 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:22:14.841456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4988836610494ab48a138bd43d5b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3657e8df46a4252b9eb1eb159306a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:14.849086 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e71e8e7-68b9-4f2f-8735-1933923a62f2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 200 len: 1184 microversion: 2.1 time: 0.110044 May 07 22:22:14.849746 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3034/6095] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:14 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 1184 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:15.616391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:15.617211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:15.624213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:15.624668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:15.625435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:15.625874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:15.761991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:15.770141 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64a55e71-7c14-4ed5-8f44-a86fd59a50eb tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1682 microversion: 2.1 time: 0.157609 May 07 22:22:15.770732 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3062/6096] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:15 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:15.867403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:15.868049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 72021281-107d-4e98-b768-6b8d54710130] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:15.875375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:15.875848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:15.876636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:15.877094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:15.890978 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 72021281-107d-4e98-b768-6b8d54710130 could not be found. May 07 22:22:15.891583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 72021281-107d-4e98-b768-6b8d54710130 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:22:15.892419 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-161013bc-be96-44ee-8b4a-4683c991b6d2 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130" status: 404 len: 111 microversion: 2.1 time: 0.029101 May 07 22:22:15.892952 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3035/6097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:15 2022] GET /compute/v2.1/servers/72021281-107d-4e98-b768-6b8d54710130 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:22:16.347386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:16.347901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:16.353969 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:16.354370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:16.355186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:16.355634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:16.370978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 could not be found. May 07 22:22:16.371573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:22:16.372435 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-39560316-0561-4690-a70d-ca212532ff37 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 404 len: 111 microversion: 2.1 time: 0.028991 May 07 22:22:16.372968 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3063/6098] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:22:16 2022] DELETE /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:22:16.381334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:16.381975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] [instance: 20f0b5de-f6ce-4056-b170-f80b05559ef2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:16.388583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:16.389051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:16.390034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:16.390492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:16.404355 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] HTTP exception thrown: Instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 could not be found. May 07 22:22:16.404961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Returning 404 to user: Instance 20f0b5de-f6ce-4056-b170-f80b05559ef2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:22:16.405799 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5b659e4-2c0e-421a-8bad-94b1da5d1738 tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2" status: 404 len: 111 microversion: 2.1 time: 0.028481 May 07 22:22:16.406338 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3036/6099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:16 2022] GET /compute/v2.1/servers/20f0b5de-f6ce-4056-b170-f80b05559ef2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:22:17.685634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4e96a265-cb3d-45da-809a-f78accd42b7c req-17d4c49c-85e4-41d6-988b-c9a3db11733d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb0157b-8f8e-4034-8008-661d7feedd75", "name": "network-vif-plugged", "status": "completed", "tag": "9f190edf-f733-4a78-83fc-965d6c3096bd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:22:17.696544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4e96a265-cb3d-45da-809a-f78accd42b7c req-17d4c49c-85e4-41d6-988b-c9a3db11733d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:17.697308 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4e96a265-cb3d-45da-809a-f78accd42b7c req-17d4c49c-85e4-41d6-988b-c9a3db11733d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:17.713234 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4e96a265-cb3d-45da-809a-f78accd42b7c req-17d4c49c-85e4-41d6-988b-c9a3db11733d service nova] Creating event network-vif-plugged:9f190edf-f733-4a78-83fc-965d6c3096bd for instance 0fb0157b-8f8e-4034-8008-661d7feedd75 on nch2-master-1 May 07 22:22:17.719412 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4e96a265-cb3d-45da-809a-f78accd42b7c req-17d4c49c-85e4-41d6-988b-c9a3db11733d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038216 May 07 22:22:17.720491 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3064/6100] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:22:18.739888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d92091b-c9b8-4b75-981e-13320d07ebca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] Calling method '.version_select at 0x7fc41cc9de50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:18.760177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d92091b-c9b8-4b75-981e-13320d07ebca tempest-TestVolumeBootPattern-860620187 tempest-TestVolumeBootPattern-860620187-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-419159820" status: 202 len: 0 microversion: 2.1 time: 0.024306 May 07 22:22:18.760759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3037/6101] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 22:22:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-419159820 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:22:39.967668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7fe9333-5f01-43e1-9907-5784c67f53b6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:22:39.968689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7fe9333-5f01-43e1-9907-5784c67f53b6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:39.975294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7fe9333-5f01-43e1-9907-5784c67f53b6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:39.975754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7fe9333-5f01-43e1-9907-5784c67f53b6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:39.976518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7fe9333-5f01-43e1-9907-5784c67f53b6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:39.976963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7fe9333-5f01-43e1-9907-5784c67f53b6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:40.030542 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7fe9333-5f01-43e1-9907-5784c67f53b6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "POST /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75/action" status: 200 len: 24567 microversion: 2.1 time: 0.067503 May 07 22:22:40.031211 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3065/6102] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:22:39 2022] POST /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75/action => generated 24567 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:22:51.897535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:51.898082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:51.906083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:51.906625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:51.907589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:51.908158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:51.935964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:22:52.027539 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6e2336aa-edc6-4559-8a60-e3e5e295fbb3 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 204 len: 0 microversion: 2.1 time: 0.135873 May 07 22:22:52.028750 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3038/6103] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:22:51 2022] DELETE /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:22:52.038462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:52.039228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:52.045556 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:52.046162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:52.047007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:52.047475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:52.104565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-5528a463-6bcd-4fa6-8aa2-e5163cc5d25d req-d2f8e21f-ea37-4655-a213-b34d2fb02159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fb0157b-8f8e-4034-8008-661d7feedd75", "tag": "9f190edf-f733-4a78-83fc-965d6c3096bd"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:22:52.113568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5528a463-6bcd-4fa6-8aa2-e5163cc5d25d req-d2f8e21f-ea37-4655-a213-b34d2fb02159 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:52.114301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-5528a463-6bcd-4fa6-8aa2-e5163cc5d25d req-d2f8e21f-ea37-4655-a213-b34d2fb02159 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:52.125388 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-5528a463-6bcd-4fa6-8aa2-e5163cc5d25d req-d2f8e21f-ea37-4655-a213-b34d2fb02159 service nova] Creating event network-changed:9f190edf-f733-4a78-83fc-965d6c3096bd for instance 0fb0157b-8f8e-4034-8008-661d7feedd75 on nch2-master-1 May 07 22:22:52.130685 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-5528a463-6bcd-4fa6-8aa2-e5163cc5d25d req-d2f8e21f-ea37-4655-a213-b34d2fb02159 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237092 May 07 22:22:52.131626 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3066/6104] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:22:52.191363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:52.198984 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1f335c27-d3be-4d76-a598-40dcd13fd9dd tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1688 microversion: 2.1 time: 0.165450 May 07 22:22:52.199878 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3039/6105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:52 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:22:53.217965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:53.218673 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:53.225538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:53.225995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:53.226829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:53.227276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:53.373890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:53.381506 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e1a346ab-662a-4771-955f-654198ee4d88 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1688 microversion: 2.1 time: 0.168656 May 07 22:22:53.382105 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3067/6106] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:53 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:54.148473 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-110f6df3-85d5-4d73-b75a-dfc34d59e991 req-f307575b-f5b8-4578-b988-f2dcc8f78abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fb0157b-8f8e-4034-8008-661d7feedd75", "name": "network-vif-deleted", "tag": "9f190edf-f733-4a78-83fc-965d6c3096bd"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:22:54.157251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-110f6df3-85d5-4d73-b75a-dfc34d59e991 req-f307575b-f5b8-4578-b988-f2dcc8f78abc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:54.157710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-110f6df3-85d5-4d73-b75a-dfc34d59e991 req-f307575b-f5b8-4578-b988-f2dcc8f78abc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:54.168660 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-110f6df3-85d5-4d73-b75a-dfc34d59e991 req-f307575b-f5b8-4578-b988-f2dcc8f78abc service nova] Creating event network-vif-deleted:9f190edf-f733-4a78-83fc-965d6c3096bd for instance 0fb0157b-8f8e-4034-8008-661d7feedd75 on nch2-master-1 May 07 22:22:54.175896 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-110f6df3-85d5-4d73-b75a-dfc34d59e991 req-f307575b-f5b8-4578-b988-f2dcc8f78abc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030772 May 07 22:22:54.176527 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3040/6107] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:22:54.399608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:54.400285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:54.407749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:54.408209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:54.409301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:54.409822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:54.443982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:54.444496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:54.444986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lazy-loading 'fault' on Instance uuid 0fb0157b-8f8e-4034-8008-661d7feedd75 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:22:54.486362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeee01bf990e46bfa331c1cd93528cab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16812b38c4514406886f0ab13cabe8ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:22:54.492996 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eaa142b1-d3a3-4d99-9de5-322a76a3cc3d tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 200 len: 1356 microversion: 2.1 time: 0.097482 May 07 22:22:54.493571 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3068/6108] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:54 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:22:55.511638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:55.512364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] [instance: 0fb0157b-8f8e-4034-8008-661d7feedd75] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:22:55.518689 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:55.519195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:55.519980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:22:55.520438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:22:55.534001 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] HTTP exception thrown: Instance 0fb0157b-8f8e-4034-8008-661d7feedd75 could not be found. May 07 22:22:55.534598 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Returning 404 to user: Instance 0fb0157b-8f8e-4034-8008-661d7feedd75 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:22:55.535466 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be02a893-6228-4715-b3d9-4448b96c66e6 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75" status: 404 len: 111 microversion: 2.1 time: 0.029021 May 07 22:22:55.535996 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3041/6109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:22:55 2022] GET /compute/v2.1/servers/0fb0157b-8f8e-4034-8008-661d7feedd75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:22:58.922688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-627951b4-67bd-4805-a18d-84140c0d99c1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] Calling method '.version_select at 0x7fc40faad160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:22:58.943527 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-627951b4-67bd-4805-a18d-84140c0d99c1 tempest-TestNetworkAdvancedServerOps-1526183139 tempest-TestNetworkAdvancedServerOps-1526183139-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1691361429" status: 202 len: 0 microversion: 2.1 time: 0.024596 May 07 22:22:58.944128 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3069/6110] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:22:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1691361429 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:23:11.257265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-394038383", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:11.307805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] validate_networks() for None {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:23:11.596768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:23:11.597216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:23:11.597717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:23:11.598151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:23:11.598592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:23:11.607530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:11.608007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:11.608836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:11.609300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:11.625803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Getting quotas for project b72b3d9fbb75435bbea655f49329ad94. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:23:11.631222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Getting quotas for user 30f6e56e1b944bf7affeeecf22b39218 and project b72b3d9fbb75435bbea655f49329ad94. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:23:11.644532 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:23:11.646863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:23:11.690082 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0ce4a17d-1088-4bb9-8481-eaed8dd053cf tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558431 May 07 22:23:11.690746 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3042/6111] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:23:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:23:11.702896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4d331833-e396-432f-8d14-5636bd8e3aba tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:11.703524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4d331833-e396-432f-8d14-5636bd8e3aba tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:11.756402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4d331833-e396-432f-8d14-5636bd8e3aba tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:11.763544 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4d331833-e396-432f-8d14-5636bd8e3aba tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1221 microversion: 2.1 time: 0.066260 May 07 22:23:11.764108 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3070/6112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:11 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:12.782745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:12.784699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:12.792278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:12.792763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:12.794294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:12.794765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:12.873241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:12.880676 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5a608f28-141b-44cd-9959-3fe5fd4b4142 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1279 microversion: 2.1 time: 0.103817 May 07 22:23:12.881259 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3043/6113] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:12 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:13.897717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:13.898423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:13.905208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:13.905655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:13.906422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:13.906890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:14.050453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:14.057985 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8829ce5a-defa-4598-8d75-af5c8f8fd0c7 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1321 microversion: 2.1 time: 0.164356 May 07 22:23:14.058580 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3071/6114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:13 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:14.175175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9d84ec7a-5243-43be-a6d9-16c85057e309 req-cf8d7655-c259-4a98-bb59-2d0cfbd0bb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc93974c-bf9c-4e96-83b1-966a1372cace", "tag": "5622ed89-49eb-403b-a3a4-8fc2d8cfab28"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:14.188428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9d84ec7a-5243-43be-a6d9-16c85057e309 req-cf8d7655-c259-4a98-bb59-2d0cfbd0bb57 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:14.189058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9d84ec7a-5243-43be-a6d9-16c85057e309 req-cf8d7655-c259-4a98-bb59-2d0cfbd0bb57 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:14.203890 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9d84ec7a-5243-43be-a6d9-16c85057e309 req-cf8d7655-c259-4a98-bb59-2d0cfbd0bb57 service nova] Creating event network-changed:5622ed89-49eb-403b-a3a4-8fc2d8cfab28 for instance bc93974c-bf9c-4e96-83b1-966a1372cace on nch2-master-1 May 07 22:23:14.209186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9d84ec7a-5243-43be-a6d9-16c85057e309 req-cf8d7655-c259-4a98-bb59-2d0cfbd0bb57 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041181 May 07 22:23:14.210380 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3044/6115] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:15.075973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:15.076587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:15.083356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:15.083811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:15.084574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:15.085012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:15.219922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:15.227265 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7e61127c-cf98-4bcc-a7f1-2b6a1665fb42 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1321 microversion: 2.1 time: 0.155833 May 07 22:23:15.227848 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3072/6116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:15 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:16.245606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:16.246350 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:16.253548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:16.254024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:16.254852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:16.255317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:16.388080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:16.395509 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a7f5e9e-c694-48bb-8730-5b63500cf4a4 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1321 microversion: 2.1 time: 0.154172 May 07 22:23:16.396124 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3045/6117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:16 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:17.413011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:17.413636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:17.421371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:17.421834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:17.422624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:17.423112 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:17.555456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:17.562725 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0387b8fc-e3c1-47fc-8787-d54c9abd3b9a tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1321 microversion: 2.1 time: 0.153636 May 07 22:23:17.563348 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3073/6118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:17 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:18.580571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:18.581206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:18.588093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:18.588563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:18.589352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:18.589811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:18.716462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:18.723863 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-336f6b64-2662-4ce3-95cd-3d86310df669 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1321 microversion: 2.1 time: 0.147461 May 07 22:23:18.724442 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3046/6119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:18 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:19.740677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:19.741304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:19.748132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:19.748606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:19.749382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:19.749836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:19.883849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:19.891836 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5624c60d-e645-4de8-b551-60632a3e04b0 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1321 microversion: 2.1 time: 0.155081 May 07 22:23:19.892627 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3074/6120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:19 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:20.021154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-59cd315d-7523-40ce-8459-684bbfc39212 req-42381566-85fe-4f2b-88cf-1b66dda61ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc93974c-bf9c-4e96-83b1-966a1372cace", "name": "network-vif-plugged", "status": "completed", "tag": "5622ed89-49eb-403b-a3a4-8fc2d8cfab28"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:20.029531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-59cd315d-7523-40ce-8459-684bbfc39212 req-42381566-85fe-4f2b-88cf-1b66dda61ad1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:20.030513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-59cd315d-7523-40ce-8459-684bbfc39212 req-42381566-85fe-4f2b-88cf-1b66dda61ad1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:20.044150 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-59cd315d-7523-40ce-8459-684bbfc39212 req-42381566-85fe-4f2b-88cf-1b66dda61ad1 service nova] Creating event network-vif-plugged:5622ed89-49eb-403b-a3a4-8fc2d8cfab28 for instance bc93974c-bf9c-4e96-83b1-966a1372cace on nch2-master-1 May 07 22:23:20.049291 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-59cd315d-7523-40ce-8459-684bbfc39212 req-42381566-85fe-4f2b-88cf-1b66dda61ad1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094543 May 07 22:23:20.049941 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3047/6121] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:20.908675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:20.909290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:20.916281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:20.916732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:20.917521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:20.917961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:21.044663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:21.052547 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e48a4c1-f338-4a59-93c4-8c100be16086 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1321 microversion: 2.1 time: 0.148290 May 07 22:23:21.053117 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3075/6122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:20 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:22.069619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:22.070416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:22.077504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.077978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.078797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.079248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.207272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:22.214836 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8156910b-9378-4bac-8bbc-da6b78bc010f tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1471 microversion: 2.1 time: 0.149509 May 07 22:23:22.215421 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3048/6123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:22 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:22.289495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a9107b28-340d-4710-ae08-818c71c6c1fd tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Calling method '.version_select at 0x7fc40fab5160>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:22.355271 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a9107b28-340d-4710-ae08-818c71c6c1fd tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/0a46c3500bad44c4ba2f968f1ea14486" status: 200 len: 371 microversion: 2.1 time: 0.123029 May 07 22:23:22.355844 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3076/6124] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:23:22 2022] GET /compute/v2.1/os-quota-sets/0a46c3500bad44c4ba2f968f1ea14486 => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:22.366639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-56e80831-6e5f-4b23-a877-7a9ccb3371b2 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-41065813", "id": 2102279825, "os-flavor-access:is_public": "True"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:22.368261 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:23:22.368261 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 22:23:22.383927 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56e80831-6e5f-4b23-a877-7a9ccb3371b2 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021013 May 07 22:23:22.384533 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3049/6125] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:23:22 2022] POST /compute/v2.1/flavors => generated 436 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:22.395099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2102279825"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:22.396135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:22.402124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.402584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.403387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.403836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.588997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ed3fb8431bc54bdda8acf0d19c6407da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a46c3500bad44c4ba2f968f1ea14486', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:22.596031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-41065813 {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:23:22.602474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.603003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.603818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.604270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.626239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Getting quotas for project b72b3d9fbb75435bbea655f49329ad94. Resources: {'cores', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:23:22.631282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Getting quotas for user 30f6e56e1b944bf7affeeecf22b39218 and project b72b3d9fbb75435bbea655f49329ad94. Resources: {'cores', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:23:22.644292 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] ram quota exceeded for 0a46c3500bad44c4ba2f968f1ea14486, tried to resize instance. May 07 22:23:22.644838 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 07 22:23:22.645435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:23:22.646279 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e310c88e-50a5-420b-b45a-1d47a336345e tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace/action" status: 403 len: 118 microversion: 2.1 time: 0.255139 May 07 22:23:22.646871 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3077/6126] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:23:22 2022] POST /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace/action => generated 118 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 22:23:22.655745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9cef165b-b2e8-48aa-8cbf-ec18128cadcf tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:22.656540 ncdv-master-1 devstack@n-api.service[136681]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:23:22.656540 ncdv-master-1 devstack@n-api.service[136681]: warnings.warn(msg) May 07 22:23:22.672759 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9cef165b-b2e8-48aa-8cbf-ec18128cadcf tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2102279825" status: 202 len: 0 microversion: 2.1 time: 0.021349 May 07 22:23:22.673347 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3050/6127] 10.222.0.32 () {58 vars in 1160 bytes} [Sat May 7 22:23:22 2022] DELETE /compute/v2.1/flavors/2102279825 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:23:22.680971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3b32c2e-5893-4f64-a730-f2d689772efa tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:22.699196 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a3b32c2e-5893-4f64-a730-f2d689772efa tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021817 May 07 22:23:22.699772 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3078/6128] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 22:23:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:22.715839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f66aff84-930a-4f7a-a52b-289d9ba4dfbd tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Calling method '.version_select at 0x7fc41cc30dc0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:22.784559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f66aff84-930a-4f7a-a52b-289d9ba4dfbd tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/0a46c3500bad44c4ba2f968f1ea14486" status: 200 len: 371 microversion: 2.1 time: 0.072430 May 07 22:23:22.785140 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3051/6129] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:23:22 2022] GET /compute/v2.1/os-quota-sets/0a46c3500bad44c4ba2f968f1ea14486 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:22.795660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-10a76881-e4ab-46f3-8ad5-39bc333ad376 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-294091302", "id": 535317502, "os-flavor-access:is_public": "True"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:22.797251 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:23:22.797251 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:23:22.811843 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-10a76881-e4ab-46f3-8ad5-39bc333ad376 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.019907 May 07 22:23:22.812353 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3079/6130] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:23:22 2022] POST /compute/v2.1/flavors => generated 433 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:22.823306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "535317502"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:22.824360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:22.831050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.831526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.832317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.832780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.917124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ed3fb8431bc54bdda8acf0d19c6407da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a46c3500bad44c4ba2f968f1ea14486', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:22.923364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-294091302 {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:23:22.929861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.930337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.931191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:22.931658 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:22.951931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Getting quotas for project b72b3d9fbb75435bbea655f49329ad94. Resources: {'cores', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:23:22.956958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Getting quotas for user 30f6e56e1b944bf7affeeecf22b39218 and project b72b3d9fbb75435bbea655f49329ad94. Resources: {'cores', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:23:22.969410 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.compute.api [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] cores quota exceeded for 0a46c3500bad44c4ba2f968f1ea14486, tried to resize instance. May 07 22:23:22.969971 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 07 22:23:22.970588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:23:22.971497 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-76fcee84-4ebd-4a65-b0d6-9b4cda82d432 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace/action" status: 403 len: 113 microversion: 2.1 time: 0.152173 May 07 22:23:22.972082 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3052/6131] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:23:22 2022] POST /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace/action => generated 113 bytes in 153 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 07 22:23:22.980166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60eda412-40ca-4f5e-afc6-b43c27b6d6cd tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:22.980957 ncdv-master-1 devstack@n-api.service[136682]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:23:22.980957 ncdv-master-1 devstack@n-api.service[136682]: warnings.warn(msg) May 07 22:23:22.996669 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-60eda412-40ca-4f5e-afc6-b43c27b6d6cd tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/535317502" status: 202 len: 0 microversion: 2.1 time: 0.020257 May 07 22:23:22.997230 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3080/6132] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 22:23:22 2022] DELETE /compute/v2.1/flavors/535317502 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:23:23.004876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-95588429-f83a-4fd3-91f3-9b3854ec4f28 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:23.023857 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-95588429-f83a-4fd3-91f3-9b3854ec4f28 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022571 May 07 22:23:23.024411 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3053/6133] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 22:23:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:23.041679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:23.042186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:23.048201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:23.048663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:23.049437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:23.049881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:23.075638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:23:23.151441 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fc85236a-9d0f-4cef-b9a7-20d12d17921d tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 204 len: 0 microversion: 2.1 time: 0.113678 May 07 22:23:23.152216 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3081/6134] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:23:23 2022] DELETE /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:23:23.160358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:23.161002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:23.168171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:23.168645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:23.169438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:23.169921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:23.297367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:23.305483 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f5fb6f64-7d3e-4277-a9ee-1a19cf495b87 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1477 microversion: 2.1 time: 0.149067 May 07 22:23:23.306044 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3054/6135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:23 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1477 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:23:24.323669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:24.324368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:24.331638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:24.332089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:24.332879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:24.333320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:24.481716 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30f6e56e1b944bf7affeeecf22b39218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72b3d9fbb75435bbea655f49329ad94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:24.492078 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-26c497d3-83da-4ffa-a860-b872365d7a63 tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 200 len: 1477 microversion: 2.1 time: 0.172629 May 07 22:23:24.492672 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3082/6136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:24 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 1477 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:24.866321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-02c0309c-76b9-4da6-b936-b0115cafaab3 req-2a255b55-9971-4e45-9a72-419de575343b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc93974c-bf9c-4e96-83b1-966a1372cace", "name": "network-vif-deleted", "tag": "5622ed89-49eb-403b-a3a4-8fc2d8cfab28"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:24.876500 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-02c0309c-76b9-4da6-b936-b0115cafaab3 req-2a255b55-9971-4e45-9a72-419de575343b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:24.876965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-02c0309c-76b9-4da6-b936-b0115cafaab3 req-2a255b55-9971-4e45-9a72-419de575343b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:24.888450 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-02c0309c-76b9-4da6-b936-b0115cafaab3 req-2a255b55-9971-4e45-9a72-419de575343b service nova] Creating event network-vif-deleted:5622ed89-49eb-403b-a3a4-8fc2d8cfab28 for instance bc93974c-bf9c-4e96-83b1-966a1372cace on nch2-master-1 May 07 22:23:24.894497 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-02c0309c-76b9-4da6-b936-b0115cafaab3 req-2a255b55-9971-4e45-9a72-419de575343b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 May 07 22:23:24.895340 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3055/6137] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:25.508660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:25.509287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] [instance: bc93974c-bf9c-4e96-83b1-966a1372cace] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:25.516799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:25.517261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:25.518031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:25.518504 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:25.531580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] HTTP exception thrown: Instance bc93974c-bf9c-4e96-83b1-966a1372cace could not be found. May 07 22:23:25.532165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] Returning 404 to user: Instance bc93974c-bf9c-4e96-83b1-966a1372cace could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:23:25.532988 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3bd695a-60a6-465f-bf3f-9742ae0ce1dc tempest-ServersAdminNegativeTestJSON-1597380126 tempest-ServersAdminNegativeTestJSON-1597380126-project] 10.222.0.32 "GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace" status: 404 len: 111 microversion: 2.1 time: 0.028296 May 07 22:23:25.533513 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3083/6138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:25 2022] GET /compute/v2.1/servers/bc93974c-bf9c-4e96-83b1-966a1372cace => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:23:28.138673 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1410239259", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0fec4d6d-f03a-40d5-88eb-8c0a2074eaab"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:28.191936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] validate_networks() for [('0fec4d6d-f03a-40d5-88eb-8c0a2074eaab', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:23:28.864229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:23:28.864679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:23:28.865209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:23:28.865650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:23:28.866083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:23:28.875873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:28.876353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:28.877183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:28.877646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:28.894277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Getting quotas for project 55ed75dcd4ce4cb3a25250247e45159c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:23:28.899504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Getting quotas for user 7c787a6b43bf4218a444fd63f4b706b1 and project 55ed75dcd4ce4cb3a25250247e45159c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:23:28.911805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:23:28.914199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:23:28.959134 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dcbc415b-fd5b-4413-8110-d383810ef400 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934259 May 07 22:23:28.959796 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3056/6139] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:23:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:23:28.970696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-81f90f38-c056-434e-97a2-125cc74da83a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:28.971348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-81f90f38-c056-434e-97a2-125cc74da83a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:29.029293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-81f90f38-c056-434e-97a2-125cc74da83a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:29.037411 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-81f90f38-c056-434e-97a2-125cc74da83a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1215 microversion: 2.1 time: 0.071513 May 07 22:23:29.037975 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3084/6140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:28 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:30.055451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:30.056087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:30.063199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:30.063681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:30.064492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:30.064951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:30.137848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:30.145298 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9bb7af48-c9b1-4364-8c47-5c9bd6c2718b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1273 microversion: 2.1 time: 0.094787 May 07 22:23:30.146093 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3057/6141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:30 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:31.169911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:31.171171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cfa48167-7187-4fc6-8ef1-2a3c41b46521 req-dc8a870a-ffa7-44c6-8198-1bedd3f73d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2268fce0-6818-4c73-bbde-6161aa0d79c3", "tag": "cf71ca56-a87b-4c84-81ab-3966bfc6cab9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:31.172495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:31.181996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cfa48167-7187-4fc6-8ef1-2a3c41b46521 req-dc8a870a-ffa7-44c6-8198-1bedd3f73d51 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:31.182461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cfa48167-7187-4fc6-8ef1-2a3c41b46521 req-dc8a870a-ffa7-44c6-8198-1bedd3f73d51 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:31.183164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:31.183841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:31.184820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:31.185430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:31.199831 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cfa48167-7187-4fc6-8ef1-2a3c41b46521 req-dc8a870a-ffa7-44c6-8198-1bedd3f73d51 service nova] Creating event network-changed:cf71ca56-a87b-4c84-81ab-3966bfc6cab9 for instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 on nch2-master-1 May 07 22:23:31.205806 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cfa48167-7187-4fc6-8ef1-2a3c41b46521 req-dc8a870a-ffa7-44c6-8198-1bedd3f73d51 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039063 May 07 22:23:31.206603 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3058/6142] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:23:31.326589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:31.334032 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f8a46a89-d541-4f31-86f6-779f5d22b16f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1315 microversion: 2.1 time: 0.174646 May 07 22:23:31.334617 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3085/6143] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:31 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:32.351558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:32.352281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:32.360233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:32.360714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:32.361520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:32.362022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:32.569379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:32.577136 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc59a228-952b-4bc3-a04f-247a1927e2da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1315 microversion: 2.1 time: 0.229406 May 07 22:23:32.583183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3059/6144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:32 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:33.593257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:33.593877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:33.600679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:33.601135 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:33.601906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:33.602372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:33.732202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:33.740154 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-652ee55f-10da-4927-b58f-629d3622b322 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1315 microversion: 2.1 time: 0.150867 May 07 22:23:33.740726 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3086/6145] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:33 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:34.757103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:34.757765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:34.764693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:34.765169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:34.765956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:34.766413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:34.892774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:34.900247 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-40575581-badf-4a53-bd65-6e128764dadb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1315 microversion: 2.1 time: 0.147182 May 07 22:23:34.900842 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3060/6146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:34 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:35.917387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:35.918018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:35.925143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:35.925602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:35.926378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:35.926843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:36.039399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d5351a89-1b8b-4117-a8da-3d447e68ea47 req-ba2aaea7-13d9-4b40-bceb-1ea6cf05891f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2268fce0-6818-4c73-bbde-6161aa0d79c3", "name": "network-vif-plugged", "status": "completed", "tag": "cf71ca56-a87b-4c84-81ab-3966bfc6cab9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:36.049959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d5351a89-1b8b-4117-a8da-3d447e68ea47 req-ba2aaea7-13d9-4b40-bceb-1ea6cf05891f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:36.050668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d5351a89-1b8b-4117-a8da-3d447e68ea47 req-ba2aaea7-13d9-4b40-bceb-1ea6cf05891f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:36.059927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:36.063374 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d5351a89-1b8b-4117-a8da-3d447e68ea47 req-ba2aaea7-13d9-4b40-bceb-1ea6cf05891f service nova] Creating event network-vif-plugged:cf71ca56-a87b-4c84-81ab-3966bfc6cab9 for instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 on nch2-master-1 May 07 22:23:36.068556 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d5351a89-1b8b-4117-a8da-3d447e68ea47 req-ba2aaea7-13d9-4b40-bceb-1ea6cf05891f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033012 May 07 22:23:36.069045 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-76bfd20c-7ae0-4fa0-97f9-74ab5a4d9598 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1315 microversion: 2.1 time: 0.155950 May 07 22:23:36.069404 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3061/6147] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:23:36.069695 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3087/6148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:35 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:37.088022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:37.088740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:37.095693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:37.096160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:37.096938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:37.097389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:37.234481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:37.241842 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-888e34b3-7a6a-461b-9a0c-8405cedd43da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1315 microversion: 2.1 time: 0.158929 May 07 22:23:37.242442 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3062/6149] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:37 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:38.258665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:38.259320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:38.266171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:38.266626 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:38.267428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:38.267873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:38.399534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:38.407660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07860f75-906b-47b1-b0ad-11d9acb0f3bd tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1501 microversion: 2.1 time: 0.152916 May 07 22:23:38.408237 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3088/6150] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:38 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:38.424631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:23:38.425618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:38.432784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:38.433341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:38.434206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:38.434667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:38.464458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:38.470502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Old instance type m1.heat2, new instance type m1.heat {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:23:38.476666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:23:38.477105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:23:38.477628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:23:38.478054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:23:38.478481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:23:38.539320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-245b78e3-12be-46eb-8b56-6eb33320aeb8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "POST /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3/action" status: 202 len: 0 microversion: 2.1 time: 0.119122 May 07 22:23:38.539948 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3063/6151] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:23:38 2022] POST /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:23:38.548511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:38.549166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:38.555117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:38.555577 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:38.556352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:38.556799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:38.690812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:38.699206 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce099a63-4140-4fc4-b890-52fd3d30c94c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1510 microversion: 2.1 time: 0.154534 May 07 22:23:38.699831 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3089/6152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:38 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:39.718894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:39.719460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:39.725537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:39.726053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:39.727666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:39.727666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:39.933298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:39.941204 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d154cd9d-9fd7-4403-8314-e5d05736a59d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1510 microversion: 2.1 time: 0.227807 May 07 22:23:39.942005 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3064/6153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:39 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:40.957967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:40.958587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:40.965589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:40.966050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:40.966851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:40.967304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:41.094033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:41.101406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-89e1d097-43e0-4ccc-8491-5eaf0102e48c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.147398 May 07 22:23:41.101986 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3090/6154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:40 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:42.119667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:42.120304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:42.127744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:42.128213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:42.128997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:42.129452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:42.255708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:42.263070 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e7bb68b-9cae-48ad-95fa-f81217c255c1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.147281 May 07 22:23:42.263654 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3065/6155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:42 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:43.279275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:43.280465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:43.287230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:43.287691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:43.288463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:43.288909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:43.415683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:43.423067 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b93c1b75-dd9f-4578-8c4e-c24ff0c2d70d tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.147633 May 07 22:23:43.423645 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3091/6156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:43 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:44.440724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:44.441355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:44.448366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:44.448875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:44.449696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:44.450159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:44.575763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:44.583360 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc07a4a7-8226-474c-ad81-460bc07dbdca tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.146476 May 07 22:23:44.583972 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3066/6157] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:44 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:45.600937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:45.601563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:45.608730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:45.609193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:45.610034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:45.610677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:45.746436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:45.754469 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ba361a6-e5c2-4aa0-a678-90443d9cfb0f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.157498 May 07 22:23:45.755078 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3092/6158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:45 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:46.772300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:46.772969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:46.779880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:46.780354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:46.781144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:46.781606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:46.910992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:46.918805 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06546a7d-802e-4792-a2bf-b226a6914d2c tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.150457 May 07 22:23:46.919386 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3067/6159] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:46 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:47.935847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:47.936756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:47.943292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:47.943749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:47.944521 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:47.944964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:48.074966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:48.083038 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d27d5cb8-beef-4294-ac0f-2a4e428a2fbb tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.151159 May 07 22:23:48.083616 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3093/6160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:47 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:49.100015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:49.100648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:49.107394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:49.107862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:49.108642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:49.109093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:49.235439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:49.242729 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bf575b7-237e-445b-8555-2c1837ad8ed3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.146577 May 07 22:23:49.243338 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3068/6161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:49 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:50.259681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:50.260306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:50.267750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:50.268204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:50.269003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:50.269449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:50.403553 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:50.410988 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da322d14-881a-4938-8114-8c9e33ee82d3 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.155147 May 07 22:23:50.411750 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3094/6162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:50 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:51.428249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:51.428880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:51.437003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:51.437481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:51.438279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:51.438741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:51.571626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:51.579148 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-079439de-4cb1-4a5c-a389-ab757c4d10e8 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.154802 May 07 22:23:51.579728 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3069/6163] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:51 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:52.596613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:52.597219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:52.603950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:52.604403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:52.605167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:52.605605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:52.733995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:52.741374 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-40c9d7ec-d5e4-4230-9396-e1356ff76ed0 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.148662 May 07 22:23:52.741945 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3095/6164] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:52 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:53.757561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:53.758236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:53.765090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:53.765567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:53.766363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:53.766847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:53.892080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:53.899592 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-be8b6de7-7108-4ee2-966e-0039e6f3e150 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.145938 May 07 22:23:53.900175 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3070/6165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:53 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:54.917347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:54.917971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:54.924871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:54.925336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:54.926115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:54.926563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:55.058304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:55.066290 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-972a6eeb-48e6-4404-bcdb-99935db275da tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.153192 May 07 22:23:55.066881 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3096/6166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:54 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:56.083619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:56.084262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:56.091295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:56.091771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:56.092572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:56.093036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:56.222346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:56.229891 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-59901dc1-e2b3-4512-8afe-b43984f9f623 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.150151 May 07 22:23:56.230475 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3071/6167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:56 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:57.247650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:57.248266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:57.255062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:57.255520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:57.256290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:57.256731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:57.382265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:57.390228 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef5140fd-fca8-49a7-8963-f4b73bf434f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.146432 May 07 22:23:57.390863 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3097/6168] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:57 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:58.407361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:58.408001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:58.415124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:58.415604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:58.416397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:58.416878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:58.545410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:58.552830 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bf637929-71fa-4bb6-8b85-da6c2c462c6f tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.149430 May 07 22:23:58.553417 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3072/6169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:58 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:23:59.570925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:23:59.571557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:23:59.578693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:59.579174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:59.580087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:23:59.580642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:23:59.711818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:23:59.719300 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07a38957-d46a-4c92-a9f0-dc4fea116f12 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.152507 May 07 22:23:59.719868 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3098/6170] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:23:59 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:00.736069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:00.736738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:00.744801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:00.745280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:00.746189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:00.746655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:00.873405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:00.881247 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-aff5e6e0-8a23-4dc6-8282-c4c6f7489b65 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.149076 May 07 22:24:00.881850 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3073/6171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:00 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:01.898276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:01.898916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:01.905788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:01.906249 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:01.907059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:01.907512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:02.041351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:02.048908 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-526c6602-017d-48f2-9d89-aa80d4cb3c3b tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.154494 May 07 22:24:02.049493 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3099/6172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:01 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:03.066365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:03.067046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:03.073854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:03.074327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:03.075267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:03.075729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:03.212574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:03.220190 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6c884f0f-bdbd-4f78-8457-a280df982638 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.158225 May 07 22:24:03.220769 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3074/6173] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:03 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:04.237675 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:04.238301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:04.245210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:04.245698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:04.246475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:04.246966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:04.374048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:04.381540 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-17bfde72-8a77-4571-9967-4a0ab3b46041 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.148344 May 07 22:24:04.382119 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3100/6174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:04 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:05.398687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:05.399363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:05.405915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:05.406386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:05.407218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:05.407684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:05.535926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:05.543546 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eddce6b0-ba88-4333-9fec-ffc0d0aa47d4 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.148946 May 07 22:24:05.544130 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3075/6175] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:05 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:06.561515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:06.562625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:06.569068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:06.569529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:06.570307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:06.570756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:06.703077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:06.710423 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-311f2ca6-ccb3-4e36-977a-e420dfbf0476 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1515 microversion: 2.1 time: 0.152957 May 07 22:24:06.711036 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3101/6176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:06 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:07.607712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3589d4ca-ad00-4ba8-ab6c-a2aea6cee77c req-51e81a3d-8ccd-481d-b48b-b5e73a5187ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2268fce0-6818-4c73-bbde-6161aa0d79c3", "name": "network-vif-unplugged", "status": "completed", "tag": "cf71ca56-a87b-4c84-81ab-3966bfc6cab9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:07.620133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3589d4ca-ad00-4ba8-ab6c-a2aea6cee77c req-51e81a3d-8ccd-481d-b48b-b5e73a5187ee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:07.620601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3589d4ca-ad00-4ba8-ab6c-a2aea6cee77c req-51e81a3d-8ccd-481d-b48b-b5e73a5187ee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:07.633465 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3589d4ca-ad00-4ba8-ab6c-a2aea6cee77c req-51e81a3d-8ccd-481d-b48b-b5e73a5187ee service nova] Creating event network-vif-unplugged:cf71ca56-a87b-4c84-81ab-3966bfc6cab9 for instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 on nch1-master-1 May 07 22:24:07.639905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-3589d4ca-ad00-4ba8-ab6c-a2aea6cee77c req-51e81a3d-8ccd-481d-b48b-b5e73a5187ee service nova] Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:24:07.651373 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3589d4ca-ad00-4ba8-ab6c-a2aea6cee77c req-51e81a3d-8ccd-481d-b48b-b5e73a5187ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109747 May 07 22:24:07.652767 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3076/6177] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:24:07.727968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:07.728634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:07.736733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:07.737190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:07.738148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:07.739067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:07.976086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:07.983729 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c8c2c019-ac34-4f38-b2d4-4e7a2b0da5f7 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1514 microversion: 2.1 time: 0.259507 May 07 22:24:07.984314 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3102/6178] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:07 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1514 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:09.002017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:09.002731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:09.008981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:09.009450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:09.010224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:09.010680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:09.142254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:09.149730 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d975f72b-2cb2-4b4f-9b83-fd369ce2c720 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1512 microversion: 2.1 time: 0.152805 May 07 22:24:09.150302 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3077/6179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:08 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:09.678859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-031e8aa8-b06e-4ac0-8ea4-b99785b093c0 req-8979d46c-1dae-469a-83bb-eeb83839a1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2268fce0-6818-4c73-bbde-6161aa0d79c3", "tag": "cf71ca56-a87b-4c84-81ab-3966bfc6cab9"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:09.688625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-031e8aa8-b06e-4ac0-8ea4-b99785b093c0 req-8979d46c-1dae-469a-83bb-eeb83839a1c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:09.689077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-031e8aa8-b06e-4ac0-8ea4-b99785b093c0 req-8979d46c-1dae-469a-83bb-eeb83839a1c3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:09.700946 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-031e8aa8-b06e-4ac0-8ea4-b99785b093c0 req-8979d46c-1dae-469a-83bb-eeb83839a1c3 service nova] Creating event network-changed:cf71ca56-a87b-4c84-81ab-3966bfc6cab9 for instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 on nch1-master-1 May 07 22:24:09.706635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-031e8aa8-b06e-4ac0-8ea4-b99785b093c0 req-8979d46c-1dae-469a-83bb-eeb83839a1c3 service nova] Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:24:09.717179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-031e8aa8-b06e-4ac0-8ea4-b99785b093c0 req-8979d46c-1dae-469a-83bb-eeb83839a1c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042014 May 07 22:24:09.717842 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3103/6180] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:24:10.168261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:10.169248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:10.176199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:10.176675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:10.177478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:10.177947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:10.553025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:10.560282 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f53efe49-99cd-4dff-8101-a2a9ecb96924 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1509 microversion: 2.1 time: 0.396255 May 07 22:24:10.560862 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3078/6181] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:10 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:24:10.576874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:10.577987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:10.584145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:10.584608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:10.585384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:10.585832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:10.611444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:24:10.666058 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.compute.api [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Found an unconfirmed migration during delete, id: 16, status: finished May 07 22:24:11.961693 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3852de7c-9d0a-43ff-baf7-f6e87bd3ecdf tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 204 len: 0 microversion: 2.1 time: 1.388820 May 07 22:24:11.966167 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3104/6182] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:24:10 2022] DELETE /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:24:11.971866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:11.973045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:11.981481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:11.981997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:11.982828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:11.983296 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:12.121732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:12.133080 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-72a26d53-e257-494a-8d5a-2c3b1abdc9b1 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1501 microversion: 2.1 time: 0.166420 May 07 22:24:12.133673 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3079/6183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:11 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:24:13.150091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:13.150834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:13.157759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:13.158223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:13.159032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:13.159488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:13.320984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c787a6b43bf4218a444fd63f4b706b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ed75dcd4ce4cb3a25250247e45159c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:13.329316 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-96a5aefd-c1b6-4eef-bc71-bd38b6c2635a tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 200 len: 1501 microversion: 2.1 time: 0.183444 May 07 22:24:13.329791 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3105/6184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:13 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:13.764491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-23df0971-7e61-48a6-84e1-79e6a6f274b8 req-fcfafadc-c887-486d-b8f0-2fa4a4d4d0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2268fce0-6818-4c73-bbde-6161aa0d79c3", "name": "network-vif-deleted", "tag": "cf71ca56-a87b-4c84-81ab-3966bfc6cab9"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:13.773762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-23df0971-7e61-48a6-84e1-79e6a6f274b8 req-fcfafadc-c887-486d-b8f0-2fa4a4d4d0fd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:13.774224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-23df0971-7e61-48a6-84e1-79e6a6f274b8 req-fcfafadc-c887-486d-b8f0-2fa4a4d4d0fd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:13.787046 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-23df0971-7e61-48a6-84e1-79e6a6f274b8 req-fcfafadc-c887-486d-b8f0-2fa4a4d4d0fd service nova] Creating event network-vif-deleted:cf71ca56-a87b-4c84-81ab-3966bfc6cab9 for instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 on nch1-master-1 May 07 22:24:13.792400 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-23df0971-7e61-48a6-84e1-79e6a6f274b8 req-fcfafadc-c887-486d-b8f0-2fa4a4d4d0fd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031698 May 07 22:24:13.793254 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3080/6185] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:24:14.346391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:14.347032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:14.354102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:14.354561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:14.355350 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:14.355792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:14.369322 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] HTTP exception thrown: Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 could not be found. May 07 22:24:14.369905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Returning 404 to user: Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:24:14.370753 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a9b3e82b-a57a-4d6f-867f-9de5f54eeb15 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 404 len: 111 microversion: 2.1 time: 0.028337 May 07 22:24:14.371292 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3106/6186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:14 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:24:14.386965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:14.387569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:14.393921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:14.394385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:14.395200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:14.395640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:14.408688 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] HTTP exception thrown: Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 could not be found. May 07 22:24:14.409321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Returning 404 to user: Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:24:14.410155 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e39171bd-ef64-4c0a-acaa-98d7c216da34 tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 404 len: 111 microversion: 2.1 time: 0.027456 May 07 22:24:14.410682 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3081/6187] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:24:14 2022] DELETE /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:24:14.418555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:14.419196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] [instance: 2268fce0-6818-4c73-bbde-6161aa0d79c3] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:14.425499 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:14.425946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:14.426707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:14.427189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:14.445897 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] HTTP exception thrown: Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 could not be found. May 07 22:24:14.446490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] Returning 404 to user: Instance 2268fce0-6818-4c73-bbde-6161aa0d79c3 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:24:14.447346 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-218734ad-2959-4533-a331-1e5d855205ad tempest-DeleteServersTestJSON-375193796 tempest-DeleteServersTestJSON-375193796-project] 10.222.0.32 "GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3" status: 404 len: 111 microversion: 2.1 time: 0.032820 May 07 22:24:14.447889 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3107/6188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:14 2022] GET /compute/v2.1/servers/2268fce0-6818-4c73-bbde-6161aa0d79c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:24:16.868984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-18660796", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0f3a316b-8dfb-4fb1-baa4-fc05f7ac4ded"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:16.919607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] validate_networks() for [('0f3a316b-8dfb-4fb1-baa4-fc05f7ac4ded', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:24:17.267312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:24:17.267758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:24:17.268252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:24:17.268680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:24:17.269112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:24:17.278014 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:17.278492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:17.279389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:17.279797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:17.296995 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Getting quotas for project ce6f4e2c33bb4c6d98d8b89b302d2b2a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:24:17.302183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Getting quotas for user b49d5a27410a4d1cb7c0f63db60a9036 and project ce6f4e2c33bb4c6d98d8b89b302d2b2a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:24:17.315517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:24:17.317859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:24:17.362241 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff4c2723-f38e-44fc-8dac-1936d8419bc3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607345 May 07 22:24:17.363093 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3082/6189] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:24:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:24:17.372831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-669ebbde-2558-475c-aec2-8cc10b9a4181 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:17.373572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-669ebbde-2558-475c-aec2-8cc10b9a4181 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:17.426978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-669ebbde-2558-475c-aec2-8cc10b9a4181 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:17.434348 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-669ebbde-2558-475c-aec2-8cc10b9a4181 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1216 microversion: 2.1 time: 0.065318 May 07 22:24:17.435258 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3108/6190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:17 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1216 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:18.451991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:18.453614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:18.462378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:18.462909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:18.463710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:18.464181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:18.562857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:18.570450 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-196c7d24-b035-49de-9abd-55e0efcf2c50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1286 microversion: 2.1 time: 0.123451 May 07 22:24:18.571078 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3083/6191] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:18 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:19.588418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:19.589189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:19.596052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:19.596513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:19.597327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:19.597770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:19.645651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7be69847-4072-472c-a1d8-416e3fd32020 req-d96be205-dc86-4176-9084-0c0674d31a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e68003a-fd19-4fb1-990f-82987d03e0e8", "tag": "c14cbcc8-a625-427e-bc16-26d770f1ce10"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:19.657240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7be69847-4072-472c-a1d8-416e3fd32020 req-d96be205-dc86-4176-9084-0c0674d31a97 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:19.658068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7be69847-4072-472c-a1d8-416e3fd32020 req-d96be205-dc86-4176-9084-0c0674d31a97 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:19.680823 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7be69847-4072-472c-a1d8-416e3fd32020 req-d96be205-dc86-4176-9084-0c0674d31a97 service nova] Creating event network-changed:c14cbcc8-a625-427e-bc16-26d770f1ce10 for instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 on nch2-master-1 May 07 22:24:19.687317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7be69847-4072-472c-a1d8-416e3fd32020 req-d96be205-dc86-4176-9084-0c0674d31a97 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045126 May 07 22:24:19.688450 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3084/6192] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:24:19.737538 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:19.744950 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55f92dd5-1390-49e8-9b0f-d86c2efbf223 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1316 microversion: 2.1 time: 0.160652 May 07 22:24:19.745513 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3109/6193] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:19 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:20.762365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:20.763119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:20.770937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:20.771407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:20.772192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:20.772685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:21.230072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:21.237598 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-50640003-1732-48bd-8507-49f156bd7496 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1316 microversion: 2.1 time: 0.479585 May 07 22:24:21.238296 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3085/6194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:20 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:22.255169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:22.255801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:22.262519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:22.263020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:22.263800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:22.264248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:22.392517 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:22.399852 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-faa15c3d-5d2d-4ed4-861e-8c764b65f993 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1316 microversion: 2.1 time: 0.148568 May 07 22:24:22.400435 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3110/6195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:22 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:23.416442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:23.417115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:23.424541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:23.425015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:23.425809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:23.426274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:23.558710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:23.566132 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d206e617-bb02-4176-8ad4-9a0541fd38d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1316 microversion: 2.1 time: 0.153937 May 07 22:24:23.566715 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3086/6196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:23 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:24.257880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f3d7a9dd-7ed3-42c6-97bc-478e976c727a req-762e9e44-eba6-4ab8-a869-f7538c152ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e68003a-fd19-4fb1-990f-82987d03e0e8", "name": "network-vif-plugged", "status": "completed", "tag": "c14cbcc8-a625-427e-bc16-26d770f1ce10"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:24.267899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f3d7a9dd-7ed3-42c6-97bc-478e976c727a req-762e9e44-eba6-4ab8-a869-f7538c152ffd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:24.268348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f3d7a9dd-7ed3-42c6-97bc-478e976c727a req-762e9e44-eba6-4ab8-a869-f7538c152ffd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:24.279876 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f3d7a9dd-7ed3-42c6-97bc-478e976c727a req-762e9e44-eba6-4ab8-a869-f7538c152ffd service nova] Creating event network-vif-plugged:c14cbcc8-a625-427e-bc16-26d770f1ce10 for instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 on nch2-master-1 May 07 22:24:24.285283 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f3d7a9dd-7ed3-42c6-97bc-478e976c727a req-762e9e44-eba6-4ab8-a869-f7538c152ffd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031081 May 07 22:24:24.285856 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3111/6197] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:24:24.583804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:24.584501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:24.591834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:24.592303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:24.593147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:24.593679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:24.721645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:24.728959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a1831f71-20b9-4377-8cf1-f4ed6548c308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1316 microversion: 2.1 time: 0.149119 May 07 22:24:24.729531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3087/6198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:24 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:25.747010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:25.747724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:25.754535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:25.755034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:25.755809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:25.756255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:25.885988 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:25.893450 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-da1d10b1-30ac-4e0a-aef4-78045a01e713 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1506 microversion: 2.1 time: 0.151646 May 07 22:24:25.894042 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3112/6199] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:25 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:25.909921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:25.910548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:25.917992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:25.918468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:25.919274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:25.919728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.046414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:26.054535 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4f32a0b6-abcc-49f0-973d-99815f918bae tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1506 microversion: 2.1 time: 0.148975 May 07 22:24:26.055166 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3088/6200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:25 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:26.070966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a6d4d810-5e71-4ab9-9a0e-d1e57c2615f8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:26.072134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a6d4d810-5e71-4ab9-9a0e-d1e57c2615f8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:26.079435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6d4d810-5e71-4ab9-9a0e-d1e57c2615f8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.079895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6d4d810-5e71-4ab9-9a0e-d1e57c2615f8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.080715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6d4d810-5e71-4ab9-9a0e-d1e57c2615f8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.081159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a6d4d810-5e71-4ab9-9a0e-d1e57c2615f8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.145178 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a6d4d810-5e71-4ab9-9a0e-d1e57c2615f8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "PUT /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1078 microversion: 2.1 time: 0.078099 May 07 22:24:26.146030 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3113/6201] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 22:24:26 2022] PUT /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1078 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:26.159591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:26.160217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:26.166438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.166934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.167968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.168536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.296249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:26.304151 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-addb215f-e067-4da5-a3d1-3a5986c0df89 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1504 microversion: 2.1 time: 0.148416 May 07 22:24:26.304735 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3089/6202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:26 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:26.320367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:26.320991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:26.326974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.327437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.328209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.328659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.460317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:26.467706 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1cd3370-e613-45ef-a7aa-e4f826542a64 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1504 microversion: 2.1 time: 0.151220 May 07 22:24:26.468283 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3114/6203] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:26 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:24:26.483529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:26.484545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:26.490406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.490910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.491684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.492134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.528009 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:26.534025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Old instance type m1.heat2, new instance type m1.heat {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:24:26.540708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:24:26.541147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:24:26.541643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:24:26.542067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:24:26.542492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:24:26.603109 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c8e47fd-5482-4435-b43f-a028287bb59e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "POST /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8/action" status: 202 len: 0 microversion: 2.1 time: 0.123342 May 07 22:24:26.603892 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3090/6204] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:24:26 2022] POST /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:24:26.612211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:26.612907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:26.619284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.619743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.620528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:26.621041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:26.757075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:26.764906 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c28bfe24-578d-4780-80a9-d997e05303c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1515 microversion: 2.1 time: 0.156800 May 07 22:24:26.765478 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3115/6205] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:26 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:27.784703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:27.785335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:27.791649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:27.792113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:27.792898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:27.793349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:27.993340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:28.000793 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1cf35c87-7b6a-47fd-beff-69ddb806a2b2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1515 microversion: 2.1 time: 0.221416 May 07 22:24:28.001368 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3091/6206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:27 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:29.018682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:29.019342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:29.026117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:29.026579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:29.027384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:29.027835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:29.158336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:29.165911 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b267920f-83d4-4dee-83fd-0ad74bad0a4b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.151143 May 07 22:24:29.166481 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3116/6207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:29 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:30.183653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:30.184283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:30.191785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:30.192248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:30.193021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:30.193466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:30.325366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:30.332828 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5889e8af-aa59-4f04-bef9-ebed871ee7c6 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.153052 May 07 22:24:30.333400 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3092/6208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:30 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:31.349373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:31.349997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:31.356674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:31.357131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:31.357896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:31.358340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:31.495494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:31.504230 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-55dfb59b-81a7-444f-b209-221b3175fc09 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.158715 May 07 22:24:31.504912 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3117/6209] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:31 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:32.524865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:32.525516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:32.531582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:32.532048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:32.532828 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:32.533279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:32.659015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:32.666661 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a0bed5be-0b1e-4f22-812c-571684e6256b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.148713 May 07 22:24:32.667262 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3093/6210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:32 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:33.683787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:33.684417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:33.691284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:33.691745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:33.692526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:33.692974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:33.824434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:33.832303 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-716c232c-7253-4836-a854-71cfe7fef936 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.152415 May 07 22:24:33.832880 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3118/6211] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:33 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:34.849440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:34.850082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:34.856609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:34.857085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:34.857873 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:34.858333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:34.985298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:34.993346 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-701f69e6-ca16-4cf1-b860-7a1312aaf331 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.148495 May 07 22:24:34.993925 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3094/6212] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:34 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:36.010404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:36.011056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:36.018348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:36.018834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:36.019611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:36.020053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:36.414647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:36.422359 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-08034016-9bc1-4e7b-a7ef-de4030aa92e0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.415861 May 07 22:24:36.422951 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3119/6213] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:36 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:37.440392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:37.441028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:37.449171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:37.449793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:37.450637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:37.451082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:37.578650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:37.586532 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b14d1511-f8d1-4959-9881-88038131d03a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.150788 May 07 22:24:37.587135 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3095/6214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:37 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:38.603232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:38.603856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:38.610619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:38.611104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:38.611875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:38.612317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:38.740002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:38.747387 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce8f2dd2-7de6-4587-90c6-0595b6196bc1 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.148037 May 07 22:24:38.747951 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3120/6215] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:38 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:39.765027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:39.765648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:39.773005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:39.773475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:39.774259 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:39.774719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:39.904488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:39.912575 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0c91fb1-0a0a-4fc4-a056-8ebc53d029ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.151487 May 07 22:24:39.913153 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3096/6216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:39 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:40.930192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:40.930861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:40.937736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:40.938223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:40.939032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:40.939481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:41.076222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:41.084175 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-18d2a96d-88c9-45bb-9190-f33f24970b3f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.157932 May 07 22:24:41.084747 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3121/6217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:40 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:42.101227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:42.101885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:42.108700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:42.109176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:42.109968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:42.110432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:42.241637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:42.249053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d2bfeab7-314d-4a0c-ac93-ee0ce71c651e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.151758 May 07 22:24:42.249629 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3097/6218] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:42 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:43.265265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:43.265893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:43.273276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:43.273742 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:43.274518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:43.274995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:43.401264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:43.408665 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d634d23f-931a-4200-8a33-568393d06833 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.147396 May 07 22:24:43.409238 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3122/6219] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:43 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:44.426564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:44.427229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:44.434044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:44.434625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:44.435335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:44.435875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:44.567006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:44.574383 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9bd99030-78a7-4c85-b31d-2fc8b5dd6586 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.152430 May 07 22:24:44.574994 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3098/6220] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:44 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:45.592371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:45.592993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:45.599838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:45.600303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:45.601077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:45.601525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:45.729412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:45.737500 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-434caa14-4884-4f2e-99ad-d1c8e7e36e1b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.148471 May 07 22:24:45.738080 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3123/6221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:45 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:46.764028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:46.764662 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:46.772326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:46.772799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:46.773601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:46.774059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:46.902254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:46.909650 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-38eb32f3-b616-4497-9e04-a8f0bd43fc0b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.149656 May 07 22:24:46.910440 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3099/6222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:46 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:24:47.927524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:47.928151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:47.934957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:47.935423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:47.936215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:47.936682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:48.066150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:48.073580 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fdedc91b-41c1-4e56-ab71-cf1a7077f1a5 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.150578 May 07 22:24:48.074157 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3124/6223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:47 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:49.090744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:49.091406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:49.098260 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:49.098732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:49.099546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:49.100004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:49.230703 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:49.238096 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9bc6c6cb-ac62-4500-ba76-ccea1a2d3a5e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.151314 May 07 22:24:49.238682 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3100/6224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:49 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:50.255159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:50.255777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:50.262529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:50.263020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:50.263791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:50.264236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:50.389595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:50.397396 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-89614217-ba5f-4a46-87f9-cda11be4e91f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.146191 May 07 22:24:50.397962 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3125/6225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:50 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:51.414234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:51.414907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:51.422029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:51.422505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:51.423323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:51.423786 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:51.550381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:51.557890 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c16711a8-a8d8-4bd9-afef-2812d296d6ba tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.148223 May 07 22:24:51.558493 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3101/6226] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:51 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:52.578513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:52.579182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:52.586807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:52.587273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:52.588045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:52.588491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:52.720102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:52.727989 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c508bf0d-9d8b-412f-811b-edd37a070a30 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.153622 May 07 22:24:52.728562 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3126/6227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:52 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:53.744625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:53.745300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:53.752122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:53.752594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:53.753379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:53.753837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:53.885525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:53.893007 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bb1378a-6892-4fbf-9634-e34f39827f63 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.152319 May 07 22:24:53.893590 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3102/6228] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:53 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:54.911229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:54.911851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:54.918926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:54.919386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:54.920164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:54.920615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:55.050456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:55.058470 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b57d8945-fd68-4082-9248-f6f2abdf4c95 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1520 microversion: 2.1 time: 0.151782 May 07 22:24:55.059083 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3127/6229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:54 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:55.541511 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d29de594-8d70-4ba3-b18d-82c899a1049b req-9216366a-c0f6-48d5-a813-762f59af756c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e68003a-fd19-4fb1-990f-82987d03e0e8", "name": "network-vif-unplugged", "status": "completed", "tag": "c14cbcc8-a625-427e-bc16-26d770f1ce10"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:55.550616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d29de594-8d70-4ba3-b18d-82c899a1049b req-9216366a-c0f6-48d5-a813-762f59af756c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:55.551207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d29de594-8d70-4ba3-b18d-82c899a1049b req-9216366a-c0f6-48d5-a813-762f59af756c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:55.564279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d29de594-8d70-4ba3-b18d-82c899a1049b req-9216366a-c0f6-48d5-a813-762f59af756c service nova] Creating event network-vif-unplugged:c14cbcc8-a625-427e-bc16-26d770f1ce10 for instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 on nch1-master-1 May 07 22:24:55.570497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-d29de594-8d70-4ba3-b18d-82c899a1049b req-9216366a-c0f6-48d5-a813-762f59af756c service nova] Instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:24:55.581191 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d29de594-8d70-4ba3-b18d-82c899a1049b req-9216366a-c0f6-48d5-a813-762f59af756c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043745 May 07 22:24:55.581806 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3103/6230] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:24:56.076084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:56.076660 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:56.084453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:56.084922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:56.085738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:56.086192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:56.523348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:56.530706 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc7321d0-3d3a-4b12-b827-b188e0434eee tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1519 microversion: 2.1 time: 0.458698 May 07 22:24:56.531312 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3128/6231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:56 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:57.550135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:57.550882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:57.557103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:57.557575 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:57.558363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:57.558848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:57.597118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-37ab0f4e-0362-4623-a933-1411531d1651 req-3fc587d0-c110-44e4-921b-e9a39ba7578d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e68003a-fd19-4fb1-990f-82987d03e0e8", "tag": "c14cbcc8-a625-427e-bc16-26d770f1ce10"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:57.606246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-37ab0f4e-0362-4623-a933-1411531d1651 req-3fc587d0-c110-44e4-921b-e9a39ba7578d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:57.606707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-37ab0f4e-0362-4623-a933-1411531d1651 req-3fc587d0-c110-44e4-921b-e9a39ba7578d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:57.618073 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-37ab0f4e-0362-4623-a933-1411531d1651 req-3fc587d0-c110-44e4-921b-e9a39ba7578d service nova] Creating event network-changed:c14cbcc8-a625-427e-bc16-26d770f1ce10 for instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 on nch1-master-1 May 07 22:24:57.623344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-37ab0f4e-0362-4623-a933-1411531d1651 req-3fc587d0-c110-44e4-921b-e9a39ba7578d service nova] Instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:24:57.634544 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-37ab0f4e-0362-4623-a933-1411531d1651 req-3fc587d0-c110-44e4-921b-e9a39ba7578d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041027 May 07 22:24:57.635181 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3129/6232] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:24:57.727773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:57.735520 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb4eaad1-0b33-456f-89d0-937b856dcd6a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1517 microversion: 2.1 time: 0.190414 May 07 22:24:57.736116 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3104/6233] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:57 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:58.755078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:58.755787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:58.761977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:58.762439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:58.763243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:58.763700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:58.891237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:58.899250 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0786798e-f826-4856-97c6-0977e182e747 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1514 microversion: 2.1 time: 0.149927 May 07 22:24:58.899840 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3130/6234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:58 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:24:58.916302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b2c35543-4386-4e16-bfc0-625b9ad3d4e8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:24:58.916863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b2c35543-4386-4e16-bfc0-625b9ad3d4e8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:58.923813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2c35543-4386-4e16-bfc0-625b9ad3d4e8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:58.924287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2c35543-4386-4e16-bfc0-625b9ad3d4e8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:58.925078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2c35543-4386-4e16-bfc0-625b9ad3d4e8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:58.925539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b2c35543-4386-4e16-bfc0-625b9ad3d4e8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:58.982065 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b2c35543-4386-4e16-bfc0-625b9ad3d4e8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "POST /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8/action" status: 204 len: 0 microversion: 2.1 time: 0.069812 May 07 22:24:58.982706 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3105/6235] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:24:58 2022] POST /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8/action => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:24:58.990737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:24:58.991388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:24:58.997376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:58.997838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:58.998619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:24:58.999648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:24:59.136864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:24:59.144323 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-90835a77-61ce-4b8d-a2db-a2b6cb5e12b4 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1514 microversion: 2.1 time: 0.157396 May 07 22:24:59.145524 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3131/6236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:24:58 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:00.162915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:00.164241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:00.170686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.171414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.172213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.172847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.312496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:00.320633 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-933799d8-c3a4-41a8-beb0-02fcb87dd7a8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1506 microversion: 2.1 time: 0.162909 May 07 22:25:00.321231 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3106/6237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:00 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:00.337331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:00.337997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:00.344319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.344781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.345602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.346029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.474906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:00.482285 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b1622e67-eaa9-4aa3-9d84-46349e79bcf8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1506 microversion: 2.1 time: 0.148869 May 07 22:25:00.482881 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3132/6238] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:00 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:00.498488 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:00.499179 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:00.505663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.506138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.506956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.507419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.634015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:00.641507 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b9cf46d6-98e4-403f-ae6c-8257010582c7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 200 len: 1506 microversion: 2.1 time: 0.146862 May 07 22:25:00.642080 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3107/6239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:00 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:00.657330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:00.657857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:00.664336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.664787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.665816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:00.666256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:00.690902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:25:00.762807 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b21540e5-eaf4-4c8e-b2e7-594750d10472 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 204 len: 0 microversion: 2.1 time: 0.109047 May 07 22:25:00.763417 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3133/6240] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:25:00 2022] DELETE /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:25:00.815546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1578522465", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0f3a316b-8dfb-4fb1-baa4-fc05f7ac4ded"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:00.865708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] validate_networks() for [('0f3a316b-8dfb-4fb1-baa4-fc05f7ac4ded', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:25:01.233677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:25:01.234245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:25:01.234602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:25:01.235069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:25:01.235507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:25:01.244670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:01.245135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:01.245958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:01.246422 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:01.263486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Getting quotas for project ce6f4e2c33bb4c6d98d8b89b302d2b2a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:25:01.268609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Getting quotas for user b49d5a27410a4d1cb7c0f63db60a9036 and project ce6f4e2c33bb4c6d98d8b89b302d2b2a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:25:01.280562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:25:01.282824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:25:01.327109 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-64dc70cd-7e4c-4b0f-ae45-38166b00fc56 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515240 May 07 22:25:01.327759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3108/6241] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:25:01.338341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f3a6eeae-66fb-4275-84a8-e9d7d4856cd0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:01.339111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f3a6eeae-66fb-4275-84a8-e9d7d4856cd0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:01.392908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f3a6eeae-66fb-4275-84a8-e9d7d4856cd0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:01.400356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f3a6eeae-66fb-4275-84a8-e9d7d4856cd0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1218 microversion: 2.1 time: 0.066326 May 07 22:25:01.400926 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3134/6242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:01 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:25:01.863017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bf54fe36-abc5-4f10-8eb9-68db9fda689f req-fd897742-ff37-4dde-a817-9ea9c6da3f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e68003a-fd19-4fb1-990f-82987d03e0e8", "name": "network-vif-plugged", "status": "completed", "tag": "c14cbcc8-a625-427e-bc16-26d770f1ce10"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:01.871909 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bf54fe36-abc5-4f10-8eb9-68db9fda689f req-fd897742-ff37-4dde-a817-9ea9c6da3f0b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:01.872319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bf54fe36-abc5-4f10-8eb9-68db9fda689f req-fd897742-ff37-4dde-a817-9ea9c6da3f0b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:01.885865 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bf54fe36-abc5-4f10-8eb9-68db9fda689f req-fd897742-ff37-4dde-a817-9ea9c6da3f0b service nova] Creating event network-vif-plugged:c14cbcc8-a625-427e-bc16-26d770f1ce10 for instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 on nch1-master-1 May 07 22:25:01.890915 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bf54fe36-abc5-4f10-8eb9-68db9fda689f req-fd897742-ff37-4dde-a817-9ea9c6da3f0b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031816 May 07 22:25:01.891805 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3109/6243] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:25:02.418265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:02.419402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:02.428121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:02.428579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:02.430226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:02.430877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:02.538128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:02.545914 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86faf192-0849-432a-9ff3-f41223235733 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1276 microversion: 2.1 time: 0.132742 May 07 22:25:02.546422 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3135/6244] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:02 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:02.936721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-dd9eaeba-d862-440c-a909-c8f9c7137e05 req-0e413456-ad12-4996-ab3c-1d1e27ecbcaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e68003a-fd19-4fb1-990f-82987d03e0e8", "name": "network-vif-deleted", "tag": "c14cbcc8-a625-427e-bc16-26d770f1ce10"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:02.945264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dd9eaeba-d862-440c-a909-c8f9c7137e05 req-0e413456-ad12-4996-ab3c-1d1e27ecbcaf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:02.945986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-dd9eaeba-d862-440c-a909-c8f9c7137e05 req-0e413456-ad12-4996-ab3c-1d1e27ecbcaf service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:02.961385 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-dd9eaeba-d862-440c-a909-c8f9c7137e05 req-0e413456-ad12-4996-ab3c-1d1e27ecbcaf service nova] Creating event network-vif-deleted:c14cbcc8-a625-427e-bc16-26d770f1ce10 for instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 on nch1-master-1 May 07 22:25:02.966269 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-dd9eaeba-d862-440c-a909-c8f9c7137e05 req-0e413456-ad12-4996-ab3c-1d1e27ecbcaf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034549 May 07 22:25:02.966919 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3110/6245] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:25:03.563481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:03.564108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:03.571592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:03.572051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:03.572832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:03.573283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:03.788005 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:03.795650 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-61deff4c-62f0-45ac-b01e-de4e3423a6fd tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1318 microversion: 2.1 time: 0.236078 May 07 22:25:03.796245 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3136/6246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:03 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:04.814088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:04.814820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:04.822226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:04.823006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:04.823819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:04.824291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:04.959126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:04.966603 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7f7032fc-e3af-441c-8321-736d7cea54f2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1318 microversion: 2.1 time: 0.157657 May 07 22:25:04.967254 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3111/6247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:04 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:04.981353 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-eac7db0e-ac72-421c-909b-90c68dee4fbd req-70eebbb1-aadd-4ddb-bcd8-d5c6b58a4759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29c11d9-2c68-4e19-8087-e6f6129b551d", "tag": "c05065a2-b0e4-4e51-9766-c340cdf87896"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:04.990798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-eac7db0e-ac72-421c-909b-90c68dee4fbd req-70eebbb1-aadd-4ddb-bcd8-d5c6b58a4759 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:04.991277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-eac7db0e-ac72-421c-909b-90c68dee4fbd req-70eebbb1-aadd-4ddb-bcd8-d5c6b58a4759 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:05.002238 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-eac7db0e-ac72-421c-909b-90c68dee4fbd req-70eebbb1-aadd-4ddb-bcd8-d5c6b58a4759 service nova] Creating event network-changed:c05065a2-b0e4-4e51-9766-c340cdf87896 for instance d29c11d9-2c68-4e19-8087-e6f6129b551d on nch1-master-1 May 07 22:25:05.007963 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-eac7db0e-ac72-421c-909b-90c68dee4fbd req-70eebbb1-aadd-4ddb-bcd8-d5c6b58a4759 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030320 May 07 22:25:05.008548 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3137/6248] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:25:05.983547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:05.984192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:05.992061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:05.992558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:05.993368 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:05.993821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:06.119883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:06.127186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b6aee4bd-696b-413d-8325-5219bc5ec87b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1318 microversion: 2.1 time: 0.147564 May 07 22:25:06.127758 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3112/6249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:05 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:07.145950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:07.147048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:07.153359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:07.153812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:07.154582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:07.155042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:07.290855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:07.298245 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f99637c0-2c9c-4759-b169-4c93cc433c3e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1318 microversion: 2.1 time: 0.158185 May 07 22:25:07.298842 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3138/6250] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:07 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:08.315661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:08.316868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:08.323892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:08.324360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:08.325141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:08.325604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:08.455354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:08.463211 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-123e5f1e-f872-459b-af38-0fdd9834c0cf tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1318 microversion: 2.1 time: 0.151406 May 07 22:25:08.463789 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3113/6251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:08 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:09.483407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:09.484119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:09.491564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:09.492021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:09.492796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:09.493241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:09.621912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:09.629309 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc3f7f61-b53a-4a30-8f34-b8c0cf50a02c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1318 microversion: 2.1 time: 0.152912 May 07 22:25:09.629884 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3139/6252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:09 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:09.889270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d22b4e76-325b-4d15-a68a-9abde9d82ebd req-07be5cb4-8317-4c7f-bc92-3f81f109d28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29c11d9-2c68-4e19-8087-e6f6129b551d", "name": "network-vif-plugged", "status": "completed", "tag": "c05065a2-b0e4-4e51-9766-c340cdf87896"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:09.898551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d22b4e76-325b-4d15-a68a-9abde9d82ebd req-07be5cb4-8317-4c7f-bc92-3f81f109d28b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:09.899073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d22b4e76-325b-4d15-a68a-9abde9d82ebd req-07be5cb4-8317-4c7f-bc92-3f81f109d28b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:09.911131 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d22b4e76-325b-4d15-a68a-9abde9d82ebd req-07be5cb4-8317-4c7f-bc92-3f81f109d28b service nova] Creating event network-vif-plugged:c05065a2-b0e4-4e51-9766-c340cdf87896 for instance d29c11d9-2c68-4e19-8087-e6f6129b551d on nch1-master-1 May 07 22:25:09.916199 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d22b4e76-325b-4d15-a68a-9abde9d82ebd req-07be5cb4-8317-4c7f-bc92-3f81f109d28b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030692 May 07 22:25:09.917007 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3114/6253] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:25:10.645876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:10.647833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:10.656224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:10.656695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:10.657519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:10.658041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:10.787476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:10.794979 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bb67c0b1-33ea-4520-8d1b-3671df537052 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1318 microversion: 2.1 time: 0.153422 May 07 22:25:10.795559 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3140/6254] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:10 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:11.813591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:11.814443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:11.824612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:11.825351 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:11.826564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:11.827299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:11.970028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:11.978007 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-044b0301-89b7-4c4f-96d4-50bc916c4307 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1508 microversion: 2.1 time: 0.169389 May 07 22:25:11.978585 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3115/6255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:11 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:11.994848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:11.995483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:12.002511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:12.003081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:12.003912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:12.004367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:12.131253 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:12.138708 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9fcaacf7-5dce-4014-9310-3785b6c13a36 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1508 microversion: 2.1 time: 0.147942 May 07 22:25:12.139315 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3141/6256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:11 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:12.155073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:12.156087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:12.162860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:12.163333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:12.164327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:12.165095 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:12.194126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:12.200330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Old instance type m1.heat2, new instance type m1.heat {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:25:12.206627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:25:12.207619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:25:12.208114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:25:12.208545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:25:12.208974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:25:12.272936 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1f2aebf8-efb8-414e-ac4a-28b1fa969c39 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "POST /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d/action" status: 202 len: 0 microversion: 2.1 time: 0.121741 May 07 22:25:12.273555 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3116/6257] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:25:12 2022] POST /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:25:12.281707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:12.282335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:12.288939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:12.289406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:12.290202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:12.290939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:12.435333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:12.444915 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-48c60060-0835-4fdf-8ece-f0c86dc1112e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1515 microversion: 2.1 time: 0.167030 May 07 22:25:12.445481 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3142/6258] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:12 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:13.464865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:13.465550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:13.471596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:13.472061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:13.473389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:13.473848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:13.607355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:13.615541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-409ab249-8cba-42fd-8a3d-200194f03aca tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1515 microversion: 2.1 time: 0.157631 May 07 22:25:13.616118 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3117/6259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:13 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:14.633434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:14.634047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:14.640805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:14.641336 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:14.642103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:14.642546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:14.772898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:14.780293 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-11c3dd3c-91a3-4230-8e53-dd997ad37c02 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.151411 May 07 22:25:14.780874 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3143/6260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:14 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:15.798416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:15.799065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:15.806512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:15.807016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:15.807803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:15.808254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:15.934286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:15.941755 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bb20a4d8-8d78-4e84-9e2e-661fc760d2c3 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.147110 May 07 22:25:15.942337 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3118/6261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:15 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:16.959124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:16.959753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:16.966648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:16.967149 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:16.967934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:16.968385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:17.095167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:17.102604 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-db453eaa-05a0-4ad4-9bd6-473d339e451e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.147493 May 07 22:25:17.103204 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3144/6262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:16 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:18.120040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:18.120679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:18.127498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:18.127973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:18.129405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:18.129865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:18.266461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:18.273853 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0edad0bf-8559-4cc3-8f26-166b9bb9e75c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.157736 May 07 22:25:18.274428 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3119/6263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:18 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:19.290322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:19.291283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:19.298110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:19.298571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:19.299387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:19.299835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:19.434458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:19.442401 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-734c56e2-2a00-4a5a-8739-3bf7e1cad8b9 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.155977 May 07 22:25:19.443015 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3145/6264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:19 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:20.459415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:20.459979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:20.467136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:20.467604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:20.468406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:20.468856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:20.595173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:20.602481 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-45e68bd0-e38b-49dd-9e8d-502d309b0b70 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.147020 May 07 22:25:20.603090 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3120/6265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:20 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:21.619698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:21.620397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:21.627271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:21.627735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:21.628532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:21.628967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:21.755542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:21.762904 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4f42d4a-ecda-4fad-ab41-03ca872fc49b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.147180 May 07 22:25:21.763484 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3146/6266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:21 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:22.780599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:22.781241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:22.788801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:22.789279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:22.790071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:22.790801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:22.921315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:22.928679 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-96aeeed7-fef6-4d07-85a0-0e954b0bd9c8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.152042 May 07 22:25:22.929257 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3121/6267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:22 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:23.946090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:23.946638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:23.953450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:23.953913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:23.954684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:23.955156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:24.084476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:24.091968 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5374fba5-6e07-4910-904a-84bacfb3d1d8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.150360 May 07 22:25:24.092545 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3147/6268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:23 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:25.109097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:25.109772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:25.116709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:25.117186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:25.117974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:25.118434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:25.248074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:25.256097 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89b570de-89c8-4f57-a1b2-2c2659c97308 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.150952 May 07 22:25:25.256688 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3122/6269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:25 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:26.273621 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:26.274272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:26.282173 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:26.282636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:26.283448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:26.283894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:26.410068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:26.417722 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cffcaa84-685a-4188-9d90-fa87d40377dc tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.148572 May 07 22:25:26.418291 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3148/6270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:26 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:27.434752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:27.435418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:27.442897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:27.443376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:27.444176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:27.444635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:27.576332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:27.584387 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b511746c-9902-4aa8-88be-6f704196e724 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.153579 May 07 22:25:27.584960 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3123/6271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:27 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:28.601361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:28.601986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:28.608787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:28.609248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:28.610021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:28.610470 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:28.739033 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:28.748231 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7b05a6af-c982-48f5-b589-47a31fd4a3da tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.150616 May 07 22:25:28.758427 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3149/6272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:28 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:29.765542 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:29.766216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:29.773671 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:29.774143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:29.774959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:29.775418 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:29.905112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:29.913167 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2a2853fb-9f24-4507-8fab-264e4878f22a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.151630 May 07 22:25:29.913746 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3124/6273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:29 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:30.931030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:30.931658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:30.938219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:30.938726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:30.939520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:30.939970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:31.069814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:31.077060 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-759f1ac2-f031-4a41-b08e-2cde8d657eb7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.150680 May 07 22:25:31.077632 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3150/6274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:30 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:32.094724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:32.095399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:32.102683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:32.103181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:32.103975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:32.104435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:32.238684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:32.246808 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48aff4c4-ca8a-4d22-b7eb-23a2c3471312 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.156067 May 07 22:25:32.247656 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3125/6275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:32 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:33.264107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:33.264733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:33.272140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:33.272597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:33.273369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:33.273816 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:33.402355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:33.409804 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0da29f1d-a794-40df-a594-edfc0d80f29a tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.149614 May 07 22:25:33.410355 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3151/6276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:33 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:34.428753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:34.429428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:34.436378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:34.436851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:34.437915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:34.438482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:34.568634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:34.576155 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71760721-0850-48c6-9063-28e9c181076e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.151960 May 07 22:25:34.576741 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3126/6277] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:34 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:35.593710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:35.594330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:35.600929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:35.601379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:35.602145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:35.602583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:35.732393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:35.739765 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e25683d2-5baa-482a-83ae-f43b62bccc84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.150021 May 07 22:25:35.740998 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3152/6278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:35 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:36.757498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:36.758130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:36.764695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:36.765164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:36.765946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:36.766410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:36.894404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:36.902356 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dca0a787-0c76-4b66-9822-1bd08d0d8626 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.148981 May 07 22:25:36.902959 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3127/6279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:36 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:37.919603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:37.920222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:37.927108 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:37.928065 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:37.928835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:37.929281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:38.057332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:38.064718 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d2d808be-0ac6-4df5-97b9-6f66ea3e5ad8 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.149331 May 07 22:25:38.065290 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3153/6280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:37 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:39.081731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:39.082358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:39.089130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:39.089591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:39.090363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:39.090836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:39.225060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:39.232579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5eeb3a9-2c7e-4d0c-821c-2f0a956a7fc2 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.154850 May 07 22:25:39.233160 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3128/6281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:39 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:39.308152 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:25:39.308701 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:25:40.250176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:40.250864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:40.257724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:40.258188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:40.258998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:40.259450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:40.389351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:40.397829 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c8bc76e-e81f-43c0-b0c1-19f07f4fd34f tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1520 microversion: 2.1 time: 0.151561 May 07 22:25:40.398401 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3154/6282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:40 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:41.414670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:41.415336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:41.422029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:41.422501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:41.423323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:41.423776 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:41.464507 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e38ff451-bc78-464f-b5a6-580a14bdfb7c req-99cd38d9-ea76-417e-9e5d-1d0778d6cae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29c11d9-2c68-4e19-8087-e6f6129b551d", "name": "network-vif-unplugged", "status": "completed", "tag": "c05065a2-b0e4-4e51-9766-c340cdf87896"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:41.473488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e38ff451-bc78-464f-b5a6-580a14bdfb7c req-99cd38d9-ea76-417e-9e5d-1d0778d6cae7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:41.473944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e38ff451-bc78-464f-b5a6-580a14bdfb7c req-99cd38d9-ea76-417e-9e5d-1d0778d6cae7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:41.486259 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e38ff451-bc78-464f-b5a6-580a14bdfb7c req-99cd38d9-ea76-417e-9e5d-1d0778d6cae7 service nova] Creating event network-vif-unplugged:c05065a2-b0e4-4e51-9766-c340cdf87896 for instance d29c11d9-2c68-4e19-8087-e6f6129b551d on nch2-master-1 May 07 22:25:41.491680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-e38ff451-bc78-464f-b5a6-580a14bdfb7c req-99cd38d9-ea76-417e-9e5d-1d0778d6cae7 service nova] Instance d29c11d9-2c68-4e19-8087-e6f6129b551d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:25:41.502539 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e38ff451-bc78-464f-b5a6-580a14bdfb7c req-99cd38d9-ea76-417e-9e5d-1d0778d6cae7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041561 May 07 22:25:41.503103 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3155/6283] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:25:41.682563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:41.690233 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-efbd1976-8760-4c3f-b35a-50446c772d8d tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1519 microversion: 2.1 time: 0.279983 May 07 22:25:41.690848 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3129/6284] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:41 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:42.709888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:42.710552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:42.716897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:42.717363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:42.718139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:42.718588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:42.864040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:42.871605 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-20f54930-a449-4d62-8c45-25a00095357b tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1517 microversion: 2.1 time: 0.166972 May 07 22:25:42.872190 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3156/6285] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:42 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:43.517985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cd71f554-4c98-459a-a741-9db5a9fa968a req-c99a1adb-2a4d-44f0-bd49-1b3cec75691e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29c11d9-2c68-4e19-8087-e6f6129b551d", "tag": "c05065a2-b0e4-4e51-9766-c340cdf87896"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:43.527272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cd71f554-4c98-459a-a741-9db5a9fa968a req-c99a1adb-2a4d-44f0-bd49-1b3cec75691e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:43.527732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cd71f554-4c98-459a-a741-9db5a9fa968a req-c99a1adb-2a4d-44f0-bd49-1b3cec75691e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:43.538871 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cd71f554-4c98-459a-a741-9db5a9fa968a req-c99a1adb-2a4d-44f0-bd49-1b3cec75691e service nova] Creating event network-changed:c05065a2-b0e4-4e51-9766-c340cdf87896 for instance d29c11d9-2c68-4e19-8087-e6f6129b551d on nch2-master-1 May 07 22:25:43.544283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-cd71f554-4c98-459a-a741-9db5a9fa968a req-c99a1adb-2a4d-44f0-bd49-1b3cec75691e service nova] Instance d29c11d9-2c68-4e19-8087-e6f6129b551d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:25:43.555264 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cd71f554-4c98-459a-a741-9db5a9fa968a req-c99a1adb-2a4d-44f0-bd49-1b3cec75691e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041002 May 07 22:25:43.555838 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3130/6286] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:25:43.888769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:43.895109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:43.906180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:43.919619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:43.920496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:43.920952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:44.267234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:44.274671 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f5907d3c-fe4a-49b1-b879-3fd68a7f0d55 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1514 microversion: 2.1 time: 0.389987 May 07 22:25:44.275304 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3157/6287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:43 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:44.292365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-edafa074-e33d-4840-9762-8c3ffb2490f7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:44.293048 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-edafa074-e33d-4840-9762-8c3ffb2490f7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:44.299311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafa074-e33d-4840-9762-8c3ffb2490f7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:44.299780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafa074-e33d-4840-9762-8c3ffb2490f7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:44.300569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafa074-e33d-4840-9762-8c3ffb2490f7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:44.301025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-edafa074-e33d-4840-9762-8c3ffb2490f7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:44.359838 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-edafa074-e33d-4840-9762-8c3ffb2490f7 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "POST /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d/action" status: 204 len: 0 microversion: 2.1 time: 0.072426 May 07 22:25:44.360728 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3131/6288] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:25:44 2022] POST /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:25:44.369136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:44.371844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:44.379286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:44.380366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:44.382659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:44.383322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:44.586225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:44.594636 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6a483b8f-1758-440a-bca9-3fa25816c88c tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1514 microversion: 2.1 time: 0.229760 May 07 22:25:44.605176 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3158/6289] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:44 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1514 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:45.613459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:45.614209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:45.622047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:45.622518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:45.623353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:45.623810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:45.751890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:45.759969 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-38519ed2-ef21-4afa-b61e-17ac18d23ece tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1506 microversion: 2.1 time: 0.150917 May 07 22:25:45.760545 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3132/6290] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:45 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:25:45.776197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:45.776823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:45.783546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:45.784008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:45.784780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:45.785228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:45.917418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:45.924827 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b73ad1bd-56a4-4cab-a583-0d74502625fa tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1506 microversion: 2.1 time: 0.152498 May 07 22:25:45.925400 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3159/6291] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:45 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:45.940498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:45.941227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:45.947176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:45.947649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:45.948438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:45.948930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.072022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:46.079408 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-991ff925-59bc-4b45-b580-abc0b10d36d0 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1506 microversion: 2.1 time: 0.142897 May 07 22:25:46.079981 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3133/6292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:45 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1506 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:46.095779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:46.096321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:46.102930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:46.103397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.104179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:46.104630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.128737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:25:46.203753 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77d6205b-fbf8-4f6c-93b9-8bd13935182e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 204 len: 0 microversion: 2.1 time: 0.111526 May 07 22:25:46.204483 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3160/6293] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:25:46 2022] DELETE /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:25:46.221300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:46.221820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:46.227896 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:46.228363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.229147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:46.229609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.253772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:25:46.297579 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.compute.api [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Instance is already in deleting state, ignoring this request May 07 22:25:46.298411 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8489f4b9-eaaf-45ff-9c86-85ca0a07f36e tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 204 len: 0 microversion: 2.1 time: 0.081032 May 07 22:25:46.299011 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3134/6294] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:25:46 2022] DELETE /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:25:46.307636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:46.308346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:46.314227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:46.314722 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.316111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:46.316568 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.446316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:46.453864 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b5248f7-9b5e-43fe-b565-99d6572d23ec tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1512 microversion: 2.1 time: 0.150576 May 07 22:25:46.454433 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3161/6295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:46 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:46.595579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-193cf4e5-db7b-47a5-bb24-106ec5ea61e7 req-1180f520-2b7e-49b3-bbed-a405238c6dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29c11d9-2c68-4e19-8087-e6f6129b551d", "name": "network-vif-plugged", "status": "completed", "tag": "c05065a2-b0e4-4e51-9766-c340cdf87896"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:46.603623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-193cf4e5-db7b-47a5-bb24-106ec5ea61e7 req-1180f520-2b7e-49b3-bbed-a405238c6dbc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:46.604139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-193cf4e5-db7b-47a5-bb24-106ec5ea61e7 req-1180f520-2b7e-49b3-bbed-a405238c6dbc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:46.615996 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-193cf4e5-db7b-47a5-bb24-106ec5ea61e7 req-1180f520-2b7e-49b3-bbed-a405238c6dbc service nova] Creating event network-vif-plugged:c05065a2-b0e4-4e51-9766-c340cdf87896 for instance d29c11d9-2c68-4e19-8087-e6f6129b551d on nch2-master-1 May 07 22:25:46.621237 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-193cf4e5-db7b-47a5-bb24-106ec5ea61e7 req-1180f520-2b7e-49b3-bbed-a405238c6dbc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029459 May 07 22:25:46.621846 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3135/6296] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:25:47.471395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:47.471931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:47.479636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:47.480116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:47.480901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:47.481384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:47.614967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49d5a27410a4d1cb7c0f63db60a9036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:47.623207 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ead8c99-f1ce-4f38-9c24-7d5114477b50 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 200 len: 1512 microversion: 2.1 time: 0.155588 May 07 22:25:47.623790 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3162/6297] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:47 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:47.972412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d0a31442-e943-4aea-a637-9894a15aede6 req-a05eb649-27c4-4264-8680-d6bfc94b1ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29c11d9-2c68-4e19-8087-e6f6129b551d", "name": "network-vif-deleted", "tag": "c05065a2-b0e4-4e51-9766-c340cdf87896"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:47.981527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d0a31442-e943-4aea-a637-9894a15aede6 req-a05eb649-27c4-4264-8680-d6bfc94b1ab1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:47.981942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d0a31442-e943-4aea-a637-9894a15aede6 req-a05eb649-27c4-4264-8680-d6bfc94b1ab1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:47.995774 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d0a31442-e943-4aea-a637-9894a15aede6 req-a05eb649-27c4-4264-8680-d6bfc94b1ab1 service nova] Creating event network-vif-deleted:c05065a2-b0e4-4e51-9766-c340cdf87896 for instance d29c11d9-2c68-4e19-8087-e6f6129b551d on nch2-master-1 May 07 22:25:48.000393 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d0a31442-e943-4aea-a637-9894a15aede6 req-a05eb649-27c4-4264-8680-d6bfc94b1ab1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 May 07 22:25:48.000987 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3136/6298] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:25:48.639325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:48.639951 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: d29c11d9-2c68-4e19-8087-e6f6129b551d] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:48.646859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:48.647319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:48.648106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:48.648550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:48.661497 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] HTTP exception thrown: Instance d29c11d9-2c68-4e19-8087-e6f6129b551d could not be found. May 07 22:25:48.662078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Returning 404 to user: Instance d29c11d9-2c68-4e19-8087-e6f6129b551d could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:25:48.663432 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a95fde7-1b5a-422a-882a-ecf79a117c84 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d" status: 404 len: 111 microversion: 2.1 time: 0.028111 May 07 22:25:48.663947 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3163/6299] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:48 2022] GET /compute/v2.1/servers/d29c11d9-2c68-4e19-8087-e6f6129b551d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:25:48.672714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:48.673326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:48.680934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:48.681397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:48.682195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:48.682655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:48.696047 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] HTTP exception thrown: Instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 could not be found. May 07 22:25:48.696655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Returning 404 to user: Instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:25:48.697494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7e633d53-f142-4c74-ba72-790c7601dc78 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 404 len: 111 microversion: 2.1 time: 0.029037 May 07 22:25:48.698027 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3137/6300] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:25:48 2022] DELETE /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:25:48.705962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:48.706624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] [instance: 1e68003a-fd19-4fb1-990f-82987d03e0e8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:48.712615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:48.713084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:48.713860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:48.714315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:48.728113 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] HTTP exception thrown: Instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 could not be found. May 07 22:25:48.728709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] Returning 404 to user: Instance 1e68003a-fd19-4fb1-990f-82987d03e0e8 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:25:48.729564 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ba9786a-520a-4b3c-8133-30f3a7f36028 tempest-ServerDiskConfigTestJSON-1653423715 tempest-ServerDiskConfigTestJSON-1653423715-project] 10.222.0.32 "GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8" status: 404 len: 111 microversion: 2.1 time: 0.027485 May 07 22:25:48.730089 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3164/6301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:48 2022] GET /compute/v2.1/servers/1e68003a-fd19-4fb1-990f-82987d03e0e8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:25:54.642406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-786243ef-05f8-47d6-a44d-5ef9c295797e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'create', calling method: .version_select at 0x7fc40fb47160>, body: {"keypair": {"name": "tempest-keypair-2117323651"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:54.657072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-786243ef-05f8-47d6-a44d-5ef9c295797e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:25:54.663842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-786243ef-05f8-47d6-a44d-5ef9c295797e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:25:54.829447 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-786243ef-05f8-47d6-a44d-5ef9c295797e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:25:54.837448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-786243ef-05f8-47d6-a44d-5ef9c295797e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:25:54.859959 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-786243ef-05f8-47d6-a44d-5ef9c295797e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.339978 May 07 22:25:54.860501 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3138/6302] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:25:54 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:56.151656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1300217032", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0edc1271-8a82-489b-912c-a8fef30fb1c9"}], "security_groups": [{"name": "tempest-securitygroup--1338130233"}], "key_name": "tempest-keypair-2117323651", "user_data": "}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:56.259655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] validate_networks() for [('0edc1271-8a82-489b-912c-a8fef30fb1c9', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:25:56.632674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:25:56.633341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:25:56.633826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:25:56.634238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:25:56.634677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:25:56.643565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:56.644103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:56.644916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:56.645356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:56.663709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:25:56.669423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:25:56.681477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:25:56.683853 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:25:56.731074 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-93fdaea4-4ee5-4192-a0f9-16ab71810176 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.583584 May 07 22:25:56.731983 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3165/6303] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:25:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:25:56.743049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ff42f44-af22-4141-bf1a-76ded638b72a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:56.743685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ff42f44-af22-4141-bf1a-76ded638b72a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:56.813917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3ff42f44-af22-4141-bf1a-76ded638b72a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:56.821014 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ff42f44-af22-4141-bf1a-76ded638b72a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1239 microversion: 2.1 time: 0.082861 May 07 22:25:56.821596 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3139/6304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:56 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:25:57.839764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:57.840983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:57.857609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:57.858563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:57.859684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:57.863256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:57.966643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:57.975359 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3ecc5997-89a2-4f8a-9d21-007203c936fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1309 microversion: 2.1 time: 0.141229 May 07 22:25:57.976310 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3166/6305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:57 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:58.992898 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:25:58.993495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:25:59.001327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:59.002073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:59.002940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:59.003408 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:59.301573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:25:59.311134 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-01814f08-a6d4-42d5-80da-8abe55e3390c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1365 microversion: 2.1 time: 0.322160 May 07 22:25:59.312122 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3140/6306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:25:58 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:25:59.540415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-37585fca-8c41-40e0-9a12-83871ae56651 req-6f02c91e-8a70-45fb-a79b-3ed51afac06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e245463-fb48-4610-aa39-d81eb23f6a5f", "tag": "68feade0-83ad-484a-aa0b-bfb4e7c07f70"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:25:59.563685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-37585fca-8c41-40e0-9a12-83871ae56651 req-6f02c91e-8a70-45fb-a79b-3ed51afac06d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:25:59.564458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-37585fca-8c41-40e0-9a12-83871ae56651 req-6f02c91e-8a70-45fb-a79b-3ed51afac06d service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:25:59.579872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-37585fca-8c41-40e0-9a12-83871ae56651 req-6f02c91e-8a70-45fb-a79b-3ed51afac06d service nova] Creating event network-changed:68feade0-83ad-484a-aa0b-bfb4e7c07f70 for instance 3e245463-fb48-4610-aa39-d81eb23f6a5f on nch2-master-1 May 07 22:25:59.586703 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-37585fca-8c41-40e0-9a12-83871ae56651 req-6f02c91e-8a70-45fb-a79b-3ed51afac06d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052497 May 07 22:25:59.587510 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3167/6307] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:00.330426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:00.331253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:00.338334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:00.338824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:00.339609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:00.340059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:00.473088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:00.481099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-97ba40b2-a5c5-48c5-9dd8-d08fd97310d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1365 microversion: 2.1 time: 0.156036 May 07 22:26:00.481680 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3141/6308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:00 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:01.498330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:01.499053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:01.506443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:01.507007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:01.507776 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:01.508220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:01.703566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:01.711095 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a3ee1e06-1af5-4010-a67c-f46e14c2cf65 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1365 microversion: 2.1 time: 0.216974 May 07 22:26:01.711690 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3168/6309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:01 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:02.728714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:02.729349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:02.736497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:02.736497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:02.737295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:02.737743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:02.869900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:02.877531 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4497e81b-eb96-4254-83f9-d7c5c1f41ef3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1365 microversion: 2.1 time: 0.153349 May 07 22:26:02.878111 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3142/6310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:02 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:03.894523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:03.895139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:03.902363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:03.902872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:03.903661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:03.904118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:04.038562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:04.046395 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ce0a552-266f-4d46-8a3b-7a38461be81b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1365 microversion: 2.1 time: 0.155879 May 07 22:26:04.046987 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3169/6311] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:03 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:04.658922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-af2908b1-68b3-4967-8597-137e31711589 req-bc9949a1-5e80-4bb1-9cea-01d9939850d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e245463-fb48-4610-aa39-d81eb23f6a5f", "name": "network-vif-plugged", "status": "completed", "tag": "68feade0-83ad-484a-aa0b-bfb4e7c07f70"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:04.668428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-af2908b1-68b3-4967-8597-137e31711589 req-bc9949a1-5e80-4bb1-9cea-01d9939850d0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:04.668930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-af2908b1-68b3-4967-8597-137e31711589 req-bc9949a1-5e80-4bb1-9cea-01d9939850d0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:04.680779 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-af2908b1-68b3-4967-8597-137e31711589 req-bc9949a1-5e80-4bb1-9cea-01d9939850d0 service nova] Creating event network-vif-plugged:68feade0-83ad-484a-aa0b-bfb4e7c07f70 for instance 3e245463-fb48-4610-aa39-d81eb23f6a5f on nch2-master-1 May 07 22:26:04.685719 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-af2908b1-68b3-4967-8597-137e31711589 req-bc9949a1-5e80-4bb1-9cea-01d9939850d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 May 07 22:26:04.686323 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3143/6312] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:05.063859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:05.064532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:05.071125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:05.071617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:05.072407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:05.072856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:05.203806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:05.211104 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-78dc0e32-1c5d-464d-a072-abd8efdc958f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1365 microversion: 2.1 time: 0.151334 May 07 22:26:05.211674 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3170/6313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:05 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:06.229469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:06.230198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:06.236555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:06.237024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:06.237813 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:06.238272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:06.364003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:06.371949 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f9361aa8-4c84-4ee6-8a1c-6d02f986f200 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1551 microversion: 2.1 time: 0.147692 May 07 22:26:06.372533 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3144/6314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:06 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1551 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:06.388868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c6f1fe4-b573-4fac-bc4c-ae01802abc1c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:06.389416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c6f1fe4-b573-4fac-bc4c-ae01802abc1c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:06.396144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c6f1fe4-b573-4fac-bc4c-ae01802abc1c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:06.396611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c6f1fe4-b573-4fac-bc4c-ae01802abc1c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:06.397398 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c6f1fe4-b573-4fac-bc4c-ae01802abc1c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:06.397855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c6f1fe4-b573-4fac-bc4c-ae01802abc1c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:06.473604 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c6f1fe4-b573-4fac-bc4c-ae01802abc1c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088898 May 07 22:26:06.474215 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3171/6315] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:26:06 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:07.452414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:07.453053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:07.455543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-fceeedc7-ebf8-4312-a798-882f5c574744 req-703cc5f1-e8d8-4563-b704-75295d950038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e245463-fb48-4610-aa39-d81eb23f6a5f", "tag": "68feade0-83ad-484a-aa0b-bfb4e7c07f70"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:07.460923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:07.461393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:07.462193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:07.462649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:07.465208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fceeedc7-ebf8-4312-a798-882f5c574744 req-703cc5f1-e8d8-4563-b704-75295d950038 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:07.465735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-fceeedc7-ebf8-4312-a798-882f5c574744 req-703cc5f1-e8d8-4563-b704-75295d950038 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:07.479331 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-fceeedc7-ebf8-4312-a798-882f5c574744 req-703cc5f1-e8d8-4563-b704-75295d950038 service nova] Creating event network-changed:68feade0-83ad-484a-aa0b-bfb4e7c07f70 for instance 3e245463-fb48-4610-aa39-d81eb23f6a5f on nch2-master-1 May 07 22:26:07.484382 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-fceeedc7-ebf8-4312-a798-882f5c574744 req-703cc5f1-e8d8-4563-b704-75295d950038 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034226 May 07 22:26:07.484993 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3172/6316] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:07.691217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:07.698960 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b3607d4-e499-479f-aa85-f90926af18aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1551 microversion: 2.1 time: 0.250775 May 07 22:26:07.699544 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3145/6317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:07 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1551 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:07.716637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:07.717365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:07.723728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:07.724430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:07.725811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:07.726447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:07.867082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:07.874742 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7fdba431-66ed-4a67-a412-e9f1af841fbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1551 microversion: 2.1 time: 0.162328 May 07 22:26:07.875361 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3173/6318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:07 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:08.891534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:08.892086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:08.898908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:08.899387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:08.900218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:08.900682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:09.027142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:09.034543 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a000b7a7-3212-412b-a8b4-8874208e2ce6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1670 microversion: 2.1 time: 0.147048 May 07 22:26:09.035177 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3146/6319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:08 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:26:09.051213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:09.051850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:09.059391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:09.059861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:09.060641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:09.061094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:09.192546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:09.200070 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aa456822-7479-4b70-ab4b-7c83b2776dca tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1670 microversion: 2.1 time: 0.152774 May 07 22:26:09.200822 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3174/6320] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:09 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:09.216906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:09.218168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:09.224194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:09.224665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:09.226101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:09.226553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:09.253633 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:09.259252 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Old instance type m1.heat2, new instance type m1.heat {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:26:09.265380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:26:09.265819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:26:09.266313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:26:09.266743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:26:09.267195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:26:09.327906 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4680e27c-c24f-4c6d-a7fa-9b5539c5984c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f/action" status: 202 len: 0 microversion: 2.1 time: 0.114997 May 07 22:26:09.328526 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3147/6321] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:26:09 2022] POST /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:26:09.337241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:09.337876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:09.343978 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:09.344446 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:09.345267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:09.345737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:09.478798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:09.486442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a4c8c85a-64ab-4bca-804d-04308bd901f6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1679 microversion: 2.1 time: 0.153685 May 07 22:26:09.487107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3175/6322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:09 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:10.504819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:10.505549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:10.512354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:10.512826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:10.513644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:10.514103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:10.702467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:10.710138 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cc9d71ee-0b8b-4095-8ab8-5e3943f17c92 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1679 microversion: 2.1 time: 0.210107 May 07 22:26:10.710721 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3148/6323] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:10 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:11.729665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:11.730299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:11.737203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:11.737671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:11.738461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:11.738942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:11.887273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:11.894754 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6846be6-1f9e-4ff5-b611-4b8d451d305c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.169027 May 07 22:26:11.895351 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3176/6324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:11 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:12.913431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:12.914593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:12.924489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:12.924952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:12.925819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:12.926428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:13.058050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:13.065429 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87977583-e3c6-4e70-b748-e661d893df23 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.156573 May 07 22:26:13.066014 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3149/6325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:12 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:14.082555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:14.083201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:14.090019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:14.090484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:14.091328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:14.091756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:14.219825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:14.227754 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6814b7fe-92ca-42d7-ba7d-2c5fee9620d4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.149135 May 07 22:26:14.228335 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3177/6326] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:14 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:15.244954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:15.245590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:15.252433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:15.252900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:15.253680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:15.254135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:15.386945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:15.394354 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-59d23c46-7007-46f8-a22e-ac5197ec8aab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.153339 May 07 22:26:15.394958 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3150/6327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:15 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:16.411680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:16.412826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:16.420176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:16.420640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:16.421419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:16.421873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:16.549447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:16.557529 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2fbd7261-431b-4ebe-b04d-4d3d9e9b97ed tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.149820 May 07 22:26:16.558286 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3178/6328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:16 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:17.575419 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:17.576057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:17.582889 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:17.583364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:17.584153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:17.584616 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:17.709512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:17.717186 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b6ca6a2-4f25-4866-bd08-7b8e678589c0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.145655 May 07 22:26:17.717774 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3151/6329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:17 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:18.736052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:18.736674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:18.743860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:18.744326 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:18.745111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:18.745562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:18.876794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:18.884912 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-faf1d403-b394-4d5d-9769-c9b9ebc7ff26 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.153611 May 07 22:26:18.885486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3179/6330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:18 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:19.902503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:19.903169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:19.909837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:19.910305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:19.911234 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:19.911691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:20.038092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:20.049532 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-45f124cf-e763-47a5-b667-2cecb2898f77 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.150309 May 07 22:26:20.049741 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3152/6331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:19 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:21.067063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:21.067669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:21.074455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:21.074957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:21.075729 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:21.076198 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:21.210242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:21.217966 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07ce5c22-9411-4d27-9e5c-9842ed6f06cc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.154841 May 07 22:26:21.218562 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3180/6332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:21 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:22.235957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:22.236607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:22.244059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:22.244529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:22.245346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:22.245808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:22.376150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:22.383614 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a7f56b65-bb6f-49cd-b0f2-bf4db4d6a6f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.151626 May 07 22:26:22.384345 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3153/6333] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:22 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:23.401204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:23.401833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:23.408815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:23.409277 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:23.410053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:23.410501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:23.542023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:23.549501 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8e266530-5723-4fb9-9b70-39c75320eb80 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.152230 May 07 22:26:23.550072 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3181/6334] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:23 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:24.567206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:24.567854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:24.575389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:24.575869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:24.576667 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:24.577127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:24.704371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:24.712446 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bd17df68-754b-4739-a02b-f9851e4fd317 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.149139 May 07 22:26:24.713159 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3154/6335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:24 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:25.729758 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:25.730376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:25.737206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:25.737647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:25.738407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:25.738871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:25.866157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:25.873473 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-35e2c608-00d8-4173-bf45-d0650b830279 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.147665 May 07 22:26:25.874046 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3182/6336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:25 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:26.891523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:26.892109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:26.898983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:26.899460 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:26.900248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:26.900720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:27.034081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:27.042470 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7bb93363-229d-4f6e-b838-3a83db1ea1b1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1684 microversion: 2.1 time: 0.155020 May 07 22:26:27.043165 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3155/6337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:26 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:28.060212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:28.060820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:28.067681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:28.068139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:28.069508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:28.069952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:28.260117 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:28.267708 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b89802c8-da47-47b9-836a-a32c2fb0f934 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1683 microversion: 2.1 time: 0.211374 May 07 22:26:28.268296 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3183/6338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:28 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:28.319925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-27864f99-17cb-446f-ab68-0670f08f0f91 req-7b7eca2f-9784-4746-8e3a-de7113c483ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e245463-fb48-4610-aa39-d81eb23f6a5f", "name": "network-vif-unplugged", "status": "completed", "tag": "68feade0-83ad-484a-aa0b-bfb4e7c07f70"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:28.329084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-27864f99-17cb-446f-ab68-0670f08f0f91 req-7b7eca2f-9784-4746-8e3a-de7113c483ff service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:28.329562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-27864f99-17cb-446f-ab68-0670f08f0f91 req-7b7eca2f-9784-4746-8e3a-de7113c483ff service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:28.342336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-27864f99-17cb-446f-ab68-0670f08f0f91 req-7b7eca2f-9784-4746-8e3a-de7113c483ff service nova] Creating event network-vif-unplugged:68feade0-83ad-484a-aa0b-bfb4e7c07f70 for instance 3e245463-fb48-4610-aa39-d81eb23f6a5f on nch1-master-1 May 07 22:26:28.347940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-27864f99-17cb-446f-ab68-0670f08f0f91 req-7b7eca2f-9784-4746-8e3a-de7113c483ff service nova] Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:26:28.358618 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-27864f99-17cb-446f-ab68-0670f08f0f91 req-7b7eca2f-9784-4746-8e3a-de7113c483ff service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043131 May 07 22:26:28.359433 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3156/6339] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:29.285707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:29.286346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:29.294406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:29.295181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:29.295983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:29.296438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:29.442525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:29.450373 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-99845828-ad9f-44e5-9a25-d2a91909b9f4 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1683 microversion: 2.1 time: 0.168802 May 07 22:26:29.450973 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3184/6340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:29 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:30.374897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-43bdeba0-8b26-43f4-a0bc-21bb9abceca1 req-f36a6272-7906-44d5-8dd8-0d9bc5bc71e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e245463-fb48-4610-aa39-d81eb23f6a5f", "tag": "68feade0-83ad-484a-aa0b-bfb4e7c07f70"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:30.383772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-43bdeba0-8b26-43f4-a0bc-21bb9abceca1 req-f36a6272-7906-44d5-8dd8-0d9bc5bc71e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:30.384239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-43bdeba0-8b26-43f4-a0bc-21bb9abceca1 req-f36a6272-7906-44d5-8dd8-0d9bc5bc71e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:30.398213 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-43bdeba0-8b26-43f4-a0bc-21bb9abceca1 req-f36a6272-7906-44d5-8dd8-0d9bc5bc71e1 service nova] Creating event network-changed:68feade0-83ad-484a-aa0b-bfb4e7c07f70 for instance 3e245463-fb48-4610-aa39-d81eb23f6a5f on nch1-master-1 May 07 22:26:30.403576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-43bdeba0-8b26-43f4-a0bc-21bb9abceca1 req-f36a6272-7906-44d5-8dd8-0d9bc5bc71e1 service nova] Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:26:30.414700 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-43bdeba0-8b26-43f4-a0bc-21bb9abceca1 req-f36a6272-7906-44d5-8dd8-0d9bc5bc71e1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044828 May 07 22:26:30.415388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3157/6341] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:30.468341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:30.468897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:30.476720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:30.477417 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:30.478391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:30.478863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:30.675130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:30.683196 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-92047cd5-4ec6-41c2-a19c-65d9c3c427e3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1681 microversion: 2.1 time: 0.218897 May 07 22:26:30.683776 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3185/6342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:30 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:31.702404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:31.703100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:31.709295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:31.709767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:31.710555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:31.711041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:31.839986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:31.847512 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b6919e5-bf86-4593-a9ef-4826c6bf1b4f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1678 microversion: 2.1 time: 0.150253 May 07 22:26:31.848091 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3158/6343] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:31 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:26:31.863904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a2b0c176-6804-4a3c-828c-1150d9db9b44 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:31.864459 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a2b0c176-6804-4a3c-828c-1150d9db9b44 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:31.872067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2b0c176-6804-4a3c-828c-1150d9db9b44 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:31.872535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2b0c176-6804-4a3c-828c-1150d9db9b44 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:31.873447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2b0c176-6804-4a3c-828c-1150d9db9b44 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:31.873772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a2b0c176-6804-4a3c-828c-1150d9db9b44 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:31.934641 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a2b0c176-6804-4a3c-828c-1150d9db9b44 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f/action" status: 204 len: 0 microversion: 2.1 time: 0.074499 May 07 22:26:31.935322 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3186/6344] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:26:31 2022] POST /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:26:31.943478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:31.944158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:31.950236 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:31.950713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:31.951572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:31.952036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:32.158761 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:32.167273 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-098fd736-9d2e-4e7d-af87-262c782248f8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1678 microversion: 2.1 time: 0.227570 May 07 22:26:32.167864 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3159/6345] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:31 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:33.186736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:33.187571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:33.194588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:33.195011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:33.195799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:33.196276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:33.647950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:33.655381 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-75361989-7771-4b1e-8dee-6d62eb6dfb37 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1678 microversion: 2.1 time: 0.473748 May 07 22:26:33.655954 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3187/6346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:33 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1678 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:34.281117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c564cd3a-026c-4938-bb81-5c73507ca0d6 req-9ceed4ce-504b-4acf-8b06-320d28cb48b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e245463-fb48-4610-aa39-d81eb23f6a5f", "name": "network-vif-plugged", "status": "completed", "tag": "68feade0-83ad-484a-aa0b-bfb4e7c07f70"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:34.290213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c564cd3a-026c-4938-bb81-5c73507ca0d6 req-9ceed4ce-504b-4acf-8b06-320d28cb48b1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:34.290685 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c564cd3a-026c-4938-bb81-5c73507ca0d6 req-9ceed4ce-504b-4acf-8b06-320d28cb48b1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:34.302641 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c564cd3a-026c-4938-bb81-5c73507ca0d6 req-9ceed4ce-504b-4acf-8b06-320d28cb48b1 service nova] Creating event network-vif-plugged:68feade0-83ad-484a-aa0b-bfb4e7c07f70 for instance 3e245463-fb48-4610-aa39-d81eb23f6a5f on nch1-master-1 May 07 22:26:34.307683 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c564cd3a-026c-4938-bb81-5c73507ca0d6 req-9ceed4ce-504b-4acf-8b06-320d28cb48b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030330 May 07 22:26:34.308293 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3160/6347] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:34.672987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:34.673594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:34.680911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:34.681375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:34.682154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:34.682608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:34.825093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:34.832648 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7753ed61-7a73-4d22-adaf-49fb24002a64 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1670 microversion: 2.1 time: 0.163689 May 07 22:26:34.833284 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3188/6348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:34 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:34.849318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:34.850055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:34.856440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:34.856915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:34.857709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:34.858175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:34.992916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:35.000293 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8c71d6bb-8193-4cbe-b161-c0ecf8faa169 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1670 microversion: 2.1 time: 0.155261 May 07 22:26:35.000879 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3161/6349] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:34 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:35.016202 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:35.016834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:35.023063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:35.023524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:35.024299 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:35.024748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:35.165396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:35.173137 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86676d35-376f-425d-b47d-757db925a9f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1670 microversion: 2.1 time: 0.160849 May 07 22:26:35.173714 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3189/6350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:35 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:35.190047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:35.190497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:35.196471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:35.196934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:35.197708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:35.198157 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:35.222492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:26:35.296939 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-190ed0a7-a23c-40bf-a261-7c8b1659c49d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 204 len: 0 microversion: 2.1 time: 0.110505 May 07 22:26:35.297657 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3162/6351] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:26:35 2022] DELETE /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:26:35.305726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:35.306345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:35.312352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:35.312814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:35.313593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:35.314040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:35.444544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:35.452019 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bc982d26-3795-46c2-b2c1-ce7e38f4bfae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1676 microversion: 2.1 time: 0.150158 May 07 22:26:35.452603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3190/6352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:35 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:36.469559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:36.470210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:36.477034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:36.477509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:36.478302 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:36.478762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:36.604937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:36.612926 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1902f20b-5017-4c74-8855-49521aca194c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1676 microversion: 2.1 time: 0.147657 May 07 22:26:36.613718 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3163/6353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:36 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:26:37.459169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-0137d70b-f712-46f7-aa42-9bf63ad07369 req-5f38f17a-3394-4bc7-ae0f-52c3cb02ab68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e245463-fb48-4610-aa39-d81eb23f6a5f", "name": "network-vif-deleted", "tag": "68feade0-83ad-484a-aa0b-bfb4e7c07f70"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:37.468737 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0137d70b-f712-46f7-aa42-9bf63ad07369 req-5f38f17a-3394-4bc7-ae0f-52c3cb02ab68 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:37.469201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0137d70b-f712-46f7-aa42-9bf63ad07369 req-5f38f17a-3394-4bc7-ae0f-52c3cb02ab68 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:37.481103 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-0137d70b-f712-46f7-aa42-9bf63ad07369 req-5f38f17a-3394-4bc7-ae0f-52c3cb02ab68 service nova] Creating event network-vif-deleted:68feade0-83ad-484a-aa0b-bfb4e7c07f70 for instance 3e245463-fb48-4610-aa39-d81eb23f6a5f on nch1-master-1 May 07 22:26:37.486261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-0137d70b-f712-46f7-aa42-9bf63ad07369 req-5f38f17a-3394-4bc7-ae0f-52c3cb02ab68 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031164 May 07 22:26:37.486925 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3191/6354] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:37.629804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:37.630478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:37.638593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:37.639426 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:37.640437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:37.641068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:37.679562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:37.680045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:37.680541 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lazy-loading 'fault' on Instance uuid 3e245463-fb48-4610-aa39-d81eb23f6a5f {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:26:37.722255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:37.729272 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6a75cdec-68d0-43f0-8f04-ed22e26ca602 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 200 len: 1329 microversion: 2.1 time: 0.103360 May 07 22:26:37.729943 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3164/6355] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:37 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:26:38.747676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:38.748393 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:38.754634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:38.755133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:38.755912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:38.756364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:38.769974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. May 07 22:26:38.770558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:26:38.771420 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a690e826-5905-4886-bb12-ed43c14c3612 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 404 len: 111 microversion: 2.1 time: 0.028970 May 07 22:26:38.771942 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3192/6356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:38 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:26:38.785534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:38.786167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:38.793249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:38.793714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:38.794497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:38.794981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:38.808398 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. May 07 22:26:38.809008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:26:38.809852 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5ba5ce13-7219-4c0b-8519-5b16e124944c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 404 len: 111 microversion: 2.1 time: 0.028291 May 07 22:26:38.810388 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3165/6357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:38 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:26:38.857980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-21646845", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0edc1271-8a82-489b-912c-a8fef30fb1c9"}], "security_groups": [{"name": "tempest-securitygroup--1338130233"}], "key_name": "tempest-keypair-2117323651", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:38.959524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] validate_networks() for [('0edc1271-8a82-489b-912c-a8fef30fb1c9', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:26:39.324899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:26:39.325359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:26:39.325843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:26:39.326262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:26:39.326682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:26:39.335465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:39.335930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:39.336746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:39.337199 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:39.354000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:26:39.359469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:26:39.372188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:26:39.374495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:26:39.420337 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b4f12608-e9e6-46de-8b0f-15e899da4658 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.566303 May 07 22:26:39.421011 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3193/6358] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:26:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:26:39.431679 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e3c3befc-c5cd-43ae-927f-5dff233acd94 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:39.432421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e3c3befc-c5cd-43ae-927f-5dff233acd94 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:39.488884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e3c3befc-c5cd-43ae-927f-5dff233acd94 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:39.496297 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e3c3befc-c5cd-43ae-927f-5dff233acd94 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1237 microversion: 2.1 time: 0.068624 May 07 22:26:39.496858 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3166/6359] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:39 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:40.514127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:40.514898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:40.523220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:40.523689 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:40.524474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:40.524949 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:40.594488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:40.602350 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b82c636a-a5fe-48ec-9203-d9c338ec43c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1295 microversion: 2.1 time: 0.092378 May 07 22:26:40.603154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3194/6360] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:40 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:41.620362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:41.621258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:41.629483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:41.629956 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:41.630741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:41.631220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:41.657862 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-88b285a4-3acd-4a31-be53-21c1943fe621 req-3456c4b9-0e53-44d9-8c90-9780b6655bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23", "tag": "86657e51-7c13-4822-82f8-a74debc881c8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:41.695549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-88b285a4-3acd-4a31-be53-21c1943fe621 req-3456c4b9-0e53-44d9-8c90-9780b6655bbe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:41.696712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-88b285a4-3acd-4a31-be53-21c1943fe621 req-3456c4b9-0e53-44d9-8c90-9780b6655bbe service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:41.709886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-88b285a4-3acd-4a31-be53-21c1943fe621 req-3456c4b9-0e53-44d9-8c90-9780b6655bbe service nova] Creating event network-changed:86657e51-7c13-4822-82f8-a74debc881c8 for instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 on nch2-master-1 May 07 22:26:41.715646 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-88b285a4-3acd-4a31-be53-21c1943fe621 req-3456c4b9-0e53-44d9-8c90-9780b6655bbe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066872 May 07 22:26:41.716369 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3195/6361] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:41.897227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:41.905762 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9ac7bbd8-ec12-4790-9c8c-bbaddd288589 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1363 microversion: 2.1 time: 0.290261 May 07 22:26:41.906345 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3167/6362] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:41 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:26:42.925312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:42.926027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:42.933465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:42.933927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:42.934699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:42.935162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:43.072374 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:43.079931 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5691a9a2-b2e3-42ec-948e-b2475a112ad5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1363 microversion: 2.1 time: 0.158848 May 07 22:26:43.080510 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3196/6363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:42 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:26:44.097381 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:44.098045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:44.107091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:44.107570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:44.108393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:44.108858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:44.236911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:44.244392 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-777c09f1-3ab7-4feb-9a31-3abeb4a85225 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1363 microversion: 2.1 time: 0.151092 May 07 22:26:44.244974 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3168/6364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:44 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:45.261925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:45.262547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:45.269365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:45.269826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:45.270603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:45.271090 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:45.398783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:45.406155 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f79a8f09-f4bb-482b-8812-0ca0714e7fb5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1363 microversion: 2.1 time: 0.148124 May 07 22:26:45.406735 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3197/6365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:45 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:46.424383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:46.425021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:46.432635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:46.433107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:46.433893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:46.434355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:46.564649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:46.571947 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e8fb12c-af55-4cb5-9c82-95e7cd4a8fd3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1363 microversion: 2.1 time: 0.151537 May 07 22:26:46.572517 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3169/6366] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:46 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:46.855915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f6b62b64-c4f1-48f7-80fd-379a613780f1 req-953499e6-6eb3-43fd-a97f-aa87a7cb5702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23", "name": "network-vif-plugged", "status": "completed", "tag": "86657e51-7c13-4822-82f8-a74debc881c8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:46.865000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f6b62b64-c4f1-48f7-80fd-379a613780f1 req-953499e6-6eb3-43fd-a97f-aa87a7cb5702 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:46.865474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f6b62b64-c4f1-48f7-80fd-379a613780f1 req-953499e6-6eb3-43fd-a97f-aa87a7cb5702 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:46.876651 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f6b62b64-c4f1-48f7-80fd-379a613780f1 req-953499e6-6eb3-43fd-a97f-aa87a7cb5702 service nova] Creating event network-vif-plugged:86657e51-7c13-4822-82f8-a74debc881c8 for instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 on nch2-master-1 May 07 22:26:46.882157 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f6b62b64-c4f1-48f7-80fd-379a613780f1 req-953499e6-6eb3-43fd-a97f-aa87a7cb5702 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029569 May 07 22:26:46.882986 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3198/6367] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:47.589102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:47.589732 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:47.596553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:47.597016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:47.597792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:47.598245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:47.727320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:47.734694 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-dc44dee8-fdb3-48a5-bd5c-5edb3b693b00 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1363 microversion: 2.1 time: 0.149525 May 07 22:26:47.735300 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3170/6368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:47 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:48.754076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:48.754809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:48.763608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:48.764069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:48.765609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:48.766057 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:48.902712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:48.910108 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5deb09fc-210c-4b60-8bba-0317770ada0a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1549 microversion: 2.1 time: 0.161138 May 07 22:26:48.910687 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3199/6369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:48 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:48.927025 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-60620bdc-30be-4419-9f0e-8c03387f5b79 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:48.927536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-60620bdc-30be-4419-9f0e-8c03387f5b79 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:48.934733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60620bdc-30be-4419-9f0e-8c03387f5b79 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:48.935231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60620bdc-30be-4419-9f0e-8c03387f5b79 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:48.936008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60620bdc-30be-4419-9f0e-8c03387f5b79 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:48.936466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-60620bdc-30be-4419-9f0e-8c03387f5b79 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:49.011681 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-60620bdc-30be-4419-9f0e-8c03387f5b79 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088474 May 07 22:26:49.012301 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3171/6370] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:26:48 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:50.260861 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41ebeb72-6ebd-494a-882b-b9ba920e55f5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:50.263578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-da9b196b-71be-4ec4-845d-49b8c87fbf1f req-e2dae6a5-361f-446b-a562-40d4019994e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23", "tag": "86657e51-7c13-4822-82f8-a74debc881c8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:26:50.271391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-da9b196b-71be-4ec4-845d-49b8c87fbf1f req-e2dae6a5-361f-446b-a562-40d4019994e8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:50.271851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-da9b196b-71be-4ec4-845d-49b8c87fbf1f req-e2dae6a5-361f-446b-a562-40d4019994e8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:50.273667 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41ebeb72-6ebd-494a-882b-b9ba920e55f5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:50.274129 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41ebeb72-6ebd-494a-882b-b9ba920e55f5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:50.283551 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-da9b196b-71be-4ec4-845d-49b8c87fbf1f req-e2dae6a5-361f-446b-a562-40d4019994e8 service nova] Creating event network-changed:86657e51-7c13-4822-82f8-a74debc881c8 for instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 on nch2-master-1 May 07 22:26:50.289188 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-da9b196b-71be-4ec4-845d-49b8c87fbf1f req-e2dae6a5-361f-446b-a562-40d4019994e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029995 May 07 22:26:50.289971 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3172/6371] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:26:50.300228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41ebeb72-6ebd-494a-882b-b9ba920e55f5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:26:50.354732 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41ebeb72-6ebd-494a-882b-b9ba920e55f5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action" status: 202 len: 0 microversion: 2.1 time: 0.097746 May 07 22:26:50.355397 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3200/6372] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:26:50 2022] POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:26:50.364119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:50.365116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:50.372851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:50.373697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:50.374576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:50.375332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:50.609438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:50.617834 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-18546bd6-ab8f-40cb-8c74-73280314d741 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1559 microversion: 2.1 time: 0.257835 May 07 22:26:50.618454 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3173/6373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:50 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1559 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:51.636750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:51.637471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:51.643717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:51.644122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:51.644894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:51.645341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:51.777137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:51.784668 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-582bf8ff-58a3-451e-b743-986239acd80c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.153073 May 07 22:26:51.785259 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3201/6374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:51 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:26:52.803169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:52.803814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:52.810528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:52.811028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:52.811803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:52.812255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:52.943272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:52.951266 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c5ee4fc5-75ed-495c-b166-b2389508d0ae tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.152073 May 07 22:26:52.951845 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3174/6375] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:52 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:53.969162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:53.969706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:53.976496 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:53.976958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:53.977731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:53.978188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:54.109559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:54.117903 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c72737ab-2bfe-4de9-9827-83f84fa9acee tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.152714 May 07 22:26:54.118547 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3202/6376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:53 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:55.136382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:55.137016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:55.143830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:55.144297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:55.145080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:55.145540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:55.271163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:55.278531 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-39eac767-1f7b-4698-a8d3-2d26f54ec112 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.146689 May 07 22:26:55.279136 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3175/6377] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:55 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:56.296451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:56.297081 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:56.303938 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:56.304403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:56.305211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:56.305664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:56.431763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:56.439185 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ddb62355-a5e6-4b1e-8590-5cc0e75ff4b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.146668 May 07 22:26:56.439754 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3203/6378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:56 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:57.456306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:57.456866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:57.463801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:57.464264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:57.465042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:57.465493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:57.595384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:57.603296 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8467eaa8-55f9-4932-aad7-2ac07759ec61 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.150943 May 07 22:26:57.603876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3176/6379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:57 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:58.620973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:58.621598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:58.628441 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:58.628897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:58.629671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:58.630116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:58.756463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:58.764776 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-be9e46bb-0717-41a5-a032-2fcd631c43d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.147711 May 07 22:26:58.765365 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3204/6380] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:58 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:26:59.782073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:26:59.782735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:26:59.790174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:59.790643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:59.791727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:26:59.792183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:26:59.924801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:26:59.932836 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9fc86e78-b3b7-4aa8-961b-ca2401b5e605 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.154811 May 07 22:26:59.933423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3177/6381] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:26:59 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:00.950979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:00.951566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:00.958039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:00.958501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:00.959317 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:00.959773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:01.091639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:01.099004 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4bf7cec3-998c-4c33-9118-60fbbdc05320 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.152437 May 07 22:27:01.099584 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3205/6382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:00 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:02.116204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:02.116868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:02.123756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:02.124231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:02.125024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:02.125485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:02.251720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:02.259626 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-66ad456d-dcb9-416e-a6ce-ea0d789c7698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.147420 May 07 22:27:02.260201 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3178/6383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:02 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:03.277508 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:03.278139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:03.285010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:03.285474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:03.286250 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:03.286697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:03.413650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:03.421373 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b000685f-2428-42f9-90fd-069171196c9e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.147802 May 07 22:27:03.421985 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3206/6384] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:03 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:04.437752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:04.438393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:04.446367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:04.446910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:04.447677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:04.448151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:04.585208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:04.593187 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c91ede40-8daf-45b6-bfc1-72d9dd249077 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.159310 May 07 22:27:04.593898 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3179/6385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:04 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:05.610023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:05.610640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:05.617440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:05.617905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:05.618686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:05.619163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:05.751869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:05.759752 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6e09fda-8400-4eff-9b97-da7f0213ff76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.153671 May 07 22:27:05.760321 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3207/6386] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:05 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:06.777545 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:06.778175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:06.784712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:06.785181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:06.785964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:06.786416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:06.912827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:06.921111 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2860bc54-c912-48ff-9ee0-834766fb2ad9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.147621 May 07 22:27:06.921724 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3180/6387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:06 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:07.938302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:07.938968 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:07.945928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:07.946386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:07.947223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:07.947670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:08.081143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:08.088660 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e62c3b22-2b5e-4682-8eea-552c41ef5bcb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.154318 May 07 22:27:08.089240 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3208/6388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:07 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:09.106103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:09.106729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:09.113551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:09.114023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:09.114824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:09.115279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:09.247855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:09.255873 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3674c35b-6ae2-4223-aeae-a3771cf93051 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.153746 May 07 22:27:09.256448 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3181/6389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:09 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:10.273748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:10.274410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:10.281894 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:10.282356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:10.283162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:10.283636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:10.414877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:10.422623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0cf2675-e22f-4f1a-bfa8-3cb5726ae71a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.152778 May 07 22:27:10.423231 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3209/6390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:10 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:11.443482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:11.444795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:11.452073 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:11.452476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:11.453348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:11.453804 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:11.649742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:11.657840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e93f0f71-cdee-4bf3-921c-6b830876bd06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.218337 May 07 22:27:11.658423 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3182/6391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:11 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:12.676184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:12.676826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:12.684269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:12.684719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:12.685485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:12.685924 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:12.811863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:12.819488 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aadd04b0-4428-4a68-b0d3-def3185b42f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.147246 May 07 22:27:12.820063 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3210/6392] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:12 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:13.836850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:13.837484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:13.843932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:13.844403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:13.845187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:13.845643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:13.975467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:13.983341 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-04877720-271d-43f4-ba9f-c4495a27f597 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.150572 May 07 22:27:13.983922 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3183/6393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:13 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:15.000607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:15.001239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:15.008092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:15.008559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:15.009970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:15.010438 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:15.140464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:15.148175 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f18d5a1c-e06f-448b-91fa-bb9198f0e674 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.151528 May 07 22:27:15.148746 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3211/6394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:14 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:16.166326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:16.167045 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:16.173847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:16.174310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:16.175124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:16.175579 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:16.301333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:16.308850 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-389a5a58-9687-48d7-b631-a3fe16be333f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1655 microversion: 2.1 time: 0.147203 May 07 22:27:16.309433 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3184/6395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:16 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:27:16.325530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:16.326554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:16.333405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:16.333870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:16.334647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:16.335128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:16.362925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:16.368541 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Old instance type m1.heat2, new instance type m1.heat {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:27:16.374697 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:27:16.375171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:27:16.375665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:27:16.376085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:27:16.376505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:27:16.438821 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41c42058-c31d-4723-ac25-54f1526830f0 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action" status: 202 len: 0 microversion: 2.1 time: 0.117644 May 07 22:27:16.439385 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3212/6396] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:27:16 2022] POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:27:16.448273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:16.448980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:16.455899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:16.457061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:16.461258 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:16.461733 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:16.621353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:16.629185 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-02c819f2-bcc6-402c-82fa-6531ad2d2954 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.185560 May 07 22:27:16.630193 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3185/6397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:16 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:17.651916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:17.652632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:17.662920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:17.663411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:17.664192 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:17.664633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:17.801176 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:17.808794 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fe19b9ff-7006-4f5b-ad72-81039b25cf51 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1678 microversion: 2.1 time: 0.163000 May 07 22:27:17.809492 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3213/6398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:17 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:18.825499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:18.826122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:18.832880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:18.833342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:18.834114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:18.834567 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:18.961620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:18.969416 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b7dfb0a2-381d-48b8-a6de-448c1cc7b7fd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1683 microversion: 2.1 time: 0.147876 May 07 22:27:18.969987 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3186/6399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:18 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:19.987452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:19.988069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:19.995180 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:19.995633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:19.996399 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:19.996849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:20.132898 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:20.142230 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-377f5678-b0f2-4dd0-9b7c-250a051d7bbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1683 microversion: 2.1 time: 0.158637 May 07 22:27:20.142985 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3214/6400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:19 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:20.659055 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c25acfb0-9990-4c26-ab89-af11c9d142f3 req-99cf238f-d8cd-42ca-a45a-f987ae041f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23", "name": "network-vif-unplugged", "status": "completed", "tag": "86657e51-7c13-4822-82f8-a74debc881c8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:20.668102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c25acfb0-9990-4c26-ab89-af11c9d142f3 req-99cf238f-d8cd-42ca-a45a-f987ae041f6b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:20.668572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c25acfb0-9990-4c26-ab89-af11c9d142f3 req-99cf238f-d8cd-42ca-a45a-f987ae041f6b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:20.680711 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c25acfb0-9990-4c26-ab89-af11c9d142f3 req-99cf238f-d8cd-42ca-a45a-f987ae041f6b service nova] Creating event network-vif-unplugged:86657e51-7c13-4822-82f8-a74debc881c8 for instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 on nch1-master-1 May 07 22:27:20.686278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-c25acfb0-9990-4c26-ab89-af11c9d142f3 req-99cf238f-d8cd-42ca-a45a-f987ae041f6b service nova] Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:27:20.697735 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c25acfb0-9990-4c26-ab89-af11c9d142f3 req-99cf238f-d8cd-42ca-a45a-f987ae041f6b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041867 May 07 22:27:20.698346 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3187/6401] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:27:21.160876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:21.161597 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:21.170451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:21.170451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:21.171073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:21.171638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:21.394049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:21.401717 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3ef7ce8c-304b-402d-9b69-96c922d5c455 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1682 microversion: 2.1 time: 0.244796 May 07 22:27:21.402396 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3215/6402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:21 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:22.421177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:22.421814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:22.428103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:22.428577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:22.429366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:22.429830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:22.557790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:22.565148 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-abe9f695-36bd-4aa8-a850-840fe544c4a1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1680 microversion: 2.1 time: 0.149461 May 07 22:27:22.565738 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3188/6403] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:22 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:22.715230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d5ca36d9-dc75-4bc4-8a58-156fe64f8d84 req-ce3848f3-ede0-4317-bd4f-ae2aaf2ada18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23", "tag": "86657e51-7c13-4822-82f8-a74debc881c8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:22.724084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d5ca36d9-dc75-4bc4-8a58-156fe64f8d84 req-ce3848f3-ede0-4317-bd4f-ae2aaf2ada18 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:22.724539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d5ca36d9-dc75-4bc4-8a58-156fe64f8d84 req-ce3848f3-ede0-4317-bd4f-ae2aaf2ada18 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:22.736548 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d5ca36d9-dc75-4bc4-8a58-156fe64f8d84 req-ce3848f3-ede0-4317-bd4f-ae2aaf2ada18 service nova] Creating event network-changed:86657e51-7c13-4822-82f8-a74debc881c8 for instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 on nch1-master-1 May 07 22:27:22.741762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-d5ca36d9-dc75-4bc4-8a58-156fe64f8d84 req-ce3848f3-ede0-4317-bd4f-ae2aaf2ada18 service nova] Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:27:22.752241 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d5ca36d9-dc75-4bc4-8a58-156fe64f8d84 req-ce3848f3-ede0-4317-bd4f-ae2aaf2ada18 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041303 May 07 22:27:22.752832 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3216/6404] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:27:23.582573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:23.583280 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:23.590051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:23.590524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:23.591339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:23.591801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:23.718858 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:23.726387 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2fac5c0-1e5a-4069-aff9-64bd201bd046 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1676 microversion: 2.1 time: 0.147701 May 07 22:27:23.726996 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3189/6405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:23 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:23.745359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7336a7e-bf5a-4c4e-8968-267bda3be61e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:23.745999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7336a7e-bf5a-4c4e-8968-267bda3be61e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:23.752200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7336a7e-bf5a-4c4e-8968-267bda3be61e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:23.752664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7336a7e-bf5a-4c4e-8968-267bda3be61e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:23.753474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7336a7e-bf5a-4c4e-8968-267bda3be61e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:23.753929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7336a7e-bf5a-4c4e-8968-267bda3be61e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:23.811118 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7336a7e-bf5a-4c4e-8968-267bda3be61e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action" status: 204 len: 0 microversion: 2.1 time: 0.071275 May 07 22:27:23.811685 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3217/6406] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:27:23 2022] POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:27:23.819899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:23.820534 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:23.826648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:23.827159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:23.827950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:23.828446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:24.034434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:24.042930 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c496dc00-7083-4608-8bbc-3a9209c256ff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1676 microversion: 2.1 time: 0.226837 May 07 22:27:24.043506 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3190/6407] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:23 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:27:25.062371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:25.063114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:25.069678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:25.070407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:25.071228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:25.071682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:25.209158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:25.217420 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c90450d4-624c-4292-b05c-47cac27fd22e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1655 microversion: 2.1 time: 0.161062 May 07 22:27:25.218008 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3218/6408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:25 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:25.235836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:25.236475 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:25.243343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:25.244458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:25.245299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:25.245696 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:25.376717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:25.384269 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51358362-a844-4088-acf3-769193fe05f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1655 microversion: 2.1 time: 0.152245 May 07 22:27:25.384853 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3191/6409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:25 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:25.400566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82f0fe96-a062-414b-add6-a3863dab89dd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:25.406744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82f0fe96-a062-414b-add6-a3863dab89dd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:25.407290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82f0fe96-a062-414b-add6-a3863dab89dd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:25.430084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82f0fe96-a062-414b-add6-a3863dab89dd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Going to try to start instance {{(pid=136682) start /opt/stack/nova/nova/compute/api.py:2730}} May 07 22:27:25.474061 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82f0fe96-a062-414b-add6-a3863dab89dd tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action" status: 202 len: 0 microversion: 2.1 time: 0.077391 May 07 22:27:25.474650 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3219/6410] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:27:25 2022] POST /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:27:25.483625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:25.484299 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:25.490215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:25.490686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:25.491527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:25.491977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:25.622795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:25.630245 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56022a53-6662-4829-b2cf-d4f6995b875b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1664 microversion: 2.1 time: 0.150539 May 07 22:27:25.630852 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3192/6411] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:25 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:26.517247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a513b992-f231-4016-bc2f-764e84aad8b1 req-ad0f69c8-7f5a-46db-9123-3e04a5d02657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23", "name": "network-vif-plugged", "status": "completed", "tag": "86657e51-7c13-4822-82f8-a74debc881c8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:26.528259 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a513b992-f231-4016-bc2f-764e84aad8b1 req-ad0f69c8-7f5a-46db-9123-3e04a5d02657 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:26.528828 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a513b992-f231-4016-bc2f-764e84aad8b1 req-ad0f69c8-7f5a-46db-9123-3e04a5d02657 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:26.543227 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a513b992-f231-4016-bc2f-764e84aad8b1 req-ad0f69c8-7f5a-46db-9123-3e04a5d02657 service nova] Creating event network-vif-plugged:86657e51-7c13-4822-82f8-a74debc881c8 for instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 on nch1-master-1 May 07 22:27:26.548233 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a513b992-f231-4016-bc2f-764e84aad8b1 req-ad0f69c8-7f5a-46db-9123-3e04a5d02657 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038713 May 07 22:27:26.549310 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3220/6412] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:27:26.648285 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:26.648917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:26.655740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:26.656204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:26.656983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:26.657436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:26.789486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:26.798372 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-44f68d19-47fe-4fe9-b8dc-7d397e388c14 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1668 microversion: 2.1 time: 0.154063 May 07 22:27:26.798991 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3193/6413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:26 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:26.817428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:26.818027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:26.824531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:26.824997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:26.825771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:26.826217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:26.850634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:27:26.924031 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6fc71017-a33a-439a-814c-cc88d3be2f81 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 204 len: 0 microversion: 2.1 time: 0.112216 May 07 22:27:26.924634 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3221/6414] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:27:26 2022] DELETE /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:27:26.935815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:26.936601 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:26.942903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:26.943375 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:26.944163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:26.944620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:27.069013 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:27.076278 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e59e2b8-2339-48f7-aabc-590c71a289f1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1674 microversion: 2.1 time: 0.147096 May 07 22:27:27.076857 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3194/6415] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:26 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:28.094055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:28.094859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:28.101682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:28.102146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:28.103490 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:28.103936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:28.233064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:28.240577 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86150057-d492-405a-bcec-2a0c7b52cdc2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1674 microversion: 2.1 time: 0.150903 May 07 22:27:28.241158 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3222/6416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:28 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:29.260153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:29.260802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:29.268138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:29.268619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:29.269797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:29.270261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:29.337224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:29.348251 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c2492f9a-dfd1-4b32-82c2-088fb468458a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 200 len: 1606 microversion: 2.1 time: 0.092752 May 07 22:27:29.348976 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3195/6417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:29 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:29.480188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f1dfe7ed-fc57-4d90-b1a9-da89b071f812 req-c3d9a07d-75de-4853-a9d5-a789198eef8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23", "name": "network-vif-deleted", "tag": "86657e51-7c13-4822-82f8-a74debc881c8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:29.489468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f1dfe7ed-fc57-4d90-b1a9-da89b071f812 req-c3d9a07d-75de-4853-a9d5-a789198eef8c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:29.490003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f1dfe7ed-fc57-4d90-b1a9-da89b071f812 req-c3d9a07d-75de-4853-a9d5-a789198eef8c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:29.502691 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f1dfe7ed-fc57-4d90-b1a9-da89b071f812 req-c3d9a07d-75de-4853-a9d5-a789198eef8c service nova] Creating event network-vif-deleted:86657e51-7c13-4822-82f8-a74debc881c8 for instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 on nch1-master-1 May 07 22:27:29.508005 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f1dfe7ed-fc57-4d90-b1a9-da89b071f812 req-c3d9a07d-75de-4853-a9d5-a789198eef8c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031479 May 07 22:27:29.508653 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3223/6418] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:27:30.365737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:30.366373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:30.373100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:30.373569 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:30.374357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:30.374867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:30.388604 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. May 07 22:27:30.389211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:27:30.390055 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-23ba1039-b895-4701-bda8-5bedc9d1a270 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 404 len: 111 microversion: 2.1 time: 0.028329 May 07 22:27:30.390592 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3196/6419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:30 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:27:30.411422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:30.412554 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:30.419615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:30.420078 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:30.420863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:30.421314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:30.434856 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. May 07 22:27:30.435465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:27:30.436342 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-51d3acea-9245-41c4-b80d-1d69aa55542c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 404 len: 111 microversion: 2.1 time: 0.029681 May 07 22:27:30.436891 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3224/6420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:30 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:27:30.487718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1221523361", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0edc1271-8a82-489b-912c-a8fef30fb1c9"}], "security_groups": [{"name": "tempest-securitygroup--1338130233"}], "key_name": "tempest-keypair-2117323651", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:30.596849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] validate_networks() for [('0edc1271-8a82-489b-912c-a8fef30fb1c9', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:27:30.999755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:27:31.000205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:27:31.000701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:27:31.001134 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:27:31.001570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:27:31.010860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:31.011333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:31.012160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:31.012618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:31.029042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:27:31.034251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:27:31.047031 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:27:31.049305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:27:31.093949 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-460aa3aa-236c-49e4-9c3e-aaae1bcbe9cf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.610116 May 07 22:27:31.094597 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3197/6421] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:27:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:27:31.105491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d57443d9-70f6-4dfa-a124-641db9575dc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:31.106133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d57443d9-70f6-4dfa-a124-641db9575dc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:31.160169 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d57443d9-70f6-4dfa-a124-641db9575dc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:31.170366 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d57443d9-70f6-4dfa-a124-641db9575dc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1239 microversion: 2.1 time: 0.068686 May 07 22:27:31.171419 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3225/6422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:31 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:32.189978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:32.190619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:32.198455 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:32.198958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:32.199768 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:32.200221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:32.478298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:32.485965 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-21187ceb-fc14-43b0-b6f8-b5067217f6c1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1297 microversion: 2.1 time: 0.300047 May 07 22:27:32.486554 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3198/6423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:32 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1297 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:33.504346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:33.505151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:33.514539 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:33.515185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:33.516085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:33.516659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:33.613244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-7f3b501f-5f03-4a26-a7d7-154398734ef3 req-8ae7b231-3934-4a5c-924e-1faebbdc4add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cbc3dd-6401-46bb-9337-dced1409c1bd", "tag": "f074d4aa-c0b3-439e-bc78-a4a1379e7f1c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:33.645867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7f3b501f-5f03-4a26-a7d7-154398734ef3 req-8ae7b231-3934-4a5c-924e-1faebbdc4add service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:33.648284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-7f3b501f-5f03-4a26-a7d7-154398734ef3 req-8ae7b231-3934-4a5c-924e-1faebbdc4add service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:33.664273 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-7f3b501f-5f03-4a26-a7d7-154398734ef3 req-8ae7b231-3934-4a5c-924e-1faebbdc4add service nova] Creating event network-changed:f074d4aa-c0b3-439e-bc78-a4a1379e7f1c for instance 34cbc3dd-6401-46bb-9337-dced1409c1bd on nch2-master-1 May 07 22:27:33.671398 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-7f3b501f-5f03-4a26-a7d7-154398734ef3 req-8ae7b231-3934-4a5c-924e-1faebbdc4add service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068332 May 07 22:27:33.672063 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3199/6424] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:27:33.688999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:33.697549 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c404f14-6a28-409f-a70f-860ca0b4f154 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1365 microversion: 2.1 time: 0.196452 May 07 22:27:33.698137 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3226/6425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:33 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:34.717051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:34.717777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:34.724053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:34.724528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:34.725311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:34.725772 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:34.858474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:34.865900 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f8133c4-b1d6-4a35-b55f-2d7fe2dd12e6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1365 microversion: 2.1 time: 0.154462 May 07 22:27:34.866478 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3200/6426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:34 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:35.886798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:35.887927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:35.896320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:35.896320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:35.896922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:35.897373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:36.033264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:36.040845 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eebaa30c-a080-402f-bbca-87aded4b08f2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1365 microversion: 2.1 time: 0.161475 May 07 22:27:36.041684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3227/6427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:35 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:37.057505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:37.058151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:37.065160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:37.065629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:37.066452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:37.066947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:37.203108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:37.211635 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e764e92-aec5-45df-9980-77637f5184d1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1365 microversion: 2.1 time: 0.158004 May 07 22:27:37.212229 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3201/6428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:37 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:38.230628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:38.231384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:38.239093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:38.239726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:38.240738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:38.241281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:38.367686 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:38.375553 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-26ca7050-ac91-4439-a42e-bdd658e14298 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1365 microversion: 2.1 time: 0.150398 May 07 22:27:38.376154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3228/6429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:38 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:39.147084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ba547c36-f5ee-430a-91be-9d82cefed8d2 req-9314be74-8766-4dc5-973e-66c37ebc6d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cbc3dd-6401-46bb-9337-dced1409c1bd", "name": "network-vif-plugged", "status": "completed", "tag": "f074d4aa-c0b3-439e-bc78-a4a1379e7f1c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:39.157070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ba547c36-f5ee-430a-91be-9d82cefed8d2 req-9314be74-8766-4dc5-973e-66c37ebc6d5f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:39.157600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ba547c36-f5ee-430a-91be-9d82cefed8d2 req-9314be74-8766-4dc5-973e-66c37ebc6d5f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:39.170449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ba547c36-f5ee-430a-91be-9d82cefed8d2 req-9314be74-8766-4dc5-973e-66c37ebc6d5f service nova] Creating event network-vif-plugged:f074d4aa-c0b3-439e-bc78-a4a1379e7f1c for instance 34cbc3dd-6401-46bb-9337-dced1409c1bd on nch2-master-1 May 07 22:27:39.175567 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ba547c36-f5ee-430a-91be-9d82cefed8d2 req-9314be74-8766-4dc5-973e-66c37ebc6d5f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032321 May 07 22:27:39.176167 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3202/6430] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:27:39.393166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:39.393971 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:39.401420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:39.401899 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:39.402663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:39.403130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:39.534608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:39.542418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ecf1afab-0edd-41b7-896c-6d8645eb0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1365 microversion: 2.1 time: 0.153192 May 07 22:27:39.543008 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3229/6431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:39 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:40.560219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:40.560949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:40.568067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:40.568543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:40.569333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:40.569798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:40.695429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:40.702791 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-250e82e1-a153-4eca-8069-e2ea90e215d9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1551 microversion: 2.1 time: 0.146842 May 07 22:27:40.703372 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3203/6432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:40 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1551 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:40.719886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-379e4445-59e4-4ee1-b7f1-4768a1058840 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:40.720406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-379e4445-59e4-4ee1-b7f1-4768a1058840 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:40.727209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-379e4445-59e4-4ee1-b7f1-4768a1058840 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:40.727677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-379e4445-59e4-4ee1-b7f1-4768a1058840 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:40.728449 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-379e4445-59e4-4ee1-b7f1-4768a1058840 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:40.729537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-379e4445-59e4-4ee1-b7f1-4768a1058840 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:40.804971 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-379e4445-59e4-4ee1-b7f1-4768a1058840 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089010 May 07 22:27:40.805595 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3230/6433] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:27:40 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:27:41.771101 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:41.772097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:41.774102 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1fc20b1e-8dec-4d35-89ff-c234f77e5bb8 req-7c6588bd-d3d7-418d-a6ce-09fb6cb213f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cbc3dd-6401-46bb-9337-dced1409c1bd", "tag": "f074d4aa-c0b3-439e-bc78-a4a1379e7f1c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:27:41.779096 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:41.779573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:41.780374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:41.780833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:41.782528 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1fc20b1e-8dec-4d35-89ff-c234f77e5bb8 req-7c6588bd-d3d7-418d-a6ce-09fb6cb213f4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:41.783015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1fc20b1e-8dec-4d35-89ff-c234f77e5bb8 req-7c6588bd-d3d7-418d-a6ce-09fb6cb213f4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:41.796307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1fc20b1e-8dec-4d35-89ff-c234f77e5bb8 req-7c6588bd-d3d7-418d-a6ce-09fb6cb213f4 service nova] Creating event network-changed:f074d4aa-c0b3-439e-bc78-a4a1379e7f1c for instance 34cbc3dd-6401-46bb-9337-dced1409c1bd on nch2-master-1 May 07 22:27:41.801782 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1fc20b1e-8dec-4d35-89ff-c234f77e5bb8 req-7c6588bd-d3d7-418d-a6ce-09fb6cb213f4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 May 07 22:27:41.802603 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3231/6434] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:27:41.820529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:41.827394 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Old instance type m1.heat2, new instance type m1.heat {{(pid=136681) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:27:41.834041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:27:41.834722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:27:41.835250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:27:41.835680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:27:41.836110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:27:41.909153 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d72a621b-5f7f-46a4-9bd7-f62adc37dcd9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd/action" status: 202 len: 0 microversion: 2.1 time: 0.141796 May 07 22:27:41.912948 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3204/6435] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:27:41 2022] POST /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:27:41.920379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:41.922453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:41.930238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:41.930407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:41.931219 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:41.931677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:42.097463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:42.107303 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-91859924-2fc3-4526-871b-808861d4a335 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1560 microversion: 2.1 time: 0.192479 May 07 22:27:42.115803 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3232/6436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:41 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:43.127061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:43.127684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:43.133621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:43.134086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:43.134895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:43.135345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:43.354497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:43.361800 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a90d9991-21ec-43d0-aea5-ea4223e98071 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1679 microversion: 2.1 time: 0.240008 May 07 22:27:43.362377 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3205/6437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:43 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:44.379880 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:44.380498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:44.388119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:44.388574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:44.389344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:44.389812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:44.519284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:44.526590 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b4869d08-eee8-4ce5-a34c-a81e95d05cb7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.150608 May 07 22:27:44.527189 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3233/6438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:44 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:27:45.543976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:45.544607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:45.551362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:45.551825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:45.552600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:45.553049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:45.682436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:45.689845 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d98d4fed-c222-447b-851d-f6e10edeb365 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.150129 May 07 22:27:45.690421 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3206/6439] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:45 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:46.708309 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:46.708955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:46.716316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:46.716770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:46.717540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:46.717985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:46.849749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:46.857380 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3f7390bd-5edb-4635-ad37-e5d714b4ad7f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.153129 May 07 22:27:46.857968 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3234/6440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:46 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:47.875486 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:47.876119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:47.882890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:47.883354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:47.884123 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:47.884573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:48.011934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:48.019306 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a40e12fe-e3ca-4420-9334-057b89366b06 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.147768 May 07 22:27:48.019885 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3207/6441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:47 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:49.036929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:49.037556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:49.045498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:49.045959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:49.046740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:49.047236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:49.177235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:49.184653 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-69b2a3da-1ea3-47d8-a664-b74fbe58e90a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.151685 May 07 22:27:49.185236 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3235/6442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:49 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:50.201586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:50.202298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:50.209169 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:50.209644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:50.210439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:50.211017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:50.342041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:50.349422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed27d9a7-8e0d-4c84-a86b-48dd649a4070 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.151811 May 07 22:27:50.349989 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3208/6443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:50 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:51.367267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:51.367923 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:51.375457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:51.375917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:51.376695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:51.377147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:51.505070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:51.512371 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0d9435c9-3267-4730-bdae-05af99e7478d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.149038 May 07 22:27:51.512943 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3236/6444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:51 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:52.529809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:52.530482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:52.537888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:52.538364 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:52.539227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:52.539677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:52.669639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:52.676993 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1c8cf1ed-4ab0-41aa-a512-b839ab7ae8bc tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.151461 May 07 22:27:52.677572 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3209/6445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:52 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:53.694637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:53.695284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:53.702007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:53.702463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:53.703261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:53.703702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:53.835840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:53.843231 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-639d62bd-4445-40d1-90e8-7cefd9dc4025 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.152433 May 07 22:27:53.843809 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3237/6446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:53 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:27:54.861481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:54.862120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:54.868967 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:54.869439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:54.870225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:54.870681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:54.996743 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:55.004323 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d1d1c16d-9ba9-4def-ad0f-9f634fefa765 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.146793 May 07 22:27:55.004897 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3210/6447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:54 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:56.021462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:56.022093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:56.029480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:56.029945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:56.030724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:56.031203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:56.157743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:56.165287 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ad481b0-2e94-4afd-aa8b-8e720d29c4b8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.147819 May 07 22:27:56.165867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3238/6448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:56 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:57.182257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:57.182922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:57.189738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:57.190207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:57.191024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:57.191480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:57.326120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:57.333708 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f2212743-78f5-446a-b691-ec8764377641 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.155345 May 07 22:27:57.334290 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3211/6449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:57 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:58.351635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:58.352263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:58.359672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:58.360139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:58.360916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:58.361367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:58.488773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:58.496230 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-00360bcb-b56b-4ecf-9e30-0f6da6964188 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.148579 May 07 22:27:58.496814 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3239/6450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:58 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:27:59.513852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:27:59.514495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:27:59.521358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:59.521834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:59.522612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:27:59.523168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:27:59.646799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:27:59.654179 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2bb574a4-21fb-439d-bd4c-84c2f9c27f31 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.144818 May 07 22:27:59.654755 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3212/6451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:27:59 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:00.671666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:00.672292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:00.679142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:00.679609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:00.680386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:00.680845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:00.814932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:00.822319 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c585627-788b-4f98-8e0d-75046677752b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.154624 May 07 22:28:00.822945 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3240/6452] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:00 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:01.841481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:01.842487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:01.849380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:01.849837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:01.850617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:01.851094 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:01.979666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:01.987090 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ea391279-4a67-44b7-a0c6-f3a99d37335f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.150687 May 07 22:28:01.987684 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3213/6453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:01 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:03.003511 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:03.004127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:03.010870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:03.011327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:03.012094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:03.012535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:03.139079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:03.146438 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fe56c5eb-c529-44e9-9589-373f12ce8aa6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.146872 May 07 22:28:03.147044 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3241/6454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:02 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:04.165088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:04.165727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:04.172883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:04.173358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:04.174145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:04.174605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:04.304224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:04.312255 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14679216-96c6-4f6e-beb1-07aaf1bf13b5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.151108 May 07 22:28:04.312830 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3214/6455] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:04 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:05.330230 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:05.330886 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:05.337340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:05.337799 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:05.338573 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:05.339048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:05.470289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:05.477670 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bdbcff68-4b65-43e6-b01a-1506b08028df tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.151535 May 07 22:28:05.478246 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3242/6456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:05 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:06.494879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:06.495539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:06.502607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:06.503178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:06.503961 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:06.504417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:06.636267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:06.643784 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9392ebd8-ebd8-499e-bc36-5cad53de5611 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.152969 May 07 22:28:06.644373 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3215/6457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:06 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:07.661605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:07.662204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:07.669312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:07.669767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:07.670526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:07.671000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:07.798098 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:07.805563 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2aef7fe1-afad-4978-8ee4-823fdfa6b4ab tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.147966 May 07 22:28:07.806129 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3243/6458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:07 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:08.823186 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:08.823820 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:08.831112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:08.831578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:08.832344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:08.832794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:08.967253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:08.974982 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b0c6afae-efdf-4587-9a84-c65aa8bf60c7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.155653 May 07 22:28:08.975594 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3216/6459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:08 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:09.992609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:09.993234 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:10.000491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:10.000945 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:10.001747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:10.002190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:10.133769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:10.141406 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5c1713f0-cdb5-4bef-9175-16fd9b3e8b70 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.153145 May 07 22:28:10.145126 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3244/6460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:09 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:11.162314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:11.162981 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:11.170154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:11.170624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:11.171446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:11.171907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:11.302879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:11.311040 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-94ce2476-3fe0-4336-8559-b110dbe6069b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.152591 May 07 22:28:11.311628 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3217/6461] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:11 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:12.327595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:12.328229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:12.335148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:12.335620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:12.336402 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:12.336864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:12.468118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:12.475652 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14261b22-6721-41ef-8fad-f979510c2132 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.151983 May 07 22:28:12.476224 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3245/6462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:12 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:13.493621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:13.494269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:13.501527 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:13.502007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:13.504468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:13.504468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:13.702941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:13.710507 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e39bb238-302b-4608-a7a7-c23ca951cdff tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.220926 May 07 22:28:13.711145 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3218/6463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:13 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:14.727804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:14.728432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:14.735310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:14.735773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:14.736556 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:14.737006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:14.866560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:14.874545 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae0aaf65-1823-4c9e-a6b1-ad31906871d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1684 microversion: 2.1 time: 0.150737 May 07 22:28:14.875156 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3246/6464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:14 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:15.892441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:15.893243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:15.900617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:15.901088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:15.901887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:15.902340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:16.038740 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:16.046912 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cf0dabaa-0b47-44a6-9348-1681f0abd178 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1683 microversion: 2.1 time: 0.159182 May 07 22:28:16.047493 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3219/6465] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:15 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:16.277999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c6f08ab2-7b3c-4239-ae11-a8757b1ba81e req-53dbe030-9e42-4fd0-82bc-5abba574affc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cbc3dd-6401-46bb-9337-dced1409c1bd", "name": "network-vif-unplugged", "status": "completed", "tag": "f074d4aa-c0b3-439e-bc78-a4a1379e7f1c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:16.287304 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c6f08ab2-7b3c-4239-ae11-a8757b1ba81e req-53dbe030-9e42-4fd0-82bc-5abba574affc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:16.287766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c6f08ab2-7b3c-4239-ae11-a8757b1ba81e req-53dbe030-9e42-4fd0-82bc-5abba574affc service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:16.301254 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c6f08ab2-7b3c-4239-ae11-a8757b1ba81e req-53dbe030-9e42-4fd0-82bc-5abba574affc service nova] Creating event network-vif-unplugged:f074d4aa-c0b3-439e-bc78-a4a1379e7f1c for instance 34cbc3dd-6401-46bb-9337-dced1409c1bd on nch1-master-1 May 07 22:28:16.307285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-c6f08ab2-7b3c-4239-ae11-a8757b1ba81e req-53dbe030-9e42-4fd0-82bc-5abba574affc service nova] Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:28:16.319285 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c6f08ab2-7b3c-4239-ae11-a8757b1ba81e req-53dbe030-9e42-4fd0-82bc-5abba574affc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045219 May 07 22:28:16.319918 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3247/6466] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:28:17.066917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:17.068822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:17.076683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:17.077162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:17.077973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:17.078432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:17.225518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:17.233090 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-51f0ba28-a4d4-4a79-b0b3-0c344f4cd00c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1683 microversion: 2.1 time: 0.172681 May 07 22:28:17.233679 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3220/6467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:17 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:18.255054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:18.255767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:18.262740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:18.263221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:18.263997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:18.264444 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:18.335894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0d62a1f7-d63e-401f-87b8-193196ee3759 req-6c8554a4-8674-472c-89d0-7dc8d6c47519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cbc3dd-6401-46bb-9337-dced1409c1bd", "tag": "f074d4aa-c0b3-439e-bc78-a4a1379e7f1c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:18.344452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0d62a1f7-d63e-401f-87b8-193196ee3759 req-6c8554a4-8674-472c-89d0-7dc8d6c47519 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:18.344904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0d62a1f7-d63e-401f-87b8-193196ee3759 req-6c8554a4-8674-472c-89d0-7dc8d6c47519 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:18.356363 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0d62a1f7-d63e-401f-87b8-193196ee3759 req-6c8554a4-8674-472c-89d0-7dc8d6c47519 service nova] Creating event network-changed:f074d4aa-c0b3-439e-bc78-a4a1379e7f1c for instance 34cbc3dd-6401-46bb-9337-dced1409c1bd on nch1-master-1 May 07 22:28:18.362303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-0d62a1f7-d63e-401f-87b8-193196ee3759 req-6c8554a4-8674-472c-89d0-7dc8d6c47519 service nova] Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:28:18.373705 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0d62a1f7-d63e-401f-87b8-193196ee3759 req-6c8554a4-8674-472c-89d0-7dc8d6c47519 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041507 May 07 22:28:18.374314 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3221/6468] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:28:18.401492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:18.409475 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9b8ecd6-437f-4c18-8c5b-259051ed3ce9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1681 microversion: 2.1 time: 0.159003 May 07 22:28:18.410152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3248/6469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:18 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:19.429057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:19.430090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:19.437691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.438168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.439007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.439492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.570926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:19.578929 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-448bafc9-7ac8-4a3a-abb9-825e66f80529 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1678 microversion: 2.1 time: 0.155075 May 07 22:28:19.579506 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3222/6470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:19 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:19.595344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:19.595891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:19.602726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.603220 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.603989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.604435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.641603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.642051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.642875 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.643319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.662594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:28:19.668012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:28:19.767075 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a55884a6-af89-4a74-af42-45f5059f8bac tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd/action" status: 202 len: 0 microversion: 2.1 time: 0.175400 May 07 22:28:19.767719 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3249/6471] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:28:19 2022] POST /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:28:19.775908 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:19.776573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:19.782680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.783207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.784011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:19.784593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:19.918624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:19.926491 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2306c0d-b25a-4601-8455-9cd640d05d5e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1677 microversion: 2.1 time: 0.154461 May 07 22:28:19.927118 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3223/6472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:19 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:20.945730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:20.946403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:20.954312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:20.954788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:20.955567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:20.956020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:21.086222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:21.094473 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-79e2f7a7-cd0a-4fe2-a226-bf3cc8a4bfe5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1677 microversion: 2.1 time: 0.153136 May 07 22:28:21.095094 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3250/6473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:20 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:22.112163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:22.113289 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:22.121499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:22.121971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:22.122801 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:22.123261 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:22.260374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:22.268427 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-28b13c9b-e7a8-4b82-a7c2-6b8dde1fb8d7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1677 microversion: 2.1 time: 0.160224 May 07 22:28:22.269009 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3224/6474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:22 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:23.285684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:23.287152 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:23.295747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:23.296614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:23.297657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:23.298615 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:23.302712 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-612af242-b0b6-4fbf-8022-1ce8bc64c3e1 req-d7358b42-211f-49be-aa39-c7e3b3fb2018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cbc3dd-6401-46bb-9337-dced1409c1bd", "tag": "f074d4aa-c0b3-439e-bc78-a4a1379e7f1c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:23.319432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-612af242-b0b6-4fbf-8022-1ce8bc64c3e1 req-d7358b42-211f-49be-aa39-c7e3b3fb2018 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:23.319992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-612af242-b0b6-4fbf-8022-1ce8bc64c3e1 req-d7358b42-211f-49be-aa39-c7e3b3fb2018 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:23.346610 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-612af242-b0b6-4fbf-8022-1ce8bc64c3e1 req-d7358b42-211f-49be-aa39-c7e3b3fb2018 service nova] Creating event network-changed:f074d4aa-c0b3-439e-bc78-a4a1379e7f1c for instance 34cbc3dd-6401-46bb-9337-dced1409c1bd on nch2-master-1 May 07 22:28:23.362740 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-612af242-b0b6-4fbf-8022-1ce8bc64c3e1 req-d7358b42-211f-49be-aa39-c7e3b3fb2018 service nova] Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:28:23.377605 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-612af242-b0b6-4fbf-8022-1ce8bc64c3e1 req-d7358b42-211f-49be-aa39-c7e3b3fb2018 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192338 May 07 22:28:23.379330 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3251/6475] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:28:23.556125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:23.567208 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-baf87da4-557a-4fdb-ae8f-5fe751adc5f7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1677 microversion: 2.1 time: 0.285254 May 07 22:28:23.567800 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3225/6476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:23 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:28:24.585015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:24.585735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:24.593850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:24.594376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:24.595297 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:24.595739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:24.733832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:24.742335 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-82260209-4444-4ec1-a30e-6cc98419b316 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1677 microversion: 2.1 time: 0.161642 May 07 22:28:24.742953 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3252/6477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:24 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:25.759665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:25.760303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:25.771267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:25.771741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:25.772537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:25.773001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:25.901267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:25.908687 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bdb7b0bd-8135-470e-864d-064bd57bec30 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1670 microversion: 2.1 time: 0.152956 May 07 22:28:25.909276 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3226/6478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:25 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:25.926427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:25.927109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:25.934509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:25.935679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:25.936463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:25.936911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:26.066236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:26.073669 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6aeb8f38-f7b6-4199-aab3-5cb59c66fddf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1670 microversion: 2.1 time: 0.151521 May 07 22:28:26.074264 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3253/6479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:25 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:26.089558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:26.090200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:26.096724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:26.097198 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:26.097987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:26.098449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:26.225623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:26.233088 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1c5d40ed-035e-4f24-8ba7-a4c940aa3d7e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1670 microversion: 2.1 time: 0.147463 May 07 22:28:26.233660 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3227/6480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:26 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:26.249509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:26.250019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:26.255970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:26.256431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:26.257213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:26.257664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:26.282523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:28:26.353924 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1cdba61-0b6d-4916-bc65-4f933a2d6d8f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 204 len: 0 microversion: 2.1 time: 0.108686 May 07 22:28:26.354529 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3254/6481] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:28:26 2022] DELETE /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:28:26.362892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:26.363519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:26.369449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:26.369928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:26.370719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:26.371211 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:26.504042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:26.511437 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-56a1f049-42ae-487c-98cd-4153aae225da tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1676 microversion: 2.1 time: 0.152514 May 07 22:28:26.512017 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3228/6482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:26 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:27.529387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:27.530177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:27.537040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:27.537494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:27.538268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:27.538711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:27.674313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:27.682104 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9e41aaf1-80a1-4ce5-8b24-3ef5ee8dec4d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1676 microversion: 2.1 time: 0.157058 May 07 22:28:27.682684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3255/6483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:27 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:28.681245 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bb2a8ef7-0202-4137-8a72-c32d75ad3317 req-31df5a42-e4b1-415b-a6c5-439e4635e123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cbc3dd-6401-46bb-9337-dced1409c1bd", "name": "network-vif-deleted", "tag": "f074d4aa-c0b3-439e-bc78-a4a1379e7f1c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:28.690716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bb2a8ef7-0202-4137-8a72-c32d75ad3317 req-31df5a42-e4b1-415b-a6c5-439e4635e123 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:28.691474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bb2a8ef7-0202-4137-8a72-c32d75ad3317 req-31df5a42-e4b1-415b-a6c5-439e4635e123 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:28.700529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:28.701731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:28.704422 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bb2a8ef7-0202-4137-8a72-c32d75ad3317 req-31df5a42-e4b1-415b-a6c5-439e4635e123 service nova] Creating event network-vif-deleted:f074d4aa-c0b3-439e-bc78-a4a1379e7f1c for instance 34cbc3dd-6401-46bb-9337-dced1409c1bd on nch2-master-1 May 07 22:28:28.709849 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bb2a8ef7-0202-4137-8a72-c32d75ad3317 req-31df5a42-e4b1-415b-a6c5-439e4635e123 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032440 May 07 22:28:28.710909 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3229/6484] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:28:28.723983 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:28.724375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:28.725182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:28.725634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:28.805334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:28.813811 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f3f300cb-1a7c-425b-baa0-d19001ee0ae6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 200 len: 1324 microversion: 2.1 time: 0.118122 May 07 22:28:28.814382 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3256/6485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:28 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 1324 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:29.832281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:29.833068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:29.839592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:29.840062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:29.840859 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:29.841856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:29.858458 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. May 07 22:28:29.859125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:28:29.859986 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-508b3744-7b7b-4cf1-b9e4-33c3dc6e0cc9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 404 len: 111 microversion: 2.1 time: 0.033019 May 07 22:28:29.860549 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3230/6486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:29 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:28:29.880435 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:29.881174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:29.887789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:29.888282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:29.889056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:29.889522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:29.904161 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. May 07 22:28:29.904797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:28:29.905646 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-95ba4555-d961-4e42-aae1-431c52769996 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 404 len: 111 microversion: 2.1 time: 0.029519 May 07 22:28:29.906251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3257/6487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:29 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:28:29.957279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-7132046", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "0edc1271-8a82-489b-912c-a8fef30fb1c9"}], "security_groups": [{"name": "tempest-securitygroup--1338130233"}], "key_name": "tempest-keypair-2117323651", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:30.060370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] validate_networks() for [('0edc1271-8a82-489b-912c-a8fef30fb1c9', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:28:30.429722 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:28:30.430172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:28:30.430668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:28:30.431160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:28:30.431596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:28:30.440399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:30.440870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:30.441706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:30.442166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:30.459320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:28:30.464563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:28:30.477530 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:28:30.479856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:28:30.524177 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-64b4f6c7-9120-4ef8-b222-3838ea883aaa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.571010 May 07 22:28:30.524825 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3231/6488] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:28:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:28:30.535562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-abc10392-c9ef-4438-a1a0-d0423a654cbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:30.536301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-abc10392-c9ef-4438-a1a0-d0423a654cbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:30.589584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-abc10392-c9ef-4438-a1a0-d0423a654cbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:30.597457 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-abc10392-c9ef-4438-a1a0-d0423a654cbe tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1236 microversion: 2.1 time: 0.065578 May 07 22:28:30.598131 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3258/6489] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:30 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:31.615883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:31.616526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:31.623822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:31.624320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:31.625107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:31.625588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:31.692020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:31.699567 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c6117a8e-d44b-49b0-967e-c19640d3d005 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1294 microversion: 2.1 time: 0.088718 May 07 22:28:31.700159 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3232/6490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:31 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:28:32.717822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:32.718645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:32.727524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:32.728159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:32.729256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:32.729750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:32.928877 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-85b2e658-1e9a-4e9f-b540-5a93fd6901fa req-a1abf729-52a8-4787-bdd2-11ec2c7f5ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:32.947758 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-85b2e658-1e9a-4e9f-b540-5a93fd6901fa req-a1abf729-52a8-4787-bdd2-11ec2c7f5ae2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:32.948247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-85b2e658-1e9a-4e9f-b540-5a93fd6901fa req-a1abf729-52a8-4787-bdd2-11ec2c7f5ae2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:32.956174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:32.960991 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-85b2e658-1e9a-4e9f-b540-5a93fd6901fa req-a1abf729-52a8-4787-bdd2-11ec2c7f5ae2 service nova] Creating event network-changed:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch1-master-1 May 07 22:28:32.964836 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0c3d47ee-da23-4c5e-9cc3-4708a7a3409e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1362 microversion: 2.1 time: 0.251158 May 07 22:28:32.965883 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3259/6491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:32 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:32.976964 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-85b2e658-1e9a-4e9f-b540-5a93fd6901fa req-a1abf729-52a8-4787-bdd2-11ec2c7f5ae2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053171 May 07 22:28:32.977866 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3233/6492] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:28:33.982601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:33.983256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:33.990125 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:33.990617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:33.991426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:33.991882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:34.477307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:34.484982 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c8f5721f-9512-4efe-bba8-c6bcd560d516 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1362 microversion: 2.1 time: 0.506813 May 07 22:28:34.485577 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3260/6493] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:33 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:35.504421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:35.505149 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:35.511487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:35.511958 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:35.512779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:35.513241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:35.639738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:35.647070 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a3a11335-0e40-42d8-b976-3450e2396e96 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1362 microversion: 2.1 time: 0.148436 May 07 22:28:35.647647 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3234/6494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:35 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:36.664451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:36.665074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:36.672458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:36.672920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:36.673718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:36.674163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:36.810596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:36.819247 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8e4281b1-422a-419a-91f5-e5c74bafd6a8 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1362 microversion: 2.1 time: 0.158712 May 07 22:28:36.819904 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3261/6495] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:36 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:37.836646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:37.837277 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:37.844903 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:37.845363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:37.846141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:37.846588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:37.985787 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:37.993369 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9dcaa3d6-ae84-4626-a95d-d05d52d2889d tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1362 microversion: 2.1 time: 0.160666 May 07 22:28:37.993960 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3235/6496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:37 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:38.932876 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dc59a7db-d7a2-4132-bc59-7ff6619e5d62 req-b2db50f2-8537-4158-a985-8d51dbc86957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "name": "network-vif-plugged", "status": "completed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:38.942241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dc59a7db-d7a2-4132-bc59-7ff6619e5d62 req-b2db50f2-8537-4158-a985-8d51dbc86957 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:38.942696 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dc59a7db-d7a2-4132-bc59-7ff6619e5d62 req-b2db50f2-8537-4158-a985-8d51dbc86957 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:38.954947 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dc59a7db-d7a2-4132-bc59-7ff6619e5d62 req-b2db50f2-8537-4158-a985-8d51dbc86957 service nova] Creating event network-vif-plugged:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch1-master-1 May 07 22:28:38.960093 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dc59a7db-d7a2-4132-bc59-7ff6619e5d62 req-b2db50f2-8537-4158-a985-8d51dbc86957 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100439 May 07 22:28:38.960691 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3262/6497] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:28:39.010539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:39.011255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:39.018612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:39.019219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:39.020021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:39.020485 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:39.151080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:39.158740 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f7796be-ef3d-4638-b1fd-8b4e5f34d494 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1362 microversion: 2.1 time: 0.152106 May 07 22:28:39.159343 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3236/6498] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:39 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:40.176872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:40.177582 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:40.184562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:40.185021 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:40.185798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:40.186238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:40.317761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:40.325410 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-076d442b-5eff-40cb-8437-bc2acf29d1e9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1362 microversion: 2.1 time: 0.152909 May 07 22:28:40.325990 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3263/6499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:40 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:41.343450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:41.344092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:41.350984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:41.351462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:41.352249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:41.352709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:41.484890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:41.492278 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-398acd0a-a446-4198-9fa4-061d1f941b24 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1547 microversion: 2.1 time: 0.152768 May 07 22:28:41.492856 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3237/6500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:41 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:41.509469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14f3cc48-f36d-4f0c-9f98-bb75d90c0576 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:41.510032 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14f3cc48-f36d-4f0c-9f98-bb75d90c0576 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:41.516822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14f3cc48-f36d-4f0c-9f98-bb75d90c0576 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:41.517294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14f3cc48-f36d-4f0c-9f98-bb75d90c0576 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:41.518111 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14f3cc48-f36d-4f0c-9f98-bb75d90c0576 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:41.518563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14f3cc48-f36d-4f0c-9f98-bb75d90c0576 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:41.595090 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14f3cc48-f36d-4f0c-9f98-bb75d90c0576 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089433 May 07 22:28:41.595700 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3264/6501] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:28:41 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:28:42.573060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bbdb9583-bd19-4db9-9f7a-ed5c610aab64 req-8a690b8c-7314-41a8-8142-1ae1955f8a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:42.582604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bbdb9583-bd19-4db9-9f7a-ed5c610aab64 req-8a690b8c-7314-41a8-8142-1ae1955f8a56 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:42.583135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bbdb9583-bd19-4db9-9f7a-ed5c610aab64 req-8a690b8c-7314-41a8-8142-1ae1955f8a56 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:42.595287 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bbdb9583-bd19-4db9-9f7a-ed5c610aab64 req-8a690b8c-7314-41a8-8142-1ae1955f8a56 service nova] Creating event network-changed:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch1-master-1 May 07 22:28:42.600520 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bbdb9583-bd19-4db9-9f7a-ed5c610aab64 req-8a690b8c-7314-41a8-8142-1ae1955f8a56 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031482 May 07 22:28:42.601606 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3238/6502] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:28:43.939477 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:43.940150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:43.946333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:43.946810 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:43.947579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:43.948018 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:44.080551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:44.088034 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2df0394d-3b1f-467f-9fb8-e6ffad3f9c07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1666 microversion: 2.1 time: 0.153923 May 07 22:28:44.088698 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3265/6503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:43 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:44.106539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8803baac-833f-42a6-9477-276c4f54bf2c"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:44.107778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:44.114600 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:44.115112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:44.115904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:44.116366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:44.341335 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-18d7bae4-309f-46fd-9f6a-e1dae538ec71 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239779 May 07 22:28:44.341951 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3239/6504] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:28:44 2022] POST /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:28:46.566526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:28:46.567545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:46.574228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:46.574687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:46.575497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:46.575948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:46.606502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:46.612289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Old instance type m1.heat2, new instance type m1.heat {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:28:46.618860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:28:46.619290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:28:46.619770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:28:46.620186 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:28:46.620601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:28:46.682396 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-17d13939-b2d0-4983-91cf-5b9fd0f0b2d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/action" status: 202 len: 0 microversion: 2.1 time: 0.119789 May 07 22:28:46.683053 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3266/6505] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:28:46 2022] POST /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:28:46.692257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:46.692994 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:46.699919 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:46.700383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:46.701164 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:46.701621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:46.856265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:46.866605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-474b66f4-9b50-43e8-a854-76e2df077827 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1721 microversion: 2.1 time: 0.178447 May 07 22:28:46.867541 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3240/6506] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:46 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:47.887887 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:47.888494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:47.895476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:47.896006 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:47.896762 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:47.897214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:48.111634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:48.119763 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8fafb774-ac22-4e5f-aa6f-deb0147c1dc1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1721 microversion: 2.1 time: 0.236797 May 07 22:28:48.120370 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3267/6507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:47 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:49.137182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:49.137819 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:49.145247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:49.145720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:49.146540 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:49.147033 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:49.279463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:49.287964 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bc30e17a-e334-493c-a4d9-4a0349e741d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.154724 May 07 22:28:49.288552 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3241/6508] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:49 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:50.305858 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:50.306487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:50.313519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:50.313989 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:50.314764 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:50.315255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:50.446396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:50.454991 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-251b29fc-9d2a-4827-ba2a-24d38e5957e7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.152997 May 07 22:28:50.456118 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3268/6509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:50 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:51.472934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:51.473507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:51.480674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:51.481154 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:51.481950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:51.482412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:51.610230 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:51.618299 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8fa11e6c-ba33-4771-83c1-1abfdf99faa5 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.149282 May 07 22:28:51.618899 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3242/6510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:51 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:52.635792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:52.636406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:52.643780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:52.644215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:52.645017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:52.645461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:52.772428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:52.780386 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5a697b3b-3b85-4412-9b13-6f800d9240ce tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.148517 May 07 22:28:52.780966 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3269/6511] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:52 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:53.797718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:53.798348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:53.812535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:53.813012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:53.813832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:53.814443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:53.946890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:53.955456 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-530ad8a0-6efa-4d06-bc91-9a61187a756c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.162035 May 07 22:28:53.956085 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3243/6512] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:53 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:54.972174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:54.972790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:54.979693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:54.980146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:54.980911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:54.981351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:55.111834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:55.119768 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb539a4d-9f6e-4198-a261-87f5b4b47273 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.152069 May 07 22:28:55.120346 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3270/6513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:54 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:56.137200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:56.137834 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:56.145661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:56.146136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:56.146968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:56.147428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:56.277477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:56.285319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b25fe50-433f-475c-a978-65d1dc18b8bb tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.152064 May 07 22:28:56.285896 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3244/6514] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:56 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:57.302753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:57.303440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:57.310291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:57.310750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:57.311550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:57.311995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:57.438360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:57.446242 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a67d7082-c790-4657-8b47-9ed559414474 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.147392 May 07 22:28:57.446846 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3271/6515] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:57 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:58.464067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:58.464644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:58.472061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:58.472512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:58.473305 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:58.473754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:58.599865 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:58.607649 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3208f6e-c6da-4f8d-8020-bd46000e4f62 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.147615 May 07 22:28:58.608221 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3245/6516] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:58 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:59.316501 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:28:59.316929 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:28:59.625901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:28:59.626533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:28:59.633188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:59.633640 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:59.634404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:28:59.634869 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:28:59.761041 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:28:59.768945 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6b64397a-1dcc-4a29-81ea-7b00e1d2f447 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.147483 May 07 22:28:59.769526 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3272/6517] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:28:59 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:28:59.803535 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:28:59.804013 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:29:00.785440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:00.786080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:00.793757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:00.794233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:00.795051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:00.795518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:00.926112 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:00.933996 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-af3cdb33-4c64-4f07-8a76-47f42fb0e7bf tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.152450 May 07 22:29:00.934564 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3246/6518] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:00 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:01.952056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:01.952694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:01.959632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:01.960099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:01.961206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:01.961663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:02.096741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:02.104706 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d4d05dcf-433f-4e41-8384-2f71bbc7dfe9 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.156756 May 07 22:29:02.105286 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3273/6519] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:01 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:03.121866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:03.122536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:03.129398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:03.129872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:03.130660 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:03.131147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:03.262514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:03.270493 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-73c3f897-e2a1-428d-bcbb-f3fe09d247c3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.152556 May 07 22:29:03.271101 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3247/6520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:03 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:04.287338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:04.287957 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:04.294986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:04.295445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:04.296215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:04.296658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:04.423381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:04.431257 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e88a4566-4565-487f-995b-786aef12497f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.147833 May 07 22:29:04.431829 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3274/6521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:04 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:05.448124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:05.448756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:05.455878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:05.456163 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:05.457148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:05.457606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:05.594159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:05.602055 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db8ec42b-52db-4c51-ae16-174ced46957e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.157839 May 07 22:29:05.602631 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3248/6522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:05 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:06.619472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:06.620091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:06.627319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:06.627771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:06.628534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:06.628975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:06.759679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:06.768166 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b638212e-258f-4818-9205-cbd5f38b3af7 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.152639 May 07 22:29:06.768739 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3275/6523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:06 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:07.784635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:07.785282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:07.794763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:07.795272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:07.796581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:07.799143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:07.924197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:07.932124 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c8322416-38da-4ba6-8e9b-2d9ee1b1fad1 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.151392 May 07 22:29:07.932697 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3249/6524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:07 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:08.950283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:08.950970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:08.958484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:08.958986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:08.959772 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:08.960225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:09.089403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:09.097420 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-352bb7ef-477d-4f07-807d-e00be8b25b40 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.151329 May 07 22:29:09.097996 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3276/6525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:08 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:10.115216 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:10.115863 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:10.122708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:10.123214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:10.124562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:10.125030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:10.252779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:10.260691 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1cc922c8-1abb-4717-a837-83b41d949af3 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.149410 May 07 22:29:10.261297 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3250/6526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:10 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:11.277526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:11.278131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:11.284931 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:11.285389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:11.286164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:11.286607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:11.426182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:11.434510 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07b83077-a9a0-40f4-996d-4ddf1b68556b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1726 microversion: 2.1 time: 0.160958 May 07 22:29:11.435457 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3277/6527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:11 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:11.862815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-acb77ce2-9c4d-4978-8563-b8833be7db4f req-19d7dd00-8b11-4a87-b10f-89cb4494c502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "name": "network-vif-unplugged", "status": "completed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:11.871770 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-acb77ce2-9c4d-4978-8563-b8833be7db4f req-19d7dd00-8b11-4a87-b10f-89cb4494c502 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:11.872213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-acb77ce2-9c4d-4978-8563-b8833be7db4f req-19d7dd00-8b11-4a87-b10f-89cb4494c502 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:11.885078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-acb77ce2-9c4d-4978-8563-b8833be7db4f req-19d7dd00-8b11-4a87-b10f-89cb4494c502 service nova] Creating event network-vif-unplugged:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch2-master-1 May 07 22:29:11.891264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-acb77ce2-9c4d-4978-8563-b8833be7db4f req-19d7dd00-8b11-4a87-b10f-89cb4494c502 service nova] Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:29:11.901889 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-acb77ce2-9c4d-4978-8563-b8833be7db4f req-19d7dd00-8b11-4a87-b10f-89cb4494c502 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042867 May 07 22:29:11.902506 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3251/6528] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:12.452142 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:12.452778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:12.460461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:12.461028 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:12.461897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:12.462351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:12.599236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:12.607179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1acf5678-b1a8-4d71-8a77-0fccdc6e5bfa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1725 microversion: 2.1 time: 0.159060 May 07 22:29:12.607748 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3278/6529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:12 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:13.627548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:13.629047 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:13.637645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:13.638337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:13.640276 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:13.640895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:13.815614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:13.823416 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d19126e-6184-4dc0-a069-894fa2046547 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1723 microversion: 2.1 time: 0.201671 May 07 22:29:13.823985 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3252/6530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:13 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:13.918575 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-16ec5dc2-250e-47f4-a4d1-f64a28579484 req-0ec5635e-b3b1-4019-8bb0-fd8f5b3b5662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:13.927893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-16ec5dc2-250e-47f4-a4d1-f64a28579484 req-0ec5635e-b3b1-4019-8bb0-fd8f5b3b5662 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:13.928351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-16ec5dc2-250e-47f4-a4d1-f64a28579484 req-0ec5635e-b3b1-4019-8bb0-fd8f5b3b5662 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:13.940482 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-16ec5dc2-250e-47f4-a4d1-f64a28579484 req-0ec5635e-b3b1-4019-8bb0-fd8f5b3b5662 service nova] Creating event network-changed:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch2-master-1 May 07 22:29:13.945829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-16ec5dc2-250e-47f4-a4d1-f64a28579484 req-0ec5635e-b3b1-4019-8bb0-fd8f5b3b5662 service nova] Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:29:13.956809 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-16ec5dc2-250e-47f4-a4d1-f64a28579484 req-0ec5635e-b3b1-4019-8bb0-fd8f5b3b5662 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042310 May 07 22:29:13.957418 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3279/6531] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:14.840870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:14.841516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:14.848839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:14.849307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:14.850126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:14.850580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:15.064311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:15.072484 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-878b5a9e-49ec-415b-8672-9991173ecdc6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1723 microversion: 2.1 time: 0.235513 May 07 22:29:15.073387 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3253/6532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:14 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:16.091206 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:16.091912 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:16.098726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:16.099224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:16.099991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:16.100434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:16.233793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:16.241713 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-78fad9ba-b928-4e24-b350-2887cc8527d2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1723 microversion: 2.1 time: 0.155692 May 07 22:29:16.242303 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3280/6533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:16 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:17.258899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:17.259544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:17.267141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.267649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.268449 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.268915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.394927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:17.402869 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bedfbd97-0449-4fba-9fd2-f367012b4694 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1720 microversion: 2.1 time: 0.147853 May 07 22:29:17.403452 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3254/6534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:17 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:17.419700 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:17.420251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:17.427662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.428127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.428908 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.429364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.467281 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.467757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.468574 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.469025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.489775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:29:17.494950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Getting quotas for user 29f04b492fa34ec79228aeb116b422e0 and project 697345bef14f49b0a7ffff78f8f90913. Resources: {'cores', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:29:17.604059 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e0e205cc-d7e4-46d3-809e-221960f0af07 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "POST /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/action" status: 202 len: 0 microversion: 2.1 time: 0.188349 May 07 22:29:17.607706 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3281/6535] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:29:17 2022] POST /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:29:17.614509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:17.615189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:17.621552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.622027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.623308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:17.624614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:17.827328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:17.836314 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a6194bd2-0c54-4aef-ba32-de69916fa367 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1719 microversion: 2.1 time: 0.226712 May 07 22:29:17.837123 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3255/6536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:17 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:18.855780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:18.856529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:18.863467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:18.863930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:18.864708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:18.865158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:19.000434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:19.008412 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ac44242d-79ad-4461-ae2b-7f04c9cf6a3e tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1719 microversion: 2.1 time: 0.157936 May 07 22:29:19.009013 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3282/6537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:18 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:19.631322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e7b4bc7a-5682-4527-b23c-7cf0bd2ee6f9 req-251b85b5-165e-4e79-841d-16d8f5427292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "name": "network-vif-plugged", "status": "completed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:19.641825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e7b4bc7a-5682-4527-b23c-7cf0bd2ee6f9 req-251b85b5-165e-4e79-841d-16d8f5427292 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:19.642505 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e7b4bc7a-5682-4527-b23c-7cf0bd2ee6f9 req-251b85b5-165e-4e79-841d-16d8f5427292 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:19.654527 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e7b4bc7a-5682-4527-b23c-7cf0bd2ee6f9 req-251b85b5-165e-4e79-841d-16d8f5427292 service nova] Creating event network-vif-plugged:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch2-master-1 May 07 22:29:19.660617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-e7b4bc7a-5682-4527-b23c-7cf0bd2ee6f9 req-251b85b5-165e-4e79-841d-16d8f5427292 service nova] Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:29:19.672279 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e7b4bc7a-5682-4527-b23c-7cf0bd2ee6f9 req-251b85b5-165e-4e79-841d-16d8f5427292 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044701 May 07 22:29:19.672889 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3256/6538] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:20.025409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:20.026043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:20.033092 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:20.033588 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:20.034419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:20.035029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:20.169314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:20.177665 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9bc355b1-f31d-4a66-85a0-e6455642d92f tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1719 microversion: 2.1 time: 0.156157 May 07 22:29:20.178360 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3283/6539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:20 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:21.196265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:21.197038 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:21.207337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:21.213437 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:21.214410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:21.215011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:21.238523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-8518db87-0965-48ce-b33c-d35ac9f020d3 req-f47b42a0-0958-471b-9d70-719665406910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "name": "network-vif-unplugged", "status": "completed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:21.255653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8518db87-0965-48ce-b33c-d35ac9f020d3 req-f47b42a0-0958-471b-9d70-719665406910 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:21.256389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8518db87-0965-48ce-b33c-d35ac9f020d3 req-f47b42a0-0958-471b-9d70-719665406910 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:21.271764 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-8518db87-0965-48ce-b33c-d35ac9f020d3 req-f47b42a0-0958-471b-9d70-719665406910 service nova] Creating event network-vif-unplugged:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch1-master-1 May 07 22:29:21.277962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-8518db87-0965-48ce-b33c-d35ac9f020d3 req-f47b42a0-0958-471b-9d70-719665406910 service nova] Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:29:21.288922 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-8518db87-0965-48ce-b33c-d35ac9f020d3 req-f47b42a0-0958-471b-9d70-719665406910 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150074 May 07 22:29:21.289805 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3257/6540] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:21.467296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:21.475649 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4b1b8d2a-60b8-425a-9586-1b3a5179a764 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1719 microversion: 2.1 time: 0.283673 May 07 22:29:21.476240 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3284/6541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:21 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1719 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:29:22.494992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:22.495749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:22.501982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:22.502452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:22.503279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:22.503739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:22.637993 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:22.646718 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e4f6c89a-78ba-4fbf-9bd1-5698a48d8b76 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1719 microversion: 2.1 time: 0.156981 May 07 22:29:22.647330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3258/6542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:22 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:23.311256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a6234c43-bf3e-4bee-b22d-8937e86b7631 req-0538df6d-c578-48d9-88e6-a70fd3492cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:23.320708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a6234c43-bf3e-4bee-b22d-8937e86b7631 req-0538df6d-c578-48d9-88e6-a70fd3492cb3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:23.321162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a6234c43-bf3e-4bee-b22d-8937e86b7631 req-0538df6d-c578-48d9-88e6-a70fd3492cb3 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:23.333701 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a6234c43-bf3e-4bee-b22d-8937e86b7631 req-0538df6d-c578-48d9-88e6-a70fd3492cb3 service nova] Creating event network-changed:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch1-master-1 May 07 22:29:23.339288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-a6234c43-bf3e-4bee-b22d-8937e86b7631 req-0538df6d-c578-48d9-88e6-a70fd3492cb3 service nova] Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:29:23.349801 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a6234c43-bf3e-4bee-b22d-8937e86b7631 req-0538df6d-c578-48d9-88e6-a70fd3492cb3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042251 May 07 22:29:23.350406 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3285/6543] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:23.665388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:23.666044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:23.673643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:23.674298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:23.675138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:23.675650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:23.885184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:23.893127 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-351aa587-3c93-44a1-8bdf-7947871d1837 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1719 microversion: 2.1 time: 0.232416 May 07 22:29:23.893713 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3259/6544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:23 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:24.911977 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:24.912698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:24.919495 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:24.919962 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:24.920741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:24.921217 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:25.056464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:25.064412 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a066b836-83f1-46a8-a602-8972b732ce4b tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1719 microversion: 2.1 time: 0.158642 May 07 22:29:25.064999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3286/6545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:24 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:26.082141 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:26.082710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:26.089571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.090044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.090862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.091328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.229727 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:26.237857 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b200b023-2c4d-44da-81ab-7b3415171457 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1712 microversion: 2.1 time: 0.160338 May 07 22:29:26.238443 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3260/6546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:26 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1712 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:26.254552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:26.255207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:26.261950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.262409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.263215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.263664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.394087 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:26.402077 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2bad70ad-5fcb-4cd6-bf4e-4be27203e891 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1712 microversion: 2.1 time: 0.151939 May 07 22:29:26.402653 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3287/6547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:26 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:26.418487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:26.419151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:26.425594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.426068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.426886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.427349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.564182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:26.572272 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a03ea16-3318-4995-8091-66947f00cf32 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1712 microversion: 2.1 time: 0.157965 May 07 22:29:26.572868 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3261/6548] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:26 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:26.588488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:26.588999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:26.595329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.595749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.596552 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.597019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.621615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:29:26.697848 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b249a866-98d9-42af-9f8a-3e1596d69987 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 204 len: 0 microversion: 2.1 time: 0.112973 May 07 22:29:26.698822 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3288/6549] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:29:26 2022] DELETE /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:29:26.706720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:26.707383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:26.713438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.713928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.714717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:26.715208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:26.840986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:26.849392 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9dab5e5f-f884-4c61-b4f6-d05758132550 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1718 microversion: 2.1 time: 0.146442 May 07 22:29:26.849908 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3262/6550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:26 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1718 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:27.867352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:27.868064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:27.875471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:27.875941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:27.876723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:27.877172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:28.006197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:28.014252 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9f95e155-ad5a-48ed-b34d-2cced903d740 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1718 microversion: 2.1 time: 0.151190 May 07 22:29:28.014849 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3289/6551] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:27 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:29.031440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:29.032078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:29.039188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:29.039914 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:29.040803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:29.041525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:29.109706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29f04b492fa34ec79228aeb116b422e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697345bef14f49b0a7ffff78f8f90913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:29.117637 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2115d975-5799-4de2-a12d-bbe1897f302c tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 200 len: 1650 microversion: 2.1 time: 0.090148 May 07 22:29:29.118226 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3263/6552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:29 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 1650 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:29.185534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-bdec2667-a076-43a0-aa7b-aac5a2352b07 req-5286e5aa-bcce-40ec-8af6-07210cca2232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b45ab2-7469-460c-9cc8-a8993d5906ed", "name": "network-vif-deleted", "tag": "4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:29.195663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bdec2667-a076-43a0-aa7b-aac5a2352b07 req-5286e5aa-bcce-40ec-8af6-07210cca2232 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:29.196739 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bdec2667-a076-43a0-aa7b-aac5a2352b07 req-5286e5aa-bcce-40ec-8af6-07210cca2232 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:29.209949 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-bdec2667-a076-43a0-aa7b-aac5a2352b07 req-5286e5aa-bcce-40ec-8af6-07210cca2232 service nova] Creating event network-vif-deleted:4aa349b6-2d5a-4bf6-b3e1-d949ac3abc1d for instance a5b45ab2-7469-460c-9cc8-a8993d5906ed on nch1-master-1 May 07 22:29:29.215498 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-bdec2667-a076-43a0-aa7b-aac5a2352b07 req-5286e5aa-bcce-40ec-8af6-07210cca2232 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033740 May 07 22:29:29.216361 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3290/6553] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:30.135741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:30.136303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:30.143901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:30.144466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:30.145339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:30.145805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:30.159993 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. May 07 22:29:30.160620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:30.161465 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a29de3af-1122-46d4-9d36-c9219c5d6c68 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 404 len: 111 microversion: 2.1 time: 0.029858 May 07 22:29:30.162018 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3264/6554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:30 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:30.223777 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:30.224859 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:30.231282 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:30.231746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:30.232523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:30.232970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:30.245948 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. May 07 22:29:30.246567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:30.247482 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ea72d305-9377-41d1-8325-5a5021f756aa tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029707 May 07 22:29:30.248025 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3291/6555] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:29:30 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.442022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.442577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.449424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.449897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.450736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.451185 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.464428 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. May 07 22:29:31.465035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.465881 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b3dcc064-d204-41a1-a5bd-592845b0e13a tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 404 len: 111 microversion: 2.1 time: 0.027856 May 07 22:29:31.466417 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3265/6556] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:29:31 2022] DELETE /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.474952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.475630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: a5b45ab2-7469-460c-9cc8-a8993d5906ed] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.482423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.482910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.483677 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.484783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.497831 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. May 07 22:29:31.498421 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance a5b45ab2-7469-460c-9cc8-a8993d5906ed could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.499273 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7d8007e-9b2c-4156-8d7e-341117d47eb2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed" status: 404 len: 111 microversion: 2.1 time: 0.028326 May 07 22:29:31.499792 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3292/6557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:31 2022] GET /compute/v2.1/servers/a5b45ab2-7469-460c-9cc8-a8993d5906ed => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.507590 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.508117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.514093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.514570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.515395 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.515860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.529400 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. May 07 22:29:31.530034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.531457 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1bda35f4-2526-40b8-848c-5b002497bb45 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 404 len: 111 microversion: 2.1 time: 0.027215 May 07 22:29:31.531979 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3266/6558] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:29:31 2022] DELETE /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.539620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.540238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 34cbc3dd-6401-46bb-9337-dced1409c1bd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.546284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.547379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.548144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.548586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.561713 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. May 07 22:29:31.562292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 34cbc3dd-6401-46bb-9337-dced1409c1bd could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.563133 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-703eed42-7eda-40ff-ab6b-c75a0f6213e2 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd" status: 404 len: 111 microversion: 2.1 time: 0.027317 May 07 22:29:31.563653 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3293/6559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:31 2022] GET /compute/v2.1/servers/34cbc3dd-6401-46bb-9337-dced1409c1bd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.571330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.571913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.578087 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.578561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.579389 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.579878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.594353 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. May 07 22:29:31.595007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.595868 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d767416-ec71-4f75-bc0e-892985db55b6 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 404 len: 111 microversion: 2.1 time: 0.028462 May 07 22:29:31.596422 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3267/6560] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:29:31 2022] DELETE /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.605015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.605644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.613838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.614310 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.615194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.615974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.632925 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. May 07 22:29:31.633520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.634354 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-358c20c0-653a-45ec-8788-46d3f11ccc27 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23" status: 404 len: 111 microversion: 2.1 time: 0.033588 May 07 22:29:31.634921 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3294/6561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:31 2022] GET /compute/v2.1/servers/d5cbb6de-b5cb-4d93-8ac4-e7b81fcf7c23 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.643374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.643895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.649875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.650349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.651209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.651674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.665582 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. May 07 22:29:31.666182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.667308 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b40d7e09-cb0b-4e5e-8086-31f3facbce10 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 404 len: 111 microversion: 2.1 time: 0.028368 May 07 22:29:31.667828 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3268/6562] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:29:31 2022] DELETE /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.675611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.676238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] [instance: 3e245463-fb48-4610-aa39-d81eb23f6a5f] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:31.682047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.682513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.683322 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:31.683851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:31.697317 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] HTTP exception thrown: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. May 07 22:29:31.697904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Returning 404 to user: Instance 3e245463-fb48-4610-aa39-d81eb23f6a5f could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:29:31.698727 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cd2379c8-7256-4c1e-9928-7f2b5b7e0698 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f" status: 404 len: 111 microversion: 2.1 time: 0.026943 May 07 22:29:31.699282 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3295/6563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:31 2022] GET /compute/v2.1/servers/3e245463-fb48-4610-aa39-d81eb23f6a5f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:29:31.707936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87942bb4-4621-43d2-916f-b11e1b5a9489 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] Calling method '.version_select at 0x7fc40c271ee0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:31.728722 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87942bb4-4621-43d2-916f-b11e1b5a9489 tempest-ServerActionsTestJSON-114634088 tempest-ServerActionsTestJSON-114634088-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117323651" status: 202 len: 0 microversion: 2.1 time: 0.024630 May 07 22:29:31.729282 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3269/6564] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:29:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117323651 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:29:37.485405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-840987144", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "f2975d03-209e-4fce-88c6-92b80d15feea"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:37.536849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] validate_networks() for [('f2975d03-209e-4fce-88c6-92b80d15feea', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:29:37.945355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:29:37.945782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:29:37.946265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:29:37.946744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:29:37.947153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:29:37.956152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:37.956616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:37.957492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:37.957966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:37.974307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Getting quotas for project 513bc8fe3df847c2914e5d3e465e864f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:29:37.979522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Getting quotas for user 1bc01d9efcd942f7b17489817b1c6af0 and project 513bc8fe3df847c2914e5d3e465e864f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:29:37.992312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:29:37.994680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:29:38.038923 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c305e371-d607-4415-bad5-650924c3cb8f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667266 May 07 22:29:38.039584 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3296/6565] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:29:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:29:38.052332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-71c2baa0-a1e4-4c0f-8465-17d4296a692d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:38.053051 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-71c2baa0-a1e4-4c0f-8465-17d4296a692d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:38.107683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-71c2baa0-a1e4-4c0f-8465-17d4296a692d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:38.114864 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-71c2baa0-a1e4-4c0f-8465-17d4296a692d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1216 microversion: 2.1 time: 0.068531 May 07 22:29:38.115439 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3270/6566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:38 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1216 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:39.132731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:39.133473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:39.139948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:39.141085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:39.141964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:39.142418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:39.207151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:39.217486 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab1f77c7-8d8b-4865-91b7-51f3981a2236 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1286 microversion: 2.1 time: 0.089182 May 07 22:29:39.224349 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3297/6567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:39 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:40.240814 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:40.241446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:40.248618 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:40.249124 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:40.250450 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:40.250938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:40.660312 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:40.668169 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-cf70d3eb-a037-4be4-a21d-e2aefa486bda tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1316 microversion: 2.1 time: 0.431285 May 07 22:29:40.668751 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3271/6568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:40 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:40.701422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-ef17b334-74d6-41bf-b4ef-3bb1f0ad1735 req-8ec67560-c0f2-4e37-b4bd-cdc8bc20f044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a524c004-9e63-4ff9-9b20-839398f5eefb", "tag": "e916cbd4-3734-4867-9a4c-7957b9d9d9ca"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:40.714397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ef17b334-74d6-41bf-b4ef-3bb1f0ad1735 req-8ec67560-c0f2-4e37-b4bd-cdc8bc20f044 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:40.714926 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-ef17b334-74d6-41bf-b4ef-3bb1f0ad1735 req-8ec67560-c0f2-4e37-b4bd-cdc8bc20f044 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:40.728968 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-ef17b334-74d6-41bf-b4ef-3bb1f0ad1735 req-8ec67560-c0f2-4e37-b4bd-cdc8bc20f044 service nova] Creating event network-changed:e916cbd4-3734-4867-9a4c-7957b9d9d9ca for instance a524c004-9e63-4ff9-9b20-839398f5eefb on nch2-master-1 May 07 22:29:40.733847 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-ef17b334-74d6-41bf-b4ef-3bb1f0ad1735 req-8ec67560-c0f2-4e37-b4bd-cdc8bc20f044 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036135 May 07 22:29:40.734509 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3298/6569] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:41.684379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:41.685221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:41.692647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:41.693118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:41.693906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:41.694360 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:41.822934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:41.830596 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a6508ae7-28c2-4c1c-8bb5-5f0e9e12b650 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1316 microversion: 2.1 time: 0.150051 May 07 22:29:41.831759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3272/6570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:41 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:42.848932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:42.849637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:42.855948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:42.856430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:42.857193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:42.857637 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:42.997685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:43.005983 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8487a523-be34-4f77-8fb5-41933637d46f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1316 microversion: 2.1 time: 0.162152 May 07 22:29:43.006558 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3299/6571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:42 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:44.023170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:44.023825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:44.030046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:44.030514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:44.031329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:44.031815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:44.164409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:44.172068 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6db3ea1d-98c0-4818-a69c-b290df4c800e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1316 microversion: 2.1 time: 0.153158 May 07 22:29:44.172641 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3273/6572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:44 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:45.188884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:45.189513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:45.196401 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:45.196867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:45.197650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:45.198100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:45.325694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:45.333478 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ce8b0bd3-0413-4734-b727-08287fd96198 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1316 microversion: 2.1 time: 0.148579 May 07 22:29:45.334041 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3300/6573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:45 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:45.728839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1d576e74-4509-45e3-88e4-39886634fa17 req-d71f0fce-3ae4-4f12-878f-58cb1962715f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a524c004-9e63-4ff9-9b20-839398f5eefb", "name": "network-vif-plugged", "status": "completed", "tag": "e916cbd4-3734-4867-9a4c-7957b9d9d9ca"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:45.738589 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1d576e74-4509-45e3-88e4-39886634fa17 req-d71f0fce-3ae4-4f12-878f-58cb1962715f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:45.739080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1d576e74-4509-45e3-88e4-39886634fa17 req-d71f0fce-3ae4-4f12-878f-58cb1962715f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:45.750015 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1d576e74-4509-45e3-88e4-39886634fa17 req-d71f0fce-3ae4-4f12-878f-58cb1962715f service nova] Creating event network-vif-plugged:e916cbd4-3734-4867-9a4c-7957b9d9d9ca for instance a524c004-9e63-4ff9-9b20-839398f5eefb on nch2-master-1 May 07 22:29:45.754949 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1d576e74-4509-45e3-88e4-39886634fa17 req-d71f0fce-3ae4-4f12-878f-58cb1962715f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029845 May 07 22:29:45.755547 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3274/6574] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:46.350452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:46.351184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:46.358080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:46.358545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:46.360243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:46.360711 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:46.496284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:46.504152 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5295d0c0-95d7-4474-8bbf-59bc8e8a4905 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1316 microversion: 2.1 time: 0.157989 May 07 22:29:46.504922 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3301/6575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:46 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:47.522306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:47.523075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:47.529307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:47.529771 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:47.530547 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:47.531029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:47.657899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:47.665265 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-bee6e90a-24c8-42fe-8dc9-83c7cd0a5b65 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1506 microversion: 2.1 time: 0.147975 May 07 22:29:47.665836 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3275/6576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:47 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:47.722893 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1201118282", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "f2975d03-209e-4fce-88c6-92b80d15feea"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:47.777011 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] validate_networks() for [('f2975d03-209e-4fce-88c6-92b80d15feea', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:29:48.134360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:29:48.134845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:29:48.135359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:29:48.135780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:29:48.136204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:29:48.145513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:48.145975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:48.146818 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:48.147278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:48.164373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Getting quotas for project 513bc8fe3df847c2914e5d3e465e864f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:29:48.169892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Getting quotas for user 1bc01d9efcd942f7b17489817b1c6af0 and project 513bc8fe3df847c2914e5d3e465e864f. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:29:48.182062 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:29:48.184345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:29:48.232683 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ef596d91-3fa2-4866-b7b5-8d76e5d856e0 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513652 May 07 22:29:48.233369 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3302/6577] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:29:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:29:48.243238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1fc5ddc0-aa04-43c9-86f4-79b32d9f5fdb tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:48.243880 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1fc5ddc0-aa04-43c9-86f4-79b32d9f5fdb tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:48.303354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1fc5ddc0-aa04-43c9-86f4-79b32d9f5fdb tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:48.310052 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1fc5ddc0-aa04-43c9-86f4-79b32d9f5fdb tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1217 microversion: 2.1 time: 0.070686 May 07 22:29:48.310624 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3276/6578] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:48 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:49.334359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:49.335013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:49.341070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:49.341532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:49.342311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:49.342760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:49.418705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:49.426981 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c581f7b5-bf76-4c52-8dfb-6b4400ad9b28 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1275 microversion: 2.1 time: 0.097395 May 07 22:29:49.427562 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3303/6579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:49 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:50.444581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:50.445251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:50.455061 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2854c33f-912e-427d-82e7-892dc6e007a4 req-1c35e923-d1a4-46c8-b60b-33b4864bac78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf0d7a82-c146-4ead-9901-e953dbd16ce2", "tag": "32e81fe2-b79c-425b-b366-1961f8eadc69"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:50.465126 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:50.465606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:50.466591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2854c33f-912e-427d-82e7-892dc6e007a4 req-1c35e923-d1a4-46c8-b60b-33b4864bac78 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:50.467274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2854c33f-912e-427d-82e7-892dc6e007a4 req-1c35e923-d1a4-46c8-b60b-33b4864bac78 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:50.478284 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:50.478970 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:50.480458 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2854c33f-912e-427d-82e7-892dc6e007a4 req-1c35e923-d1a4-46c8-b60b-33b4864bac78 service nova] Creating event network-changed:32e81fe2-b79c-425b-b366-1961f8eadc69 for instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 on nch1-master-1 May 07 22:29:50.485830 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2854c33f-912e-427d-82e7-892dc6e007a4 req-1c35e923-d1a4-46c8-b60b-33b4864bac78 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035254 May 07 22:29:50.486439 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3304/6580] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:29:50.611004 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:50.618502 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3cc5efb2-c3bf-4357-a100-e66393d7d972 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1317 microversion: 2.1 time: 0.178076 May 07 22:29:50.619118 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3277/6581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:50 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:51.637523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:51.638273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:51.645136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:51.645600 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:51.646383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:51.646851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:51.852594 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:51.860620 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5feecc83-3134-4b9e-8429-a72a0a4337e2 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1317 microversion: 2.1 time: 0.228215 May 07 22:29:51.861213 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3305/6582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:51 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:52.876892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:52.877441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:52.884232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:52.884707 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:52.885491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:52.885953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:53.017548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:53.024863 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c23b6a51-6f21-4852-9289-8fac4b594538 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1317 microversion: 2.1 time: 0.152020 May 07 22:29:53.025436 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3278/6583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:52 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:54.042047 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:54.042676 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:54.050143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:54.050607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:54.051419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:54.051873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:54.186044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:54.193554 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8d566167-e998-47ab-b6ad-0acf74c0d469 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1317 microversion: 2.1 time: 0.155764 May 07 22:29:54.194174 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3306/6584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:54 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:55.147392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-ba168033-a679-4c83-892c-c3bd7a7fb392 req-fb5767b8-c52a-427a-887b-c789b7ebe293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0d7a82-c146-4ead-9901-e953dbd16ce2", "name": "network-vif-plugged", "status": "completed", "tag": "32e81fe2-b79c-425b-b366-1961f8eadc69"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:55.157937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ba168033-a679-4c83-892c-c3bd7a7fb392 req-fb5767b8-c52a-427a-887b-c789b7ebe293 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:55.158409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-ba168033-a679-4c83-892c-c3bd7a7fb392 req-fb5767b8-c52a-427a-887b-c789b7ebe293 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:55.171099 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-ba168033-a679-4c83-892c-c3bd7a7fb392 req-fb5767b8-c52a-427a-887b-c789b7ebe293 service nova] Creating event network-vif-plugged:32e81fe2-b79c-425b-b366-1961f8eadc69 for instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 on nch1-master-1 May 07 22:29:55.176146 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-ba168033-a679-4c83-892c-c3bd7a7fb392 req-fb5767b8-c52a-427a-887b-c789b7ebe293 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 May 07 22:29:55.176972 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3279/6585] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:29:55.212296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:55.212939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:55.221874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:55.222555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:55.223384 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:55.223836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:55.401406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:55.410410 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-40e3c8cf-a287-48f8-a1b8-a2c44102c7ad tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1317 microversion: 2.1 time: 0.203105 May 07 22:29:55.411309 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3307/6586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:55 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:56.432352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:56.433105 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:56.440278 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:56.440748 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:56.441538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:56.441991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:56.583738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:56.591461 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e7e69211-d96b-4c38-ad2c-cdfc39c8d01b tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1317 microversion: 2.1 time: 0.164174 May 07 22:29:56.592055 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3280/6587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:56 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:57.609648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:57.610305 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:57.617221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:57.617684 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:57.618465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:57.618955 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:57.750022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:57.757487 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03780530-30fd-41ec-b09c-97cc45980a3d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1506 microversion: 2.1 time: 0.152502 May 07 22:29:57.758064 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3308/6588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:57 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:57.773436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:57.773986 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:57.781204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:57.781676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:57.782456 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:57.782949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:57.808233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:29:57.881637 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14125bdf-b92b-4d1c-9073-5178f137db11 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 204 len: 0 microversion: 2.1 time: 0.111805 May 07 22:29:57.882476 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3281/6589] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:29:57 2022] DELETE /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:29:57.891338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:57.891960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:57.898105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:57.898561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:57.899375 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:57.899822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:58.034927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:58.042518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d243d0ad-0ae7-4338-91e7-103fd9c4a8cf tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1512 microversion: 2.1 time: 0.155745 May 07 22:29:58.043135 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3309/6590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:57 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:59.060070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:29:59.060816 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:29:59.068060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:59.068523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:59.069303 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:59.069749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:59.200132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:29:59.208738 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-755aa1d7-3152-429a-ac2b-4ed9d84dabaa tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 200 len: 1512 microversion: 2.1 time: 0.152880 May 07 22:29:59.209547 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3282/6591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:29:59 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:29:59.573981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-06d49129-9e0d-44b4-879a-d18beb8a21f5 req-10c5510f-ee5e-4649-826e-cb54f4eb4c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf0d7a82-c146-4ead-9901-e953dbd16ce2", "name": "network-vif-deleted", "tag": "32e81fe2-b79c-425b-b366-1961f8eadc69"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:29:59.587617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-06d49129-9e0d-44b4-879a-d18beb8a21f5 req-10c5510f-ee5e-4649-826e-cb54f4eb4c77 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:29:59.588367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-06d49129-9e0d-44b4-879a-d18beb8a21f5 req-10c5510f-ee5e-4649-826e-cb54f4eb4c77 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:29:59.602216 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-06d49129-9e0d-44b4-879a-d18beb8a21f5 req-10c5510f-ee5e-4649-826e-cb54f4eb4c77 service nova] Creating event network-vif-deleted:32e81fe2-b79c-425b-b366-1961f8eadc69 for instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 on nch1-master-1 May 07 22:29:59.607468 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-06d49129-9e0d-44b4-879a-d18beb8a21f5 req-10c5510f-ee5e-4649-826e-cb54f4eb4c77 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037402 May 07 22:29:59.608078 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3310/6592] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:30:00.225544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:00.226183 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.233093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.233565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.234346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.234832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.248331 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] HTTP exception thrown: Instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 could not be found. May 07 22:30:00.248942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Returning 404 to user: Instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:30:00.249814 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ff6e4ce8-6feb-41f1-96b8-eb165d5d2e45 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 404 len: 111 microversion: 2.1 time: 0.028307 May 07 22:30:00.250354 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3283/6593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:00 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:30:00.259414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:00.260157 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.266919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.267378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.268153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.268601 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.410741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:00.418454 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8e377fa3-48da-411e-8541-546f6295f958 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1506 microversion: 2.1 time: 0.163309 May 07 22:30:00.419135 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3311/6594] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:00 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:00.434872 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6ad598d3-4ca4-4ed7-9c15-27a1e9bc0f8c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:00.435922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6ad598d3-4ca4-4ed7-9c15-27a1e9bc0f8c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: d735dacf-0f9c-43e3-87b8-7351f461d9df] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.441326 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6ad598d3-4ca4-4ed7-9c15-27a1e9bc0f8c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] HTTP exception thrown: Instance d735dacf-0f9c-43e3-87b8-7351f461d9df could not be found. May 07 22:30:00.441916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6ad598d3-4ca4-4ed7-9c15-27a1e9bc0f8c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Returning 404 to user: Instance d735dacf-0f9c-43e3-87b8-7351f461d9df could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:30:00.442743 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6ad598d3-4ca4-4ed7-9c15-27a1e9bc0f8c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "POST /compute/v2.1/servers/d735dacf-0f9c-43e3-87b8-7351f461d9df/action" status: 404 len: 111 microversion: 2.1 time: 0.011998 May 07 22:30:00.443291 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3284/6595] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:30:00 2022] POST /compute/v2.1/servers/d735dacf-0f9c-43e3-87b8-7351f461d9df/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:30:00.451049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:00.451610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.458029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.458485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.459290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.459763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.588130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:00.595969 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0ba171f3-6b86-4bcc-8af3-725db1791a1e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1506 microversion: 2.1 time: 0.148798 May 07 22:30:00.596547 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3312/6596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:00 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:30:00.613825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:00.614462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.621405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.621902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.622686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.623168 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.752272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:00.759654 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-150245ab-e98e-4516-abf3-4a108c2036af tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1506 microversion: 2.1 time: 0.149640 May 07 22:30:00.760225 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3285/6597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:00 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:00.775970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "95fc3ccd-37fd-48b3-ade0-bb297ae12c0a"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:00.776958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.783366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.783829 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.784602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.785049 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.813383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:00.818372 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] HTTP exception thrown: Flavor 95fc3ccd-37fd-48b3-ade0-bb297ae12c0a could not be found. May 07 22:30:00.819008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Returning 400 to user: Flavor 95fc3ccd-37fd-48b3-ade0-bb297ae12c0a could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:30:00.819849 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0229a74a-fe14-481d-afbc-cc4858758e55 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "POST /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb/action" status: 400 len: 107 microversion: 2.1 time: 0.047918 May 07 22:30:00.820415 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3313/6598] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:30:00 2022] POST /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb/action => generated 107 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:30:00.828666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:00.829304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.835207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.835684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.836479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.836943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.964020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:00.972063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f16812b0-8caa-4980-af7d-74b276160559 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1506 microversion: 2.1 time: 0.147296 May 07 22:30:00.972650 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3286/6599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:00 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:00.988714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:00.989367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:00.995363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.995831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:00.996608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:00.997058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.129224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:01.136745 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fdb50712-a3f8-4298-b9e5-d78cd3a5440f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1506 microversion: 2.1 time: 0.151866 May 07 22:30:01.137321 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3314/6600] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:00 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:01.153358 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d0280c0-8965-4087-b227-bbab28d3064d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:01.154506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9d0280c0-8965-4087-b227-bbab28d3064d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:30:01.155369 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9d0280c0-8965-4087-b227-bbab28d3064d tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "POST /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb/action" status: 400 len: 113 microversion: 2.1 time: 0.005955 May 07 22:30:01.156531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3287/6601] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:30:01 2022] POST /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb/action => generated 113 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 07 22:30:01.163860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:01.164492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:01.170656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.171158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.171956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.172404 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.298960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:01.306312 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3abe6b95-6259-466b-a71c-8d971aa5b91c tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1506 microversion: 2.1 time: 0.146064 May 07 22:30:01.306906 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3315/6602] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:01 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:01.327035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:01.328146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:01.337439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.337850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.338635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.339156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.351951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] HTTP exception thrown: Instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 could not be found. May 07 22:30:01.352552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Returning 404 to user: Instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:30:01.353396 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b7bda22-4709-401a-beca-27b352245724 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 404 len: 111 microversion: 2.1 time: 0.031094 May 07 22:30:01.353929 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3288/6603] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:30:01 2022] DELETE /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:30:01.361846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:01.362468 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: cf0d7a82-c146-4ead-9901-e953dbd16ce2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:01.368428 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.368890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.369662 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.370109 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.384040 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] HTTP exception thrown: Instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 could not be found. May 07 22:30:01.384659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Returning 404 to user: Instance cf0d7a82-c146-4ead-9901-e953dbd16ce2 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:30:01.385491 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-49f2ac7a-b0d0-403c-ab27-87b68c5d9aff tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2" status: 404 len: 111 microversion: 2.1 time: 0.027547 May 07 22:30:01.386018 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3316/6604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:01 2022] GET /compute/v2.1/servers/cf0d7a82-c146-4ead-9901-e953dbd16ce2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:30:01.394404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:01.394954 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:01.400866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.401332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.402116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.402573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.426680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:30:01.505663 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1819e246-a245-462b-b176-49341fa1637a tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 204 len: 0 microversion: 2.1 time: 0.115265 May 07 22:30:01.506434 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3289/6605] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:30:01 2022] DELETE /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:30:01.514360 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:01.515666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:01.521627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.522086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.522909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:01.523365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:01.657547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:01.664935 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bcf3b350-28d0-4725-848e-b7a4b4bc64b7 tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1512 microversion: 2.1 time: 0.154438 May 07 22:30:01.665507 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3317/6606] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:01 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:02.687789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:02.688518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:02.695317 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:02.695825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:02.696622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:02.697083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:02.825386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01d9efcd942f7b17489817b1c6af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513bc8fe3df847c2914e5d3e465e864f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:02.833523 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4a96e2ab-7b5a-4a05-85c4-72e8869af61e tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 200 len: 1512 microversion: 2.1 time: 0.150017 May 07 22:30:02.834113 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3290/6607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:02 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:03.310197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e77c9df1-ba21-4f3e-8757-c615f9185edc req-0e930e5c-21ba-4efa-900d-cb0460b98b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a524c004-9e63-4ff9-9b20-839398f5eefb", "name": "network-vif-deleted", "tag": "e916cbd4-3734-4867-9a4c-7957b9d9d9ca"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:03.319390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e77c9df1-ba21-4f3e-8757-c615f9185edc req-0e930e5c-21ba-4efa-900d-cb0460b98b8f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:03.319848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e77c9df1-ba21-4f3e-8757-c615f9185edc req-0e930e5c-21ba-4efa-900d-cb0460b98b8f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:03.331870 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e77c9df1-ba21-4f3e-8757-c615f9185edc req-0e930e5c-21ba-4efa-900d-cb0460b98b8f service nova] Creating event network-vif-deleted:e916cbd4-3734-4867-9a4c-7957b9d9d9ca for instance a524c004-9e63-4ff9-9b20-839398f5eefb on nch2-master-1 May 07 22:30:03.336713 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e77c9df1-ba21-4f3e-8757-c615f9185edc req-0e930e5c-21ba-4efa-900d-cb0460b98b8f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030253 May 07 22:30:03.337321 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3318/6608] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:30:03.850987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:03.851627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] [instance: a524c004-9e63-4ff9-9b20-839398f5eefb] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:03.858464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:03.859506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:03.860306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:03.860774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:03.877713 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] HTTP exception thrown: Instance a524c004-9e63-4ff9-9b20-839398f5eefb could not be found. May 07 22:30:03.878328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] Returning 404 to user: Instance a524c004-9e63-4ff9-9b20-839398f5eefb could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:30:03.879215 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-30ad067f-13b9-40e8-afd9-415baea31b3f tempest-ServersNegativeTestJSON-1361178991 tempest-ServersNegativeTestJSON-1361178991-project] 10.222.0.32 "GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb" status: 404 len: 111 microversion: 2.1 time: 0.032278 May 07 22:30:03.879767 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3291/6609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:03 2022] GET /compute/v2.1/servers/a524c004-9e63-4ff9-9b20-839398f5eefb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:30:40.757891 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:30:40.758825 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:30:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:30:41.419301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a9b7e33e-e07d-4255-a93e-42f7c06bb98f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Action: 'create', calling method: .version_select at 0x7fc4225cfaf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1593419953"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:41.432995 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a9b7e33e-e07d-4255-a93e-42f7c06bb98f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Getting quotas for project 42b928f3be814de2bf73bded06b23fd4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:30:41.438054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a9b7e33e-e07d-4255-a93e-42f7c06bb98f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Getting quotas for user 96de17f60f6047f2a1886aa8e80354c8 and project 42b928f3be814de2bf73bded06b23fd4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:30:41.559996 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a9b7e33e-e07d-4255-a93e-42f7c06bb98f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Getting quotas for project 42b928f3be814de2bf73bded06b23fd4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:30:41.565056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-a9b7e33e-e07d-4255-a93e-42f7c06bb98f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Getting quotas for user 96de17f60f6047f2a1886aa8e80354c8 and project 42b928f3be814de2bf73bded06b23fd4. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:30:41.580006 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a9b7e33e-e07d-4255-a93e-42f7c06bb98f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.166511 May 07 22:30:41.580638 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3319/6610] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:30:41 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:41.636606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-324798308", "imageRef": "a12af174-1a2a-4a80-a73b-a10938d77267", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1593419953", "networks": [{"uuid": "911f7ebe-0e4c-46f0-8810-404a7aa9cfab"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:41.686580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] validate_networks() for [('911f7ebe-0e4c-46f0-8810-404a7aa9cfab', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:30:42.062442 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:30:42.063107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:30:42.063407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:30:42.063831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:30:42.064265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:30:42.072777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:42.073241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:42.074052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:42.074506 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:42.091535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Getting quotas for project 42b928f3be814de2bf73bded06b23fd4. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:30:42.096611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Getting quotas for user 96de17f60f6047f2a1886aa8e80354c8 and project 42b928f3be814de2bf73bded06b23fd4. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:30:42.108927 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:30:42.111151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a12af174-1a2a-4a80-a73b-a10938d77267',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:30:42.155528 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5909acf-ee9f-4057-917b-02ca67f6ad48 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523133 May 07 22:30:42.156203 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3292/6611] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:30:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:30:42.166682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4fc569e0-b5e0-4a97-89db-d394d8626521 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:42.167566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4fc569e0-b5e0-4a97-89db-d394d8626521 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:42.227205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4fc569e0-b5e0-4a97-89db-d394d8626521 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:42.235111 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4fc569e0-b5e0-4a97-89db-d394d8626521 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1258 microversion: 2.1 time: 0.072648 May 07 22:30:42.235684 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3320/6612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:42 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:43.253943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:43.254839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:43.262295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:43.262701 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:43.263536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:43.263991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:43.347338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:43.356549 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-208a3cc2-0312-4005-83e1-4e06fae6bcae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1316 microversion: 2.1 time: 0.108016 May 07 22:30:43.357240 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3293/6613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:43 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:44.374727 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:44.376010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:44.387892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:44.388638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:44.389611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:44.390246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:44.543396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:44.551753 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b808ffe7-2aa1-4b79-aea9-c3e5c66b61f8 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.182020 May 07 22:30:44.552347 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3321/6614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:44 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:45.569078 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:45.570068 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:45.577902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:45.580558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:45.581523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:45.582400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:45.735243 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:45.743123 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-67f51820-ae6f-4066-b133-37c15d45f5ea tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.177977 May 07 22:30:45.747867 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3294/6615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:45 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:46.761153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:46.766790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:46.774557 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:46.775394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:46.776494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:46.777315 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:46.946905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:46.956952 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bb5d4569-5599-4c2e-b661-30c7bb661614 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.199731 May 07 22:30:46.957914 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3322/6616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:46 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:47.974272 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:47.975224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:47.987114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:47.987765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:47.988775 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:47.989366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:48.136767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:48.145319 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54596b29-b6fe-474c-ad1e-75454a2beb1e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.174984 May 07 22:30:48.155573 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3295/6617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:47 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:49.163000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:49.163646 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:49.171193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:49.171659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:49.172458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:49.172915 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:49.336293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:49.346484 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6a01bb3-7365-4c94-babe-461bf6609a8a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.187917 May 07 22:30:49.347561 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3323/6618] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:49 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:50.364309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:50.364947 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:50.372113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:50.372586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:50.373382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:50.374512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:50.574593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:50.574593 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c2533a4-3f33-4904-910e-c4ef38a90616 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.174166 May 07 22:30:50.574593 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3296/6619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:50 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:51.501823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-bc4761ad-f185-4152-8f69-64c09da36066 req-a17d616c-8d45-471a-a5c6-0989644249ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac17638e-6dd6-4f75-8473-22f89b9e1e56", "tag": "3bfbd29b-32ec-4b40-b0ab-497ba05496e8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:51.516708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bc4761ad-f185-4152-8f69-64c09da36066 req-a17d616c-8d45-471a-a5c6-0989644249ed service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:51.517486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bc4761ad-f185-4152-8f69-64c09da36066 req-a17d616c-8d45-471a-a5c6-0989644249ed service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:51.536474 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-bc4761ad-f185-4152-8f69-64c09da36066 req-a17d616c-8d45-471a-a5c6-0989644249ed service nova] Creating event network-changed:3bfbd29b-32ec-4b40-b0ab-497ba05496e8 for instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 on nch2-master-1 May 07 22:30:51.542118 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-bc4761ad-f185-4152-8f69-64c09da36066 req-a17d616c-8d45-471a-a5c6-0989644249ed service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044578 May 07 22:30:51.542980 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3324/6620] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:30:51.551930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:51.553159 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:51.560219 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:51.560692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:51.562040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:51.562498 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:51.793492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:51.801328 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f6fae339-cd0f-4746-a70c-a25f081b8099 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.253265 May 07 22:30:51.802238 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3297/6621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:51 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:30:52.819161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:52.819878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:52.827652 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:52.828118 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:52.828909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:52.829362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:52.963824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:52.971880 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-32d23382-232b-4ee4-af14-a36cefd70f2c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.156981 May 07 22:30:52.972463 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3325/6622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:52 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:53.993570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:53.994039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:54.001682 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:54.002148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:54.002960 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:54.003413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:54.132131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:54.139633 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f4e679a-86f9-4719-9d4c-f201073a789c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.152205 May 07 22:30:54.140226 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3298/6623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:53 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:55.158654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:55.159268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:55.166423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:55.166918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:55.167702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:55.168156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:55.299086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:55.306526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b0983d9b-2395-4b4b-884c-ce3e3a2d2b1a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.152504 May 07 22:30:55.307157 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3326/6624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:55 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:56.085917 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-471b2ea8-9234-4888-952f-bf2a97cbe8ba req-3b4fc32c-5a79-4a57-97f0-5d2034e5f0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac17638e-6dd6-4f75-8473-22f89b9e1e56", "name": "network-vif-plugged", "status": "completed", "tag": "3bfbd29b-32ec-4b40-b0ab-497ba05496e8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:56.097030 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-471b2ea8-9234-4888-952f-bf2a97cbe8ba req-3b4fc32c-5a79-4a57-97f0-5d2034e5f0e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:56.098080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-471b2ea8-9234-4888-952f-bf2a97cbe8ba req-3b4fc32c-5a79-4a57-97f0-5d2034e5f0e1 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:56.110640 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-471b2ea8-9234-4888-952f-bf2a97cbe8ba req-3b4fc32c-5a79-4a57-97f0-5d2034e5f0e1 service nova] Creating event network-vif-plugged:3bfbd29b-32ec-4b40-b0ab-497ba05496e8 for instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 on nch2-master-1 May 07 22:30:56.115844 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-471b2ea8-9234-4888-952f-bf2a97cbe8ba req-3b4fc32c-5a79-4a57-97f0-5d2034e5f0e1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033763 May 07 22:30:56.116438 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3299/6625] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:30:56.323602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:56.324228 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:56.331154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:56.331616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:56.332387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:56.332835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:56.463822 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:56.471872 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-33a57f39-f316-4ab1-a293-cfb2bdc581e0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1358 microversion: 2.1 time: 0.152154 May 07 22:30:56.472460 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3327/6626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:56 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:57.489248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:57.490008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:57.497132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.497604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:57.498924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.499390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:57.634472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:57.642653 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f747a470-d13c-496a-9e23-f8ee737ff660 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1548 microversion: 2.1 time: 0.157744 May 07 22:30:57.643263 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3300/6627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:57 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:57.658790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:57.659423 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:57.666586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.667089 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:57.667872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.668321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:57.794387 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:57.801898 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ab0d6008-4b99-4400-a805-daa3d8f19b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1548 microversion: 2.1 time: 0.147084 May 07 22:30:57.802493 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3328/6628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:57 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:57.817948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:57.821251 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:57.822040 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Searching by: {'deleted': False, 'project_id': '42b928f3be814de2bf73bded06b23fd4'} {{(pid=136681) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 07 22:30:57.827854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.828318 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:57.829130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.829584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:57.852273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.multi_cell_list [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 07 22:30:57.885595 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-149e0c2a-0cb9-4c6d-a50f-d3513b211e13 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071295 May 07 22:30:57.888368 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3301/6629] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 22:30:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:30:57.898150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:30:57.898794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:57.904920 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.905386 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:57.906165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:57.906617 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:58.039138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:30:58.046905 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c2c3dc73-437c-43e4-b39f-f47383aef7da tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1548 microversion: 2.1 time: 0.152759 May 07 22:30:58.047487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3329/6630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:30:57 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:30:59.550347 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-43639d21-1669-49ed-8d5b-7894aa0ba955 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81f278a7-4744-462b-9dcf-b548d1819434"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:30:59.551470 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-43639d21-1669-49ed-8d5b-7894aa0ba955 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:30:59.558336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43639d21-1669-49ed-8d5b-7894aa0ba955 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:59.558827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43639d21-1669-49ed-8d5b-7894aa0ba955 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:59.559622 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43639d21-1669-49ed-8d5b-7894aa0ba955 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:30:59.560083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-43639d21-1669-49ed-8d5b-7894aa0ba955 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:30:59.962371 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-43639d21-1669-49ed-8d5b-7894aa0ba955 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415813 May 07 22:30:59.963208 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3302/6631] 10.222.0.32 () {60 vars in 1322 bytes} [Sat May 7 22:30:59 2022] POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:31:02.231060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:02.231713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:02.238422 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:02.238916 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:02.239695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:02.240146 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:02.473307 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:02.481247 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dfe93d89-bfd1-4fa4-a66c-c70b8f2cbd09 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1594 microversion: 2.1 time: 0.254128 May 07 22:31:02.481815 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3330/6632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:02 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1594 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:04.155190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-897f0344-338c-4787-bee4-f1471d3f12cf req-fd3b27d2-8907-45c8-9625-73a41fe6f843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac17638e-6dd6-4f75-8473-22f89b9e1e56", "tag": "3bfbd29b-32ec-4b40-b0ab-497ba05496e8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:31:04.165596 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-897f0344-338c-4787-bee4-f1471d3f12cf req-fd3b27d2-8907-45c8-9625-73a41fe6f843 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:04.166326 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-897f0344-338c-4787-bee4-f1471d3f12cf req-fd3b27d2-8907-45c8-9625-73a41fe6f843 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:04.178597 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-897f0344-338c-4787-bee4-f1471d3f12cf req-fd3b27d2-8907-45c8-9625-73a41fe6f843 service nova] Creating event network-changed:3bfbd29b-32ec-4b40-b0ab-497ba05496e8 for instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 on nch2-master-1 May 07 22:31:04.184076 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-897f0344-338c-4787-bee4-f1471d3f12cf req-fd3b27d2-8907-45c8-9625-73a41fe6f843 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033948 May 07 22:31:04.185402 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3303/6633] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:31:05.608901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-593561874"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:31:05.609484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:05.616595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:05.617140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:05.617921 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:05.618370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:05.745330 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.network.security_group_api [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Adding security group a6b8d8fb-a299-4fa8-9cae-15d996012636 to port 3bfbd29b-32ec-4b40-b0ab-497ba05496e8 May 07 22:31:06.433179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d8eeff87-1f8b-48e7-aebb-159a8b727aae tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/action" status: 202 len: 0 microversion: 2.1 time: 0.828699 May 07 22:31:06.434348 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3331/6634] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:31:05 2022] POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:31:06.439363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-bdce2f92-7d41-4961-98df-baa9bda1276f req-a55cbb00-f9ed-4da5-bddf-204996a5d1ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac17638e-6dd6-4f75-8473-22f89b9e1e56", "tag": "3bfbd29b-32ec-4b40-b0ab-497ba05496e8"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:31:06.443107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:06.443738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:06.449947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:06.450451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:06.451751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:06.453273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:06.457319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bdce2f92-7d41-4961-98df-baa9bda1276f req-a55cbb00-f9ed-4da5-bddf-204996a5d1ac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:06.457796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-bdce2f92-7d41-4961-98df-baa9bda1276f req-a55cbb00-f9ed-4da5-bddf-204996a5d1ac service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:06.482933 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-bdce2f92-7d41-4961-98df-baa9bda1276f req-a55cbb00-f9ed-4da5-bddf-204996a5d1ac service nova] Creating event network-changed:3bfbd29b-32ec-4b40-b0ab-497ba05496e8 for instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 on nch2-master-1 May 07 22:31:06.496971 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-bdce2f92-7d41-4961-98df-baa9bda1276f req-a55cbb00-f9ed-4da5-bddf-204996a5d1ac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062995 May 07 22:31:06.511971 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3304/6635] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:31:06.641263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:06.650364 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5489eaf7-0763-4563-a118-37def0a60c39 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1759 microversion: 2.1 time: 0.211002 May 07 22:31:06.661515 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3332/6636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:06 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1759 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:31.069064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-24ee857c-3a44-4157-9951-8c5c98ce959b tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:31:31.070118 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-24ee857c-3a44-4157-9951-8c5c98ce959b tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:31.076790 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ee857c-3a44-4157-9951-8c5c98ce959b tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:31.077797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ee857c-3a44-4157-9951-8c5c98ce959b tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:31.078580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ee857c-3a44-4157-9951-8c5c98ce959b tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:31.079057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ee857c-3a44-4157-9951-8c5c98ce959b tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:31.147676 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-24ee857c-3a44-4157-9951-8c5c98ce959b tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/action" status: 202 len: 0 microversion: 2.1 time: 0.082862 May 07 22:31:31.148366 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3305/6637] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:31:31 2022] POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:31:31.157264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:31.157909 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:31.164885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:31.165340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:31.166579 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:31.166987 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:31.324904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:31.334740 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6ccc5c5f-2c41-4903-84ed-039beb498d74 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1751 microversion: 2.1 time: 0.180864 May 07 22:31:31.335363 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3333/6638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:31 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:32.353380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:32.354102 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:32.360362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:32.360833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:32.361613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:32.362070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:32.501800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:32.509978 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-eed31711-af11-49e2-b275-a09a920a7238 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.161696 May 07 22:31:32.510553 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3306/6639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:32 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:33.528265 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:33.528885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:33.535782 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:33.536242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:33.537007 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:33.537443 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:33.679008 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:33.687546 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-60496a79-84d2-4d44-9980-071957a297df tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.163230 May 07 22:31:33.688130 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3334/6640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:33 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:34.704736 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:34.705373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:34.712215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:34.712687 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:34.713465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:34.713951 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:34.858731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:34.866475 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d8340ccd-94bb-4889-8069-5a16fcbee5cb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.165694 May 07 22:31:34.867084 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3307/6641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:34 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:35.884114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:35.884653 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:35.891771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:35.892236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:35.893017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:35.893467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:36.031226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:36.039214 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5ea6d6c8-21ee-4c32-acc6-2857f863779e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.159308 May 07 22:31:36.039793 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3335/6642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:35 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:37.056639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:37.057293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:37.064106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:37.064577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:37.065354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:37.065899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:37.206468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:37.214461 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9078eb0e-26f7-445f-93a3-f8af93193631 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.161707 May 07 22:31:37.215068 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3308/6643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:37 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:38.234044 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:38.234661 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:38.241532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:38.241984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:38.242753 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:38.243223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:38.385207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:38.393581 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44de9039-de0b-4de1-8e57-ffa2f415d5b7 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.164107 May 07 22:31:38.394154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3336/6644] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:38 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:39.411424 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:39.412064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:39.419144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:39.419620 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:39.420411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:39.420870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:39.561016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:39.569476 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c7d4a2b2-6205-4545-b9b5-b4d016e64f44 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.161924 May 07 22:31:39.570051 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3309/6645] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:39 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:40.586884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:40.587546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:40.595048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:40.595520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:40.596293 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:40.596744 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:40.735985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:40.743832 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-afd901f0-fc21-4b94-9040-1219d9a8670a tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.160893 May 07 22:31:40.744404 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3337/6646] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:40 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:41.761104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:41.761747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:41.768678 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:41.769153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:41.769944 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:41.770403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:41.914075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:41.922909 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6197e630-3115-4feb-8726-af935a978b53 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.165756 May 07 22:31:41.923486 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3310/6647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:41 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:42.940721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:42.941331 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:42.948256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:42.948721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:42.949500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:42.949979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:43.100237 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:43.108310 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d5b6f8ee-ab5a-4ffd-ba68-5fa6cc0f7ca3 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.171583 May 07 22:31:43.108888 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3338/6648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:42 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:44.126137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:44.126789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:44.133170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:44.133627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:44.134399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:44.134882 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:44.283750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:44.292061 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f7c82c25-1f2f-49e3-a5f7-cbb933d63b08 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.170525 May 07 22:31:44.292631 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3311/6649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:44 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:45.309544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:45.310152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:45.317238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:45.317705 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:45.318478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:45.318964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:45.458956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:45.468911 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-18a16396-f1ca-4cfe-b6ff-ac4eb6c736eb tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.163303 May 07 22:31:45.470051 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3339/6650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:45 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:46.485985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:46.486628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:46.493628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:46.494099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:46.494928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:46.495390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:46.641144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:46.649113 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-24ce941a-8d70-435e-a57f-b6e58455fa9c tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1756 microversion: 2.1 time: 0.167017 May 07 22:31:46.649687 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3312/6651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:46 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:31:47.665455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:31:47.666343 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:31:47.673252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:47.673720 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:47.674502 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:31:47.674992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:31:47.821759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:31:47.830416 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b698cb64-4414-4408-a99c-7410999264ce tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1759 microversion: 2.1 time: 0.168921 May 07 22:31:47.831033 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3340/6652] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:31:47 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:19.386086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-593561874"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:19.386718 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:19.393700 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:19.394173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:19.395006 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:19.395468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:19.522407 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.network.security_group_api [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Removing security group a6b8d8fb-a299-4fa8-9cae-15d996012636 from port 3bfbd29b-32ec-4b40-b0ab-497ba05496e8 May 07 22:32:19.812115 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:32:19.812422 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:32:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/action (ip 10.222.0.32) !!! May 07 22:32:19.862824 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d33ebbb0-7867-46c0-827d-bf9234350368 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/action" status: 202 len: 0 microversion: 2.1 time: 0.480722 May 07 22:32:19.867414 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3313/6653] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:32:19 2022] POST /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:32:19.875608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-da6f2e94-fa53-4fde-916c-3d1ce36a6822 req-f959393a-87f8-42a0-8209-c2b9378e0446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac17638e-6dd6-4f75-8473-22f89b9e1e56", "tag": "3bfbd29b-32ec-4b40-b0ab-497ba05496e8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:19.888836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-da6f2e94-fa53-4fde-916c-3d1ce36a6822 req-f959393a-87f8-42a0-8209-c2b9378e0446 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:19.889303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-da6f2e94-fa53-4fde-916c-3d1ce36a6822 req-f959393a-87f8-42a0-8209-c2b9378e0446 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:19.901805 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-da6f2e94-fa53-4fde-916c-3d1ce36a6822 req-f959393a-87f8-42a0-8209-c2b9378e0446 service nova] Creating event network-changed:3bfbd29b-32ec-4b40-b0ab-497ba05496e8 for instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 on nch2-master-1 May 07 22:32:19.907562 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-da6f2e94-fa53-4fde-916c-3d1ce36a6822 req-f959393a-87f8-42a0-8209-c2b9378e0446 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036048 May 07 22:32:19.908590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3341/6654] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:32:21.029918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-aa004d35-ba76-407d-8715-9855b94ee8b7 req-ebce8640-772c-4ba0-8cb3-85a2589a01b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac17638e-6dd6-4f75-8473-22f89b9e1e56", "tag": "3bfbd29b-32ec-4b40-b0ab-497ba05496e8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:21.037508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:21.038288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:21.039075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aa004d35-ba76-407d-8715-9855b94ee8b7 req-ebce8640-772c-4ba0-8cb3-85a2589a01b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:21.039534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-aa004d35-ba76-407d-8715-9855b94ee8b7 req-ebce8640-772c-4ba0-8cb3-85a2589a01b7 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:21.045197 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:21.045765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:21.046653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:21.047204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:21.053700 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-aa004d35-ba76-407d-8715-9855b94ee8b7 req-ebce8640-772c-4ba0-8cb3-85a2589a01b7 service nova] Creating event network-changed:3bfbd29b-32ec-4b40-b0ab-497ba05496e8 for instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 on nch2-master-1 May 07 22:32:21.058698 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-aa004d35-ba76-407d-8715-9855b94ee8b7 req-ebce8640-772c-4ba0-8cb3-85a2589a01b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033674 May 07 22:32:21.059533 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3342/6655] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:32:21.143656 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lazy-loading 'services' on Instance uuid ac17638e-6dd6-4f75-8473-22f89b9e1e56 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:32:21.224989 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d39f973e-006b-4ddd-bd0d-f9f89898ea56 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments/81f278a7-4744-462b-9dcf-b548d1819434" status: 202 len: 0 microversion: 2.1 time: 0.203644 May 07 22:32:21.225593 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3314/6656] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:32:21 2022] DELETE /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments/81f278a7-4744-462b-9dcf-b548d1819434 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:32:21.238361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-938c1363-b2ca-4555-a07e-d8eb39ee11f9 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:21.239419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-938c1363-b2ca-4555-a07e-d8eb39ee11f9 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:21.251778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-938c1363-b2ca-4555-a07e-d8eb39ee11f9 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:21.252501 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-938c1363-b2ca-4555-a07e-d8eb39ee11f9 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:21.253381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-938c1363-b2ca-4555-a07e-d8eb39ee11f9 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:21.254319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-938c1363-b2ca-4555-a07e-d8eb39ee11f9 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:21.296431 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-938c1363-b2ca-4555-a07e-d8eb39ee11f9 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066055 May 07 22:32:21.302597 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3343/6657] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:32:21 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:32:22.311204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2272dd44-ce40-460c-b890-6dc30f2916c1 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:22.312346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2272dd44-ce40-460c-b890-6dc30f2916c1 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:22.318821 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2272dd44-ce40-460c-b890-6dc30f2916c1 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:22.319297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2272dd44-ce40-460c-b890-6dc30f2916c1 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:22.320083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2272dd44-ce40-460c-b890-6dc30f2916c1 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:22.320538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2272dd44-ce40-460c-b890-6dc30f2916c1 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:22.348807 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2272dd44-ce40-460c-b890-6dc30f2916c1 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042849 May 07 22:32:22.349373 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3315/6658] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:32:22 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 07 22:32:22.359286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:22.359788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:22.367378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:22.367841 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:22.368650 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:22.369101 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:22.442718 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] HTTP exception thrown: Instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 is not attached to volume 81f278a7-4744-462b-9dcf-b548d1819434 May 07 22:32:22.443365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Returning 404 to user: Instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 is not attached to volume 81f278a7-4744-462b-9dcf-b548d1819434 {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:32:22.444283 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9cf00947-4624-4ac9-bfe5-0a1c7c4c808d tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments/81f278a7-4744-462b-9dcf-b548d1819434" status: 404 len: 154 microversion: 2.1 time: 0.089066 May 07 22:32:22.444834 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3344/6659] 10.222.0.32 () {58 vars in 1415 bytes} [Sat May 7 22:32:22 2022] DELETE /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56/os-volume_attachments/81f278a7-4744-462b-9dcf-b548d1819434 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:32:23.574764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:23.575335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:23.582734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:23.583225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:23.584010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:23.584467 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:23.609492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:32:23.681466 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e49bb46d-4078-42bf-82f5-e1ae990e138e tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 204 len: 0 microversion: 2.1 time: 0.110218 May 07 22:32:23.682198 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3316/6660] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:32:23 2022] DELETE /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:32:23.690942 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:23.691576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:23.698746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:23.699247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:23.700042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:23.700492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:23.834524 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:23.841951 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-79329e25-a71f-4184-bc7c-0c7e8d79e546 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1554 microversion: 2.1 time: 0.155455 May 07 22:32:23.842519 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3345/6661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:23 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:24.860054 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:24.860779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:24.867591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:24.868063 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:24.868851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:24.869311 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:24.995702 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:25.003236 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0e575b3f-6856-4731-bcb0-c23b4371c06f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1554 microversion: 2.1 time: 0.147455 May 07 22:32:25.003824 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3317/6662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:24 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:25.747232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4dd0defb-a417-4924-9df3-e5084de310a4 req-f352ad60-824d-4f67-82a2-621b813ec2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac17638e-6dd6-4f75-8473-22f89b9e1e56", "name": "network-vif-deleted", "tag": "3bfbd29b-32ec-4b40-b0ab-497ba05496e8"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:25.758734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4dd0defb-a417-4924-9df3-e5084de310a4 req-f352ad60-824d-4f67-82a2-621b813ec2b4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:25.759224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4dd0defb-a417-4924-9df3-e5084de310a4 req-f352ad60-824d-4f67-82a2-621b813ec2b4 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:25.771578 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4dd0defb-a417-4924-9df3-e5084de310a4 req-f352ad60-824d-4f67-82a2-621b813ec2b4 service nova] Creating event network-vif-deleted:3bfbd29b-32ec-4b40-b0ab-497ba05496e8 for instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 on nch2-master-1 May 07 22:32:25.776384 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4dd0defb-a417-4924-9df3-e5084de310a4 req-f352ad60-824d-4f67-82a2-621b813ec2b4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033061 May 07 22:32:25.777025 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3346/6663] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:32:26.020518 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:26.021188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:26.028323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:26.028719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:26.029517 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:26.029976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:26.064728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:26.065212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:26.065712 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lazy-loading 'fault' on Instance uuid ac17638e-6dd6-4f75-8473-22f89b9e1e56 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:32:26.110844 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96de17f60f6047f2a1886aa8e80354c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b928f3be814de2bf73bded06b23fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:26.120565 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8104214c-89d5-41c0-8ccb-22f59f94487f tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 200 len: 1348 microversion: 2.1 time: 0.103917 May 07 22:32:26.128646 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3318/6664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:26 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:27.138961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:27.139709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] [instance: ac17638e-6dd6-4f75-8473-22f89b9e1e56] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:27.146014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:27.146475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:27.147283 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:27.147734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:27.160925 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] HTTP exception thrown: Instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 could not be found. May 07 22:32:27.161520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Returning 404 to user: Instance ac17638e-6dd6-4f75-8473-22f89b9e1e56 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:32:27.162545 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9e767fef-7a8e-4876-9355-60db7b64e9d0 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56" status: 404 len: 111 microversion: 2.1 time: 0.028761 May 07 22:32:27.163128 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3347/6665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:27 2022] GET /compute/v2.1/servers/ac17638e-6dd6-4f75-8473-22f89b9e1e56 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:32:27.171565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-26a3b770-d653-448c-a702-f413fd9b7f38 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] Calling method '.version_select at 0x7fc40fbe19d0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:27.194830 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-26a3b770-d653-448c-a702-f413fd9b7f38 tempest-TestMinimumBasicScenario-472552688 tempest-TestMinimumBasicScenario-472552688-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1593419953" status: 202 len: 0 microversion: 2.1 time: 0.027013 May 07 22:32:27.195438 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3319/6666] 10.222.0.32 () {58 vars in 1271 bytes} [Sat May 7 22:32:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1593419953 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:32:36.406885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0e064176-dee0-4f47-93bd-c488ef43cd33 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: .version_select at 0x7fc40fcb7b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2076724374"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:36.421314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e064176-dee0-4f47-93bd-c488ef43cd33 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:32:36.427775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e064176-dee0-4f47-93bd-c488ef43cd33 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:32:36.595695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e064176-dee0-4f47-93bd-c488ef43cd33 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:32:36.601715 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-0e064176-dee0-4f47-93bd-c488ef43cd33 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:32:36.616586 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0e064176-dee0-4f47-93bd-c488ef43cd33 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.370079 May 07 22:32:36.617217 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3348/6667] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:32:36 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:42.400513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-226087572", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "4a772aa2-7b44-4bb9-85fd-ab5c602219d9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2076724374", "security_groups": [{"name": "tempest-secgroup-smoke-1993195314"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:42.515016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] validate_networks() for [('4a772aa2-7b44-4bb9-85fd-ab5c602219d9', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:32:42.985484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:32:42.985926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:32:42.987642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:32:42.988089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:32:42.988526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:32:42.998348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:42.999713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:43.000561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:43.001021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:43.021026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:32:43.026563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:32:43.041363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:32:43.043729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:32:43.101899 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5bc0f1ae-a2ac-4303-aa4b-525b0d8175e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706180 May 07 22:32:43.107048 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3320/6668] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:32:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:32:43.114960 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e851944-7544-4c73-90b1-176843e53ef8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:43.115605 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e851944-7544-4c73-90b1-176843e53ef8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:43.173185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e851944-7544-4c73-90b1-176843e53ef8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:43.184277 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e851944-7544-4c73-90b1-176843e53ef8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1266 microversion: 2.1 time: 0.075077 May 07 22:32:43.185382 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3349/6669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:43 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:32:44.206588 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:44.207255 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:44.214480 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:44.215330 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:44.216341 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:44.216988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:44.283106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:44.292648 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d89dd123-356b-4f74-b297-b2ff6c1eb681 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1324 microversion: 2.1 time: 0.091325 May 07 22:32:44.293379 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3321/6670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:44 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1324 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:45.310896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:45.311631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:45.322083 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:45.322545 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:45.323396 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:45.323843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:45.923999 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:45.931934 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b427f25-f628-488b-bf8a-908991239e66 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1392 microversion: 2.1 time: 0.625022 May 07 22:32:45.932531 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3350/6671] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:45 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1392 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:46.055738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a7889278-53bb-4644-ac61-07105486ee8c req-c39d8e1e-4578-4d1a-9dab-5c043f529af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8", "tag": "a2baf512-a22b-493a-893b-2c9968be2ba1"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:46.072433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a7889278-53bb-4644-ac61-07105486ee8c req-c39d8e1e-4578-4d1a-9dab-5c043f529af9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:46.077069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a7889278-53bb-4644-ac61-07105486ee8c req-c39d8e1e-4578-4d1a-9dab-5c043f529af9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:46.094618 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a7889278-53bb-4644-ac61-07105486ee8c req-c39d8e1e-4578-4d1a-9dab-5c043f529af9 service nova] Creating event network-changed:a2baf512-a22b-493a-893b-2c9968be2ba1 for instance 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 on nch1-master-1 May 07 22:32:46.100391 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a7889278-53bb-4644-ac61-07105486ee8c req-c39d8e1e-4578-4d1a-9dab-5c043f529af9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048295 May 07 22:32:46.101397 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3322/6672] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:32:46.949681 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:46.950332 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:46.957795 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:46.958252 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:46.959055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:46.959505 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:47.089526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:47.096877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6439e44a-d95d-4022-abf5-5ac4064c8679 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1392 microversion: 2.1 time: 0.151356 May 07 22:32:47.097453 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3351/6673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:46 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:48.115695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:48.116574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:48.123617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:48.124333 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:48.125156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:48.125653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:48.264523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:48.272006 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-53d35b21-ca7c-442e-a33a-11a736403e9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1392 microversion: 2.1 time: 0.162066 May 07 22:32:48.272591 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3323/6674] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:48 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:49.289013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:49.289665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:49.297029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:49.297492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:49.298270 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:49.298724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:49.431430 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:49.438909 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-31fa1ff6-5d67-440c-9ce0-4daa9c3d13be tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1392 microversion: 2.1 time: 0.153834 May 07 22:32:49.439487 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3352/6675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:49 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:50.103414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-3b07fe05-4ebc-4a7e-8f04-98b2292743a4 req-f691bffe-dab5-4d60-a124-7c9184e39f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8", "name": "network-vif-plugged", "status": "completed", "tag": "a2baf512-a22b-493a-893b-2c9968be2ba1"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:50.113357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b07fe05-4ebc-4a7e-8f04-98b2292743a4 req-f691bffe-dab5-4d60-a124-7c9184e39f4a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:50.113856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-3b07fe05-4ebc-4a7e-8f04-98b2292743a4 req-f691bffe-dab5-4d60-a124-7c9184e39f4a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:50.125172 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-3b07fe05-4ebc-4a7e-8f04-98b2292743a4 req-f691bffe-dab5-4d60-a124-7c9184e39f4a service nova] Creating event network-vif-plugged:a2baf512-a22b-493a-893b-2c9968be2ba1 for instance 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 on nch1-master-1 May 07 22:32:50.130068 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-3b07fe05-4ebc-4a7e-8f04-98b2292743a4 req-f691bffe-dab5-4d60-a124-7c9184e39f4a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030379 May 07 22:32:50.130668 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3324/6676] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:32:50.456852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:50.457419 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:50.464406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:50.464863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:50.465639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:50.466093 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:50.601416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:50.608737 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2013eda6-71a4-4985-9f3f-7514b807249d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1392 microversion: 2.1 time: 0.156468 May 07 22:32:50.609312 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3353/6677] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:50 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:51.627041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:51.628443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:51.635269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:51.635747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:51.636558 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:51.637020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:51.767140 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:51.774605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-068c46dd-1452-474a-9752-24dc679941fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1563 microversion: 2.1 time: 0.152893 May 07 22:32:51.775216 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3325/6678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:51 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:51.791022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:51.791643 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:51.798329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:51.799015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:51.800292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:51.800793 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:51.930243 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:51.937623 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-56adb11d-e20a-447b-a45b-be530a0ed91b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1563 microversion: 2.1 time: 0.150897 May 07 22:32:51.938203 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3354/6679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:51 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:32:53.572254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:32:53.572933 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:32:53.575564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-47265176-5502-405f-b604-63b6eebd9aca req-57ee63af-aeb2-4861-9cbb-06b3436a6787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8", "tag": "a2baf512-a22b-493a-893b-2c9968be2ba1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:32:53.591253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:53.592580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:53.593641 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:53.594108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:53.600376 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-47265176-5502-405f-b604-63b6eebd9aca req-57ee63af-aeb2-4861-9cbb-06b3436a6787 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:32:53.600897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-47265176-5502-405f-b604-63b6eebd9aca req-57ee63af-aeb2-4861-9cbb-06b3436a6787 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:32:53.615671 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-47265176-5502-405f-b604-63b6eebd9aca req-57ee63af-aeb2-4861-9cbb-06b3436a6787 service nova] Creating event network-changed:a2baf512-a22b-493a-893b-2c9968be2ba1 for instance 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 on nch1-master-1 May 07 22:32:53.624634 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-47265176-5502-405f-b604-63b6eebd9aca req-57ee63af-aeb2-4861-9cbb-06b3436a6787 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054220 May 07 22:32:53.625251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3355/6680] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:32:53.747938 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:32:53.755651 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c21b6eee-6a93-4d14-97e4-dbe3da143b83 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1563 microversion: 2.1 time: 0.187794 May 07 22:32:53.756234 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3326/6681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:32:53 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:17.012452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bb3df912-3a63-4b7e-bbd9-4bcd0e9565ed tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:17.013473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bb3df912-3a63-4b7e-bbd9-4bcd0e9565ed tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:17.020733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3df912-3a63-4b7e-bbd9-4bcd0e9565ed tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:17.021196 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3df912-3a63-4b7e-bbd9-4bcd0e9565ed tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:17.021970 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3df912-3a63-4b7e-bbd9-4bcd0e9565ed tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:17.022418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bb3df912-3a63-4b7e-bbd9-4bcd0e9565ed tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:17.071913 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bb3df912-3a63-4b7e-bbd9-4bcd0e9565ed tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action" status: 200 len: 24564 microversion: 2.1 time: 0.063666 May 07 22:33:17.072581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3356/6682] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:33:17 2022] POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action => generated 24564 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:33:23.496850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d7fe41e-6f50-4edf-a363-ad1ed49a89a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:23.497448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1d7fe41e-6f50-4edf-a363-ad1ed49a89a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:23.504443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d7fe41e-6f50-4edf-a363-ad1ed49a89a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:23.504922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d7fe41e-6f50-4edf-a363-ad1ed49a89a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:23.505714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d7fe41e-6f50-4edf-a363-ad1ed49a89a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:23.506178 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d7fe41e-6f50-4edf-a363-ad1ed49a89a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:23.570464 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d7fe41e-6f50-4edf-a363-ad1ed49a89a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.077410 May 07 22:33:23.571193 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3327/6683] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:33:23 2022] POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:33:23.580685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:23.581392 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:23.590592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:23.591085 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:23.592034 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:23.592483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:23.742017 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:23.751877 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3010401b-2360-4192-8494-3e2a2d2ff78e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1686 microversion: 2.1 time: 0.175685 May 07 22:33:23.752390 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3357/6684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:23 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:24.772008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:24.772832 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:24.779046 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:24.779521 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:24.780338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:24.780800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:24.912241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:24.919951 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-deb61126-3533-45fd-bf63-7c845482aaac tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1666 microversion: 2.1 time: 0.154092 May 07 22:33:24.920529 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3328/6685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:24 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:26.010788 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-faa7d41b-7eef-47d8-bda1-6b7e09b5e14e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:26.011734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-faa7d41b-7eef-47d8-bda1-6b7e09b5e14e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:26.018560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa7d41b-7eef-47d8-bda1-6b7e09b5e14e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:26.019074 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa7d41b-7eef-47d8-bda1-6b7e09b5e14e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:26.020500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa7d41b-7eef-47d8-bda1-6b7e09b5e14e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:26.020952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-faa7d41b-7eef-47d8-bda1-6b7e09b5e14e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:26.069267 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-faa7d41b-7eef-47d8-bda1-6b7e09b5e14e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action" status: 200 len: 32636 microversion: 2.1 time: 0.062289 May 07 22:33:26.069913 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3358/6686] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:33:26 2022] POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action => generated 32636 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:33:26.080946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ed7d0620-cfb1-478a-b234-9f0c4f6d57f7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:26.081504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ed7d0620-cfb1-478a-b234-9f0c4f6d57f7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:26.088928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed7d0620-cfb1-478a-b234-9f0c4f6d57f7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:26.089397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed7d0620-cfb1-478a-b234-9f0c4f6d57f7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:26.090180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed7d0620-cfb1-478a-b234-9f0c4f6d57f7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:26.090635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ed7d0620-cfb1-478a-b234-9f0c4f6d57f7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:26.425210 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ed7d0620-cfb1-478a-b234-9f0c4f6d57f7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action" status: 202 len: 0 microversion: 2.1 time: 0.347869 May 07 22:33:26.425784 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3329/6687] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:33:26 2022] POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:33:26.434714 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:26.436045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:26.443798 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:26.444320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:26.445188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:26.445631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:26.582870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:26.590761 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9046e683-c73c-4f20-a13f-5fe609e2f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1673 microversion: 2.1 time: 0.160176 May 07 22:33:26.591204 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3359/6688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:26 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:27.610861 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:27.611585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:27.618492 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:27.619005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:27.619805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:27.620266 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:27.752856 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:27.760234 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-af28bae5-fd20-4649-8a5c-986c96970c2b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1673 microversion: 2.1 time: 0.154561 May 07 22:33:27.760795 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3330/6689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:27 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:28.777717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:28.778368 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:28.785888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:28.786330 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:28.787150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:28.787599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:28.915678 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:28.923090 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6745582d-81a9-458a-a362-02da012002d9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1673 microversion: 2.1 time: 0.149336 May 07 22:33:28.923665 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3360/6690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:28 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:29.940661 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:29.941838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:29.948726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:29.949192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:29.949977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:29.950435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:30.077508 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:30.084875 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2e37dc5e-c267-4d9e-83ef-3603fe5ba0a8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1673 microversion: 2.1 time: 0.148291 May 07 22:33:30.085444 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3331/6691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:29 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:31.102532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:31.103181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:31.109850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:31.110316 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:31.111127 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:31.111583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:31.252268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:31.261953 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3d4c122a-d414-46ea-80e3-e64c618d8036 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1673 microversion: 2.1 time: 0.163859 May 07 22:33:31.262731 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3361/6692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:31 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:32.280432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:32.281205 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:32.288984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:32.289472 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:32.290290 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:32.291067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:32.423737 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:32.431063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-59d300eb-5c73-46c2-9edb-30f5cb0a0cab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1681 microversion: 2.1 time: 0.154905 May 07 22:33:32.431633 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3332/6693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:32 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:32.522269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3319678c-2ce8-40f3-a765-08891e6f4211 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:32.523246 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3319678c-2ce8-40f3-a765-08891e6f4211 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:32.529985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3319678c-2ce8-40f3-a765-08891e6f4211 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:32.530440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3319678c-2ce8-40f3-a765-08891e6f4211 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:32.531224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3319678c-2ce8-40f3-a765-08891e6f4211 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:32.531669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3319678c-2ce8-40f3-a765-08891e6f4211 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:32.578888 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3319678c-2ce8-40f3-a765-08891e6f4211 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action" status: 200 len: 38462 microversion: 2.1 time: 0.060869 May 07 22:33:32.579569 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3362/6694] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:33:32 2022] POST /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8/action => generated 38462 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:33:33.906884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:33.907824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:33.908638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d2e519cd-9504-4abc-bec7-4acb9725fd91 req-1ae5ec49-eaf7-4ce1-a2a1-4bf739327fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8", "tag": "a2baf512-a22b-493a-893b-2c9968be2ba1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:33.919080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:33.919567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d2e519cd-9504-4abc-bec7-4acb9725fd91 req-1ae5ec49-eaf7-4ce1-a2a1-4bf739327fd5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:33.920030 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d2e519cd-9504-4abc-bec7-4acb9725fd91 req-1ae5ec49-eaf7-4ce1-a2a1-4bf739327fd5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:33.920291 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:33.921109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:33.921566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:33.932531 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d2e519cd-9504-4abc-bec7-4acb9725fd91 req-1ae5ec49-eaf7-4ce1-a2a1-4bf739327fd5 service nova] Creating event network-changed:a2baf512-a22b-493a-893b-2c9968be2ba1 for instance 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 on nch1-master-1 May 07 22:33:33.937508 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d2e519cd-9504-4abc-bec7-4acb9725fd91 req-1ae5ec49-eaf7-4ce1-a2a1-4bf739327fd5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038185 May 07 22:33:33.941094 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3363/6695] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:33:33.947784 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:33:34.038889 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f89d5e6-302b-44bd-b1db-ed1a81a89c4c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 204 len: 0 microversion: 2.1 time: 0.140685 May 07 22:33:34.043122 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3333/6696] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:33:33 2022] DELETE /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 07 22:33:34.051447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:34.052341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:34.058748 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:34.059395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:34.060291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:34.060851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:34.213801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:34.221667 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9095d26-f253-4ab3-901c-580bc2de12b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1687 microversion: 2.1 time: 0.176241 May 07 22:33:34.222254 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3364/6697] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:34 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:35.240692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:35.241417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:35.247840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:35.248314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:35.249097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:35.249553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:35.384166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:35.393927 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c4d5911-ed6a-40fb-ac32-053ca7c82695 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1687 microversion: 2.1 time: 0.157705 May 07 22:33:35.394511 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3334/6698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:35 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:36.120868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-0fde6913-274b-44f3-8af4-caa08c9009c0 req-3eae36e1-a2cc-4b55-acde-888277ea24e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8", "name": "network-vif-deleted", "tag": "a2baf512-a22b-493a-893b-2c9968be2ba1"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:36.129986 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0fde6913-274b-44f3-8af4-caa08c9009c0 req-3eae36e1-a2cc-4b55-acde-888277ea24e9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:36.130456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-0fde6913-274b-44f3-8af4-caa08c9009c0 req-3eae36e1-a2cc-4b55-acde-888277ea24e9 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:36.143352 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-0fde6913-274b-44f3-8af4-caa08c9009c0 req-3eae36e1-a2cc-4b55-acde-888277ea24e9 service nova] Creating event network-vif-deleted:a2baf512-a22b-493a-893b-2c9968be2ba1 for instance 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 on nch1-master-1 May 07 22:33:36.148097 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-0fde6913-274b-44f3-8af4-caa08c9009c0 req-3eae36e1-a2cc-4b55-acde-888277ea24e9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030954 May 07 22:33:36.148700 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3365/6699] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:33:36.412593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:36.413254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:36.421434 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:36.421912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:36.422728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:36.423221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:36.458572 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:36.458843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:36.459146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lazy-loading 'fault' on Instance uuid 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:33:36.507992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:36.517338 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0331fcb5-751c-4ab9-b693-89c9bae8f9f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 200 len: 1356 microversion: 2.1 time: 0.109107 May 07 22:33:36.527158 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3335/6700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:36 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:37.536365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:37.537084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:37.543663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:37.544126 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:37.544906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:37.545358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:37.559121 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] HTTP exception thrown: Instance 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 could not be found. May 07 22:33:37.559746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Returning 404 to user: Instance 4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:33:37.560583 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-74638c8a-2ba1-46a7-820b-673c412792e9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8" status: 404 len: 111 microversion: 2.1 time: 0.029406 May 07 22:33:37.561112 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3366/6701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:37 2022] GET /compute/v2.1/servers/4b50d1a1-8fc0-4c3f-9b94-ad25507a1ca8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:33:40.652452 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2f94be46-073f-40df-a3ba-36b18dc69ea1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '.version_select at 0x7fc40c243d30>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:40.672736 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2f94be46-073f-40df-a3ba-36b18dc69ea1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2076724374" status: 202 len: 0 microversion: 2.1 time: 0.024064 May 07 22:33:40.673333 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3336/6702] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2076724374 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:33:40.698434 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-415012af-17a0-40c9-9bf3-8deca3604aa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: .version_select at 0x7fc4224cc280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-390481641"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:40.712882 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-415012af-17a0-40c9-9bf3-8deca3604aa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:33:40.718749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-415012af-17a0-40c9-9bf3-8deca3604aa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:33:40.904585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-415012af-17a0-40c9-9bf3-8deca3604aa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:33:40.909566 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-415012af-17a0-40c9-9bf3-8deca3604aa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:33:40.924261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-415012af-17a0-40c9-9bf3-8deca3604aa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.229837 May 07 22:33:40.924867 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3367/6703] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:33:40 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:46.797831 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1710701179", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "adb8f422-2dac-4c3f-acc8-399fa87c8422"}], "key_name": "tempest-TestNetworkAdvancedServerOps-390481641", "security_groups": [{"name": "tempest-secgroup-smoke-59375524"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:46.912987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] validate_networks() for [('adb8f422-2dac-4c3f-acc8-399fa87c8422', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:33:47.363788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:33:47.364146 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:33:47.364650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:33:47.365621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:33:47.366061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:33:47.376892 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:47.377376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:47.378716 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:47.379217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:47.405083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:33:47.411066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:33:47.425143 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:33:47.428263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:33:47.477512 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-657b53e5-58a9-48a9-95b9-dd9f2cb018d6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.684711 May 07 22:33:47.483077 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3337/6704] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:33:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:33:47.489069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-aff1f9cd-09a7-4d8f-898f-ea7d5bbbf443 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:47.489598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-aff1f9cd-09a7-4d8f-898f-ea7d5bbbf443 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:47.562056 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-aff1f9cd-09a7-4d8f-898f-ea7d5bbbf443 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:47.569142 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-aff1f9cd-09a7-4d8f-898f-ea7d5bbbf443 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1266 microversion: 2.1 time: 0.084462 May 07 22:33:47.572152 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3368/6705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:47 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:48.588862 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:48.590032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:48.598605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:48.599764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:48.600926 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:48.601496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:48.679343 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:48.688440 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6a6ba13d-0310-4e56-8c68-d6f042f888e8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1318 microversion: 2.1 time: 0.103846 May 07 22:33:48.698952 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3338/6706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:48 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:49.707268 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:49.708958 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:49.716611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:49.717546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:49.718498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:49.719323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:49.879860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:49.888302 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a65c8058-24d1-4b9c-9bb9-f6ec0c26de5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1390 microversion: 2.1 time: 0.185982 May 07 22:33:49.889160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3369/6707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:49 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:50.412817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-c3197865-3679-4be8-b3fd-8cf260abf46d req-91b033ac-08d7-434b-8094-f52443045b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792e79ce-e39f-41ba-bda3-20429b5d9694", "tag": "49286ea3-2b3a-44c0-ac0f-f863b3d44b2e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:50.421298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c3197865-3679-4be8-b3fd-8cf260abf46d req-91b033ac-08d7-434b-8094-f52443045b3c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:50.422018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-c3197865-3679-4be8-b3fd-8cf260abf46d req-91b033ac-08d7-434b-8094-f52443045b3c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:50.433564 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-c3197865-3679-4be8-b3fd-8cf260abf46d req-91b033ac-08d7-434b-8094-f52443045b3c service nova] Creating event network-changed:49286ea3-2b3a-44c0-ac0f-f863b3d44b2e for instance 792e79ce-e39f-41ba-bda3-20429b5d9694 on nch2-master-1 May 07 22:33:50.438650 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-c3197865-3679-4be8-b3fd-8cf260abf46d req-91b033ac-08d7-434b-8094-f52443045b3c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114097 May 07 22:33:50.439643 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3339/6708] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:33:50.905208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:50.905832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:50.912815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:50.913276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:50.914050 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:50.914500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:51.047831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:51.055763 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0190eb85-f6e3-4a87-a662-1c7eafbfbb04 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1390 microversion: 2.1 time: 0.154542 May 07 22:33:51.056337 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3370/6709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:50 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:52.075582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:52.076319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:52.082922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:52.084213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:52.085020 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:52.085483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:52.223850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:52.231448 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5e1402e7-b26e-4939-bfaf-5104b2478d9e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1390 microversion: 2.1 time: 0.161849 May 07 22:33:52.232025 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3340/6710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:52 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:53.248329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:53.248954 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:53.255814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:53.256325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:53.257128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:53.257583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:53.387251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:53.394882 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-13407397-1b80-4fdc-82a4-5c69da4bcb14 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1390 microversion: 2.1 time: 0.150393 May 07 22:33:53.395474 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3371/6711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:53 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:54.413220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:54.413762 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:54.420793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:54.421287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:54.422066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:54.422520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:54.549871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:54.557891 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d6bccee7-ef4d-4fbb-b357-87a60a942bc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1390 microversion: 2.1 time: 0.149184 May 07 22:33:54.558475 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3341/6712] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:54 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1390 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:54.890932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7b728b16-c44a-4b85-9831-57d856d22203 req-df3935a9-5e00-4082-967c-9059c902ae31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792e79ce-e39f-41ba-bda3-20429b5d9694", "name": "network-vif-plugged", "status": "completed", "tag": "49286ea3-2b3a-44c0-ac0f-f863b3d44b2e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:54.899866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7b728b16-c44a-4b85-9831-57d856d22203 req-df3935a9-5e00-4082-967c-9059c902ae31 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:54.900323 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7b728b16-c44a-4b85-9831-57d856d22203 req-df3935a9-5e00-4082-967c-9059c902ae31 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:54.911147 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7b728b16-c44a-4b85-9831-57d856d22203 req-df3935a9-5e00-4082-967c-9059c902ae31 service nova] Creating event network-vif-plugged:49286ea3-2b3a-44c0-ac0f-f863b3d44b2e for instance 792e79ce-e39f-41ba-bda3-20429b5d9694 on nch2-master-1 May 07 22:33:54.917148 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7b728b16-c44a-4b85-9831-57d856d22203 req-df3935a9-5e00-4082-967c-9059c902ae31 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095358 May 07 22:33:54.917748 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3372/6713] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:33:55.574895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:55.575535 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:55.582320 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:55.582823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:55.584119 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:55.584570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:55.714890 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:55.722316 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c1788349-3cb9-4385-8107-f529cb500135 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1390 microversion: 2.1 time: 0.151394 May 07 22:33:55.722944 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3342/6714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:55 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:56.740291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:56.740994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:56.747937 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:56.748389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:56.749163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:56.749608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:56.885025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:56.892445 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-77663682-c4b8-4369-83d9-8e592aa1fcf6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1563 microversion: 2.1 time: 0.156435 May 07 22:33:56.893054 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3373/6715] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:56 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:56.908566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:56.909209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:56.916132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:56.916608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:56.917399 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:56.917866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:57.043374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:57.050737 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-89a1c853-bd9d-4f9e-8fa7-c86172985cc2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1563 microversion: 2.1 time: 0.146083 May 07 22:33:57.051340 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3343/6716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:56 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:33:58.939288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:33:58.939918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:33:58.944987 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9c985d3c-2ce7-4eb9-8426-071a673d7af8 req-b773e312-47b2-403a-9dd8-f3df40c17b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792e79ce-e39f-41ba-bda3-20429b5d9694", "tag": "49286ea3-2b3a-44c0-ac0f-f863b3d44b2e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:33:58.953924 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9c985d3c-2ce7-4eb9-8426-071a673d7af8 req-b773e312-47b2-403a-9dd8-f3df40c17b02 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:58.954469 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9c985d3c-2ce7-4eb9-8426-071a673d7af8 req-b773e312-47b2-403a-9dd8-f3df40c17b02 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:58.956849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:58.957500 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:58.958328 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:33:58.958872 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:33:58.967063 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9c985d3c-2ce7-4eb9-8426-071a673d7af8 req-b773e312-47b2-403a-9dd8-f3df40c17b02 service nova] Creating event network-changed:49286ea3-2b3a-44c0-ac0f-f863b3d44b2e for instance 792e79ce-e39f-41ba-bda3-20429b5d9694 on nch2-master-1 May 07 22:33:58.972502 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9c985d3c-2ce7-4eb9-8426-071a673d7af8 req-b773e312-47b2-403a-9dd8-f3df40c17b02 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031114 May 07 22:33:58.973167 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3344/6717] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:33:59.099633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:33:59.108272 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0fae97e7-7360-4bd9-94b7-2cd71d661bb5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1563 microversion: 2.1 time: 0.173092 May 07 22:33:59.109506 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3374/6718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:33:58 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:20.356675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fd62ad21-052f-4af5-8d3a-f734039a4574 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:34:20.357711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fd62ad21-052f-4af5-8d3a-f734039a4574 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:20.364029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd62ad21-052f-4af5-8d3a-f734039a4574 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:20.364538 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd62ad21-052f-4af5-8d3a-f734039a4574 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:20.365334 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd62ad21-052f-4af5-8d3a-f734039a4574 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:20.365802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fd62ad21-052f-4af5-8d3a-f734039a4574 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:20.416248 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fd62ad21-052f-4af5-8d3a-f734039a4574 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694/action" status: 200 len: 24559 microversion: 2.1 time: 0.064648 May 07 22:34:20.416876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3345/6719] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:34:20 2022] POST /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694/action => generated 24559 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:34:31.393807 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-05b422b2-ea5e-4810-8c35-6f8df098fa28 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:34:31.394791 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-05b422b2-ea5e-4810-8c35-6f8df098fa28 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:31.401803 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b422b2-ea5e-4810-8c35-6f8df098fa28 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:31.402267 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b422b2-ea5e-4810-8c35-6f8df098fa28 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:31.403070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b422b2-ea5e-4810-8c35-6f8df098fa28 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:31.403525 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-05b422b2-ea5e-4810-8c35-6f8df098fa28 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:31.477174 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-05b422b2-ea5e-4810-8c35-6f8df098fa28 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694/action" status: 202 len: 0 microversion: 2.1 time: 0.086991 May 07 22:34:31.478327 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3375/6720] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:34:31 2022] POST /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:34:31.486854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:31.487646 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:31.495496 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:31.495965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:31.496754 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:31.497208 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:31.721231 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:31.728773 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7c71ff5a-814e-4885-8bb3-43c639f8800e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1673 microversion: 2.1 time: 0.246365 May 07 22:34:31.729291 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3346/6721] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:31 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1673 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:32.747447 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:32.748154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:32.755420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:32.755878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:32.756680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:32.757124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:32.893257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:32.902939 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b35fe2f0-f8ab-496a-acf7-127d245d1099 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.159504 May 07 22:34:32.903538 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3376/6722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:32 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:33.925145 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:33.925713 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:33.933757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:33.934224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:33.935036 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:33.935491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:34.062028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:34.069511 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-14fa6888-1d55-46f6-9f68-f9fdb5cdeac7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.148393 May 07 22:34:34.070082 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3347/6723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:33 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:35.086529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:35.087207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:35.093906 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:35.094372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:35.095179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:35.095639 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:35.223973 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:35.231467 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0b5dc113-42f7-4493-9c29-7c1cb30d6717 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.148869 May 07 22:34:35.232046 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3377/6724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:35 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:36.249150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:36.249794 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:36.257226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:36.257705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:36.258495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:36.258992 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:36.393388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:36.401539 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-84875b58-698c-49dc-92cf-2fe7ec86fe42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.156338 May 07 22:34:36.402153 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3348/6725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:36 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:37.419609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:37.420242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:37.427201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:37.427668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:37.428451 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:37.428905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:37.564488 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:37.571965 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f0d12671-3a76-48f0-8824-68ef85e78b49 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.156551 May 07 22:34:37.572550 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3378/6726] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:37 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:38.589894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:38.590533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:38.597425 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:38.597902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:38.598693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:38.599189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:38.729906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:38.737418 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-fbb5dac3-632f-4190-b8a3-ec764dd65837 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.151537 May 07 22:34:38.738017 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3349/6727] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:38 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:39.754194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:39.754837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:39.761611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:39.762067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:39.762849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:39.763291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:39.891985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:39.899993 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cf9f55af-b342-4550-9877-59f7cf1963f4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.149718 May 07 22:34:39.900566 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3379/6728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:39 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:40.917387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:40.918065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:40.924932 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:40.925409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:40.926210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:40.926675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:41.055443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:41.062942 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b8edc48f-6686-4fe1-8645-7942ee6a6ecc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.149719 May 07 22:34:41.063512 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3350/6729] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:40 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:42.080885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:42.081510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:42.088358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:42.088823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:42.089602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:42.090053 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:42.219766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:42.227832 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1005d9ff-b0c2-48b4-a510-8ce5be0206ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.150959 May 07 22:34:42.228440 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3380/6730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:42 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:43.245002 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:43.245640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:43.252189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:43.252659 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:43.253446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:43.253904 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:43.385327 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:43.392744 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-24f3bd0d-214c-4547-a539-db4ff4954734 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.152453 May 07 22:34:43.393330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3351/6731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:43 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:44.410497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:44.411141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:44.418910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:44.419369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:44.420132 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:44.420571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:44.553175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:44.560473 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-935724ed-e898-480c-92a9-d6eed90ddd9a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.153917 May 07 22:34:44.561048 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3381/6732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:44 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:45.578697 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:45.579369 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:45.586669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:45.587173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:45.587989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:45.588448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:45.718881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:45.726988 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3c4acace-5439-4bd3-8327-9e3533964f03 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.152305 May 07 22:34:45.727570 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3352/6733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:45 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:34:46.744845 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:46.745462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:46.752302 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:46.752760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:46.753547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:46.753974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:46.886889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:46.894307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b7f8493f-941c-43f2-bd8b-a15ba50b5727 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1678 microversion: 2.1 time: 0.153998 May 07 22:34:46.894925 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3382/6734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:46 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:34:47.912630 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:34:47.913210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:34:47.920499 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:47.920983 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:47.922884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:34:47.922884 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:34:48.059907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:34:48.067462 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2767c0a9-7203-4d66-b07a-f6c12fc8b561 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1681 microversion: 2.1 time: 0.158866 May 07 22:34:48.068038 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3353/6735] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:34:47 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:12.252664 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4ea3a140-beb5-41a1-bb60-746770dfafe1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:12.253614 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4ea3a140-beb5-41a1-bb60-746770dfafe1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:12.260982 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ea3a140-beb5-41a1-bb60-746770dfafe1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:12.261431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ea3a140-beb5-41a1-bb60-746770dfafe1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:12.263284 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ea3a140-beb5-41a1-bb60-746770dfafe1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:12.264121 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4ea3a140-beb5-41a1-bb60-746770dfafe1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:12.315673 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4ea3a140-beb5-41a1-bb60-746770dfafe1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694/action" status: 200 len: 69221 microversion: 2.1 time: 0.067276 May 07 22:35:12.316334 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3383/6736] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:35:12 2022] POST /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694/action => generated 69221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:35:19.751792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:19.753049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:19.753814 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1b35adb6-ea06-43a0-9b3c-0003d23a4058 req-695c6fa6-c593-407c-a111-a3764635e53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792e79ce-e39f-41ba-bda3-20429b5d9694", "tag": "49286ea3-2b3a-44c0-ac0f-f863b3d44b2e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:19.759487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:19.760158 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:19.761029 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:19.761555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:19.763770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1b35adb6-ea06-43a0-9b3c-0003d23a4058 req-695c6fa6-c593-407c-a111-a3764635e53c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:19.764741 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1b35adb6-ea06-43a0-9b3c-0003d23a4058 req-695c6fa6-c593-407c-a111-a3764635e53c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:19.776462 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1b35adb6-ea06-43a0-9b3c-0003d23a4058 req-695c6fa6-c593-407c-a111-a3764635e53c service nova] Creating event network-changed:49286ea3-2b3a-44c0-ac0f-f863b3d44b2e for instance 792e79ce-e39f-41ba-bda3-20429b5d9694 on nch2-master-1 May 07 22:35:19.781720 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1b35adb6-ea06-43a0-9b3c-0003d23a4058 req-695c6fa6-c593-407c-a111-a3764635e53c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032115 May 07 22:35:19.782659 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3384/6737] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:35:19.795491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:35:19.880965 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5c986c84-38b6-4dc5-b10c-54535c23496f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 204 len: 0 microversion: 2.1 time: 0.133813 May 07 22:35:19.881583 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3354/6738] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:35:19 2022] DELETE /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:35:19.891645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:19.892472 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:19.899335 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:19.899952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:19.900770 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:19.901420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:20.042433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:20.050574 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-926f6ffa-d551-4ffb-b529-6807023f6c48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1687 microversion: 2.1 time: 0.163979 May 07 22:35:20.051195 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3385/6739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:19 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:21.069372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:21.070092 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:21.077824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:21.078293 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:21.079106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:21.079562 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:21.243638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:21.252070 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b306ea45-f567-4fd1-a6bd-140ae4229442 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1687 microversion: 2.1 time: 0.186923 May 07 22:35:21.252754 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3355/6740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:21 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:21.970351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2febb07c-84a8-4c7c-ad7b-d3f02f71fc92 req-e137f6d9-c3fd-4a0f-acdf-a371a4c02b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792e79ce-e39f-41ba-bda3-20429b5d9694", "name": "network-vif-deleted", "tag": "49286ea3-2b3a-44c0-ac0f-f863b3d44b2e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:21.979710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2febb07c-84a8-4c7c-ad7b-d3f02f71fc92 req-e137f6d9-c3fd-4a0f-acdf-a371a4c02b55 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:21.980175 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2febb07c-84a8-4c7c-ad7b-d3f02f71fc92 req-e137f6d9-c3fd-4a0f-acdf-a371a4c02b55 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:21.992629 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2febb07c-84a8-4c7c-ad7b-d3f02f71fc92 req-e137f6d9-c3fd-4a0f-acdf-a371a4c02b55 service nova] Creating event network-vif-deleted:49286ea3-2b3a-44c0-ac0f-f863b3d44b2e for instance 792e79ce-e39f-41ba-bda3-20429b5d9694 on nch2-master-1 May 07 22:35:21.997278 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2febb07c-84a8-4c7c-ad7b-d3f02f71fc92 req-e137f6d9-c3fd-4a0f-acdf-a371a4c02b55 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031324 May 07 22:35:21.997881 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3386/6741] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:35:22.270122 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:22.270906 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:22.278195 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:22.279577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:22.280523 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:22.280990 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:22.314842 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:22.315459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:22.316034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lazy-loading 'fault' on Instance uuid 792e79ce-e39f-41ba-bda3-20429b5d9694 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:35:22.361170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:22.372372 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8f4cb90f-fd65-4af8-b451-697bd9aeeb08 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 200 len: 1356 microversion: 2.1 time: 0.106100 May 07 22:35:22.373485 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3356/6742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:22 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:23.391563 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:23.392272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 792e79ce-e39f-41ba-bda3-20429b5d9694] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:23.398522 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:23.399013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:23.399787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:23.400235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:23.413310 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] HTTP exception thrown: Instance 792e79ce-e39f-41ba-bda3-20429b5d9694 could not be found. May 07 22:35:23.413890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Returning 404 to user: Instance 792e79ce-e39f-41ba-bda3-20429b5d9694 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:35:23.415000 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5e532551-c6fa-4f4b-b580-aff18f37f56d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694" status: 404 len: 111 microversion: 2.1 time: 0.028960 May 07 22:35:23.415526 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3387/6743] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:23 2022] GET /compute/v2.1/servers/792e79ce-e39f-41ba-bda3-20429b5d9694 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:35:26.790653 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-576ddd84-93fc-4499-91f6-ffac7f7108ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '.version_select at 0x7fc41c229af0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:26.809204 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-576ddd84-93fc-4499-91f6-ffac7f7108ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-390481641" status: 202 len: 0 microversion: 2.1 time: 0.022712 May 07 22:35:26.809830 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3357/6744] 10.222.0.32 () {58 vars in 1280 bytes} [Sat May 7 22:35:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-390481641 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:35:26.831717 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1939fd07-d9b4-4032-a2be-e53563a3e3f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: .version_select at 0x7fc41cb473a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1403160565"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:26.848542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1939fd07-d9b4-4032-a2be-e53563a3e3f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:35:26.854595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1939fd07-d9b4-4032-a2be-e53563a3e3f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:35:27.048726 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1939fd07-d9b4-4032-a2be-e53563a3e3f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:35:27.053735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1939fd07-d9b4-4032-a2be-e53563a3e3f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:35:27.068384 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1939fd07-d9b4-4032-a2be-e53563a3e3f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.242085 May 07 22:35:27.068988 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3388/6745] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:35:26 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:32.724306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-708761154", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "65601071-ae27-4806-9da1-099c419271d7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1403160565", "security_groups": [{"name": "tempest-secgroup-smoke-1638016231"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:32.839531 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] validate_networks() for [('65601071-ae27-4806-9da1-099c419271d7', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:35:33.238019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:35:33.238539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:35:33.239177 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:35:33.239614 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:35:33.240053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:35:33.248929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:33.249403 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:33.250235 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:33.250695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:33.267559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:35:33.272942 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:35:33.285611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:35:33.287946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:35:33.334857 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5ad65332-e0a5-4b43-b1ec-38d6f6cfd01b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.615427 May 07 22:35:33.335858 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3358/6746] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:35:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:35:33.347207 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-67a14e1c-547c-49f6-a9f5-572c90539c6a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:33.347835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-67a14e1c-547c-49f6-a9f5-572c90539c6a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:33.401974 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-67a14e1c-547c-49f6-a9f5-572c90539c6a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:33.409498 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-67a14e1c-547c-49f6-a9f5-572c90539c6a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1266 microversion: 2.1 time: 0.067176 May 07 22:35:33.410411 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3389/6747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:33 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:34.427644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f37c8d8d-cd62-4e89-9766-bf6320aea798 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:34.428474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f37c8d8d-cd62-4e89-9766-bf6320aea798 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:34.495950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f37c8d8d-cd62-4e89-9766-bf6320aea798 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:34.508074 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f37c8d8d-cd62-4e89-9766-bf6320aea798 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1266 microversion: 2.1 time: 0.085268 May 07 22:35:34.508987 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3359/6748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:34 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:35.524966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f86c06f8-f342-43ab-aa76-63a4fe436b1e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:35.525592 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f86c06f8-f342-43ab-aa76-63a4fe436b1e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:35.581682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f86c06f8-f342-43ab-aa76-63a4fe436b1e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:35.595364 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f86c06f8-f342-43ab-aa76-63a4fe436b1e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1266 microversion: 2.1 time: 0.074197 May 07 22:35:35.595994 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3390/6749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:35 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:36.617386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a9db706-b5b5-4c58-8db6-0b57ee47309a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:36.618023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a9db706-b5b5-4c58-8db6-0b57ee47309a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:36.673624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a9db706-b5b5-4c58-8db6-0b57ee47309a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:36.680218 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a9db706-b5b5-4c58-8db6-0b57ee47309a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1266 microversion: 2.1 time: 0.066802 May 07 22:35:36.680797 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3360/6750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:36 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:37.696327 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:37.696896 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:37.704389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:37.704852 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:37.705623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:37.706073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:37.765784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:37.773214 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-07f6f855-fe5c-420c-b16a-23915f1b9346 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1270 microversion: 2.1 time: 0.080875 May 07 22:35:37.773816 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3391/6751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:37 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:38.790194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:38.790764 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:38.797837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:38.798411 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:38.799482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:38.799953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:38.862901 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:38.870205 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ba48b3d4-c9da-415b-8513-5f0f1961c1fd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1324 microversion: 2.1 time: 0.084558 May 07 22:35:38.870805 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3361/6752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:38 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1324 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:39.331508 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:35:39.332135 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:35:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:35:39.829864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-f8072ae1-8762-4fc4-b63b-05b371c0eaef req-42ef56e4-43d4-4ae4-8805-53d6d6371526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:39.840131 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f8072ae1-8762-4fc4-b63b-05b371c0eaef req-42ef56e4-43d4-4ae4-8805-53d6d6371526 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:39.841461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-f8072ae1-8762-4fc4-b63b-05b371c0eaef req-42ef56e4-43d4-4ae4-8805-53d6d6371526 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:39.851974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-f8072ae1-8762-4fc4-b63b-05b371c0eaef req-42ef56e4-43d4-4ae4-8805-53d6d6371526 service nova] Creating event network-changed:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch1-master-1 May 07 22:35:39.857882 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-f8072ae1-8762-4fc4-b63b-05b371c0eaef req-42ef56e4-43d4-4ae4-8805-53d6d6371526 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104770 May 07 22:35:39.859803 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3392/6753] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:35:39.888221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:39.890382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:39.897226 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:39.897745 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:39.898746 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:39.899225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:40.048605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:40.056320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a55cc65b-8feb-453b-aeaf-c562b25dbee7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1392 microversion: 2.1 time: 0.172421 May 07 22:35:40.056916 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3362/6754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:39 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:41.075063 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:41.076473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:41.082721 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:41.083222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:41.084012 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:41.084464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:41.298429 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:41.305949 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d567b8dd-d2e7-4c5b-bd72-5eddce46bbda tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1392 microversion: 2.1 time: 0.236102 May 07 22:35:41.306539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3393/6755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:41 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:42.323537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:42.324106 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:42.331217 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:42.331694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:42.332512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:42.332971 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:42.460182 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:42.467611 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-948a5f0f-006e-4b26-9190-46ebb198dbfe tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1392 microversion: 2.1 time: 0.148264 May 07 22:35:42.468189 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3363/6756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:42 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1392 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:43.484405 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:43.485031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:43.492464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:43.493114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:43.494128 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:43.494730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:43.623603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:43.630849 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57364ccc-d7cd-45b8-98ae-d51701f762da tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1392 microversion: 2.1 time: 0.150640 May 07 22:35:43.631433 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3394/6757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:43 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:44.648209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:44.648853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:44.656644 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:44.657270 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:44.658110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:44.658597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:44.792817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:44.800599 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6d6b7a02-b998-4d8b-bd91-196764798c5e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1392 microversion: 2.1 time: 0.156273 May 07 22:35:44.801162 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3364/6758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:44 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:44.815959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-bdeea001-14b6-4f36-90c7-59e718388c74 req-f1d85f07-68c6-4dee-8a81-9bef30fd9fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "name": "network-vif-plugged", "status": "completed", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:44.825785 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bdeea001-14b6-4f36-90c7-59e718388c74 req-f1d85f07-68c6-4dee-8a81-9bef30fd9fca service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:44.826235 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-bdeea001-14b6-4f36-90c7-59e718388c74 req-f1d85f07-68c6-4dee-8a81-9bef30fd9fca service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:44.840024 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-bdeea001-14b6-4f36-90c7-59e718388c74 req-f1d85f07-68c6-4dee-8a81-9bef30fd9fca service nova] Creating event network-vif-plugged:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch1-master-1 May 07 22:35:44.845529 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-bdeea001-14b6-4f36-90c7-59e718388c74 req-f1d85f07-68c6-4dee-8a81-9bef30fd9fca service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033324 May 07 22:35:44.846143 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3395/6759] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:35:45.817477 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:45.818117 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:45.824975 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:45.825453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:45.826248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:45.826711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:45.957440 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:45.965011 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a2684335-f04b-4e5f-a90b-16e8da2bdb26 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1392 microversion: 2.1 time: 0.151491 May 07 22:35:45.965585 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3365/6760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:45 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:46.983745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:46.984460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:46.991967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:46.992466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:46.993262 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:46.993713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:47.126647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:47.134121 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f39a2276-434e-4a9c-8c60-458d6d995fa2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1564 microversion: 2.1 time: 0.155650 May 07 22:35:47.134698 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3396/6761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:46 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:47.150568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:47.151240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:47.158655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:47.159170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:47.159963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:47.160429 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:47.286608 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:47.294251 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d10b2e7-690c-4c7c-89fa-766b126e1ee9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1564 microversion: 2.1 time: 0.147519 May 07 22:35:47.294848 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3366/6762] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:47 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:35:49.206965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:35:49.207587 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:35:49.210042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-705bb3fa-acea-4174-b174-593a5327bde6 req-d47f2126-00df-4f40-a90a-99bc5231ad1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:35:49.217519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:49.217998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:49.218888 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:49.219346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:49.219963 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-705bb3fa-acea-4174-b174-593a5327bde6 req-d47f2126-00df-4f40-a90a-99bc5231ad1c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:35:49.220491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-705bb3fa-acea-4174-b174-593a5327bde6 req-d47f2126-00df-4f40-a90a-99bc5231ad1c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:35:49.232402 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-705bb3fa-acea-4174-b174-593a5327bde6 req-d47f2126-00df-4f40-a90a-99bc5231ad1c service nova] Creating event network-changed:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch1-master-1 May 07 22:35:49.237946 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-705bb3fa-acea-4174-b174-593a5327bde6 req-d47f2126-00df-4f40-a90a-99bc5231ad1c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031897 May 07 22:35:49.239163 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3367/6763] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:35:49.444642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:35:49.451974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c8033381-cbc5-478d-a3c0-21b27552cae2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1564 microversion: 2.1 time: 0.248868 May 07 22:35:49.452743 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3397/6764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:35:49 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:10.699213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e6ca5783-70fe-4597-b10a-b289aa5a8e35 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:36:10.700253 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e6ca5783-70fe-4597-b10a-b289aa5a8e35 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:10.707288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e6ca5783-70fe-4597-b10a-b289aa5a8e35 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:10.707767 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e6ca5783-70fe-4597-b10a-b289aa5a8e35 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:10.708557 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e6ca5783-70fe-4597-b10a-b289aa5a8e35 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:10.709021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e6ca5783-70fe-4597-b10a-b289aa5a8e35 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:10.756322 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e6ca5783-70fe-4597-b10a-b289aa5a8e35 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action" status: 200 len: 24570 microversion: 2.1 time: 0.062225 May 07 22:36:10.756967 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3368/6765] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:36:10 2022] POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action => generated 24570 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:36:21.770526 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:36:21.771598 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:21.778019 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:21.778485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:21.779285 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:21.779733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:21.959143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:21.965699 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Old instance type m1.heat2, new instance type m1.heat {{(pid=136682) resize /opt/stack/nova/nova/compute/api.py:4166}} May 07 22:36:21.972491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:36:21.972932 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:36:21.973416 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:36:21.973836 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:36:21.974258 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:36:22.037426 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6565f36-0fff-4326-9887-0af10f52a181 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action" status: 202 len: 0 microversion: 2.1 time: 0.270723 May 07 22:36:22.038084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3398/6766] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:36:21 2022] POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:36:22.047941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:22.048676 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:22.055941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:22.056423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:22.057227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:22.057699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:22.293339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:22.300899 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9bee3b28-1986-4070-a298-80b73000c5ec tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1692 microversion: 2.1 time: 0.257857 May 07 22:36:22.301478 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3369/6767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:22 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1692 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:23.318745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:23.319319 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:23.325475 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:23.325927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:23.326701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:23.327178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:23.598513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:23.605978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5f8d2722-245e-4cbb-836f-6203ac63ca01 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1692 microversion: 2.1 time: 0.292347 May 07 22:36:23.606557 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3399/6768] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:23 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1692 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:24.623550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:24.624188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:24.631032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:24.631507 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:24.632295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:24.632756 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:24.762795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:24.771076 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6f7ff1e4-3b0c-4b8f-83fa-aac83ac84c68 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.151599 May 07 22:36:24.771685 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3370/6769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:24 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:25.792473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:25.793103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:25.800225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:25.800687 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:25.801467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:25.801917 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:25.954802 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:25.962255 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a468516-4b35-4c6d-a05c-80681ddac6ad tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.177153 May 07 22:36:25.962860 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3400/6770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:25 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:26.979875 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:26.980520 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:26.988675 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:26.989148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:26.989948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:26.990401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:27.127193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:27.134667 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0a83ed41-c26c-4302-be5a-d2df6ece4c4b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.158804 May 07 22:36:27.135273 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3371/6771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:26 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:28.157768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:28.158363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:28.165409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:28.165874 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:28.166654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:28.167151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:28.299036 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:28.306422 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c4044f3-ce20-4f9e-99ef-52640c3438c4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.153268 May 07 22:36:28.307021 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3401/6772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:28 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:29.323663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:29.324306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:29.331824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:29.332309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:29.333104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:29.333566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:29.464940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:29.472552 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b1c4644d-6957-403c-aadc-29b6d9292eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.152949 May 07 22:36:29.473132 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3372/6773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:29 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:30.489580 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:30.490215 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:30.498027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:30.498567 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:30.499357 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:30.499805 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:30.628106 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:30.635474 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e5d75b56-19b9-458c-825b-56c8c9eb26f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.149866 May 07 22:36:30.636050 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3402/6774] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:30 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:31.653147 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:31.653774 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:31.661162 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:31.661631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:31.662415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:31.662897 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:31.794943 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:31.802856 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4c2c4157-dabd-4840-b779-5af0b8dc1de7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.153680 May 07 22:36:31.803452 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3373/6775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:31 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:32.819956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:32.820583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:32.827420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:32.827885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:32.828680 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:32.829124 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:32.961147 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:32.969094 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9fc7fefd-6992-4c23-a801-dc8fcce344bb tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.153093 May 07 22:36:32.969666 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3403/6776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:32 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:33.986823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:33.987494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:33.994188 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:33.994651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:33.995459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:33.995940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:34.126265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:34.133737 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0092268-20c7-45cf-b5ae-52b4f396a30b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.151427 May 07 22:36:34.134340 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3374/6777] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:33 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:35.151365 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:35.151979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:35.158611 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:35.159095 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:35.159897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:35.160340 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:35.295107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:35.303327 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cb0f2f0c-5177-47c1-82a7-c6acdd4027d3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.155893 May 07 22:36:35.303914 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3404/6778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:35 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:36.320717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:36.321362 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:36.328797 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:36.329314 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:36.330110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:36.330573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:36.462430 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:36.470539 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-534a09cd-fdad-44c8-9a75-40215f8cdfdc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.153848 May 07 22:36:36.471174 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3375/6779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:36 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:37.488222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:37.488848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:37.495965 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:37.496596 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:37.497337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:37.497865 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:37.631825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:37.645744 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e71f70e-a98c-49ad-a710-d5b69be9bb48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.161589 May 07 22:36:37.646688 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3405/6780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:37 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:38.669627 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:38.670264 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:38.677574 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:38.678248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:38.679139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:38.679595 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:38.813196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:38.820604 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-68e1b00b-742b-47f7-b08c-958e24bc731d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.155018 May 07 22:36:38.821181 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3376/6781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:38 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:39.837768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:39.838427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:39.845866 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:39.846329 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:39.847148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:39.847599 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:39.976171 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:39.984252 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1b989931-f5aa-4173-87b8-2600c8b2f323 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.149805 May 07 22:36:39.984871 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3406/6782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:39 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:41.002254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:41.002935 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:41.010462 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:41.011005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:41.011839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:41.012308 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:41.146370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:41.154271 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ac8c4304-d673-45c0-bea3-e05278b5bb7f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1697 microversion: 2.1 time: 0.156578 May 07 22:36:41.154945 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3377/6783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:40 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:41.558238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-74089c55-492e-4592-8be3-157c35fa0c2f req-4abc83d3-4b15-4243-a38c-598c5512ee8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "name": "network-vif-unplugged", "status": "completed", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:36:41.567946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-74089c55-492e-4592-8be3-157c35fa0c2f req-4abc83d3-4b15-4243-a38c-598c5512ee8b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:41.568867 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-74089c55-492e-4592-8be3-157c35fa0c2f req-4abc83d3-4b15-4243-a38c-598c5512ee8b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:41.585261 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-74089c55-492e-4592-8be3-157c35fa0c2f req-4abc83d3-4b15-4243-a38c-598c5512ee8b service nova] Creating event network-vif-unplugged:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch2-master-1 May 07 22:36:41.590743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [req-74089c55-492e-4592-8be3-157c35fa0c2f req-4abc83d3-4b15-4243-a38c-598c5512ee8b service nova] Instance 198f28b8-a612-4403-b548-7092f68b2674 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136682) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:36:41.602162 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-74089c55-492e-4592-8be3-157c35fa0c2f req-4abc83d3-4b15-4243-a38c-598c5512ee8b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047709 May 07 22:36:41.602819 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3407/6784] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:36:42.172870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:42.173537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:42.180386 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:42.180980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:42.181809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:42.182267 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:42.400883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:42.408962 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3eb8f0e2-71fe-43a5-bcd1-dcf9b59a6d41 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1696 microversion: 2.1 time: 0.241099 May 07 22:36:42.409542 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3378/6785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:42 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1696 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:43.427850 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:43.428561 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:43.435348 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:43.435842 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:43.436622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:43.437071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:43.571633 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:43.578999 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f554cf06-8e40-4f66-8b90-da4d71578af4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1694 microversion: 2.1 time: 0.156911 May 07 22:36:43.579572 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3408/6786] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:43 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:43.619848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-69ad8e5c-f1ee-416f-a6cc-5d1d679e281b req-e330b707-da38-4937-bc50-e0cc86c4d14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:36:43.628637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-69ad8e5c-f1ee-416f-a6cc-5d1d679e281b req-e330b707-da38-4937-bc50-e0cc86c4d14c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:43.629108 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-69ad8e5c-f1ee-416f-a6cc-5d1d679e281b req-e330b707-da38-4937-bc50-e0cc86c4d14c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:43.640682 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-69ad8e5c-f1ee-416f-a6cc-5d1d679e281b req-e330b707-da38-4937-bc50-e0cc86c4d14c service nova] Creating event network-changed:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch2-master-1 May 07 22:36:43.645928 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [req-69ad8e5c-f1ee-416f-a6cc-5d1d679e281b req-e330b707-da38-4937-bc50-e0cc86c4d14c service nova] Instance 198f28b8-a612-4403-b548-7092f68b2674 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136681) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 07 22:36:43.657622 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-69ad8e5c-f1ee-416f-a6cc-5d1d679e281b req-e330b707-da38-4937-bc50-e0cc86c4d14c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041460 May 07 22:36:43.658217 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3379/6787] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:36:44.596815 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:44.597363 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:44.604136 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:44.604591 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:44.605388 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:44.605834 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:44.737702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:44.745064 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-decfa79f-785c-471e-8153-bcd591a98fd1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1691 microversion: 2.1 time: 0.152258 May 07 22:36:44.745638 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3409/6788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:44 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:44.762435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9884dd28-2fd6-41b8-9aab-f126c650d85d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:36:44.763156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9884dd28-2fd6-41b8-9aab-f126c650d85d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:44.770262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9884dd28-2fd6-41b8-9aab-f126c650d85d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:44.770799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9884dd28-2fd6-41b8-9aab-f126c650d85d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:44.771599 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9884dd28-2fd6-41b8-9aab-f126c650d85d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:44.772064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9884dd28-2fd6-41b8-9aab-f126c650d85d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:44.829022 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9884dd28-2fd6-41b8-9aab-f126c650d85d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action" status: 204 len: 0 microversion: 2.1 time: 0.070673 May 07 22:36:44.829669 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3380/6789] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:36:44 2022] POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:36:44.837778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:44.838397 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:44.844622 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:44.845079 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:44.845966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:44.846572 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:45.062080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:45.069339 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bd787049-e5af-407e-8366-91d0330661e1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1691 microversion: 2.1 time: 0.235498 May 07 22:36:45.069919 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3410/6790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:44 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:45.086996 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:45.088282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:45.095471 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:45.095952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:45.096755 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:45.097223 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:45.234125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:45.242174 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c7a06c23-f67c-48c1-86b9-ad8b838fcd90 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1691 microversion: 2.1 time: 0.160121 May 07 22:36:45.243022 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3381/6791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:45 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:36:46.258856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:36:46.259481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:36:46.266291 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:46.266745 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:46.267543 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:46.267985 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:46.401963 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:36:46.409958 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb38d8de-17b4-40d6-ba97-3ba05066d8f9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1683 microversion: 2.1 time: 0.155022 May 07 22:36:46.410533 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3411/6792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:36:46 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:36:47.730415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-df7c65c2-7aa0-42f3-a9b1-6ff6bccda9b2 req-ce0c432d-4c74-4dcf-8095-ba0a66497072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "name": "network-vif-plugged", "status": "completed", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:36:47.739778 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-df7c65c2-7aa0-42f3-a9b1-6ff6bccda9b2 req-ce0c432d-4c74-4dcf-8095-ba0a66497072 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:36:47.740265 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-df7c65c2-7aa0-42f3-a9b1-6ff6bccda9b2 req-ce0c432d-4c74-4dcf-8095-ba0a66497072 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:36:47.752317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-df7c65c2-7aa0-42f3-a9b1-6ff6bccda9b2 req-ce0c432d-4c74-4dcf-8095-ba0a66497072 service nova] Creating event network-vif-plugged:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch2-master-1 May 07 22:36:47.757327 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-df7c65c2-7aa0-42f3-a9b1-6ff6bccda9b2 req-ce0c432d-4c74-4dcf-8095-ba0a66497072 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 May 07 22:36:47.757927 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3382/6793] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:37:08.587666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6b1aff06-e8f3-4b7d-a936-b31ec23d2e48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:08.588615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6b1aff06-e8f3-4b7d-a936-b31ec23d2e48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:08.594910 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b1aff06-e8f3-4b7d-a936-b31ec23d2e48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:08.595377 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b1aff06-e8f3-4b7d-a936-b31ec23d2e48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:08.596159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b1aff06-e8f3-4b7d-a936-b31ec23d2e48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:08.596610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6b1aff06-e8f3-4b7d-a936-b31ec23d2e48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:08.648160 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6b1aff06-e8f3-4b7d-a936-b31ec23d2e48 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action" status: 200 len: 24578 microversion: 2.1 time: 0.064439 May 07 22:37:08.648874 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3412/6794] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:37:08 2022] POST /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674/action => generated 24578 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:37:15.747027 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:15.747639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:15.748695 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c3801c90-a31c-4db8-8a00-269a8c928203 req-ef45e3bb-a693-4860-a10e-d0a283f626b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:15.756066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:15.756544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:15.757344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:15.757805 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:15.759943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c3801c90-a31c-4db8-8a00-269a8c928203 req-ef45e3bb-a693-4860-a10e-d0a283f626b6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:15.760461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c3801c90-a31c-4db8-8a00-269a8c928203 req-ef45e3bb-a693-4860-a10e-d0a283f626b6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:15.773000 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-c3801c90-a31c-4db8-8a00-269a8c928203 req-ef45e3bb-a693-4860-a10e-d0a283f626b6 service nova] Creating event network-changed:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch2-master-1 May 07 22:37:15.778282 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c3801c90-a31c-4db8-8a00-269a8c928203 req-ef45e3bb-a693-4860-a10e-d0a283f626b6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033768 May 07 22:37:15.779259 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3413/6795] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:37:15.784930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:37:15.879494 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ca25dfdd-c42e-4fc5-8be3-5d188281ad60 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 204 len: 0 microversion: 2.1 time: 0.136631 May 07 22:37:15.880390 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3383/6796] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:37:15 2022] DELETE /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:37:15.890930 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:15.891648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:15.898555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:15.898885 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:15.899736 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:15.899941 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:16.040156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:16.048239 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5819c106-bd2b-42d3-97d1-61abf36a17f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1689 microversion: 2.1 time: 0.162445 May 07 22:37:16.048820 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3414/6797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:15 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:17.067566 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:17.068294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:17.075502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:17.075979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:17.076780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:17.077239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:17.351680 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:17.359353 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f64f79f3-922f-4331-ba66-727412f79186 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1689 microversion: 2.1 time: 0.296895 May 07 22:37:17.360467 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3384/6798] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:17 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:18.086851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-01b7baed-92b6-4d92-9c2d-afece48d8a97 req-b6b07a2e-cd72-47f0-abd2-0916c57469e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198f28b8-a612-4403-b548-7092f68b2674", "name": "network-vif-deleted", "tag": "024aac08-2cff-469c-bbab-8f595fa70df3"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:18.096263 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-01b7baed-92b6-4d92-9c2d-afece48d8a97 req-b6b07a2e-cd72-47f0-abd2-0916c57469e8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:18.096719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-01b7baed-92b6-4d92-9c2d-afece48d8a97 req-b6b07a2e-cd72-47f0-abd2-0916c57469e8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:18.110947 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-01b7baed-92b6-4d92-9c2d-afece48d8a97 req-b6b07a2e-cd72-47f0-abd2-0916c57469e8 service nova] Creating event network-vif-deleted:024aac08-2cff-469c-bbab-8f595fa70df3 for instance 198f28b8-a612-4403-b548-7092f68b2674 on nch2-master-1 May 07 22:37:18.115818 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-01b7baed-92b6-4d92-9c2d-afece48d8a97 req-b6b07a2e-cd72-47f0-abd2-0916c57469e8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032751 May 07 22:37:18.116431 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3415/6799] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:37:18.378038 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:18.379346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:18.386524 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:18.387028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:18.387836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:18.388295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:18.422367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:18.422879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:18.423376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lazy-loading 'fault' on Instance uuid 198f28b8-a612-4403-b548-7092f68b2674 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:37:18.468240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:18.476303 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1feb74bf-570f-4b38-ba8c-cbfdd0260ba0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 200 len: 1356 microversion: 2.1 time: 0.102733 May 07 22:37:18.486082 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3385/6800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:18 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:19.494904 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:19.495624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 198f28b8-a612-4403-b548-7092f68b2674] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:19.501946 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:19.502409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:19.503229 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:19.503685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:19.517068 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] HTTP exception thrown: Instance 198f28b8-a612-4403-b548-7092f68b2674 could not be found. May 07 22:37:19.518167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Returning 404 to user: Instance 198f28b8-a612-4403-b548-7092f68b2674 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:37:19.519037 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-97d76628-ab74-4e39-bb69-ad0e8aa89d10 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674" status: 404 len: 111 microversion: 2.1 time: 0.029339 May 07 22:37:19.519576 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3416/6801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:19 2022] GET /compute/v2.1/servers/198f28b8-a612-4403-b548-7092f68b2674 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:37:22.948315 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5a440540-f9f5-4930-9cd0-4d2ff696ab38 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '.version_select at 0x7fc40fcfd040>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:22.969294 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5a440540-f9f5-4930-9cd0-4d2ff696ab38 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1403160565" status: 202 len: 0 microversion: 2.1 time: 0.024726 May 07 22:37:22.970808 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3386/6802] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1403160565 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:37:22.997732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8865594f-2feb-4a86-985b-66c09e3fabce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: .version_select at 0x7fc41c429670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1880805885"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:23.017569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8865594f-2feb-4a86-985b-66c09e3fabce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:37:23.025534 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8865594f-2feb-4a86-985b-66c09e3fabce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:37:23.179097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8865594f-2feb-4a86-985b-66c09e3fabce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:37:23.184138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-8865594f-2feb-4a86-985b-66c09e3fabce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:37:23.198343 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8865594f-2feb-4a86-985b-66c09e3fabce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.205929 May 07 22:37:23.198986 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3417/6803] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:37:22 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:28.878024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-215770596", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "113e217e-2498-42de-9275-e28e3e4deabe"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1880805885", "security_groups": [{"name": "tempest-secgroup-smoke-28696311"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:28.997050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] validate_networks() for [('113e217e-2498-42de-9275-e28e3e4deabe', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:37:29.404300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:37:29.404978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:37:29.405848 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:37:29.406487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:37:29.407268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:37:29.417165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:29.417649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:29.418494 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:29.419010 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:29.439876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:37:29.445525 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:37:29.459789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:37:29.462414 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:37:29.527666 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1a571fa5-13cd-46eb-9f9b-42607630bc99 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.653599 May 07 22:37:29.536704 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3387/6804] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:37:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:37:29.544530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-23cd072a-537e-44bd-8940-c5449d654537 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:29.545394 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-23cd072a-537e-44bd-8940-c5449d654537 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:29.624569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-23cd072a-537e-44bd-8940-c5449d654537 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:29.635600 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-23cd072a-537e-44bd-8940-c5449d654537 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1266 microversion: 2.1 time: 0.092119 May 07 22:37:29.636724 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3418/6805] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:29 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:30.654582 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:30.655976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:30.665001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:30.665826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:30.666918 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:30.667583 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:30.767200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:30.776170 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f094f730-45f4-4fb3-a898-a0e781b45218 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1336 microversion: 2.1 time: 0.127009 May 07 22:37:30.777282 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3388/6806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:30 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:31.796897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:31.798148 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:31.809831 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:31.810295 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:31.811123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:31.811565 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:32.089734 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:32.098574 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-664b4d20-9608-4246-9abf-d73df904e942 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1390 microversion: 2.1 time: 0.308331 May 07 22:37:32.102592 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3419/6807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:31 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1390 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:32.349307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9cff7041-6643-4030-ba7a-165d58083d69 req-dbd36cfe-8b53-4090-af7c-3fbb612090f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931d8542-a351-49bc-afdd-eda877dfe3c2", "tag": "1198e88f-fdd8-4ae3-acce-dbd51b91440c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:32.363209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cff7041-6643-4030-ba7a-165d58083d69 req-dbd36cfe-8b53-4090-af7c-3fbb612090f5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:32.364207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cff7041-6643-4030-ba7a-165d58083d69 req-dbd36cfe-8b53-4090-af7c-3fbb612090f5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:32.386749 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9cff7041-6643-4030-ba7a-165d58083d69 req-dbd36cfe-8b53-4090-af7c-3fbb612090f5 service nova] Creating event network-changed:1198e88f-fdd8-4ae3-acce-dbd51b91440c for instance 931d8542-a351-49bc-afdd-eda877dfe3c2 on nch1-master-1 May 07 22:37:32.395236 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9cff7041-6643-4030-ba7a-165d58083d69 req-dbd36cfe-8b53-4090-af7c-3fbb612090f5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053811 May 07 22:37:32.396814 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3389/6808] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:37:33.119665 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:33.120226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:33.127562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:33.128023 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:33.128789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:33.129232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:33.263555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:33.271376 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-46dac52a-d9fc-401f-aa7a-8b5e5e4613e2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1390 microversion: 2.1 time: 0.155682 May 07 22:37:33.272006 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3420/6809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:33 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:34.290348 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:34.291132 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:34.297437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:34.297912 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:34.298708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:34.299196 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:34.426929 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:34.434292 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b5599f0-5219-418c-9850-0afce57a08fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1390 microversion: 2.1 time: 0.149418 May 07 22:37:34.434889 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3390/6810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:34 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:35.451271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:35.451835 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:35.459356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:35.459838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:35.460679 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:35.461140 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:35.591073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:35.598389 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7307b8c9-be52-4b6d-a1a1-e2ee95d92811 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1390 microversion: 2.1 time: 0.151100 May 07 22:37:35.598998 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3421/6811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:35 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:36.662878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:36.663526 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:36.669895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:36.670376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:36.671214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:36.671674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:36.806925 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:36.814993 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-76ee9094-99b1-43b4-ba0c-feeb5db69eb3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1390 microversion: 2.1 time: 0.203601 May 07 22:37:36.815572 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3391/6812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:36 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:37.425162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-b4a88bae-1965-4080-ab4e-d6fb0b6bebab req-b5f569a9-8813-47b9-9d59-2b36354e5470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931d8542-a351-49bc-afdd-eda877dfe3c2", "name": "network-vif-plugged", "status": "completed", "tag": "1198e88f-fdd8-4ae3-acce-dbd51b91440c"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:37.433902 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b4a88bae-1965-4080-ab4e-d6fb0b6bebab req-b5f569a9-8813-47b9-9d59-2b36354e5470 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:37.434359 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-b4a88bae-1965-4080-ab4e-d6fb0b6bebab req-b5f569a9-8813-47b9-9d59-2b36354e5470 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:37.445712 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-b4a88bae-1965-4080-ab4e-d6fb0b6bebab req-b5f569a9-8813-47b9-9d59-2b36354e5470 service nova] Creating event network-vif-plugged:1198e88f-fdd8-4ae3-acce-dbd51b91440c for instance 931d8542-a351-49bc-afdd-eda877dfe3c2 on nch1-master-1 May 07 22:37:37.450701 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-b4a88bae-1965-4080-ab4e-d6fb0b6bebab req-b5f569a9-8813-47b9-9d59-2b36354e5470 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 May 07 22:37:37.451289 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3422/6813] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:37:37.832665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:37.833409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:37.840543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:37.841019 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:37.841817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:37.842279 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:37.971479 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:37.978809 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f040bd67-38f3-4544-b53a-1647de8d072a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1390 microversion: 2.1 time: 0.150758 May 07 22:37:37.979372 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3392/6814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:37 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:38.996158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:38.996873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:39.003779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:39.004271 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:39.005051 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:39.005510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:39.143703 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:39.151142 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-526c574e-a916-4fd0-a33d-b3c7fc68d85f tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1562 microversion: 2.1 time: 0.160182 May 07 22:37:39.151726 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3423/6815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:38 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:39.167847 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:39.168481 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:39.175750 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:39.176221 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:39.177001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:39.177474 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:39.309468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:39.316853 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-457569f3-d570-4849-b591-247a27df4517 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1562 microversion: 2.1 time: 0.153530 May 07 22:37:39.317439 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3393/6816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:39 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:37:41.272303 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:37:41.272939 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:37:41.274854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-fc7ca34c-515d-47d3-8182-2187d9c85fb8 req-7984f838-24e4-448b-b7b2-7de46d9d9d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931d8542-a351-49bc-afdd-eda877dfe3c2", "tag": "1198e88f-fdd8-4ae3-acce-dbd51b91440c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:37:41.279907 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:41.280383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:41.281181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:41.281655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:41.284706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fc7ca34c-515d-47d3-8182-2187d9c85fb8 req-7984f838-24e4-448b-b7b2-7de46d9d9d58 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:37:41.285176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-fc7ca34c-515d-47d3-8182-2187d9c85fb8 req-7984f838-24e4-448b-b7b2-7de46d9d9d58 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:37:41.296556 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-fc7ca34c-515d-47d3-8182-2187d9c85fb8 req-7984f838-24e4-448b-b7b2-7de46d9d9d58 service nova] Creating event network-changed:1198e88f-fdd8-4ae3-acce-dbd51b91440c for instance 931d8542-a351-49bc-afdd-eda877dfe3c2 on nch1-master-1 May 07 22:37:41.302559 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-fc7ca34c-515d-47d3-8182-2187d9c85fb8 req-7984f838-24e4-448b-b7b2-7de46d9d9d58 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031296 May 07 22:37:41.303601 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3394/6817] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:37:41.528070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:37:41.536573 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-61416257-4d22-48da-ad6c-585035a2dba9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1562 microversion: 2.1 time: 0.268575 May 07 22:37:41.537283 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3424/6818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:37:41 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:02.786304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d5294686-cbf2-47ef-82cd-89448c087183 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:38:02.787548 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d5294686-cbf2-47ef-82cd-89448c087183 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:02.794495 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5294686-cbf2-47ef-82cd-89448c087183 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:02.795016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5294686-cbf2-47ef-82cd-89448c087183 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:02.795815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5294686-cbf2-47ef-82cd-89448c087183 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:02.796282 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d5294686-cbf2-47ef-82cd-89448c087183 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:02.849317 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d5294686-cbf2-47ef-82cd-89448c087183 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action" status: 200 len: 24572 microversion: 2.1 time: 0.067933 May 07 22:38:02.850311 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3395/6819] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:38:02 2022] POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action => generated 24572 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:38:13.876287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb9c85f3-d5ed-4a7f-9d4a-825be14e6b11 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:38:13.883298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb9c85f3-d5ed-4a7f-9d4a-825be14e6b11 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:13.883800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb9c85f3-d5ed-4a7f-9d4a-825be14e6b11 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:13.906427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb9c85f3-d5ed-4a7f-9d4a-825be14e6b11 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Going to try to stop instance {{(pid=136682) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 07 22:38:13.947578 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb9c85f3-d5ed-4a7f-9d4a-825be14e6b11 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action" status: 202 len: 0 microversion: 2.1 time: 0.075505 May 07 22:38:13.948183 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3425/6820] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:38:13 2022] POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:38:13.957749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:13.958512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:13.965899 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:13.966376 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:13.967204 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:13.967668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:14.099224 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:14.107197 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c253454-b416-46b7-af5b-51f5dc971fdd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.154572 May 07 22:38:14.107770 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3396/6821] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:13 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:15.125347 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:15.126060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:15.133355 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:15.133813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:15.134586 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:15.135067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:15.268649 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:15.276687 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-09823faf-bcd7-4911-a8a0-484eb48785ff tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.155684 May 07 22:38:15.277262 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3426/6822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:15 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:16.294175 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:16.294840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:16.302433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:16.302948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:16.303759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:16.304225 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:16.437907 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:16.445363 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-767007d0-e893-47a9-b629-383424845666 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.155229 May 07 22:38:16.445927 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3397/6823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:16 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:17.461514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:17.462105 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:17.468948 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:17.469407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:17.470213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:17.470663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:17.601613 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:17.609021 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fcb98631-98fd-45d5-95ca-92224822d448 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.151520 May 07 22:38:17.609589 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3427/6824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:17 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:18.626795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:18.627445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:18.634321 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:18.634825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:18.635617 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:18.636080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:18.766625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:18.774570 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d0bbe0a3-0df1-4d78-92f4-e8245963d3e6 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.151790 May 07 22:38:18.775164 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3398/6825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:18 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:19.792042 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:19.792669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:19.799491 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:19.799952 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:19.800723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:19.801172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:20.255425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:20.263062 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2f3b28b0-f289-472e-be55-4814d2b3cc7a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.475207 May 07 22:38:20.263623 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3428/6826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:19 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:21.280443 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:21.281116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:21.288018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:21.288760 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:21.289554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:21.290021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:21.417980 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:21.425336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ffd8a730-005e-4f16-b8fb-28cab94ee3f0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.148883 May 07 22:38:21.425912 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3399/6827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:21 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:22.442139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:22.442713 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:22.449724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:22.450183 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:22.451015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:22.451448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:22.580730 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:22.588564 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-866f0086-33c6-41bd-9c9b-cc9475c2edee tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.150492 May 07 22:38:22.589129 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3429/6828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:22 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:23.606283 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:23.606948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:23.613726 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:23.614193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:23.615005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:23.615459 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:23.750127 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:23.757797 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-450eed14-211e-4d41-947e-972707b539c7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.155482 May 07 22:38:23.758408 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3400/6829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:23 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:24.775602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:24.776211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:24.783204 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:24.783631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:24.785075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:24.785530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:24.924775 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:24.932233 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7daf288b-7610-4ec7-9e4a-18311719a598 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.160569 May 07 22:38:24.932827 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3430/6830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:24 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:25.949597 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:25.950295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:25.957190 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:25.957670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:25.958465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:25.958969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:26.089731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:26.097830 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d9995de0-6dd7-488e-a9b6-2d6afe9f76bd tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.152317 May 07 22:38:26.098419 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3401/6831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:25 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:27.116031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:27.116634 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:27.123465 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:27.123929 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:27.124766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:27.125216 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:27.262503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:27.270057 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-311bedab-7a94-47f0-bb1b-1abb18a1c3ef tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.158590 May 07 22:38:27.270640 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3431/6832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:27 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:28.287734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:28.288628 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:28.295515 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:28.295997 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:28.296796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:28.297263 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:28.429577 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:28.436991 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9daac357-d393-4dae-9eb2-822b235ebb44 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1691 microversion: 2.1 time: 0.153813 May 07 22:38:28.437562 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3402/6833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:28 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:29.454849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:29.455406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:29.461881 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:29.462346 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:29.463154 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:29.463606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:29.595113 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:29.604995 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0761da9a-0b1c-4aa6-930a-36b1e03ed34d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1668 microversion: 2.1 time: 0.154173 May 07 22:38:29.605581 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3432/6834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:29 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:30.695453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-77469000-a31b-4367-9a45-d1d2340fcdc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:38:30.696650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-77469000-a31b-4367-9a45-d1d2340fcdc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:30.703654 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77469000-a31b-4367-9a45-d1d2340fcdc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:30.704130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77469000-a31b-4367-9a45-d1d2340fcdc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:30.704916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77469000-a31b-4367-9a45-d1d2340fcdc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:30.705374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-77469000-a31b-4367-9a45-d1d2340fcdc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:30.754498 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-77469000-a31b-4367-9a45-d1d2340fcdc7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action" status: 200 len: 38391 microversion: 2.1 time: 0.063106 May 07 22:38:30.755168 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3403/6835] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:38:30 2022] POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action => generated 38391 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:38:30.766514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-03b08435-73b1-4ab4-acfc-5b76d869bef4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:38:30.773967 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03b08435-73b1-4ab4-acfc-5b76d869bef4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:30.774433 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-03b08435-73b1-4ab4-acfc-5b76d869bef4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:30.796891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-03b08435-73b1-4ab4-acfc-5b76d869bef4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Going to try to start instance {{(pid=136682) start /opt/stack/nova/nova/compute/api.py:2730}} May 07 22:38:30.836966 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-03b08435-73b1-4ab4-acfc-5b76d869bef4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action" status: 202 len: 0 microversion: 2.1 time: 0.074217 May 07 22:38:30.837578 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3433/6836] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:38:30 2022] POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:38:30.846536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:30.847504 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:30.856337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:30.856815 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:30.857853 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:30.858319 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:31.000513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:31.008291 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-86cb5fc7-13ea-4f28-b73d-427e48b6c033 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1677 microversion: 2.1 time: 0.166023 May 07 22:38:31.008961 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3404/6837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:30 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:32.026950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:38:32.027581 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:32.035145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:32.035838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:32.036708 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:32.037159 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:32.171790 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:38:32.179782 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-850eb7b9-ce9e-40ce-b26f-8a7f08079e86 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1681 microversion: 2.1 time: 0.157184 May 07 22:38:32.180365 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3434/6838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:38:32 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:38:56.364742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5f3074a1-06aa-4cce-aa2b-4846552bbcc3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:38:56.365699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5f3074a1-06aa-4cce-aa2b-4846552bbcc3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:38:56.372309 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f3074a1-06aa-4cce-aa2b-4846552bbcc3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:56.372785 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f3074a1-06aa-4cce-aa2b-4846552bbcc3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:56.373576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f3074a1-06aa-4cce-aa2b-4846552bbcc3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:38:56.374039 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5f3074a1-06aa-4cce-aa2b-4846552bbcc3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:38:56.426607 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5f3074a1-06aa-4cce-aa2b-4846552bbcc3 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action" status: 200 len: 62958 microversion: 2.1 time: 0.065900 May 07 22:38:56.427360 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3405/6839] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:38:56 2022] POST /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2/action => generated 62958 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:38:59.340667 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:38:59.341124 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:38:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:39:03.467473 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:03.468143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:03.475840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:03.476300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:03.477300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:03.477751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:03.503826 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:39:03.544536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-95af24a7-8980-4de3-b672-4197687a8a08 req-d93b37ec-31fb-412d-9ca3-1b735ab00c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931d8542-a351-49bc-afdd-eda877dfe3c2", "tag": "1198e88f-fdd8-4ae3-acce-dbd51b91440c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:03.552968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-95af24a7-8980-4de3-b672-4197687a8a08 req-d93b37ec-31fb-412d-9ca3-1b735ab00c4e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:03.553448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-95af24a7-8980-4de3-b672-4197687a8a08 req-d93b37ec-31fb-412d-9ca3-1b735ab00c4e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:03.564960 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-95af24a7-8980-4de3-b672-4197687a8a08 req-d93b37ec-31fb-412d-9ca3-1b735ab00c4e service nova] Creating event network-changed:1198e88f-fdd8-4ae3-acce-dbd51b91440c for instance 931d8542-a351-49bc-afdd-eda877dfe3c2 on nch1-master-1 May 07 22:39:03.570743 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-95af24a7-8980-4de3-b672-4197687a8a08 req-d93b37ec-31fb-412d-9ca3-1b735ab00c4e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104487 May 07 22:39:03.571767 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3406/6840] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:39:03.591036 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2eae9788-b5ea-44e2-add8-3a2e6b98f48e tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 204 len: 0 microversion: 2.1 time: 0.127277 May 07 22:39:03.591643 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3435/6841] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:39:03 2022] DELETE /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:39:03.602433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:03.603543 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:03.610946 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:03.611585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:03.612514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:03.613086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:03.755142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:03.762866 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6906fa32-218c-4d69-8b8c-698dfa1ab4f1 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1687 microversion: 2.1 time: 0.165797 May 07 22:39:03.763536 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3407/6842] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:03 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:04.781668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:04.782381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:04.790058 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:04.790515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:04.791320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:04.791768 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:04.983824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:04.991410 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-4a6a9d1f-4997-420c-84e8-d979b3b13749 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1687 microversion: 2.1 time: 0.214060 May 07 22:39:04.992208 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3436/6843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:04 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:05.732086 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-baa0506a-13bb-4f28-9f82-e0085c71c91b req-7b44e49e-133f-4f15-a649-d5c233da0729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931d8542-a351-49bc-afdd-eda877dfe3c2", "name": "network-vif-deleted", "tag": "1198e88f-fdd8-4ae3-acce-dbd51b91440c"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:05.742626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-baa0506a-13bb-4f28-9f82-e0085c71c91b req-7b44e49e-133f-4f15-a649-d5c233da0729 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:05.743453 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-baa0506a-13bb-4f28-9f82-e0085c71c91b req-7b44e49e-133f-4f15-a649-d5c233da0729 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:05.757458 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-baa0506a-13bb-4f28-9f82-e0085c71c91b req-7b44e49e-133f-4f15-a649-d5c233da0729 service nova] Creating event network-vif-deleted:1198e88f-fdd8-4ae3-acce-dbd51b91440c for instance 931d8542-a351-49bc-afdd-eda877dfe3c2 on nch1-master-1 May 07 22:39:05.762612 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-baa0506a-13bb-4f28-9f82-e0085c71c91b req-7b44e49e-133f-4f15-a649-d5c233da0729 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034243 May 07 22:39:05.763247 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3408/6844] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:39:06.009663 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:06.010381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:06.017523 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:06.017984 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:06.018873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:06.019296 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:06.051994 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:06.052455 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:06.052918 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lazy-loading 'fault' on Instance uuid 931d8542-a351-49bc-afdd-eda877dfe3c2 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:39:06.097564 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:06.106317 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c3189bfd-fdb8-4c6d-9fb1-d999753de2fa tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 200 len: 1356 microversion: 2.1 time: 0.101242 May 07 22:39:06.106940 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3437/6845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:06 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:07.125286 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:07.126021 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 931d8542-a351-49bc-afdd-eda877dfe3c2] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:07.133584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:07.134053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:07.134895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:07.135361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:07.155486 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] HTTP exception thrown: Instance 931d8542-a351-49bc-afdd-eda877dfe3c2 could not be found. May 07 22:39:07.156111 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Returning 404 to user: Instance 931d8542-a351-49bc-afdd-eda877dfe3c2 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:39:07.156977 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c43df428-45fc-4744-bf89-cdccfe5fc336 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2" status: 404 len: 111 microversion: 2.1 time: 0.037072 May 07 22:39:07.157544 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3409/6846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:07 2022] GET /compute/v2.1/servers/931d8542-a351-49bc-afdd-eda877dfe3c2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:39:10.560411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dc84c6b9-38d9-4c01-abec-e12b2061a188 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '.version_select at 0x7fc41d2c44c0>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:10.581065 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dc84c6b9-38d9-4c01-abec-e12b2061a188 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1880805885" status: 202 len: 0 microversion: 2.1 time: 0.024321 May 07 22:39:10.581835 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3438/6847] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:39:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1880805885 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:39:10.609568 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9b4b21c9-0af4-4d1b-9b72-365316751904 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: .version_select at 0x7fc41d4ebc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1198430564"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:10.624591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9b4b21c9-0af4-4d1b-9b72-365316751904 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:39:10.630464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9b4b21c9-0af4-4d1b-9b72-365316751904 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:39:10.831071 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9b4b21c9-0af4-4d1b-9b72-365316751904 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:39:10.836390 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-9b4b21c9-0af4-4d1b-9b72-365316751904 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:39:10.852320 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9b4b21c9-0af4-4d1b-9b72-365316751904 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.245586 May 07 22:39:10.853148 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3410/6848] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:39:10 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:16.711895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1656048770", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "networks": [{"uuid": "f3d529df-b0b5-47a4-ba13-cc9cedbd95d2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1198430564", "security_groups": [{"name": "tempest-secgroup-smoke-1170967879"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:16.837424 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] validate_networks() for [('f3d529df-b0b5-47a4-ba13-cc9cedbd95d2', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:39:17.243425 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:39:17.243863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:39:17.244354 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:39:17.244773 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:39:17.245200 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:39:17.254440 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:17.254953 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:17.255778 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:17.256261 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:17.274463 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:39:17.279871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Getting quotas for user 374a4fe2efa9420fab9cc8370bc56810 and project f3dc672b922b4f86869d8b6108240e0a. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:39:17.293269 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:39:17.295670 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:39:17.343526 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1add5358-e18d-4b3d-87a3-73301a0f3f42 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639539 May 07 22:39:17.345154 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3439/6849] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:39:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:39:17.356457 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-028fd0dd-d9bd-47ed-a026-806e5e4b4cca tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:17.357242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-028fd0dd-d9bd-47ed-a026-806e5e4b4cca tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:17.411300 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-028fd0dd-d9bd-47ed-a026-806e5e4b4cca tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:17.418333 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-028fd0dd-d9bd-47ed-a026-806e5e4b4cca tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1267 microversion: 2.1 time: 0.066822 May 07 22:39:17.418933 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3411/6850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:17 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:39:18.435494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b6b9be7c-51a0-4213-928c-4d5d9d804fb8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:18.436251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b6b9be7c-51a0-4213-928c-4d5d9d804fb8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:18.496139 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b6b9be7c-51a0-4213-928c-4d5d9d804fb8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:18.503234 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b6b9be7c-51a0-4213-928c-4d5d9d804fb8 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1267 microversion: 2.1 time: 0.071790 May 07 22:39:18.503859 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3440/6851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:18 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:19.520870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6e84aa88-81af-474d-867a-b00a2c63dac2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:19.523193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6e84aa88-81af-474d-867a-b00a2c63dac2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:19.588138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6e84aa88-81af-474d-867a-b00a2c63dac2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:19.596757 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6e84aa88-81af-474d-867a-b00a2c63dac2 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1267 microversion: 2.1 time: 0.079799 May 07 22:39:19.597401 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3412/6852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:19 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:20.614476 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-86be9d53-bcbc-49f3-b697-4a89bf8c0b5a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:20.615039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-86be9d53-bcbc-49f3-b697-4a89bf8c0b5a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:20.669991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-86be9d53-bcbc-49f3-b697-4a89bf8c0b5a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:20.676890 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-86be9d53-bcbc-49f3-b697-4a89bf8c0b5a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1267 microversion: 2.1 time: 0.066479 May 07 22:39:20.677473 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3441/6853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:20 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1267 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:21.694719 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:21.696150 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:21.703401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:21.703881 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:21.704742 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:21.705207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:21.769056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:21.777046 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b854667e-25e5-4864-a231-a731684d435a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1271 microversion: 2.1 time: 0.086643 May 07 22:39:21.777636 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3413/6854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:21 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:22.794812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:22.795389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:22.803010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:22.803481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:22.804913 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:22.805371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:22.869925 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:22.877342 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fb178909-473f-45d1-bc80-901137995795 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1325 microversion: 2.1 time: 0.086602 May 07 22:39:22.877931 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3442/6855] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:22 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1325 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:23.798242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-2bfa2b28-f1b7-4cbb-99a8-8c33bee2f4df req-8e34371b-ece8-4947-a3d5-ade7dbb51dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d5a2eb-463e-42b2-bc8a-8b054ac226fe", "tag": "b9eb864c-7f33-4fd1-b4e2-ce05faad73ca"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:23.808860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2bfa2b28-f1b7-4cbb-99a8-8c33bee2f4df req-8e34371b-ece8-4947-a3d5-ade7dbb51dae service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:23.809391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-2bfa2b28-f1b7-4cbb-99a8-8c33bee2f4df req-8e34371b-ece8-4947-a3d5-ade7dbb51dae service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:23.827877 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-2bfa2b28-f1b7-4cbb-99a8-8c33bee2f4df req-8e34371b-ece8-4947-a3d5-ade7dbb51dae service nova] Creating event network-changed:b9eb864c-7f33-4fd1-b4e2-ce05faad73ca for instance 28d5a2eb-463e-42b2-bc8a-8b054ac226fe on nch2-master-1 May 07 22:39:23.834023 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-2bfa2b28-f1b7-4cbb-99a8-8c33bee2f4df req-8e34371b-ece8-4947-a3d5-ade7dbb51dae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042793 May 07 22:39:23.836104 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3414/6856] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:39:23.894082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:23.894756 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:23.902879 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:23.903361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:23.904162 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:23.904618 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:24.044312 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:24.052035 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9c688580-ae71-49ad-a2e8-9b024af974dc tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1393 microversion: 2.1 time: 0.162035 May 07 22:39:24.052966 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3443/6857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:23 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:25.070591 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:25.071379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:25.077586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:25.078072 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:25.078934 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:25.079407 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:25.341242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:25.348658 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9c780f14-4ed4-4f3f-bb3b-89549b910be5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1393 microversion: 2.1 time: 0.283228 May 07 22:39:25.349541 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3415/6858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:25 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1393 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:26.365431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:26.366071 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:26.373439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:26.373792 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:26.374585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:26.375096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:26.524940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:26.532369 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5b65ae62-ee38-4a12-b877-39058a3cd9f5 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1393 microversion: 2.1 time: 0.170858 May 07 22:39:26.532979 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3444/6859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:26 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:27.550024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:27.550694 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:27.557563 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:27.558032 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:27.558849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:27.559313 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:27.690806 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:27.698296 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b638ad53-4ad4-4a53-b2fa-14554c715b6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1393 microversion: 2.1 time: 0.152189 May 07 22:39:27.698917 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3416/6860] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:27 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:28.421919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-03c261da-47bf-4af9-bf3f-4290e207d803 req-a72d069e-03eb-42cf-b69d-d81e9e2dfa1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d5a2eb-463e-42b2-bc8a-8b054ac226fe", "name": "network-vif-plugged", "status": "completed", "tag": "b9eb864c-7f33-4fd1-b4e2-ce05faad73ca"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:28.431761 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-03c261da-47bf-4af9-bf3f-4290e207d803 req-a72d069e-03eb-42cf-b69d-d81e9e2dfa1c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:28.432226 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-03c261da-47bf-4af9-bf3f-4290e207d803 req-a72d069e-03eb-42cf-b69d-d81e9e2dfa1c service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:28.443599 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-03c261da-47bf-4af9-bf3f-4290e207d803 req-a72d069e-03eb-42cf-b69d-d81e9e2dfa1c service nova] Creating event network-vif-plugged:b9eb864c-7f33-4fd1-b4e2-ce05faad73ca for instance 28d5a2eb-463e-42b2-bc8a-8b054ac226fe on nch2-master-1 May 07 22:39:28.449544 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-03c261da-47bf-4af9-bf3f-4290e207d803 req-a72d069e-03eb-42cf-b69d-d81e9e2dfa1c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090600 May 07 22:39:28.450160 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3445/6861] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:39:28.715340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:28.715982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:28.726342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:28.727370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:28.728172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:28.728632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:28.876335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:28.883840 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-abe6ec6a-2b40-4036-9b38-5e91bb6077b7 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1393 microversion: 2.1 time: 0.172522 May 07 22:39:28.884419 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3417/6862] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:28 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:29.901811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:29.902535 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:29.909337 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:29.909801 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:29.910576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:29.911054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:30.041811 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:30.049454 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e6cd6d22-8ee0-4c0f-bb43-87454b4dc370 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1564 microversion: 2.1 time: 0.152460 May 07 22:39:30.050033 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3446/6863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:29 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:30.065409 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:30.066049 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:30.073385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:30.073857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:30.074645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:30.075135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:30.207974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:30.215506 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-846fbbcc-e478-4cbe-b4ce-f80fc38b8928 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1564 microversion: 2.1 time: 0.153945 May 07 22:39:30.216102 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3418/6864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:30 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:31.822254 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:39:31.822897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:31.824298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-9cfbc702-f3b0-4f9a-9d19-773ed33823cd req-658cfee9-4e75-4e6d-9cb0-962705d72521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d5a2eb-463e-42b2-bc8a-8b054ac226fe", "tag": "b9eb864c-7f33-4fd1-b4e2-ce05faad73ca"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:31.830349 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:31.830851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:31.831840 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:31.832298 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:31.833513 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cfbc702-f3b0-4f9a-9d19-773ed33823cd req-658cfee9-4e75-4e6d-9cb0-962705d72521 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:31.834080 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-9cfbc702-f3b0-4f9a-9d19-773ed33823cd req-658cfee9-4e75-4e6d-9cb0-962705d72521 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:31.846726 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-9cfbc702-f3b0-4f9a-9d19-773ed33823cd req-658cfee9-4e75-4e6d-9cb0-962705d72521 service nova] Creating event network-changed:b9eb864c-7f33-4fd1-b4e2-ce05faad73ca for instance 28d5a2eb-463e-42b2-bc8a-8b054ac226fe on nch2-master-1 May 07 22:39:31.856315 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-9cfbc702-f3b0-4f9a-9d19-773ed33823cd req-658cfee9-4e75-4e6d-9cb0-962705d72521 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031649 May 07 22:39:31.858972 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3419/6865] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:39:31.983515 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:39:31.992577 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ae3712b4-8df3-4e7a-a38d-d8b051e9e4b4 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1564 microversion: 2.1 time: 0.174723 May 07 22:39:31.993450 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3447/6866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:39:31 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:39:54.295780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63a2dd8d-08d0-4058-b81a-924c18fa4437 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:39:54.296823 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63a2dd8d-08d0-4058-b81a-924c18fa4437 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:39:54.303212 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63a2dd8d-08d0-4058-b81a-924c18fa4437 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:54.303688 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63a2dd8d-08d0-4058-b81a-924c18fa4437 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:54.304476 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63a2dd8d-08d0-4058-b81a-924c18fa4437 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:39:54.304941 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63a2dd8d-08d0-4058-b81a-924c18fa4437 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:39:54.355764 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63a2dd8d-08d0-4058-b81a-924c18fa4437 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action" status: 200 len: 24571 microversion: 2.1 time: 0.065063 May 07 22:39:54.356691 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3420/6867] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:39:54 2022] POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:40:00.793318 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:00.793934 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:00.800122 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:00.800578 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:00.801342 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:00.801784 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:00.824266 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lazy-loading 'flavor' on Instance uuid 28d5a2eb-463e-42b2-bc8a-8b054ac226fe {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:40:00.889819 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1d896eba-9dcd-415b-83ce-bd5f4396880d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action" status: 202 len: 0 microversion: 2.1 time: 0.100288 May 07 22:40:00.890442 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3448/6868] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:40:00 2022] POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:40:00.899839 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:00.900604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:00.908074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:00.908553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:00.909353 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:00.910244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:01.044966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:01.052365 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-09209456-7182-40fb-88d6-7332dfb6b9ab tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1691 microversion: 2.1 time: 0.157433 May 07 22:40:01.052943 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3421/6869] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:00 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:02.071546 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:02.072174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:02.079236 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:02.079702 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:02.080486 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:02.080919 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:02.215839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:02.223333 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-41eb3c62-66ba-4ee0-98b1-0cb50525bc2d tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1674 microversion: 2.1 time: 0.156979 May 07 22:40:02.223907 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3449/6870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:02 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:03.317218 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6b05bd22-1f6b-46fa-8ba1-b7e7f54cf2a9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:03.318174 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6b05bd22-1f6b-46fa-8ba1-b7e7f54cf2a9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:03.326349 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b05bd22-1f6b-46fa-8ba1-b7e7f54cf2a9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:03.326849 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b05bd22-1f6b-46fa-8ba1-b7e7f54cf2a9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:03.327640 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b05bd22-1f6b-46fa-8ba1-b7e7f54cf2a9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:03.328097 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6b05bd22-1f6b-46fa-8ba1-b7e7f54cf2a9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:03.376575 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6b05bd22-1f6b-46fa-8ba1-b7e7f54cf2a9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action" status: 200 len: 35435 microversion: 2.1 time: 0.063196 May 07 22:40:03.377261 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3422/6871] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:40:03 2022] POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action => generated 35435 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:40:03.389103 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6abdd663-7662-40ce-be3a-0805b77f1ab0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:03.389656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-6abdd663-7662-40ce-be3a-0805b77f1ab0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:03.396607 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6abdd663-7662-40ce-be3a-0805b77f1ab0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:03.397072 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6abdd663-7662-40ce-be3a-0805b77f1ab0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:03.397856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6abdd663-7662-40ce-be3a-0805b77f1ab0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:03.398311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-6abdd663-7662-40ce-be3a-0805b77f1ab0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:03.465839 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6abdd663-7662-40ce-be3a-0805b77f1ab0 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action" status: 202 len: 0 microversion: 2.1 time: 0.080400 May 07 22:40:03.466437 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3450/6872] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:40:03 2022] POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 07 22:40:03.475651 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:03.476372 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:03.484796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:03.485274 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:03.486247 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:03.486706 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:03.707352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:03.715031 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-99c7e25d-2e3a-4889-9aa1-2723a978467c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1680 microversion: 2.1 time: 0.243509 May 07 22:40:03.715728 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3423/6873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:03 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:04.734503 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:04.735232 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:04.741445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:04.741897 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:04.742691 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:04.743153 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:04.877701 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:04.885944 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa4554ae-fcdb-40f6-b745-926d2e116aa9 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1680 microversion: 2.1 time: 0.156552 May 07 22:40:04.886565 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3451/6874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:04 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:05.903215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:05.903851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:05.910705 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:05.911202 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:05.911984 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:05.912695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:06.053191 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:06.061347 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-02353671-c3ea-4b21-9d1b-5dd43a58fd6c tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1683 microversion: 2.1 time: 0.161982 May 07 22:40:06.061876 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3424/6875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:05 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:06.149944 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-14a36778-5fe3-4a7d-85e2-32ebdb8d004a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:06.151002 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-14a36778-5fe3-4a7d-85e2-32ebdb8d004a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:06.157694 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a36778-5fe3-4a7d-85e2-32ebdb8d004a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:06.158155 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a36778-5fe3-4a7d-85e2-32ebdb8d004a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:06.158961 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a36778-5fe3-4a7d-85e2-32ebdb8d004a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:06.159411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-14a36778-5fe3-4a7d-85e2-32ebdb8d004a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:06.198569 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-14a36778-5fe3-4a7d-85e2-32ebdb8d004a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action" status: 200 len: 35435 microversion: 2.1 time: 0.052373 May 07 22:40:06.199549 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3452/6876] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:40:06 2022] POST /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe/action => generated 35435 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 07 22:40:07.254138 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:07.254699 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:07.256780 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a6e4718b-04ec-4b0e-b8c6-1789f108e67a req-e758f1f4-d0e4-44c8-b352-62900c32495e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d5a2eb-463e-42b2-bc8a-8b054ac226fe", "tag": "b9eb864c-7f33-4fd1-b4e2-ce05faad73ca"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:07.262161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:07.262710 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:07.263647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:07.264187 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:07.269020 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a6e4718b-04ec-4b0e-b8c6-1789f108e67a req-e758f1f4-d0e4-44c8-b352-62900c32495e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:07.269757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a6e4718b-04ec-4b0e-b8c6-1789f108e67a req-e758f1f4-d0e4-44c8-b352-62900c32495e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:07.282532 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a6e4718b-04ec-4b0e-b8c6-1789f108e67a req-e758f1f4-d0e4-44c8-b352-62900c32495e service nova] Creating event network-changed:b9eb864c-7f33-4fd1-b4e2-ce05faad73ca for instance 28d5a2eb-463e-42b2-bc8a-8b054ac226fe on nch2-master-1 May 07 22:40:07.287943 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a6e4718b-04ec-4b0e-b8c6-1789f108e67a req-e758f1f4-d0e4-44c8-b352-62900c32495e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035264 May 07 22:40:07.288745 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3453/6877] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:40:07.292734 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:40:07.377876 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-12626d17-6d85-4464-905d-bf602183b326 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 204 len: 0 microversion: 2.1 time: 0.126667 May 07 22:40:07.378151 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3425/6878] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:40:07 2022] DELETE /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:40:07.388812 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:07.389609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:07.397116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:07.397738 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:07.399333 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:07.399794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:07.541759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:07.549422 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-821b70c6-a9d6-4c2a-9711-1db20d1dd122 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1689 microversion: 2.1 time: 0.166732 May 07 22:40:07.550202 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3454/6879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:07 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:08.567894 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:08.568623 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:08.575519 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:08.575991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:08.576782 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:08.577240 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:08.780648 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:08.788414 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d70927f8-ab3e-4d16-8656-767de8e4660a tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1689 microversion: 2.1 time: 0.224842 May 07 22:40:08.789002 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3426/6880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:08 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:09.489838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-76988397-5d1e-46b5-8375-b71196a0ea72 req-9454d1ec-aa05-4928-98c8-0cc7613b16d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d5a2eb-463e-42b2-bc8a-8b054ac226fe", "name": "network-vif-deleted", "tag": "b9eb864c-7f33-4fd1-b4e2-ce05faad73ca"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:09.499292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-76988397-5d1e-46b5-8375-b71196a0ea72 req-9454d1ec-aa05-4928-98c8-0cc7613b16d8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:09.499823 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-76988397-5d1e-46b5-8375-b71196a0ea72 req-9454d1ec-aa05-4928-98c8-0cc7613b16d8 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:09.512242 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-76988397-5d1e-46b5-8375-b71196a0ea72 req-9454d1ec-aa05-4928-98c8-0cc7613b16d8 service nova] Creating event network-vif-deleted:b9eb864c-7f33-4fd1-b4e2-ce05faad73ca for instance 28d5a2eb-463e-42b2-bc8a-8b054ac226fe on nch2-master-1 May 07 22:40:09.517694 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-76988397-5d1e-46b5-8375-b71196a0ea72 req-9454d1ec-aa05-4928-98c8-0cc7613b16d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 May 07 22:40:09.518417 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3455/6881] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:40:09.806478 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:09.807647 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:09.817438 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:09.818131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:09.819142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:09.819602 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:09.859103 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:09.859643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:09.860184 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lazy-loading 'fault' on Instance uuid 28d5a2eb-463e-42b2-bc8a-8b054ac226fe {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:40:09.913412 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374a4fe2efa9420fab9cc8370bc56810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3dc672b922b4f86869d8b6108240e0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:09.921427 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-183de2bd-3ef9-42d0-bb28-579feaec8d92 tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 200 len: 1357 microversion: 2.1 time: 0.119106 May 07 22:40:09.922041 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3427/6882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:09 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 1357 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:10.940844 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:10.941589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] [instance: 28d5a2eb-463e-42b2-bc8a-8b054ac226fe] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:10.947966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:10.948427 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:10.949205 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:10.949655 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:10.963771 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] HTTP exception thrown: Instance 28d5a2eb-463e-42b2-bc8a-8b054ac226fe could not be found. May 07 22:40:10.964358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Returning 404 to user: Instance 28d5a2eb-463e-42b2-bc8a-8b054ac226fe could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:40:10.965192 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-fa73790b-08f7-4bb4-aaa3-53c0449aaf6b tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe" status: 404 len: 111 microversion: 2.1 time: 0.029484 May 07 22:40:10.965733 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3456/6883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:10 2022] GET /compute/v2.1/servers/28d5a2eb-463e-42b2-bc8a-8b054ac226fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:40:14.410085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-471e366d-c6f2-4b86-9b16-e8757c6b46ce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] Calling method '.version_select at 0x7fc41d088820>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:14.437253 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-471e366d-c6f2-4b86-9b16-e8757c6b46ce tempest-TestNetworkAdvancedServerOps-1530016272 tempest-TestNetworkAdvancedServerOps-1530016272-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1198430564" status: 202 len: 0 microversion: 2.1 time: 0.032074 May 07 22:40:14.441871 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3428/6884] 10.222.0.32 () {58 vars in 1283 bytes} [Sat May 7 22:40:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1198430564 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:40:25.814115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-6d82823f-6c32-4563-a1b3-de30ccfd0698 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'create', calling method: .version_select at 0x7fc40fb55af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-67199291"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:25.829647 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6d82823f-6c32-4563-a1b3-de30ccfd0698 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:40:25.843084 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6d82823f-6c32-4563-a1b3-de30ccfd0698 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for user 6a81d6104e634bd7a6ae26dc51124c2d and project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:40:26.109889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6d82823f-6c32-4563-a1b3-de30ccfd0698 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:40:26.122632 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-6d82823f-6c32-4563-a1b3-de30ccfd0698 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for user 6a81d6104e634bd7a6ae26dc51124c2d and project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:40:26.139627 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-6d82823f-6c32-4563-a1b3-de30ccfd0698 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2310 microversion: 2.1 time: 0.507813 May 07 22:40:26.140437 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3457/6885] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:40:25 2022] POST /compute/v2.1/os-keypairs => generated 2310 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:27.118565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-988107175", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-67199291", "security_groups": [{"name": "tempest-secgroup-smoke-279780486"}], "networks": [{"uuid": "961433bf-582e-417a-89b7-d9083e8c3ca2"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:27.236757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] validate_networks() for [('961433bf-582e-417a-89b7-d9083e8c3ca2', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:40:27.735621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:40:27.736057 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:40:27.736544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:40:27.737003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:40:27.737428 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:40:27.746594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:27.747089 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:27.747900 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:27.748355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:27.765220 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:40:27.770796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for user 6a81d6104e634bd7a6ae26dc51124c2d and project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:40:27.783361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:40:27.785669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:40:27.829377 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [8a8bd463-72f5-4fee-ac1c-7f64d2af4cd4] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:40:28.837999 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [8a8bd463-72f5-4fee-ac1c-7f64d2af4cd4] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 34660. May 07 22:40:28.842902 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-422d10fa-d789-4637-871c-67d566ac1f55 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.729371 May 07 22:40:28.843659 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3429/6886] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:40:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 07 22:40:28.854453 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f65ebda5-d94f-46fe-a0d0-0ae56b0104d2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:28.855724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f65ebda5-d94f-46fe-a0d0-0ae56b0104d2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:28.909731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f65ebda5-d94f-46fe-a0d0-0ae56b0104d2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:28.916795 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f65ebda5-d94f-46fe-a0d0-0ae56b0104d2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1244 microversion: 2.1 time: 0.067176 May 07 22:40:28.917384 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3458/6887] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:28 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:40:29.935189 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4dead414-7305-4509-a00f-4da44081284c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:29.937397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4dead414-7305-4509-a00f-4da44081284c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:30.009136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4dead414-7305-4509-a00f-4da44081284c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:30.016576 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4dead414-7305-4509-a00f-4da44081284c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1244 microversion: 2.1 time: 0.086884 May 07 22:40:30.017180 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3430/6888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:29 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:31.034584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b670d01c-83a9-4f9e-b02d-2c974bd855a5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:31.035513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b670d01c-83a9-4f9e-b02d-2c974bd855a5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:31.094878 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b670d01c-83a9-4f9e-b02d-2c974bd855a5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:31.105139 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b670d01c-83a9-4f9e-b02d-2c974bd855a5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1244 microversion: 2.1 time: 0.075112 May 07 22:40:31.106432 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3459/6889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:31 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:32.123074 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f79ee5f4-0ea5-4211-9a91-49d6cf2a095a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:32.123686 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f79ee5f4-0ea5-4211-9a91-49d6cf2a095a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:32.186201 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f79ee5f4-0ea5-4211-9a91-49d6cf2a095a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:32.193046 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f79ee5f4-0ea5-4211-9a91-49d6cf2a095a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1244 microversion: 2.1 time: 0.074092 May 07 22:40:32.193716 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3431/6890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:32 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:33.209832 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:33.210487 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:33.217390 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:33.217847 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:33.218620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:33.219086 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:33.283431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:33.291433 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e86521e2-5311-4c67-8e58-00464d7ecac3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1248 microversion: 2.1 time: 0.085566 May 07 22:40:33.292009 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3460/6891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:33 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:34.308809 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:34.309463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:34.316605 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:34.317077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:34.317886 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:34.318336 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:34.390870 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:34.398304 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9e5bb637-642d-4ec7-9698-a48e6d9bc09c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1302 microversion: 2.1 time: 0.094126 May 07 22:40:34.398971 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3432/6892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:34 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:35.199184 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-509d8a8d-142b-4a72-80d9-ce5a12c5600a req-5891e014-6740-443d-ac3b-b5365e018ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:35.210123 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-509d8a8d-142b-4a72-80d9-ce5a12c5600a req-5891e014-6740-443d-ac3b-b5365e018ec5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:35.211403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-509d8a8d-142b-4a72-80d9-ce5a12c5600a req-5891e014-6740-443d-ac3b-b5365e018ec5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:35.224772 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-509d8a8d-142b-4a72-80d9-ce5a12c5600a req-5891e014-6740-443d-ac3b-b5365e018ec5 service nova] Creating event network-changed:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch1-master-1 May 07 22:40:35.237899 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-509d8a8d-142b-4a72-80d9-ce5a12c5600a req-5891e014-6740-443d-ac3b-b5365e018ec5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042549 May 07 22:40:35.239802 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3461/6893] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:40:35.415735 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:35.416405 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:35.422728 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:35.423232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:35.424026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:35.424487 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:35.556391 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:35.563990 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8f5fdd66-4e9f-4f55-a7e3-c9eba605d935 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1369 microversion: 2.1 time: 0.152380 May 07 22:40:35.564583 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3433/6894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:35 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:36.583172 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:36.583890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:36.591531 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:36.591998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:36.592783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:36.593231 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:36.797658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:36.806909 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-34f07279-f2d4-4a11-bbb1-a588929b5f29 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1369 microversion: 2.1 time: 0.229092 May 07 22:40:36.807765 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3462/6895] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:36 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1369 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:37.823883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:37.824546 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:37.831463 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:37.832018 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:37.832709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:37.833167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:37.967109 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:37.974457 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3306e267-ea07-460e-b9f6-975ba67be351 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1369 microversion: 2.1 time: 0.155037 May 07 22:40:37.975071 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3434/6896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:37 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:38.991654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:38.992445 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:38.999301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:38.999757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:39.000518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:39.000956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:39.130150 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:39.137966 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9b3d85c1-5383-4980-becc-2d446c52d2cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1369 microversion: 2.1 time: 0.150321 May 07 22:40:39.138539 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3463/6897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:38 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:40.022915 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-eccee1b3-25a2-4ba5-8047-0bd3abcc6d85 req-1744bcd2-94f8-42ac-900a-6ae543f87aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "name": "network-vif-plugged", "status": "completed", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:40.031923 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-eccee1b3-25a2-4ba5-8047-0bd3abcc6d85 req-1744bcd2-94f8-42ac-900a-6ae543f87aca service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:40.032397 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-eccee1b3-25a2-4ba5-8047-0bd3abcc6d85 req-1744bcd2-94f8-42ac-900a-6ae543f87aca service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:40.044456 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-eccee1b3-25a2-4ba5-8047-0bd3abcc6d85 req-1744bcd2-94f8-42ac-900a-6ae543f87aca service nova] Creating event network-vif-plugged:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch1-master-1 May 07 22:40:40.049428 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-eccee1b3-25a2-4ba5-8047-0bd3abcc6d85 req-1744bcd2-94f8-42ac-900a-6ae543f87aca service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030462 May 07 22:40:40.050085 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3435/6898] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:40:40.154645 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:40.155372 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:40.162593 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:40.163144 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:40.164616 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:40.165130 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:40.302334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:40.309747 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0f0f5f29-00d5-4f31-855d-b27558a3405e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1369 microversion: 2.1 time: 0.159046 May 07 22:40:40.310320 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3464/6899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:40 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:41.328061 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:41.328788 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:41.335081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:41.335555 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:41.336345 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:41.336808 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:41.466065 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:41.473596 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-78566347-8bdc-48b7-a701-0662c337f9c0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1553 microversion: 2.1 time: 0.150732 May 07 22:40:41.474278 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3436/6900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:41 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:41.490211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:40:41.490891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:40:41.498209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:41.498666 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:41.499460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:41.499905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:41.630725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:40:41.638188 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-138eeed1-91a9-465e-ad2e-029458400bf2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1553 microversion: 2.1 time: 0.151829 May 07 22:40:41.638784 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3465/6901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:40:41 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:40:43.624811 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-0f75be6d-8caa-43d4-9b69-64f28ec4d4c8 req-28ad5fc1-8e4b-492a-a4fb-1cec19972e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:40:43.634241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0f75be6d-8caa-43d4-9b69-64f28ec4d4c8 req-28ad5fc1-8e4b-492a-a4fb-1cec19972e4e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:40:43.634810 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-0f75be6d-8caa-43d4-9b69-64f28ec4d4c8 req-28ad5fc1-8e4b-492a-a4fb-1cec19972e4e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:40:43.645725 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-0f75be6d-8caa-43d4-9b69-64f28ec4d4c8 req-28ad5fc1-8e4b-492a-a4fb-1cec19972e4e service nova] Creating event network-changed:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch1-master-1 May 07 22:40:43.650756 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-0f75be6d-8caa-43d4-9b69-64f28ec4d4c8 req-28ad5fc1-8e4b-492a-a4fb-1cec19972e4e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029709 May 07 22:40:43.651550 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3437/6902] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:42:19.350001 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:42:19.350637 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:42:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:42:19.829829 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:42:19.830417 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:42:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:42:38.751905 ncdv-master-1 devstack@n-api.service[136682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24516f8a-15ff-4cb4-a27d-e178051d134e] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 07 22:42:38.752864 ncdv-master-1 devstack@n-api.service[136682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8387ff93-f02a-4ebc-8f33-a8044c5f7252] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 07 22:42:38.757877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:42:38.758413 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:38.764550 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:38.765003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:38.765771 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:38.766210 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:38.788620 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lazy-loading 'flavor' on Instance uuid 7128f583-301a-494d-86db-ada4834a3b11 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:42:39.220319 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-efae35a2-4962-4a63-836a-faae835a318f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11/action" status: 202 len: 0 microversion: 2.1 time: 0.470635 May 07 22:42:39.221104 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3466/6903] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:42:38 2022] POST /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:42:39.227690 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46a4aa07-e7b6-4e22-8e61-1f95962f6a67] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 07 22:42:39.232121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:39.232855 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:39.239779 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:39.240256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:39.241062 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:39.241529 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:39.434655 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:39.442626 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-33e85bba-3f78-48b7-9b17-c29fbec50a73 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.217060 May 07 22:42:39.443255 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3438/6904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:39 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:40.462409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:40.463068 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:40.471382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:40.471843 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:40.472612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:40.473059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:40.477761 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] [24516f8a-15ff-4cb4-a27d-e178051d134e] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 34832. May 07 22:42:40.480707 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] [8387ff93-f02a-4ebc-8f33-a8044c5f7252] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 34834. May 07 22:42:40.607141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:40.615176 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2c3a6d3d-0002-484e-890e-19854a6d42a6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.158288 May 07 22:42:40.615743 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3467/6905] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:40 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:41.632370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:41.633016 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:41.641684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:41.642156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:41.642976 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:41.643437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:41.648612 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] [46a4aa07-e7b6-4e22-8e61-1f95962f6a67] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 34838. May 07 22:42:41.780684 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:41.789789 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b0ed230c-01f3-4ff6-9940-bec04792876f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.161404 May 07 22:42:41.790366 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3439/6906] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:41 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:42.807163 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:42.807813 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:42.814759 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:42.815255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:42.816031 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:42.816481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:42.948877 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:42.956981 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-545ce3b4-0716-468e-a18e-3f6cb7e1072e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.153779 May 07 22:42:42.957569 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3468/6907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:42 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:43.974228 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:43.974795 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:43.981374 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:43.981838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:43.982613 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:43.983090 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:44.111503 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:44.119037 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a4bd0c9f-9928-4fc5-95fc-d1a4fbd365db tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.148890 May 07 22:42:44.119615 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3440/6908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:43 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:45.136456 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:45.137067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:45.143914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:45.144371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:45.145141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:45.145585 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:45.275418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:45.282978 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f7a443bd-94ad-47dd-89bf-053e66877e6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.150392 May 07 22:42:45.283557 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3469/6909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:45 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:46.301085 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:46.301729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:46.308681 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:46.309160 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:46.309952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:46.310416 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:46.446969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:46.457131 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a34b001-6a47-4ff2-ab68-029ee5092174 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.160337 May 07 22:42:46.457809 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3441/6910] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:46 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:47.475682 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:47.476225 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:47.483115 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:47.483583 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:47.485015 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:47.485462 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:47.613704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:47.621110 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-dd0d20a8-9a40-4884-b501-78422d64bcb0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.149450 May 07 22:42:47.621704 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3470/6911] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:47 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:48.638378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:48.639056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:48.646026 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:48.646502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:48.647338 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:48.647803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:48.776354 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:48.783875 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-387f26c4-2167-40a4-88bb-ba24877c0f42 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.149509 May 07 22:42:48.784456 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3442/6912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:48 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:49.802143 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:49.802754 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:49.810110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:49.810558 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:49.811492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:49.812054 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:49.949474 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:49.956914 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3b3277e4-29e6-4d04-b6a1-d352828add3a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1699 microversion: 2.1 time: 0.158812 May 07 22:42:49.957486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3471/6913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:49 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:50.975015 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:50.975657 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:50.982489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:50.982940 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:50.983731 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:50.984256 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:51.115528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:51.123033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1d94560c-755a-4591-82cd-2db16ddef2b8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1699 microversion: 2.1 time: 0.152014 May 07 22:42:51.123617 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3443/6914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:50 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:52.141467 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:52.142116 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:52.149395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:52.149933 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:52.150724 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:52.151194 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:52.289458 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:52.297989 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d6b7a6e4-dbc4-4e86-b952-beab6371b572 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.161047 May 07 22:42:52.298917 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3472/6915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:52 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:52.676383 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-cda1dd6b-4033-490f-a03a-c2942e1259de req-efbcbc53-2065-4e82-bd1c-6c787351dc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "name": "network-vif-plugged", "status": "completed", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:42:52.687609 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cda1dd6b-4033-490f-a03a-c2942e1259de req-efbcbc53-2065-4e82-bd1c-6c787351dc10 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:52.688489 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-cda1dd6b-4033-490f-a03a-c2942e1259de req-efbcbc53-2065-4e82-bd1c-6c787351dc10 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:52.706338 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-cda1dd6b-4033-490f-a03a-c2942e1259de req-efbcbc53-2065-4e82-bd1c-6c787351dc10 service nova] Creating event network-vif-plugged:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch1-master-1 May 07 22:42:52.714179 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-cda1dd6b-4033-490f-a03a-c2942e1259de req-efbcbc53-2065-4e82-bd1c-6c787351dc10 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042044 May 07 22:42:52.715183 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3444/6916] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:42:53.315536 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:53.316766 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:53.324212 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:53.324895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:53.325683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:53.326133 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:53.469752 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:53.477975 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-99d86353-76f7-48fb-a2d4-5662470693aa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.166462 May 07 22:42:53.485847 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3473/6917] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:53 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:54.497717 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:54.499739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:54.507604 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:54.508084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:54.508950 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:54.509413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:54.658576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:54.676509 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-06fb7be2-49aa-4be7-b3a3-3d16cbc6c970 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.184901 May 07 22:42:54.686565 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3445/6918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:54 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:55.694289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:55.694991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:55.702010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:55.702483 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:55.703980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:55.704760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:55.850370 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:55.858633 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-33d80200-8ad7-44af-93d5-e31ddd8102f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.168335 May 07 22:42:55.859612 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3474/6919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:55 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:56.880131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:56.882200 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:56.889537 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:56.890088 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:56.891780 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:56.892435 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:57.042339 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:57.053379 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-241e0aa8-17a0-4474-a1da-618598335b26 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.177771 May 07 22:42:57.054207 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3446/6920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:56 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:58.073436 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:58.074104 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:58.081693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:58.082241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:58.083273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:58.083794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:58.241870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:58.250248 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d4563fd8-d203-4a54-98ca-bdb4a63daa05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.183115 May 07 22:42:58.250865 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3475/6921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:58 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:42:59.267544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:42:59.269024 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:42:59.276536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:59.276999 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:59.277796 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:42:59.278250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:42:59.441268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:42:59.449656 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1e7fa48d-9e7d-4549-8b14-d2e4a945f06b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.186057 May 07 22:42:59.450328 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3447/6922] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:42:59 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:00.468485 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:00.469114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:00.476320 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:00.476781 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:00.477644 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:00.478096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:00.626749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:00.634498 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-20236370-e219-4eff-8813-388a0947e063 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1694 microversion: 2.1 time: 0.170093 May 07 22:43:00.635561 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3476/6923] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:00 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:01.651693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:01.652340 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:01.659803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:01.660287 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:01.661342 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:01.661803 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:01.798802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:01.807744 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-24c9fd85-30d1-4ad2-a36b-82605e9a1004 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1676 microversion: 2.1 time: 0.159963 May 07 22:43:01.818089 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3448/6924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:01 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:02.825606 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:02.826242 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:02.833096 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:02.833559 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:02.834334 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:02.834800 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:02.960542 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:02.967883 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0bf01300-cf64-4100-8edf-b6780147fbbe tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1676 microversion: 2.1 time: 0.146258 May 07 22:43:02.968467 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3477/6925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:02 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:03.984817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:03.985465 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:03.992396 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:03.992871 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:03.993668 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:03.994135 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:04.127306 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:04.134721 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-889812c0-53ef-44fe-93fa-f6bde4cfe756 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1619 microversion: 2.1 time: 0.153881 May 07 22:43:04.135326 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3449/6926] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:03 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1619 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:04.151806 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a1a419b1-f7aa-48e6-8aed-bc5f03df55cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:43:04.152341 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a1a419b1-f7aa-48e6-8aed-bc5f03df55cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:04.159178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1a419b1-f7aa-48e6-8aed-bc5f03df55cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:04.159641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1a419b1-f7aa-48e6-8aed-bc5f03df55cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:04.160685 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1a419b1-f7aa-48e6-8aed-bc5f03df55cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:04.161138 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a1a419b1-f7aa-48e6-8aed-bc5f03df55cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:04.301778 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a1a419b1-f7aa-48e6-8aed-bc5f03df55cb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11/action" status: 202 len: 0 microversion: 2.1 time: 0.153884 May 07 22:43:04.302590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3478/6927] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:43:04 2022] POST /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:43:04.310458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:04.311121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:04.317632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:04.318100 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:04.318913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:04.319370 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:04.460551 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:04.468189 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ef6e27d5-73ab-4bc5-95fd-23831753a217 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1627 microversion: 2.1 time: 0.161530 May 07 22:43:04.468730 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3450/6928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:04 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1627 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:04.681979 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-c4921a3e-e725-456b-baec-12a577579eed req-4f43b826-bc37-48cf-8ba1-236742b87c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "name": "network-vif-unplugged", "status": "completed", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:43:04.695718 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c4921a3e-e725-456b-baec-12a577579eed req-4f43b826-bc37-48cf-8ba1-236742b87c3a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:04.696418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-c4921a3e-e725-456b-baec-12a577579eed req-4f43b826-bc37-48cf-8ba1-236742b87c3a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:04.709950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.compute.server_external_events [req-c4921a3e-e725-456b-baec-12a577579eed req-4f43b826-bc37-48cf-8ba1-236742b87c3a service nova] Unable to find a host for instance 7128f583-301a-494d-86db-ada4834a3b11. Dropping event network-vif-unplugged {{(pid=136682) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 07 22:43:04.710886 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-c4921a3e-e725-456b-baec-12a577579eed req-4f43b826-bc37-48cf-8ba1-236742b87c3a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033549 May 07 22:43:04.711491 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3479/6929] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 07 22:43:05.485401 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:05.486041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:05.492991 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:05.493458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:05.494254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:05.494708 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:05.731888 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:05.739779 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54e99b34-9268-4476-8d9b-c8e84f23143c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.258343 May 07 22:43:05.740359 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3451/6930] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:05 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:06.331411 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-8c0de3b1-8993-46e9-8996-95e3b89113f5 req-f5d22d18-dfb6-49c2-aa76-778159b9a1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:43:06.345292 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8c0de3b1-8993-46e9-8996-95e3b89113f5 req-f5d22d18-dfb6-49c2-aa76-778159b9a1e5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:06.345631 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-8c0de3b1-8993-46e9-8996-95e3b89113f5 req-f5d22d18-dfb6-49c2-aa76-778159b9a1e5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:06.360201 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-8c0de3b1-8993-46e9-8996-95e3b89113f5 req-f5d22d18-dfb6-49c2-aa76-778159b9a1e5 service nova] Creating event network-changed:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch2-master-1 May 07 22:43:06.365490 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-8c0de3b1-8993-46e9-8996-95e3b89113f5 req-f5d22d18-dfb6-49c2-aa76-778159b9a1e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038256 May 07 22:43:06.366107 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3480/6931] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:43:06.759181 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:06.759822 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:06.767151 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:06.767666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:06.768482 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:06.768945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:06.927977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:06.935492 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4ceac127-80eb-4f21-a07e-fdc8ed1357f1 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.180424 May 07 22:43:06.936080 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3452/6932] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:06 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:07.955518 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:07.956238 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:07.962797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:07.963273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:07.964059 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:07.964513 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:08.461426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:08.470351 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b23ac370-d878-4df4-be35-d011baa9974a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.520705 May 07 22:43:08.471352 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3481/6933] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:07 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:09.489000 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:09.489626 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:09.496638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:09.497165 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:09.498007 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:09.498436 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:09.652446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:09.661062 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-5d615522-8304-4f25-b553-81e43715f4cc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.176821 May 07 22:43:09.670872 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3453/6934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:09 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:10.681728 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:10.682530 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:10.690849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:10.691659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:10.693209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:10.694156 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:10.843964 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:10.852438 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1c404d0d-fed0-4f11-b07f-2bf59841ae7b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.176589 May 07 22:43:10.853035 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3482/6935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:10 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:11.870173 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:11.870835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:11.877642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:11.878113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:11.878988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:11.879448 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:12.030041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:12.039741 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2de103b7-5a01-4475-a29a-99bf1960e5c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.173640 May 07 22:43:12.040370 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3454/6936] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:11 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:13.057167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:13.057922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:13.066029 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:13.066589 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:13.067547 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:13.068070 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:13.251279 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:13.259107 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2affaf82-941d-4173-8d6b-02ac7fdc8a8a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.205786 May 07 22:43:13.262805 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3483/6937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:13 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:14.277528 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:14.278156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:14.285843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:14.286493 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:14.287387 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:14.287978 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:14.422335 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:14.429909 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ae1392f1-c6c0-403a-8b7f-65af76e5230b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.156314 May 07 22:43:14.430498 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3455/6938] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:14 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:15.446610 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:15.447276 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:15.454570 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:15.454992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:15.455751 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:15.456209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:15.593358 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:15.601450 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-57252acb-d743-4911-a5ce-b41083d43a34 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.158763 May 07 22:43:15.602038 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3484/6939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:15 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:16.618629 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:16.619297 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:16.626167 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:16.626634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:16.627451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:16.627913 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:16.768989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:16.776590 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-75c49d3d-6523-4a31-9376-cd6ca9c3c0b0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.161890 May 07 22:43:16.777184 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3456/6940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:16 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:17.794418 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:17.795301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:17.802097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:17.802562 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:17.803369 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:17.803820 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:17.937256 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:17.945034 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-eb80ebb9-d789-46aa-bb02-b61d6899f304 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.154428 May 07 22:43:17.945634 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3485/6941] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:17 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:18.962922 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:18.963565 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:18.970902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:18.971382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:18.972176 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:18.972642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:19.099580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:19.107092 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-8f3078d6-edb7-4b6d-9dff-992fec2a3a92 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.148129 May 07 22:43:19.107679 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3457/6942] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:18 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:19.496787 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-dacd5e57-97f0-427e-9af5-bcec7a12532b req-0516aab9-0546-4e27-bd23-1ac4b41c839e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "name": "network-vif-plugged", "status": "completed", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:43:19.506255 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dacd5e57-97f0-427e-9af5-bcec7a12532b req-0516aab9-0546-4e27-bd23-1ac4b41c839e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:19.506706 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-dacd5e57-97f0-427e-9af5-bcec7a12532b req-0516aab9-0546-4e27-bd23-1ac4b41c839e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:19.518407 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-dacd5e57-97f0-427e-9af5-bcec7a12532b req-0516aab9-0546-4e27-bd23-1ac4b41c839e service nova] Creating event network-vif-plugged:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch2-master-1 May 07 22:43:19.523762 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-dacd5e57-97f0-427e-9af5-bcec7a12532b req-0516aab9-0546-4e27-bd23-1ac4b41c839e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030723 May 07 22:43:19.524357 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3486/6943] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:43:20.123953 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:20.124576 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:20.132161 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:20.132639 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:20.133437 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:20.133902 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:20.266050 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:20.273626 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-42bed20b-2c7e-4523-8df2-eddf7d09ce64 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1685 microversion: 2.1 time: 0.153667 May 07 22:43:20.274212 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3458/6944] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:20 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:43:21.292484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:43:21.293190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:43:21.299537 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:21.299997 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:21.300769 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:43:21.301214 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:43:21.432804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:43:21.441006 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-0be05068-47af-4d98-a286-905b3c8ac3da tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1672 microversion: 2.1 time: 0.153661 May 07 22:43:21.441590 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3487/6945] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:43:21 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:31.960328 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:31.960988 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:31.968522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:31.969008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:31.969959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:31.970564 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:32.000867 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:44:32.096736 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-145a8dbd-9f9e-4e9c-9341-874616724289 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 204 len: 0 microversion: 2.1 time: 0.140400 May 07 22:44:32.097683 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3459/6946] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:44:31 2022] DELETE /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:44:32.110081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:32.111037 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:32.117549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-422c4d18-9ba7-41ff-9a23-b3b1ef71c13c req-c6decffe-b291-4aff-96df-f50e681ec3ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:44:32.118128 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:32.118586 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:32.119421 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:32.119949 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:32.126052 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-422c4d18-9ba7-41ff-9a23-b3b1ef71c13c req-c6decffe-b291-4aff-96df-f50e681ec3ee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:32.126512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-422c4d18-9ba7-41ff-9a23-b3b1ef71c13c req-c6decffe-b291-4aff-96df-f50e681ec3ee service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:32.138036 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-422c4d18-9ba7-41ff-9a23-b3b1ef71c13c req-c6decffe-b291-4aff-96df-f50e681ec3ee service nova] Creating event network-changed:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch2-master-1 May 07 22:44:32.143279 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-422c4d18-9ba7-41ff-9a23-b3b1ef71c13c req-c6decffe-b291-4aff-96df-f50e681ec3ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129236 May 07 22:44:32.143883 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3488/6947] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:44:32.375084 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:32.382605 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3b88b178-7bff-48c2-b336-f7b989f6f5cf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.278362 May 07 22:44:32.383231 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3460/6948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:32 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:33.403209 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:33.403950 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:33.410922 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:33.411383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:33.412158 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:33.412602 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:33.630431 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:33.638604 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-16089d6a-0fc8-431b-bd31-a1013f4f4d81 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 200 len: 1678 microversion: 2.1 time: 0.240703 May 07 22:44:33.639591 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3489/6949] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:33 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:34.158003 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-a8db50a8-e59e-4fb4-b526-915a9258f9a7 req-556e742c-2b1c-4ea1-9ff2-c30e34a2c184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7128f583-301a-494d-86db-ada4834a3b11", "name": "network-vif-deleted", "tag": "5cd87c39-548a-4bce-abb6-300a704c2b9e"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:44:34.167669 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a8db50a8-e59e-4fb4-b526-915a9258f9a7 req-556e742c-2b1c-4ea1-9ff2-c30e34a2c184 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:34.168067 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-a8db50a8-e59e-4fb4-b526-915a9258f9a7 req-556e742c-2b1c-4ea1-9ff2-c30e34a2c184 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:34.178759 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-a8db50a8-e59e-4fb4-b526-915a9258f9a7 req-556e742c-2b1c-4ea1-9ff2-c30e34a2c184 service nova] Creating event network-vif-deleted:5cd87c39-548a-4bce-abb6-300a704c2b9e for instance 7128f583-301a-494d-86db-ada4834a3b11 on nch2-master-1 May 07 22:44:34.183595 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-a8db50a8-e59e-4fb4-b526-915a9258f9a7 req-556e742c-2b1c-4ea1-9ff2-c30e34a2c184 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029351 May 07 22:44:34.184170 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3461/6950] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:44:34.656627 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:34.657179 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 7128f583-301a-494d-86db-ada4834a3b11] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:34.664287 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:34.664731 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:34.665509 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:34.665959 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:34.679849 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] HTTP exception thrown: Instance 7128f583-301a-494d-86db-ada4834a3b11 could not be found. May 07 22:44:34.680457 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Returning 404 to user: Instance 7128f583-301a-494d-86db-ada4834a3b11 could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:44:34.681312 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-5d4d5a25-8693-43db-8b87-53c7d0cdeb5d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11" status: 404 len: 111 microversion: 2.1 time: 0.028736 May 07 22:44:34.682060 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3490/6951] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:34 2022] GET /compute/v2.1/servers/7128f583-301a-494d-86db-ada4834a3b11 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:44:34.843838 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d78e4f7f-693c-41ee-bc27-bf37854ba866 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '.version_select at 0x7fc41cedde50>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:34.865202 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d78e4f7f-693c-41ee-bc27-bf37854ba866 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-67199291" status: 202 len: 0 microversion: 2.1 time: 0.025888 May 07 22:44:34.865824 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3462/6952] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:44:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-67199291 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:44:34.889088 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-9d004374-6a53-45e8-a9e9-aa6498da36d8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'create', calling method: .version_select at 0x7fc41c443dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-671495250"}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:44:34.904274 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9d004374-6a53-45e8-a9e9-aa6498da36d8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:44:34.911091 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9d004374-6a53-45e8-a9e9-aa6498da36d8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for user 6a81d6104e634bd7a6ae26dc51124c2d and project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:44:35.491980 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9d004374-6a53-45e8-a9e9-aa6498da36d8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:44:35.497870 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-9d004374-6a53-45e8-a9e9-aa6498da36d8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for user 6a81d6104e634bd7a6ae26dc51124c2d and project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'key_pairs'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:44:35.511824 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-9d004374-6a53-45e8-a9e9-aa6498da36d8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.626847 May 07 22:44:35.512412 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3491/6953] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:44:34 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:44:38.972275 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1820089815", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-671495250", "security_groups": [{"name": "tempest-secgroup-smoke-837509777"}], "networks": [{"uuid": "961433bf-582e-417a-89b7-d9083e8c3ca2"}], "block_device_mapping_v2": [{"uuid": "7f57b01f-2fa5-46dc-b0ca-e3dece07128b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:44:39.081931 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] validate_networks() for [('961433bf-582e-417a-89b7-d9083e8c3ca2', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:44:39.510083 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:44:39.510536 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:44:39.511069 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:44:39.511512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:44:39.511952 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:44:39.521244 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:39.521721 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:39.522553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:39.523059 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:39.540483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:44:39.545753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Getting quotas for user 6a81d6104e634bd7a6ae26dc51124c2d and project 2a375b5dd32e4b6eb61e9a9877c9a04c. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:44:39.603332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:44:39.605593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f57b01f-2fa5-46dc-b0ca-e3dece07128b',volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:44:39.725503 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [8a8bd463-72f5-4fee-ac1c-7f64d2af4cd4] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:44:40.733411 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [8a8bd463-72f5-4fee-ac1c-7f64d2af4cd4] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 35254. May 07 22:44:40.737845 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-05b70258-3742-429f-b84b-1c54cd488edb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.770949 May 07 22:44:40.738503 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3463/6954] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:44:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:44:40.749514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-e9e7a63b-1c02-425c-acbf-fe9bd02918b4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:40.750141 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-e9e7a63b-1c02-425c-acbf-fe9bd02918b4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:40.802137 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-e9e7a63b-1c02-425c-acbf-fe9bd02918b4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:40.808881 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-e9e7a63b-1c02-425c-acbf-fe9bd02918b4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1088 microversion: 2.1 time: 0.064307 May 07 22:44:40.809465 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3492/6955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:40 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:41.827081 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ffd85dfe-f6f1-4b1a-9824-27ec18397494 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:41.827876 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ffd85dfe-f6f1-4b1a-9824-27ec18397494 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:41.885835 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ffd85dfe-f6f1-4b1a-9824-27ec18397494 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:41.894179 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ffd85dfe-f6f1-4b1a-9824-27ec18397494 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1088 microversion: 2.1 time: 0.072158 May 07 22:44:41.894759 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3464/6956] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:41 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:42.910746 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-47dca660-109c-453d-9452-a92ca4ecc9c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:42.911400 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-47dca660-109c-453d-9452-a92ca4ecc9c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:42.966527 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-47dca660-109c-453d-9452-a92ca4ecc9c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:42.973518 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-47dca660-109c-453d-9452-a92ca4ecc9c5 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1088 microversion: 2.1 time: 0.066925 May 07 22:44:42.974103 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3493/6957] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:42 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:43.989749 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-490e17d7-ffb0-4b1b-8ece-d980fa8a3268 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:43.990382 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-490e17d7-ffb0-4b1b-8ece-d980fa8a3268 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:44.042207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-490e17d7-ffb0-4b1b-8ece-d980fa8a3268 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:44.050033 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-490e17d7-ffb0-4b1b-8ece-d980fa8a3268 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1088 microversion: 2.1 time: 0.063586 May 07 22:44:44.050328 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3465/6958] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:43 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:45.066993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:45.067623 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:45.074512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:45.075013 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:45.075809 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:45.076257 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:45.138351 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:45.145808 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-36aa2216-099f-41d1-98be-0c9e47ff3fdb tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1138 microversion: 2.1 time: 0.083357 May 07 22:44:45.146392 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3494/6959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:45 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:46.163690 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:46.164355 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:46.172483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:46.172969 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:46.173837 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:46.175104 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:46.243114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:46.250700 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9a89976c-44c5-45da-9f71-3d8c8caa562b tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1204 microversion: 2.1 time: 0.091298 May 07 22:44:46.252510 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3466/6960] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:46 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1204 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:47.269612 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:47.270539 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:47.280664 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:47.282691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:47.283674 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:47.284466 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:47.327450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-2dc4f7a8-d43d-4b70-ae07-d709442b1692 req-06a697a7-9e41-41ad-8b9a-269df03f9380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:44:47.343544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2dc4f7a8-d43d-4b70-ae07-d709442b1692 req-06a697a7-9e41-41ad-8b9a-269df03f9380 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:47.345024 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-2dc4f7a8-d43d-4b70-ae07-d709442b1692 req-06a697a7-9e41-41ad-8b9a-269df03f9380 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:47.368112 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-2dc4f7a8-d43d-4b70-ae07-d709442b1692 req-06a697a7-9e41-41ad-8b9a-269df03f9380 service nova] Creating event network-changed:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch1-master-1 May 07 22:44:47.383853 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-2dc4f7a8-d43d-4b70-ae07-d709442b1692 req-06a697a7-9e41-41ad-8b9a-269df03f9380 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129623 May 07 22:44:47.385716 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3495/6961] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:44:47.441431 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:47.449833 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e77887d8-b7a9-4d7a-9b89-03de6f4992c8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.184704 May 07 22:44:47.450454 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3467/6962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:47 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:48.467690 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:48.468395 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:48.475817 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:48.476272 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:48.477043 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:48.477493 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:48.672804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:48.682149 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-84e59ddb-9357-4ff8-8b0c-dacf3d71c855 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.218705 May 07 22:44:48.682723 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3496/6963] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:48 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:49.698879 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:49.699514 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:49.706945 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:49.707451 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:49.708249 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:49.708715 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:49.840166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:49.848445 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-784db519-6b31-4fa0-aedc-6f9f32f43f20 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.153576 May 07 22:44:49.849113 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3468/6964] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:49 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:50.866190 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:50.866804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:50.875998 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:50.876460 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:50.877241 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:50.877688 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:51.012704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:51.021230 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8c6ed800-9051-4709-a37d-f948f6012a05 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.159024 May 07 22:44:51.021814 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3497/6965] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:50 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:52.038131 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:52.038793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:52.045642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:52.046113 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:52.046936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:52.047398 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:52.177357 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:52.184998 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1be596f0-3f6f-4d11-8622-fa943c8e6dfa tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.151373 May 07 22:44:52.185580 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3469/6966] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:52 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:53.203145 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:53.203797 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:53.211224 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:53.211693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:53.212584 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:53.213039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:53.348749 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:53.356240 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f64618cb-a19e-4bf5-923b-a15c14eb5630 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.158519 May 07 22:44:53.356815 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3498/6967] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:53 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:54.372860 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:54.373497 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:54.383042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:54.383509 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:54.384292 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:54.384744 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:54.519356 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:54.526981 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-f37a4d57-ba8b-4bd4-91f3-a2a5ce4f8b27 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.158067 May 07 22:44:54.527587 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3470/6968] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:54 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:55.327251 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-df3e9036-1cba-4d1f-8335-b6f8031b09d2 req-d895d9c7-aa78-4392-ab5e-ae9dd8379990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "name": "network-vif-plugged", "status": "completed", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:44:55.335849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-df3e9036-1cba-4d1f-8335-b6f8031b09d2 req-d895d9c7-aa78-4392-ab5e-ae9dd8379990 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:55.336311 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-df3e9036-1cba-4d1f-8335-b6f8031b09d2 req-d895d9c7-aa78-4392-ab5e-ae9dd8379990 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:55.347038 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-df3e9036-1cba-4d1f-8335-b6f8031b09d2 req-d895d9c7-aa78-4392-ab5e-ae9dd8379990 service nova] Creating event network-vif-plugged:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch1-master-1 May 07 22:44:55.352103 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-df3e9036-1cba-4d1f-8335-b6f8031b09d2 req-d895d9c7-aa78-4392-ab5e-ae9dd8379990 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077600 May 07 22:44:55.352914 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3499/6969] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:44:55.544193 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:55.544826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:55.552156 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:55.552636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:55.553404 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:55.553857 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:55.681621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:55.688960 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-af0e5923-24cc-4953-9b28-49c0e327804e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1259 microversion: 2.1 time: 0.148714 May 07 22:44:55.689531 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3471/6970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:55 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:56.707480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:56.708201 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:56.715000 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:56.715464 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:56.716245 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:56.716693 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:56.847073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:56.854802 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2ee5ad53-dece-4146-a06a-46c71fc58434 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1444 microversion: 2.1 time: 0.152227 May 07 22:44:56.855397 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3500/6971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:56 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:56.870979 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:44:56.871624 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:44:56.879192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:56.879611 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:56.880400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:56.880868 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:57.009887 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:44:57.017716 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b610409c-cec8-438e-b4bd-c5bb3193304a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1444 microversion: 2.1 time: 0.150652 May 07 22:44:57.018449 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3472/6972] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:44:56 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:44:58.636385 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-17a08978-1321-4e50-bf59-a015c15491d2 req-8fd66bb8-a402-4c20-acca-bd630f1a3503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:44:58.645073 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-17a08978-1321-4e50-bf59-a015c15491d2 req-8fd66bb8-a402-4c20-acca-bd630f1a3503 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:44:58.645648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-17a08978-1321-4e50-bf59-a015c15491d2 req-8fd66bb8-a402-4c20-acca-bd630f1a3503 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:44:58.656602 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-17a08978-1321-4e50-bf59-a015c15491d2 req-8fd66bb8-a402-4c20-acca-bd630f1a3503 service nova] Creating event network-changed:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch1-master-1 May 07 22:44:58.661987 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-17a08978-1321-4e50-bf59-a015c15491d2 req-8fd66bb8-a402-4c20-acca-bd630f1a3503 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029536 May 07 22:44:58.662694 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3501/6973] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:45:39.359697 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:45:39.360397 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:45:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:47:03.559616 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46a4aa07-e7b6-4e22-8e61-1f95962f6a67] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 07 22:47:03.652826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:47:03.653379 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:03.662393 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:03.662885 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:03.663670 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:03.664125 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:03.689692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lazy-loading 'flavor' on Instance uuid 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:47:03.760094 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [47543dad-4a34-4b61-b5d8-5831a4cb44b3] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:47:04.567751 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] [46a4aa07-e7b6-4e22-8e61-1f95962f6a67] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 35438. May 07 22:47:04.767473 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [47543dad-4a34-4b61-b5d8-5831a4cb44b3] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 35440. May 07 22:47:04.770746 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e5a71db3-c77b-4d6b-ae6d-c5155f0b8088 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7/action" status: 202 len: 0 microversion: 2.1 time: 1.213380 May 07 22:47:04.771422 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3473/6974] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:47:03 2022] POST /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7/action => generated 0 bytes in 1215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:47:04.779033 ncdv-master-1 devstack@n-api.service[136682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8387ff93-f02a-4ebc-8f33-a8044c5f7252] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:47:04.779899 ncdv-master-1 devstack@n-api.service[136682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24516f8a-15ff-4cb4-a27d-e178051d134e] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:47:04.784454 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:04.785174 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:04.799943 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:04.800415 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:04.801324 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:04.802497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:04.937432 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:04.944854 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-d62e923c-0b1f-4b0c-ba12-cbcf3b26c41e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.169058 May 07 22:47:04.945509 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3502/6975] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:04 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:05.964652 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:05.965378 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:05.972581 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:05.973053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:05.973836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:05.974295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:06.111042 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:06.119080 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-b5850a29-5a15-4c33-9aa8-0e8c8389afec tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.159584 May 07 22:47:06.119660 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3474/6976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:05 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:07.136940 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:07.137569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:07.149075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:07.149544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:07.150367 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:07.150837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:07.158508 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] [8387ff93-f02a-4ebc-8f33-a8044c5f7252] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 35456. May 07 22:47:07.159309 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] [24516f8a-15ff-4cb4-a27d-e178051d134e] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 35458. May 07 22:47:07.291992 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:07.299697 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-10b7b0a3-03bb-448d-a9a2-3d50294db3cd tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.166809 May 07 22:47:07.300284 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3503/6977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:07 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:08.317724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:08.318298 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:08.325294 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:08.325773 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:08.326584 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:08.327075 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:08.462962 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:08.470555 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-32cd6821-e202-49d3-89f3-856cc48c944d tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.157492 May 07 22:47:08.471168 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3475/6978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:08 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:09.487707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:09.488338 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:09.495373 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:09.495837 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:09.496612 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:09.497060 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:09.627595 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:09.636080 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2062b322-4769-464a-ab58-7f2570a8d548 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.152216 May 07 22:47:09.636678 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3504/6979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:09 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:10.653939 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:10.654580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:10.662241 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:10.662825 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:10.663729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:10.664227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:10.797974 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:10.805768 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e39e3c9e-ef79-40f7-8915-bc080a06b636 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.155821 May 07 22:47:10.806338 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3476/6980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:10 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:11.823461 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:11.824080 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:11.831625 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:11.832082 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:11.833484 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:11.833927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:11.969165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:11.976763 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2477e8cb-a55f-46d5-9e00-29727071db94 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.157430 May 07 22:47:11.977346 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3505/6981] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:11 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:12.993982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:12.994621 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:13.001373 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:13.001852 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:13.002645 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:13.003136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:13.136843 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:13.144590 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-87dde08a-9e10-4e74-a705-88524a0ecdad tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.154556 May 07 22:47:13.145768 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3477/6982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:12 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:14.162512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:14.163182 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:14.169914 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:14.170366 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:14.171160 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:14.171604 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:14.302306 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:14.309787 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-44e7ca0b-2596-40e1-8514-dbbbfbaa5ad6 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.151239 May 07 22:47:14.310359 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3506/6983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:14 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:15.327512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:15.328363 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:15.335878 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:15.336445 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:15.337248 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:15.337711 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:15.472692 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:15.482934 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-63cf3483-9485-43e7-8c20-5b7ccd1baae4 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.159357 May 07 22:47:15.483520 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3478/6984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:15 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:16.500076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:16.500709 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:16.507414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:16.507873 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:16.508638 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:16.509075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:16.637630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:16.645716 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2d5ae858-4443-4e87-9d85-4958a4dcd55c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.149051 May 07 22:47:16.646291 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3507/6985] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:16 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:17.663120 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:17.663765 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:17.670501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:17.671001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:17.671783 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:17.672233 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:17.811631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:17.820214 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-db07939d-88a8-4e6f-b129-f7d1a8288c6a tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1510 microversion: 2.1 time: 0.161040 May 07 22:47:17.820817 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3479/6986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:17 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:17.836864 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-247109f0-7dae-4f08-95db-60fdbdf21557 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:47:17.837450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-247109f0-7dae-4f08-95db-60fdbdf21557 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:17.844177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-247109f0-7dae-4f08-95db-60fdbdf21557 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:17.844635 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-247109f0-7dae-4f08-95db-60fdbdf21557 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:17.845412 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-247109f0-7dae-4f08-95db-60fdbdf21557 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:17.845860 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-247109f0-7dae-4f08-95db-60fdbdf21557 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:17.923974 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-247109f0-7dae-4f08-95db-60fdbdf21557 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "POST /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.091429 May 07 22:47:17.924562 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3508/6987] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:47:17 2022] POST /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:47:17.933948 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:17.934650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:17.940638 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:17.941114 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:17.941916 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:17.943064 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:18.108365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:18.117304 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-28691fe8-dec1-4814-9d63-ccfd6cc16e88 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1518 microversion: 2.1 time: 0.187716 May 07 22:47:18.118156 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3480/6988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:17 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:19.134576 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:19.135294 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:19.142097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:19.142555 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:19.143356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:19.143804 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:19.278289 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:19.286215 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-240722e7-475a-4cab-a388-2c797e53a257 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1520 microversion: 2.1 time: 0.155651 May 07 22:47:19.286807 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3509/6989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:19 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:19.340795 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:47:19.341064 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:47:19.783833 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-6c701267-8e45-40a6-9119-3454fa9d2502 req-d2eef0b6-9b8d-44df-bf96-5a1b6f0eb46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "name": "network-vif-unplugged", "status": "completed", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:47:19.793352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6c701267-8e45-40a6-9119-3454fa9d2502 req-d2eef0b6-9b8d-44df-bf96-5a1b6f0eb46a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:19.793824 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-6c701267-8e45-40a6-9119-3454fa9d2502 req-d2eef0b6-9b8d-44df-bf96-5a1b6f0eb46a service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:19.806240 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-6c701267-8e45-40a6-9119-3454fa9d2502 req-d2eef0b6-9b8d-44df-bf96-5a1b6f0eb46a service nova] Creating event network-vif-unplugged:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch2-master-1 May 07 22:47:19.811306 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-6c701267-8e45-40a6-9119-3454fa9d2502 req-d2eef0b6-9b8d-44df-bf96-5a1b6f0eb46a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031558 May 07 22:47:19.811920 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3481/6990] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:47:19.839977 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:47:19.840627 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:47:20.304039 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:20.304683 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:20.311510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:20.311975 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:20.312757 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:20.313222 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:20.457280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:20.466667 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-b3c628b4-c839-4f36-8944-d6537cc7c76f tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.166674 May 07 22:47:20.467316 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3510/6991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:20 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:20.715107 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-1b91e340-826d-4c6a-bdd9-e3abb75b2cbb req-e0af2f20-a2d2-43c5-85ae-72a1ad1da2eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:47:20.725091 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1b91e340-826d-4c6a-bdd9-e3abb75b2cbb req-e0af2f20-a2d2-43c5-85ae-72a1ad1da2eb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:20.725561 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-1b91e340-826d-4c6a-bdd9-e3abb75b2cbb req-e0af2f20-a2d2-43c5-85ae-72a1ad1da2eb service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:20.738541 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-1b91e340-826d-4c6a-bdd9-e3abb75b2cbb req-e0af2f20-a2d2-43c5-85ae-72a1ad1da2eb service nova] Creating event network-changed:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch2-master-1 May 07 22:47:20.747155 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-1b91e340-826d-4c6a-bdd9-e3abb75b2cbb req-e0af2f20-a2d2-43c5-85ae-72a1ad1da2eb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038901 May 07 22:47:20.748163 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3482/6992] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:47:21.484732 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:21.485381 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:21.494166 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:21.494972 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:21.496067 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:21.496514 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:21.629177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:21.636726 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1e1fd4c2-8d46-4522-819b-823f13ddc1ac tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.156019 May 07 22:47:21.637306 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3511/6993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:21 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:22.655053 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:22.655789 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:22.662415 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:22.662921 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:22.663753 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:22.664227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:22.795957 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:22.804090 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-ce0c96cc-2f6a-4d1e-8762-720f8d96abbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.154262 May 07 22:47:22.804679 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3483/6994] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:22 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:23.821723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:23.822275 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:23.829048 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:23.829506 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:23.830278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:23.830719 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:23.962097 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:23.969505 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-99571848-4cfc-4114-9d51-c8683cbe6ce0 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.152367 May 07 22:47:23.970084 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3512/6995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:23 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:24.986458 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:24.987133 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:24.995210 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:24.995693 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:25.000139 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:25.000642 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:25.140854 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:25.148350 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-4e441c44-0a47-4fde-b5a8-a7718fe8367c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.165908 May 07 22:47:25.148928 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3484/6996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:24 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:26.166040 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:26.166669 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:26.173520 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:26.173991 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:26.174789 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:26.175248 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:26.304389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:26.312020 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-bbb0d1f0-cd2c-4465-98b6-7b651a0d19dc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.149865 May 07 22:47:26.312599 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3513/6997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:26 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:27.329337 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:27.329985 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:27.337502 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:27.337965 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:27.338763 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:27.339246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:27.527304 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:27.535771 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27e9a86a-5755-4398-af2a-beda9f743cbc tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.210449 May 07 22:47:27.536359 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3485/6998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:27 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:28.552767 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:28.553420 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:28.560164 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:28.560619 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:28.561389 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:28.561833 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:28.711725 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:28.729509 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-a50f6eba-9aab-45bf-8bc8-cd55af8e0583 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.180589 May 07 22:47:28.730116 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3514/6999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:28 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:28.797380 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-b1b54712-847f-4ce8-8d9f-ef6018a213b5 req-3624e296-a460-408e-b67b-e8156c0f6d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "name": "network-vif-plugged", "status": "completed", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:47:28.808269 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b1b54712-847f-4ce8-8d9f-ef6018a213b5 req-3624e296-a460-408e-b67b-e8156c0f6d7f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:28.808747 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-b1b54712-847f-4ce8-8d9f-ef6018a213b5 req-3624e296-a460-408e-b67b-e8156c0f6d7f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:28.820393 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-b1b54712-847f-4ce8-8d9f-ef6018a213b5 req-3624e296-a460-408e-b67b-e8156c0f6d7f service nova] Creating event network-vif-plugged:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch2-master-1 May 07 22:47:28.825561 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-b1b54712-847f-4ce8-8d9f-ef6018a213b5 req-3624e296-a460-408e-b67b-e8156c0f6d7f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032094 May 07 22:47:28.826169 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3486/7000] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:47:29.747221 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:29.747848 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:29.755211 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:29.755672 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:29.756450 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:29.756901 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:29.885280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:29.892822 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7de9daf9-0ae1-41af-b2d7-2677dcfc27a3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1576 microversion: 2.1 time: 0.149501 May 07 22:47:29.893391 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3515/7001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:29 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:30.912752 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:47:30.913484 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:47:30.919851 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:30.920329 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:30.921116 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:47:30.921578 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:47:31.053215 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:47:31.060749 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0fa192d0-90d2-4605-980f-8e40d2215f8e tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1563 microversion: 2.1 time: 0.154154 May 07 22:47:31.061330 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3487/7002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:47:30 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:47:55.272689 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:47:55.273289 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:47:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:48:51.630177 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:48:51.630796 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:48:51.632570 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-8fadb194-c7b4-438a-a0da-045a56d1993d req-3e6ada79-7ed5-432c-968f-581340f44678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:48:51.637478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:51.638203 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:51.639022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:51.639478 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:51.642115 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8fadb194-c7b4-438a-a0da-045a56d1993d req-3e6ada79-7ed5-432c-968f-581340f44678 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:51.642793 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-8fadb194-c7b4-438a-a0da-045a56d1993d req-3e6ada79-7ed5-432c-968f-581340f44678 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:51.655078 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-8fadb194-c7b4-438a-a0da-045a56d1993d req-3e6ada79-7ed5-432c-968f-581340f44678 service nova] Creating event network-changed:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch2-master-1 May 07 22:48:51.660824 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-8fadb194-c7b4-438a-a0da-045a56d1993d req-3e6ada79-7ed5-432c-968f-581340f44678 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034003 May 07 22:48:51.661471 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3488/7003] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:48:51.667325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Going to try to terminate instance {{(pid=136682) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:48:51.754560 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-cff63389-cc24-4e32-9cc8-4f7995abb4f2 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 204 len: 0 microversion: 2.1 time: 0.130017 May 07 22:48:51.755711 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3516/7004] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:48:51 2022] DELETE /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:48:51.764388 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:48:51.765148 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:48:51.772592 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:51.773066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:51.773869 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:51.774332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:51.944082 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:48:51.951775 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-08a2e709-25a2-4369-8d7d-01b9138d62e3 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.191795 May 07 22:48:51.952437 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3489/7005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:48:51 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:48:52.970733 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:48:52.971469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:48:52.978403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:52.978891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:52.979668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:52.980119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:53.122300 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:48:53.131151 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-21fb4a0e-17f2-4e1e-856b-dcd8ca239abf tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1569 microversion: 2.1 time: 0.165373 May 07 22:48:53.135116 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3517/7006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:48:52 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:48:53.693840 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-d5dd2b8b-2254-42e6-b83c-8a59a750cf26 req-d2f99c25-05e4-4152-9536-d2066142d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e274e6d-0fee-40d1-86ba-5df7d5d31ad7", "name": "network-vif-deleted", "tag": "d4a2b006-9fc5-4562-9938-af8dd3a222c4"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:48:53.705666 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d5dd2b8b-2254-42e6-b83c-8a59a750cf26 req-d2f99c25-05e4-4152-9536-d2066142d8f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:53.706461 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-d5dd2b8b-2254-42e6-b83c-8a59a750cf26 req-d2f99c25-05e4-4152-9536-d2066142d8f0 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:53.727547 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-d5dd2b8b-2254-42e6-b83c-8a59a750cf26 req-d2f99c25-05e4-4152-9536-d2066142d8f0 service nova] Creating event network-vif-deleted:d4a2b006-9fc5-4562-9938-af8dd3a222c4 for instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 on nch2-master-1 May 07 22:48:53.732662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-d5dd2b8b-2254-42e6-b83c-8a59a750cf26 req-d2f99c25-05e4-4152-9536-d2066142d8f0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042659 May 07 22:48:53.733269 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3490/7007] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:48:54.148407 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:48:54.149161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:48:54.156022 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:54.156750 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:54.158064 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:54.158519 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:54.192290 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:54.192903 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:54.193223 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.objects.instance [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lazy-loading 'fault' on Instance uuid 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 {{(pid=136682) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:48:54.243671 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a81d6104e634bd7a6ae26dc51124c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:48:54.252465 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-04676822-fbeb-4533-9f48-9fec3a16bc6c tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 200 len: 1224 microversion: 2.1 time: 0.107995 May 07 22:48:54.253100 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3518/7008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:48:54 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:48:55.271153 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:48:55.271895 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] [instance: 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:48:55.279262 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:55.279739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:55.280533 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:48:55.281001 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:48:55.294592 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.wsgi [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] HTTP exception thrown: Instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 could not be found. May 07 22:48:55.295232 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Returning 404 to user: Instance 3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 could not be found. {{(pid=136681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:48:55.296081 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-27aae155-8ea7-40d9-ae85-f6cc981eeba8 tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7" status: 404 len: 111 microversion: 2.1 time: 0.029439 May 07 22:48:55.296612 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3491/7009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:48:55 2022] GET /compute/v2.1/servers/3e274e6d-0fee-40d1-86ba-5df7d5d31ad7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:48:55.456076 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-7cc9ae4c-d06e-43ca-bdf5-d5648504dcda tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] Calling method '.version_select at 0x7fc41c29a940>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:48:55.481142 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-7cc9ae4c-d06e-43ca-bdf5-d5648504dcda tempest-TestShelveInstance-1932052715 tempest-TestShelveInstance-1932052715-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-671495250" status: 202 len: 0 microversion: 2.1 time: 0.029043 May 07 22:48:55.481709 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3519/7010] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:48:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-671495250 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:49:13.565636 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48b894f8-107a-4901-958e-b237736bc2ab tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Action: 'create', calling method: .version_select at 0x7fc42256caf0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-731558362"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:49:13.593423 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-48b894f8-107a-4901-958e-b237736bc2ab tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:49:13.606759 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-48b894f8-107a-4901-958e-b237736bc2ab tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for user b44014561e8c455981cd814679935b11 and project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:49:13.786366 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-48b894f8-107a-4901-958e-b237736bc2ab tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:49:13.792798 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-48b894f8-107a-4901-958e-b237736bc2ab tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for user b44014561e8c455981cd814679935b11 and project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'key_pairs'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:49:13.808396 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48b894f8-107a-4901-958e-b237736bc2ab tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.419114 May 07 22:49:13.809353 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3492/7011] 10.222.0.32 () {60 vars in 1157 bytes} [Sat May 7 22:49:13 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:14.864469 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1623478054", "imageRef": "3756ae98-5c12-48e7-920e-ef5d1dd5543c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-731558362", "security_groups": [{"name": "tempest-secgroup-smoke-1836955525"}], "networks": [{"uuid": "a9ebddfa-5a35-480f-9e61-716103e7d7f8"}]}} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:49:14.970167 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.network.neutron [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] validate_networks() for [('a9ebddfa-5a35-480f-9e61-716103e7d7f8', None, None, None, None, None)] {{(pid=136682) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:49:15.474301 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Flavor limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:49:15.474735 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Image limits 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:49:15.475278 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Flavor pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:49:15.475698 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Image pref 0:0:0 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:49:15.476119 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.virt.hardware [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136682) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:49:15.488819 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:15.489273 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:15.490077 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:15.490549 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:15.513846 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:49:15.519161 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.quota [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for user b44014561e8c455981cd814679935b11 and project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136682) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:49:15.531361 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Going to run 1 instances... {{(pid=136682) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:49:15.533654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3756ae98-5c12-48e7-920e-ef5d1dd5543c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136682) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:49:15.584418 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-1f776820-012d-4a91-8841-eb933599af91 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724749 May 07 22:49:15.585251 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3520/7012] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:49:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:49:15.597077 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-1714be0c-3752-4145-ab54-849584ac004f tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:15.597729 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-1714be0c-3752-4145-ab54-849584ac004f tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:15.655730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-1714be0c-3752-4145-ab54-849584ac004f tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:15.664983 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-1714be0c-3752-4145-ab54-849584ac004f tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1248 microversion: 2.1 time: 0.073539 May 07 22:49:15.665683 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3493/7013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:15 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:16.682540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:16.683704 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:16.692362 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:16.696165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:16.697379 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:16.697839 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:16.815824 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:16.831571 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-3ac5fbd8-9388-4562-b48d-6d5f7f7599fc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1318 microversion: 2.1 time: 0.153792 May 07 22:49:16.833527 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3521/7014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:16 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:17.857413 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:17.858056 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:17.870632 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:17.871144 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:17.871973 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:17.872446 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:18.037741 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:18.046108 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-d3fb42d5-0625-4c62-beff-2becba22fa41 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1374 microversion: 2.1 time: 0.193336 May 07 22:49:18.048284 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3494/7015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:17 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:18.155075 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9baf7bbd-11bc-43e7-b702-d1bdb09ec00f req-6557cf99-f463-4703-af30-3e04e8f87d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61747fc-a610-49f2-9321-ef40bb2e3e5a", "tag": "42373cc5-2f7d-4dee-bc96-2e01c9842ebb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:49:18.178110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9baf7bbd-11bc-43e7-b702-d1bdb09ec00f req-6557cf99-f463-4703-af30-3e04e8f87d3b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:18.179239 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9baf7bbd-11bc-43e7-b702-d1bdb09ec00f req-6557cf99-f463-4703-af30-3e04e8f87d3b service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:18.194269 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9baf7bbd-11bc-43e7-b702-d1bdb09ec00f req-6557cf99-f463-4703-af30-3e04e8f87d3b service nova] Creating event network-changed:42373cc5-2f7d-4dee-bc96-2e01c9842ebb for instance f61747fc-a610-49f2-9321-ef40bb2e3e5a on nch1-master-1 May 07 22:49:18.203281 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9baf7bbd-11bc-43e7-b702-d1bdb09ec00f req-6557cf99-f463-4703-af30-3e04e8f87d3b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051889 May 07 22:49:18.204667 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3522/7016] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:49:19.064571 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:19.065206 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:19.072207 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:19.072683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:19.073516 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:19.073977 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:19.203332 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:19.211667 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e028c887-05a9-425e-87a4-7591e025553c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1374 microversion: 2.1 time: 0.151058 May 07 22:49:19.212248 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3495/7017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:19 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1374 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:20.230471 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:20.231227 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:20.238152 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:20.238608 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:20.239414 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:20.239868 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:20.379871 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:20.387338 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2b2a7e5b-3659-41db-8aed-4c1b4536d401 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1374 microversion: 2.1 time: 0.161973 May 07 22:49:20.387928 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3523/7018] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:20 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:21.404273 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:21.404937 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:21.412550 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:21.413017 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:21.413792 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:21.414250 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:21.550739 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:21.558196 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-deb297f3-b80c-48fe-9db7-61b588a81bb3 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1374 microversion: 2.1 time: 0.157846 May 07 22:49:21.558812 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3496/7019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:21 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:22.575927 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:22.576481 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:22.583403 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:22.583890 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:22.584656 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:22.585100 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:22.721928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:22.729398 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-256850a0-3960-4bdf-ba2c-877793ce4b7e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1374 microversion: 2.1 time: 0.157526 May 07 22:49:22.729985 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3524/7020] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:22 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 07 22:49:23.745544 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:23.746170 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:23.753665 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:23.754142 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:23.754968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:23.755433 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:23.890209 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:23.897662 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a9e36155-b3db-4312-8b7e-dfdbb12a4536 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1374 microversion: 2.1 time: 0.156128 May 07 22:49:23.898281 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3497/7021] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:23 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:24.351560 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-882fc5ee-c470-4512-b113-d2d3fd8e1182 req-be4fde48-2d7e-4421-b0c4-1b832a662409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61747fc-a610-49f2-9321-ef40bb2e3e5a", "name": "network-vif-plugged", "status": "completed", "tag": "42373cc5-2f7d-4dee-bc96-2e01c9842ebb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:49:24.360636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-882fc5ee-c470-4512-b113-d2d3fd8e1182 req-be4fde48-2d7e-4421-b0c4-1b832a662409 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:24.361094 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-882fc5ee-c470-4512-b113-d2d3fd8e1182 req-be4fde48-2d7e-4421-b0c4-1b832a662409 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:24.372384 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-882fc5ee-c470-4512-b113-d2d3fd8e1182 req-be4fde48-2d7e-4421-b0c4-1b832a662409 service nova] Creating event network-vif-plugged:42373cc5-2f7d-4dee-bc96-2e01c9842ebb for instance f61747fc-a610-49f2-9321-ef40bb2e3e5a on nch1-master-1 May 07 22:49:24.377243 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-882fc5ee-c470-4512-b113-d2d3fd8e1182 req-be4fde48-2d7e-4421-b0c4-1b832a662409 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029664 May 07 22:49:24.377832 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3525/7022] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:49:24.915023 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:24.915663 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:24.922427 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:24.922936 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:24.923730 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:24.924192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:25.065757 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:25.073179 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-389e665b-7235-4167-ae81-973c6c298a1c tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1374 microversion: 2.1 time: 0.162107 May 07 22:49:25.073767 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3498/7023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:24 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:26.091371 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:26.092099 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:26.098884 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:26.099345 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:26.100110 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:26.100551 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:26.234674 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:26.242065 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-2302c3db-2db5-4d13-ba2e-84cab900c26b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1558 microversion: 2.1 time: 0.155841 May 07 22:49:26.242639 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3526/7024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:26 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:26.258709 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:49:26.259246 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:49:26.267432 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:26.267905 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:26.268714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:26.269171 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:26.414214 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:49:26.421643 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3cb12520-75e6-482c-8494-8606286a70fe tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1558 microversion: 2.1 time: 0.167063 May 07 22:49:26.422241 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3499/7025] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:49:26 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:49:28.426448 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-a3760fbc-aabb-44c4-a9e3-73e4a4bd10af req-836f24b5-ce2e-4966-9866-7b2dfe7ed803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61747fc-a610-49f2-9321-ef40bb2e3e5a", "tag": "42373cc5-2f7d-4dee-bc96-2e01c9842ebb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:49:28.435114 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a3760fbc-aabb-44c4-a9e3-73e4a4bd10af req-836f24b5-ce2e-4966-9866-7b2dfe7ed803 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:49:28.435636 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-a3760fbc-aabb-44c4-a9e3-73e4a4bd10af req-836f24b5-ce2e-4966-9866-7b2dfe7ed803 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:49:28.446678 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-a3760fbc-aabb-44c4-a9e3-73e4a4bd10af req-836f24b5-ce2e-4966-9866-7b2dfe7ed803 service nova] Creating event network-changed:42373cc5-2f7d-4dee-bc96-2e01c9842ebb for instance f61747fc-a610-49f2-9321-ef40bb2e3e5a on nch1-master-1 May 07 22:49:28.451702 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-a3760fbc-aabb-44c4-a9e3-73e4a4bd10af req-836f24b5-ce2e-4966-9866-7b2dfe7ed803 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029537 May 07 22:49:28.452236 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3527/7026] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:50:40.802553 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:50:40.803276 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:50:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:51:23.543073 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81a8d81d-3358-426f-88a9-c890b68ca706] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 07 22:51:23.544031 ncdv-master-1 devstack@n-api.service[136681]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46a4aa07-e7b6-4e22-8e61-1f95962f6a67] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 07 22:51:23.547817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-e0a8d401-7d4d-4d0b-b57b-10930bdc9d7d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-47871504"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:51:23.548959 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-e0a8d401-7d4d-4d0b-b57b-10930bdc9d7d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:23.555238 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0a8d401-7d4d-4d0b-b57b-10930bdc9d7d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:23.555724 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0a8d401-7d4d-4d0b-b57b-10930bdc9d7d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:23.556522 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0a8d401-7d4d-4d0b-b57b-10930bdc9d7d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:23.556989 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-e0a8d401-7d4d-4d0b-b57b-10930bdc9d7d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:23.931764 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-e0a8d401-7d4d-4d0b-b57b-10930bdc9d7d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "POST /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a/action" status: 202 len: 0 microversion: 2.1 time: 0.390547 May 07 22:51:23.932409 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3500/7027] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:51:23 2022] POST /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 07 22:51:29.052991 ncdv-master-1 devstack@n-api.service[136682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8387ff93-f02a-4ebc-8f33-a8044c5f7252] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:51:29.055352 ncdv-master-1 devstack@n-api.service[136682]: ERROR oslo.messaging._drivers.impl_rabbit [-] [24516f8a-15ff-4cb4-a27d-e178051d134e] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 07 22:51:29.123863 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1f6a54e2-ab63-45be-8dad-58913533ba4f req-effc6809-700a-4a8c-9949-0c40322a82d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61747fc-a610-49f2-9321-ef40bb2e3e5a", "name": "network-vif-plugged", "status": "completed", "tag": "42373cc5-2f7d-4dee-bc96-2e01c9842ebb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:51:29.145603 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1f6a54e2-ab63-45be-8dad-58913533ba4f req-effc6809-700a-4a8c-9949-0c40322a82d6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:29.146288 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1f6a54e2-ab63-45be-8dad-58913533ba4f req-effc6809-700a-4a8c-9949-0c40322a82d6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:29.162664 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1f6a54e2-ab63-45be-8dad-58913533ba4f req-effc6809-700a-4a8c-9949-0c40322a82d6 service nova] Creating event network-vif-plugged:42373cc5-2f7d-4dee-bc96-2e01c9842ebb for instance f61747fc-a610-49f2-9321-ef40bb2e3e5a on nch1-master-1 May 07 22:51:29.168367 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1f6a54e2-ab63-45be-8dad-58913533ba4f req-effc6809-700a-4a8c-9949-0c40322a82d6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117520 May 07 22:51:29.169459 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3528/7028] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:51:37.459643 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1882187318", "imageRef": "8e74d4e2-1e24-49be-96e2-ab2210286697", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-731558362", "security_groups": [{"name": "tempest-secgroup-smoke-1836955525"}], "networks": [{"uuid": "a9ebddfa-5a35-480f-9e61-716103e7d7f8"}]}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:51:37.485682 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] [81a8d81d-3358-426f-88a9-c890b68ca706] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 36094. May 07 22:51:37.486276 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] [46a4aa07-e7b6-4e22-8e61-1f95962f6a67] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 36096. May 07 22:51:37.574028 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.network.neutron [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] validate_networks() for [('a9ebddfa-5a35-480f-9e61-716103e7d7f8', None, None, None, None, None)] {{(pid=136681) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 07 22:51:37.990606 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Flavor limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 07 22:51:37.991079 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Image limits 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 07 22:51:37.991580 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Flavor pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 07 22:51:37.992011 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Image pref 0:0:0 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 07 22:51:37.992444 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.virt.hardware [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 07 22:51:38.001385 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:38.001802 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:38.002637 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:38.003136 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:38.023099 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 07 22:51:38.028310 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.quota [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Getting quotas for user b44014561e8c455981cd814679935b11 and project a16ae1c6eaad44359f6bac5eaef3d3a5. Resources: {'cores', 'instances', 'ram'} {{(pid=136681) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 07 22:51:38.040552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Going to run 1 instances... {{(pid=136681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 07 22:51:38.043022 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e74d4e2-1e24-49be-96e2-ab2210286697',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 07 22:51:38.090506 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-70b9c5a1-b000-4ee6-8ae6-8fc36ccb3e71 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638447 May 07 22:51:38.091292 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3501/7029] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:51:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 07 22:51:38.103352 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-64cd1891-6b2b-439d-9513-279c843a2be5 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:38.104165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-64cd1891-6b2b-439d-9513-279c843a2be5 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:38.114958 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] [24516f8a-15ff-4cb4-a27d-e178051d134e] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 36120. May 07 22:51:38.122599 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] [8387ff93-f02a-4ebc-8f33-a8044c5f7252] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 36118. May 07 22:51:38.235383 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-64cd1891-6b2b-439d-9513-279c843a2be5 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:38.242350 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-64cd1891-6b2b-439d-9513-279c843a2be5 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1248 microversion: 2.1 time: 0.144609 May 07 22:51:38.242964 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3529/7030] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:38 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1248 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:38.987070 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [req-e23a7242-2d12-4a4b-b212-a8c840233f6a req-850a0c75-2e98-4be9-ad9d-77898c343c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61747fc-a610-49f2-9321-ef40bb2e3e5a", "name": "network-vif-unplugged", "status": "completed", "tag": "42373cc5-2f7d-4dee-bc96-2e01c9842ebb"}]} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:51:38.999850 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e23a7242-2d12-4a4b-b212-a8c840233f6a req-850a0c75-2e98-4be9-ad9d-77898c343c78 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:39.000322 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [req-e23a7242-2d12-4a4b-b212-a8c840233f6a req-850a0c75-2e98-4be9-ad9d-77898c343c78 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:39.011053 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.compute.server_external_events [req-e23a7242-2d12-4a4b-b212-a8c840233f6a req-850a0c75-2e98-4be9-ad9d-77898c343c78 service nova] Creating event network-vif-unplugged:42373cc5-2f7d-4dee-bc96-2e01c9842ebb for instance f61747fc-a610-49f2-9321-ef40bb2e3e5a on nch1-master-1 May 07 22:51:39.016336 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [req-e23a7242-2d12-4a4b-b212-a8c840233f6a req-850a0c75-2e98-4be9-ad9d-77898c343c78 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033268 May 07 22:51:39.017384 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3502/7031] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:51:39.259794 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:39.260529 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:39.268189 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:39.268648 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:39.269426 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:39.269900 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:39.337055 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:39.345307 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8a0ca32e-6356-4def-b854-f3ceca800777 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1306 microversion: 2.1 time: 0.089441 May 07 22:51:39.345886 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3530/7032] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:39 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1306 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:40.364052 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:40.365281 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:40.372325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:40.372800 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:40.373585 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:40.374041 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:40.525593 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:40.533449 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-15c344ac-a80b-4d67-83a3-805d635a5c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.174037 May 07 22:51:40.534035 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3503/7033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:40 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:41.553911 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:41.555439 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:41.563849 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:41.564321 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:41.565325 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:41.565779 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:41.724659 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:41.746442 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-31f953a3-1ca6-492a-9deb-420dd27fbb96 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.198394 May 07 22:51:41.758702 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3531/7034] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:41 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:42.768227 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:42.768864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:42.776137 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:42.776607 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:42.777400 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:42.777864 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:42.923192 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:42.931174 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3ddef74e-4e20-4b88-a783-112da69edacc tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.166926 May 07 22:51:42.931756 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3504/7035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:42 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:43.948615 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:43.949247 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:43.956168 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:43.956624 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:43.957406 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:43.957851 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:44.138512 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:44.146108 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-68599637-19f6-4c48-9c97-46b32639938d tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.201381 May 07 22:51:44.147439 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3532/7036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:43 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:45.193683 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:45.194966 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:45.209229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:45.210035 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:45.211268 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:45.211738 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:45.393464 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:45.403419 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-48d987a1-2a56-4c23-8b30-b492eddcf005 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.234425 May 07 22:51:45.404604 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3505/7037] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:45 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:46.422356 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:46.423165 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:46.433540 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:46.433905 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:46.434707 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:46.435197 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:46.590825 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:46.599015 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-c6e8151e-bf18-4a20-9611-57c1419ced98 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.180580 May 07 22:51:46.609658 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3533/7038] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:46 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:47.616559 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:47.617130 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:47.624229 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:47.624695 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:47.625552 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:47.626005 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:47.831893 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:47.839518 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-0c255615-78ae-4bee-a04c-2819aea37767 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.227563 May 07 22:51:47.840109 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3506/7039] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:47 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:48.413891 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-9b078fea-9b89-4c2f-96bf-044b8cf9059c req-eef7a30b-35f5-48ea-91f2-4c2a3659235e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42420dca-cf0f-4a38-8b0e-e468308926fd", "tag": "c05e9f80-dc38-4661-b4cb-1f6ef687700a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:51:48.422480 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9b078fea-9b89-4c2f-96bf-044b8cf9059c req-eef7a30b-35f5-48ea-91f2-4c2a3659235e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:48.423027 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-9b078fea-9b89-4c2f-96bf-044b8cf9059c req-eef7a30b-35f5-48ea-91f2-4c2a3659235e service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:48.439404 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-9b078fea-9b89-4c2f-96bf-044b8cf9059c req-eef7a30b-35f5-48ea-91f2-4c2a3659235e service nova] Creating event network-changed:c05e9f80-dc38-4661-b4cb-1f6ef687700a for instance 42420dca-cf0f-4a38-8b0e-e468308926fd on nch2-master-1 May 07 22:51:48.447061 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-9b078fea-9b89-4c2f-96bf-044b8cf9059c req-eef7a30b-35f5-48ea-91f2-4c2a3659235e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105559 May 07 22:51:48.447887 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3534/7040] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:51:48.856691 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:48.857316 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:48.864352 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:48.864826 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:48.865635 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:48.866098 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:49.126058 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:49.133413 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-238e6f8b-5765-49ed-ac5e-d471881275d7 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.280827 May 07 22:51:49.134229 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3507/7041] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:48 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:50.153498 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:50.154492 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:50.160642 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:50.161107 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:50.161892 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:50.162344 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:50.297466 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:50.304906 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-8cc95089-8988-478c-bfa9-df8ea990366b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.156550 May 07 22:51:50.305486 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3535/7042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:50 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:51.322254 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:51.322930 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:51.329866 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:51.330344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:51.331172 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:51.331649 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:51.465594 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:51.472975 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3785e8cd-de30-4033-aa55-82e7feaad63b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.155427 May 07 22:51:51.473575 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3508/7043] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:51 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:52.489628 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:52.490364 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:52.497286 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:52.497747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:52.498532 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:52.499010 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:52.639014 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:52.646551 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-72f8870f-5c56-4e3a-92df-faca2996714b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.160774 May 07 22:51:52.647173 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3536/7044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:52 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:53.664410 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:53.665044 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:53.671910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:53.672384 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:53.673166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:53.673625 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:53.809392 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:53.816830 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-c888f717-ff4e-4404-add9-4055d99155a8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.156983 May 07 22:51:53.817434 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3509/7045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:53 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:54.072883 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-d3e7e608-9323-4882-be74-3b23a3dc22b9 req-f640b52c-84fd-4420-9ee0-d79a63b111d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42420dca-cf0f-4a38-8b0e-e468308926fd", "name": "network-vif-plugged", "status": "completed", "tag": "c05e9f80-dc38-4661-b4cb-1f6ef687700a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:51:54.081889 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d3e7e608-9323-4882-be74-3b23a3dc22b9 req-f640b52c-84fd-4420-9ee0-d79a63b111d5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:54.082313 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-d3e7e608-9323-4882-be74-3b23a3dc22b9 req-f640b52c-84fd-4420-9ee0-d79a63b111d5 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:54.094299 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-d3e7e608-9323-4882-be74-3b23a3dc22b9 req-f640b52c-84fd-4420-9ee0-d79a63b111d5 service nova] Creating event network-vif-plugged:c05e9f80-dc38-4661-b4cb-1f6ef687700a for instance 42420dca-cf0f-4a38-8b0e-e468308926fd on nch2-master-1 May 07 22:51:54.099356 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-d3e7e608-9323-4882-be74-3b23a3dc22b9 req-f640b52c-84fd-4420-9ee0-d79a63b111d5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030206 May 07 22:51:54.099963 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3537/7046] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:51:54.835199 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:54.835836 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:54.842619 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:54.843121 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:54.843910 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:54.844361 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:54.978288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:54.985682 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-476e5fa7-2fa8-4376-934f-5d069c267409 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1374 microversion: 2.1 time: 0.154913 May 07 22:51:54.986256 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3510/7047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:54 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:56.003497 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:56.004213 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:56.012314 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:56.012783 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:56.013569 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:56.014025 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:56.143548 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:56.152020 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-ac31ab0d-32a2-40df-b80a-255360efa4fb tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1557 microversion: 2.1 time: 0.152872 May 07 22:51:56.152602 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3538/7048] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:55 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:56.168180 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:51:56.168830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:51:56.175634 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:56.176110 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:56.176911 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:56.177371 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:56.307344 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:51:56.314891 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-6286f11f-a32c-4b6b-82f8-ac937c877c50 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1557 microversion: 2.1 time: 0.150559 May 07 22:51:56.315474 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3511/7049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:51:56 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:51:57.942494 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-89a53bdc-6c5b-4c0f-80f6-3cc03334e374 req-892689ea-f386-4579-814b-690437993596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42420dca-cf0f-4a38-8b0e-e468308926fd", "tag": "c05e9f80-dc38-4661-b4cb-1f6ef687700a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:51:57.948956 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-89a53bdc-6c5b-4c0f-80f6-3cc03334e374 req-892689ea-f386-4579-814b-690437993596 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:51:57.949410 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-89a53bdc-6c5b-4c0f-80f6-3cc03334e374 req-892689ea-f386-4579-814b-690437993596 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:51:57.960748 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-89a53bdc-6c5b-4c0f-80f6-3cc03334e374 req-892689ea-f386-4579-814b-690437993596 service nova] Creating event network-changed:c05e9f80-dc38-4661-b4cb-1f6ef687700a for instance 42420dca-cf0f-4a38-8b0e-e468308926fd on nch2-master-1 May 07 22:51:57.965982 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-89a53bdc-6c5b-4c0f-80f6-3cc03334e374 req-892689ea-f386-4579-814b-690437993596 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030239 May 07 22:51:57.966739 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3539/7050] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:52:19.371177 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:52:19.371944 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:52:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:52:19.850529 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:52:19.851127 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:52:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:53:27.097213 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-40bd9422-5db9-4de8-addb-1a5a53d4e19b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-958123483"}} {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:53:27.098307 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-40bd9422-5db9-4de8-addb-1a5a53d4e19b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:27.104501 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40bd9422-5db9-4de8-addb-1a5a53d4e19b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:27.104982 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40bd9422-5db9-4de8-addb-1a5a53d4e19b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:27.105777 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40bd9422-5db9-4de8-addb-1a5a53d4e19b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:27.106242 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-40bd9422-5db9-4de8-addb-1a5a53d4e19b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:27.384397 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-40bd9422-5db9-4de8-addb-1a5a53d4e19b tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "POST /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd/action" status: 202 len: 0 microversion: 2.1 time: 0.292083 May 07 22:53:27.384974 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3512/7051] 10.222.0.32 () {60 vars in 1277 bytes} [Sat May 7 22:53:27 2022] POST /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 07 22:53:32.588151 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-1f293b5b-d9ef-4e6f-8c53-493c6223190e req-f149d288-038d-45f3-ba29-1ecfd72035a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42420dca-cf0f-4a38-8b0e-e468308926fd", "name": "network-vif-plugged", "status": "completed", "tag": "c05e9f80-dc38-4661-b4cb-1f6ef687700a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:53:32.596544 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1f293b5b-d9ef-4e6f-8c53-493c6223190e req-f149d288-038d-45f3-ba29-1ecfd72035a2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:32.597571 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-1f293b5b-d9ef-4e6f-8c53-493c6223190e req-f149d288-038d-45f3-ba29-1ecfd72035a2 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:32.619642 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-1f293b5b-d9ef-4e6f-8c53-493c6223190e req-f149d288-038d-45f3-ba29-1ecfd72035a2 service nova] Creating event network-vif-plugged:c05e9f80-dc38-4661-b4cb-1f6ef687700a for instance 42420dca-cf0f-4a38-8b0e-e468308926fd on nch2-master-1 May 07 22:53:32.625750 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-1f293b5b-d9ef-4e6f-8c53-493c6223190e req-f149d288-038d-45f3-ba29-1ecfd72035a2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047408 May 07 22:53:32.626947 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3540/7052] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:53:41.090677 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:41.091417 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:41.091857 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-797cfb86-589c-491b-a1a4-ab661d60a15d req-ca4ed110-2f8e-40dc-8007-424baab425b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42420dca-cf0f-4a38-8b0e-e468308926fd", "tag": "c05e9f80-dc38-4661-b4cb-1f6ef687700a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:53:41.098012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:41.098554 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:41.099439 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:41.099964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:41.101838 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-797cfb86-589c-491b-a1a4-ab661d60a15d req-ca4ed110-2f8e-40dc-8007-424baab425b6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:41.102966 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-797cfb86-589c-491b-a1a4-ab661d60a15d req-ca4ed110-2f8e-40dc-8007-424baab425b6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:41.114476 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-797cfb86-589c-491b-a1a4-ab661d60a15d req-ca4ed110-2f8e-40dc-8007-424baab425b6 service nova] Creating event network-changed:c05e9f80-dc38-4661-b4cb-1f6ef687700a for instance 42420dca-cf0f-4a38-8b0e-e468308926fd on nch2-master-1 May 07 22:53:41.120052 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-797cfb86-589c-491b-a1a4-ab661d60a15d req-ca4ed110-2f8e-40dc-8007-424baab425b6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033451 May 07 22:53:41.120869 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3541/7053] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:53:41.132573 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:53:41.220725 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-9188d8f2-f7e3-466b-b9f4-11eaaa82b8ac tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "DELETE /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 204 len: 0 microversion: 2.1 time: 0.136526 May 07 22:53:41.221655 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3513/7054] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:53:41 2022] DELETE /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:53:41.231936 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:41.233003 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:41.240760 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:41.241382 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:41.242280 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:41.242895 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:41.380193 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:53:41.388522 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-25b7021e-c332-4913-8310-343ee1d3d9db tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1682 microversion: 2.1 time: 0.162582 May 07 22:53:41.389227 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3542/7055] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:41 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:53:42.409553 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:42.410194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:42.417720 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:42.418194 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:42.419012 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:42.419468 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:42.571743 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-7e78f4b8-7ce6-4b66-b71b-f443b70cc0fc req-df6fada7-5368-47de-8b05-e4e8a3f552bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42420dca-cf0f-4a38-8b0e-e468308926fd", "name": "network-vif-unplugged", "status": "completed", "tag": "c05e9f80-dc38-4661-b4cb-1f6ef687700a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:53:42.581981 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7e78f4b8-7ce6-4b66-b71b-f443b70cc0fc req-df6fada7-5368-47de-8b05-e4e8a3f552bd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:42.582710 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-7e78f4b8-7ce6-4b66-b71b-f443b70cc0fc req-df6fada7-5368-47de-8b05-e4e8a3f552bd service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:42.594988 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-7e78f4b8-7ce6-4b66-b71b-f443b70cc0fc req-df6fada7-5368-47de-8b05-e4e8a3f552bd service nova] Creating event network-vif-unplugged:c05e9f80-dc38-4661-b4cb-1f6ef687700a for instance 42420dca-cf0f-4a38-8b0e-e468308926fd on nch2-master-1 May 07 22:53:42.596483 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:53:42.600063 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-7e78f4b8-7ce6-4b66-b71b-f443b70cc0fc req-df6fada7-5368-47de-8b05-e4e8a3f552bd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032472 May 07 22:53:42.600670 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3543/7056] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:53:42.605637 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3aba2b7c-d863-431d-913f-490c6e22112e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1682 microversion: 2.1 time: 0.200457 May 07 22:53:42.606593 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3514/7057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:42 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:53:43.289856 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-4d78840a-08cc-4483-8f52-843dbd970b9f req-5a7e7db7-63d3-4c18-b194-a102d1916332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42420dca-cf0f-4a38-8b0e-e468308926fd", "name": "network-vif-deleted", "tag": "c05e9f80-dc38-4661-b4cb-1f6ef687700a"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:53:43.302069 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4d78840a-08cc-4483-8f52-843dbd970b9f req-5a7e7db7-63d3-4c18-b194-a102d1916332 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:43.302609 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-4d78840a-08cc-4483-8f52-843dbd970b9f req-5a7e7db7-63d3-4c18-b194-a102d1916332 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:43.316515 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-4d78840a-08cc-4483-8f52-843dbd970b9f req-5a7e7db7-63d3-4c18-b194-a102d1916332 service nova] Creating event network-vif-deleted:c05e9f80-dc38-4661-b4cb-1f6ef687700a for instance 42420dca-cf0f-4a38-8b0e-e468308926fd on nch2-master-1 May 07 22:53:43.322700 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-4d78840a-08cc-4483-8f52-843dbd970b9f req-5a7e7db7-63d3-4c18-b194-a102d1916332 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037465 May 07 22:53:43.323351 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3544/7058] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:53:43.623587 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:43.624239 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:43.631346 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:43.631827 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:43.632650 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:43.633751 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:43.669367 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:43.669845 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:43.670323 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lazy-loading 'fault' on Instance uuid 42420dca-cf0f-4a38-8b0e-e468308926fd {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:53:43.714964 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:53:43.723656 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-7fef73fe-740a-4b09-ac33-b285f7e973b2 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 200 len: 1338 microversion: 2.1 time: 0.104405 May 07 22:53:43.724825 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3515/7059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:43 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:53:44.741947 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:44.742668 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: 42420dca-cf0f-4a38-8b0e-e468308926fd] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:44.749723 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:44.750185 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:44.751001 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:44.751452 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:44.767167 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] HTTP exception thrown: Instance 42420dca-cf0f-4a38-8b0e-e468308926fd could not be found. May 07 22:53:44.767763 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Returning 404 to user: Instance 42420dca-cf0f-4a38-8b0e-e468308926fd could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:53:44.768599 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1481744-9642-4300-ac62-dc5035931ac8 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd" status: 404 len: 111 microversion: 2.1 time: 0.030926 May 07 22:53:44.769135 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3545/7060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:44 2022] GET /compute/v2.1/servers/42420dca-cf0f-4a38-8b0e-e468308926fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:53:46.104441 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:46.104968 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:46.107264 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-666da9f6-1ebf-49d0-8a77-9882b5375ebb req-894e5f4a-bdb3-46ff-8b79-9ac430c5000f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61747fc-a610-49f2-9321-ef40bb2e3e5a", "tag": "42373cc5-2f7d-4dee-bc96-2e01c9842ebb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:53:46.112166 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:46.112817 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:46.113631 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:46.114093 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:46.116178 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-666da9f6-1ebf-49d0-8a77-9882b5375ebb req-894e5f4a-bdb3-46ff-8b79-9ac430c5000f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:46.116641 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-666da9f6-1ebf-49d0-8a77-9882b5375ebb req-894e5f4a-bdb3-46ff-8b79-9ac430c5000f service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:46.129531 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-666da9f6-1ebf-49d0-8a77-9882b5375ebb req-894e5f4a-bdb3-46ff-8b79-9ac430c5000f service nova] Creating event network-changed:42373cc5-2f7d-4dee-bc96-2e01c9842ebb for instance f61747fc-a610-49f2-9321-ef40bb2e3e5a on nch1-master-1 May 07 22:53:46.135385 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-666da9f6-1ebf-49d0-8a77-9882b5375ebb req-894e5f4a-bdb3-46ff-8b79-9ac430c5000f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 May 07 22:53:46.135999 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3546/7061] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 07 22:53:46.141288 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Going to try to terminate instance {{(pid=136681) delete /opt/stack/nova/nova/compute/api.py:2664}} May 07 22:53:46.250207 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-2157aaf5-efe5-4104-918f-5772a2161788 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 204 len: 0 microversion: 2.1 time: 0.149105 May 07 22:53:46.251639 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3516/7062] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:53:46 2022] DELETE /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 07 22:53:46.260134 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:46.261045 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:46.267928 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:46.268391 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:46.269181 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:46.269630 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:46.422654 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.policy [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136682) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:53:46.430179 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-f1c452ac-21f6-437f-8913-d56b22cd88df tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1682 microversion: 2.1 time: 0.174413 May 07 22:53:46.430857 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3547/7063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:46 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:53:47.448799 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:47.449512 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:47.456295 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:47.456766 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:47.457549 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:47.458034 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:47.595257 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:53:47.602880 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-3f8e8007-d840-4c76-bdec-cfd874fc0796 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1682 microversion: 2.1 time: 0.158850 May 07 22:53:47.603485 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3517/7064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:47 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:53:48.374208 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [req-e56987d6-7302-4dd6-9025-bb2ef17ebf5b req-ea2ecaec-2ba6-4e2a-bb90-2652b68ccdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61747fc-a610-49f2-9321-ef40bb2e3e5a", "name": "network-vif-deleted", "tag": "42373cc5-2f7d-4dee-bc96-2e01c9842ebb"}]} {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 07 22:53:48.384533 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e56987d6-7302-4dd6-9025-bb2ef17ebf5b req-ea2ecaec-2ba6-4e2a-bb90-2652b68ccdd6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:48.385993 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [req-e56987d6-7302-4dd6-9025-bb2ef17ebf5b req-ea2ecaec-2ba6-4e2a-bb90-2652b68ccdd6 service nova] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:48.400648 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.compute.server_external_events [req-e56987d6-7302-4dd6-9025-bb2ef17ebf5b req-ea2ecaec-2ba6-4e2a-bb90-2652b68ccdd6 service nova] Creating event network-vif-deleted:42373cc5-2f7d-4dee-bc96-2e01c9842ebb for instance f61747fc-a610-49f2-9321-ef40bb2e3e5a on nch1-master-1 May 07 22:53:48.406601 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [req-e56987d6-7302-4dd6-9025-bb2ef17ebf5b req-ea2ecaec-2ba6-4e2a-bb90-2652b68ccdd6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118243 May 07 22:53:48.407558 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3548/7065] 10.222.0.32 () {64 vars in 1317 bytes} [Sat May 7 22:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 07 22:53:48.621066 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:48.621714 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.compute.api [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136681) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:48.629222 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:48.629883 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:48.631060 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:48.631491 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:48.674365 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:48.677325 ncdv-master-1 devstack@n-api.service[136681]: DEBUG oslo_concurrency.lockutils [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:48.678008 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.objects.instance [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lazy-loading 'fault' on Instance uuid f61747fc-a610-49f2-9321-ef40bb2e3e5a {{(pid=136681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 07 22:53:48.726830 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.policy [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b44014561e8c455981cd814679935b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136681) authorize /opt/stack/nova/nova/policy.py:199}} May 07 22:53:48.736787 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-54a3d70f-502c-46d3-9795-991c27c036b0 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 200 len: 1338 microversion: 2.1 time: 0.120031 May 07 22:53:48.738266 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3518/7066] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:48 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 1338 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 07 22:53:49.756747 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '>' {{(pid=136682) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:49.757510 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.compute.api [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] [instance: f61747fc-a610-49f2-9321-ef40bb2e3e5a] Fetching instance by UUID {{(pid=136682) get /opt/stack/nova/nova/compute/api.py:2920}} May 07 22:53:49.764188 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:49.764658 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:49.765409 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 07 22:53:49.765855 ncdv-master-1 devstack@n-api.service[136682]: DEBUG oslo_concurrency.lockutils [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Lock "6aeab614-f3b8-4d04-8f8a-0ac34a04d05f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136682) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 07 22:53:49.779792 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.wsgi [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] HTTP exception thrown: Instance f61747fc-a610-49f2-9321-ef40bb2e3e5a could not be found. May 07 22:53:49.780378 ncdv-master-1 devstack@n-api.service[136682]: DEBUG nova.api.openstack.wsgi [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Returning 404 to user: Instance f61747fc-a610-49f2-9321-ef40bb2e3e5a could not be found. {{(pid=136682) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 07 22:53:49.781207 ncdv-master-1 devstack@n-api.service[136682]: INFO nova.api.openstack.requestlog [None req-89d33290-b2a7-448f-968b-6ccada781f0e tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a" status: 404 len: 111 microversion: 2.1 time: 0.029650 May 07 22:53:49.781735 ncdv-master-1 devstack@n-api.service[136682]: [pid: 136682|app: 0|req: 3549/7067] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:53:49 2022] GET /compute/v2.1/servers/f61747fc-a610-49f2-9321-ef40bb2e3e5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 07 22:53:49.944406 ncdv-master-1 devstack@n-api.service[136681]: DEBUG nova.api.openstack.wsgi [None req-a18fc98a-a528-478e-9abf-43a5dc3f4741 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] Calling method '.version_select at 0x7fc41cadbaf0>' {{(pid=136681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 07 22:53:49.966540 ncdv-master-1 devstack@n-api.service[136681]: INFO nova.api.openstack.requestlog [None req-a18fc98a-a528-478e-9abf-43a5dc3f4741 tempest-TestSnapshotPattern-1499973881 tempest-TestSnapshotPattern-1499973881-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-731558362" status: 202 len: 0 microversion: 2.1 time: 0.025973 May 07 22:53:49.967540 ncdv-master-1 devstack@n-api.service[136681]: [pid: 136681|app: 0|req: 3519/7068] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 22:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-731558362 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 07 22:53:59.352859 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:53:59.353444 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:53:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:54:00.811095 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:54:00.811647 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:54:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:55:39.379272 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:55:39.379852 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:55:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:56:15.287263 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:56:15.287865 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:56:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:57:19.361226 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:57:19.361895 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:57:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:57:20.819330 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:57:20.819880 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:57:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:58:59.387139 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:58:59.387725 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:58:59.862315 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:58:59.862889 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:59:17.760856 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:59:17.761606 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 22:59:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 22:59:35.296145 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 22:59:35.296666 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 22:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 23:00:39.370759 ncdv-master-1 devstack@n-api.service[136682]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 23:00:39.371432 ncdv-master-1 devstack@n-api.service[136682]: Sat May 7 23:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 07 23:00:40.828539 ncdv-master-1 devstack@n-api.service[136681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 07 23:00:40.829094 ncdv-master-1 devstack@n-api.service[136681]: Sat May 7 23:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!